Skip to main content
Solved

Create DQ rule to validate data in same column

  • November 30, 2024
  • 5 replies
  • 101 views
V
Data Voyager

Hi,

I want to create DQ rule to check data within same column. For example, from below table, I want to check if Value of Category B is >= Value of Category D.

How can I do this in the Ataccama One UI?

 

Thanks

Category Value
A 5
B 2
C 6
D 4

Best answer by ivan.kozlov

Hi ​@Vaishali, unfortunately, I don’t think what you’re trying to do is possible, especially using only rules created in web app UI. For the rule condition to be evaluated, all the input attributes should be within the same row of data and the data you need for your rule will never be in one place unless the catalog item structure would look completely different (values for A, B, C, D that have to be compared would be in the same row). 

5 replies

ivan.kozlov
Ataccamer
Forum|alt.badge.img+3
  • ivan.kozlovAtaccamer
  • Ataccamer
  • 55 replies
  • December 2, 2024

Hi ​@Vaishali , dq rules in Ataccama ONE usually work on the row basis - rule condition would usually evaluate the column values in specific row of data. You can build aggregated rules that would compare specific row of data with aggregated data in the dataset but you need to have a clear idea how you would aggregate it based on what exactly you’re trying to see in the result.

Could you please clarify what is the final goal of the rule?
Do you need to compare the values only between specific categories or between all of them (basically identifying the maximum)?
Thank you!
Ivan

V
Data Voyager
  • VaishaliData Voyager
  • Author
  • 1 reply
  • December 6, 2024

Thanks ​@ivan.kozlov for your response.

I am not looking for aggregate values. I want to compare some of the categories with each other. The comparison may be checking values less than or greater than each other. Or it can be checking if value of category B is x times value of category A.

ivan.kozlov
Ataccamer
Forum|alt.badge.img+3
  • ivan.kozlovAtaccamer
  • Ataccamer
  • 55 replies
  • Answer
  • December 10, 2024

Hi ​@Vaishali, unfortunately, I don’t think what you’re trying to do is possible, especially using only rules created in web app UI. For the rule condition to be evaluated, all the input attributes should be within the same row of data and the data you need for your rule will never be in one place unless the catalog item structure would look completely different (values for A, B, C, D that have to be compared would be in the same row). 

M
Data Voyager
  • marellaData Voyager
  • Data Voyager
  • 1 reply
  • April 16, 2025

Going off of this, are there ways to apply rules on a column level? And is there any kind of AI generated automatic classification option when it comes to column level classifications? Thank you 

A
Forum|alt.badge.img+1

Hi ​@marella, apologies for coming back a bit delayed here, not for the moment unfortunately. You can see the full list of ONE AI capabilities here and if you’d like please don’t hesitate to share that as a feature request in our ideas section 🙋🏻‍♀️

Check out our Quick Start Guide to get started on the community 🙋‍♀️


Community Terms of Use & ConditionsCookie settingsAccessibility statement