Skip to main content
Solved

Creating flat file using Ataccama One Desktop where records failed business rule


Forum|alt.badge.img+2

We created a number of data quality business rules that will fail records from the source file we are reading.  1.5 Million records.

How do you port the failed records to a flat file?  There is no drill down in One Desktop so we are having issues getting business users approval on code without seeing the failed records?

Best answer by Anonymous

Hi @RoberTallitsch ,

thank you for your question.

You can use DQI (Data Quality Indicator) Step to assess records in the pipeline against a number of business rules and have two outputs created:

  • Output 1 - containing the individual data records with an extra column to say if the record met or failed the business rule (or when Out Record Filter Type selected as WRONG to see only records where at least one of the rules were evaluated as false)
  • Output 2 - containing a summary

An example:

 

💡Tip: Documentation is accessible through Help tab in the navigation, there is more information about Step Data Quality Indicator.

Hope it helps.

View original
Did this topic help you find an answer to your question?

2 replies

  • 0 replies
  • Answer
  • May 20, 2022

Hi @RoberTallitsch ,

thank you for your question.

You can use DQI (Data Quality Indicator) Step to assess records in the pipeline against a number of business rules and have two outputs created:

  • Output 1 - containing the individual data records with an extra column to say if the record met or failed the business rule (or when Out Record Filter Type selected as WRONG to see only records where at least one of the rules were evaluated as false)
  • Output 2 - containing a summary

An example:

 

💡Tip: Documentation is accessible through Help tab in the navigation, there is more information about Step Data Quality Indicator.

Hope it helps.


Forum|alt.badge.img+3

thanks


Reply


Cookie policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie settings