Skip to main content

We created a number of data quality business rules that will fail records from the source file we are reading.  1.5 Million records.

How do you port the failed records to a flat file?  There is no drill down in One Desktop so we are having issues getting business users approval on code without seeing the failed records?

Hi @RoberTallitsch ,

thank you for your question.

You can use DQI (Data Quality Indicator) Step to assess records in the pipeline against a number of business rules and have two outputs created:

  • Output 1 - containing the individual data records with an extra column to say if the record met or failed the business rule (or when Out Record Filter Type selected as WRONG to see only records where at least one of the rules were evaluated as false)
  • Output 2 - containing a summary

An example:

 

💡Tip: Documentation is accessible through Help tab in the navigation, there is more information about Step Data Quality Indicator.

Hope it helps.

thanks

Reply


Community Terms of Use & ConditionsCookie settings