Sometimes we have monitoring project results where a DQ check returns 1000 records because of so many rule failures. We want to limit the amount of records in the monitoring project export file for each DQ rule. If I only want to show X invalid samples per DQ check, how can I go about doing this? I initially thought of using a sequence step then filtering the final result, but this does not work because each rule needs its own sequence or count. Basically, I think I may need to group each DQ rule and apply a sequence to each group separately. This is how I am thinking of solving the problem. Any suggestions on what I can do? Thank you in advance for your help!
Solved
How to limit number of each DQ rule in invalid sample exports from One Desktop
Best answer by AKislyakov
Are you sure it is Group Selector and not Group Aggregator.
Here is a sample Group Selector configuration. It selects up to 3 first (by Id
) records from each group defined by the value in the ruleName
column.


And test result.

Reply
Login to the Ataccama Community
No account yet? Create an account
For Ataccama Customers and Partners
or
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.