Distinct records

Edit Subject

Hello,
did you mean DQC or just DQA? Unfortunately this cannot be done using only DQA, but in DQC there are multiple ways, for example Unification (step for match), Representative Creator (step for merge) or Group Aggregator, which is usually used to create reports with metrics above sets of records.

I have used the Group Aggregator in a following example, where I create a distinct list of Company IDs from the input. The configuration of Group Aggregator is very similar to SQL GROUP BY clause. You may see in the Progress Viewer, that the number of records on the output is lower as it outputs only a distinct Company IDs.