DQI SK stage sample demo

Hi @Bhumi,

There is a step description in the Help section of the Thick client (Ataccama ONE Desktop → Steps → DQI SK).

Here is excerpt from it:

The step evaluates a set of named boolean expressions (Rules) and writes the result to an output column and also creates a summary report. It contains rules which are types of coded boolean conditions. The other fields are not required for step functionality. The step works as follows:

• Computes all rule conditions for each row from the input.
• Sends each row to the 'out' endpoint and adds boolean columns which are named according to the code of rules to the output format. This implies that no code can be the same as any of the input column names. Then it stores the results of the conditions into these added columns.
• Finally, it creates a report with as many slots as there are rules. Each slot can contain one or more rows depending on how grouping has been defined. When no grouping is used, then each slot consists of just one row. When the grouping is employed, each slot contains as many rows as there are groups in the input data. Data in each slot are calculated from data matching that rule (when condition) and particular group. Generally, each row in a slot contains the rule with all its fields as columns and the following added columns:
  • Success_count - how many times the condition of this rule returned a true value
  • Total - count of input rows matching any rule.
  • Total_Per_Rule - count of input rows matching this rule
  • Total_Exposure_Value - total exposure value over all records matching rhis rule
  • Group_By - grouping key