Beginner with tool needs help with filtering input data

Edit Subject

Hello,
If I understand correctly, you need to profile only a subset of data in your text file. This scenario with using condition step is described in the E-mail Contact Analysis video tutorial.

In short, from the Create profile dialog, you need to Create a Plan file instead of a Profiling file. In the Plan file editor, delete the connection between Text File Reader and Profiling step and add a Condition step and a Trash step.

Connection from Text File Reader should be connected to in endpoint of the Condition, out_false from Condition to the Trash and out_true to the Profiling.



Double-clicking the condition step opens the Step dialog. In the condition field, you can write conditions you like, for example adding client_type = "COMPANY" will send all the records with COMPANY in the client_type column to the endpoint out_true (so to the Profiling step) and all records which don't satisfy the condition to the out_false endpoint (so to the Trash step).

This should do the job for you. In case you are reading data from database, it is easier to create plan in a similar way I've described., then open the JDBC Reader step and add a "WHERE client_type='...' ..." clause to the Query String.

I hope I described it correctly, check the linked video tutorial and ask any more questions you need.