Skip to main content
Question

Post Processing with filter to filter columns with DQ Rules

  • February 17, 2026
  • 3 replies
  • 7 views

Forum|alt.badge.img

Hi ​@anna.spakova 

How to add a filter to a PPP that should pull columns only with DQ checks. This is because there is a limitation of columns(256) to write in excel from PPP but at source there are 500+ columns.

3 replies

Forum|alt.badge.img+2
  • Data Pioneer L2
  • February 18, 2026

I am assuming you are using the IDE for the post processing plan - you can add a filter step when you are pulling results to select which columns you would like to bring into the plan for the results table.


Forum|alt.badge.img
  • Author
  • Data Pioneer
  • February 18, 2026

@ThomasPro  - Filter step will filter only records. Here I am talking about columns. I need only columns with DQ Checks. I know we can manually edit in integration input but its not a feasible way coz the user keeps adding/removing checks. The columns should get automatically added/removed 


Forum|alt.badge.img+2
  • Data Pioneer L2
  • February 19, 2026

Architecturally speaking - I believe that there is not a functionality baked into the IDE due to it referencing the entirety of the artifact. If there are unnessary columns that can be dropped from the catalog that could be an option, but it does not seem like it is. 

Besides that, I have implemented API calls that retrieve the monitoring process results, pull the Rule and Catalog ID’s and map them that way to only pull back results of columns with data quality rules applied. Otherwise, I believe the functionality will just pull in all of the columns by default related to the catalog item, but I believe manually is the only other way to edit that within the plan