Skip to main content
Solved

Data Quality

  • 1 July 2024
  • 2 replies
  • 50 views

Hi team,I am working on a story where a user needs to see the results of the monitoring project which is running.Like where the results are getting saved in the backend,in the tables.Need to create a pipeline for that like when we click the run monitoring button in Ataccama Web,a workflow in Ataccama desktop should run and the results should be saved in the database to look at to see how many records are passing and failing.So how can we create that pipeline?

2 replies

Userlevel 5
Badge +2

Hi Soniya,

It's not possible to access the intermediate state of a running monitoring project. This is because this data only exists temporarily within the Data Processing Engine (DPE) and isn't saved to a database. You can check the DPE and DPM data flows for more information.

May I ask what the goal is behind this request? Do your users need to see which specific rows passed or failed validation? Or are they looking for a way to speed up development by getting partial results more quickly?

Userlevel 6
Badge +3

Hi @Soniya, Iā€™m closing this thread for now. If you have any follow-up questions please feel free to share them in the comments below or create a new post šŸ™‹ā€ā™€ļø

Reply