Solved

How to upload DQ results from my monitoring project into a database?

  • 30 March 2023
  • 8 replies
  • 395 views

Userlevel 3
Badge +3

Hello everyone!

I created a VCI (Virtual Catolog Item) and created a Monitoring Project with Rules in Atacama One, using a Post Processing Plan I wanted to upload the result of the monitoring project to databases, in Atacama One we have a csv file with the results in the Export tab, but I can't upload it to the database, the database is empty. Сreated a Global Runtime Configuration, but there is no result. Who has faced such a problem?

icon

Best answer by pdanpoonkij 12 April 2023, 13:15

View original

8 replies

Userlevel 6
Badge +7

Hi @FCB developer , thank you for posting! I’m checking your question with the team and will be back with an update 👍

Userlevel 3
Badge +3

Hello @Cansu, thanks for the feedback! I'll be looking forward to it.

Userlevel 6
Badge +7

Hi again @FCB developer the team needs more information on your set up so would you be able to create a support ticket, so that they can take a closer look into your question? Thank you!

Userlevel 3
Badge +3

Good day @Cansu, no problem, thanks for the advice and answer👍🏻

Userlevel 2
Badge +3

Did you change you Post processing plan output to DB Object and updated the runtimeconfig file? if yes, then restart DPM

Userlevel 3
Badge +3

Hello, I’m not sure if this has already been resolved, but there are a couple of ways you can write data to a database from within the post-processing plan. You should start by replacing your text file writer step with a JDBC writer step (similar to the screenshot below).

In the post-processing plans, you can use the connections defined in the Ataccama ONE web application. Please see the screenshots below, where we navigate to the Ataccama One Source connection page. Here, you can get the connection id from the URL (as highlighted). And then, you can use this id as a Data Source Name in the JDBC Writer step.

Don’t worry about the red X icon here as the plan will be execute from Ataccama One and it will recognize this id there.

Hopefully this helps you 😀

Userlevel 3
Badge +3

@pdanpoonkij Good day! It helped me a lot, thank you!😃

Userlevel 1
Badge +1

A post processing component has a different deployment model to main pipeline code deployed via git. If you want to write just one main pipeline to read all monitoring projects’ results and write them to a database it can be done, albeit complicated, via a ONE Metadata Reader.

 

 

Reply