Monitoring Project Summary Exports Not Generating/Landing in S3

Question

Last week we noticed that the export files we created for the summary results of monitoring projects are no longer generating and landing in our S3 bucket. The component/scheduler/workflow were all created by an Ataccama consultant and so we never tamper with these in ONE Desktop. One thing that recently changed is the way the DPE works with the monitoring projects. We were having trouble with scheduled monitoring projects running (they would always fail). Our platform engineer determined that the scheduled runs were going to the wrong DPE so he forced it to go to the hybrid-DPE instead. The scheduled monitoring project runs are no longer failing, but coincidentally the summary export files stopped working the same day that the scheduled runs problem was fixed. Could the change with the hybrid-DPE be the cause of the issue?

Best answer by WesT

@anna.spakova thank you for your response! our platform engineer was able to fix the problem. What happened is he set the DPE drivers to point to a new location, and originally the output of the summary files was pointing to postgres. He switched it back to postgres and left the monitoring projects to run on the Oracle driver. That was the fix.

View original

WesT · Accepted Answer

​@anna.spakovathank you for your response! our platform engineer was able to fix the problem. What happenedis he set the DPE drivers to point to a new location, and originally the output of the summary files was pointing to postgres. Heswitched it back to postgres and left the monitoring projects to run on the Oracle driver. That was the fix.

anna.spakova · Answer

Hi ​@WesT,From your description it sounds like you have some extra workflow (process) running on the orchestration server that generates that report. Without exactly knowing what it does and how it cooperates with the projects, it is hard to confirm if the hybrid DPE switch is really the cause. If the process is independent, I’d say it is not related and might be more something about expired authentication on S3 or similar. If the project is exporting some summary data for the process, the problem might be that the hybrid DPE cannot save the results to the same location from which the process is reading it. But this is really hard to say.I recommend reaching out to our support team who can access your environment in cloud and examine the logs to find the root cause.Kind regards,Anna