Hi Community people!
I have a question regarding data observability. I am especially interested in noticing changes in record volume and applying this observability functionality in the process of a data delivery. This delivery is orchestrated with a tool, Jams in our case, starting with data retrieval and ending with the actual data delivery. Somewhere in this data flow orchestration I want to check for anomalous changes in record volume. The orchestration tool could then, for instance just before file creation, trigger an observability job to check the underlying database tables for record volume.
But when configuring data observability I see a scheduler, which does not match with the idea of an orchestrated flow.
So question 1 is if data observablity can be triggered.
Maybe in a scenario where the orchestration tool starts an Ataccama job via a command, like a workflow that starts the observability and reads the observability results and returns an OK or Not OK to the orchestration tool. Something like that. Any other suggestions are welcome of course.
Question 2 is how the observability results can be read. In the metadata model I found entity observabilityIssue. Are there other relevant entities as well?
Thanks and kind regards,
Albert


