Hello, I hipe I can provide some information:
ad 1. Yes, during evaluation (either profiling or DQ), DPE creates temporary file on the server (by default it is the /tmp folder on the server, this can be changed). Once the evaluation is over, all these files are deleted.
ad 2. Samples of invalid records are stored in MiniO, so even after the connection is closed, they are stored in the platform. This can be disabled in the configuration of monitoring project. As for metadata, they are stored in the Ataccama database (e.g. profiling results, table attributes, aggregated results for DQ etc.). Temporary files as mentiond in #1 are deleted once the evaluation is finished.
ad 3. What do you mean about this? Like what specific queries are called to the database? In very high level, once a job is started (profiling or DQ), Ataccama DPE will call several select queries into the datasource and as mentioned, several temporary files with the data are created on the DPE server, on top of which is Ataccama doing the computation. So the actual profiling or DQ evaluation is happening in DPE, not in the datasource. If you need more details, I can ask our engineering team.
Hope this helps :)
Anna
