Learn & Share

I'm working on workflows on my local machine and have set up a scheduler to trigger every 10 minutes. Each time the workflow runs, I would like to capture the following details from the job execution history, such as: Execution Date, Execution State, Executed Action ID, Details. I am using Apache Derby as my database and would like to store this information there. Please let me know if there is a way to retrieve the above-mentioned details and store them in my database.Thank you for your assistance.Best regards,Dhaval

Hi I am new to Ataccama and would like to understand the Sql Catalog Item feature provided in Ataccama web v15.4.I am trying to create a sql catalog item on a table and unable to save it to workspace → new folderI am curious to know what level of access is needed on Ataccama to save the SCI. Also would like to know where exactly the SCI and it’s metadata is stored.

Hi,How is data governance concepts used in Ataccama tool?

re: Duplicate record checking upon inputting new records into RDM-WebI know about setting up the uniqueness check and validations on the data once. I have users in the Web portal potentially entering duplicate values, can we set up uniqueness checks BEFORE they publish records. So, any record that is deemed duplicate (on 1 or more columns) would not be publishable. If this question has already been submitted/answered, please direct me there.Thanks,

Hi everyone,I’m exploring ways to automate the import of Qlik reports (or datasets exported from Qlik Sense) into Ataccama’s data management platform using API-based workflows. My goal is to ensure that reference data or analytical results generated in Qlik can be seamlessly ingested into Ataccama for further processing, enrichment, or distribution to downstream systems.From what I understand, Qlik offers REST APIs for data export and integration, while Ataccama provides robust APIs for job execution and data ingestion. However, I’m looking for practical advice or examples on how to best orchestrate this integration—specifically: What is the recommended approach to export data from Qlik (e.g., via Qlik’s REST API or by generating CSV/Excel files from the load script) and then import it into Ataccama using its API? Are there any existing patterns, connectors, or scripts that community members have used to automate this process? How do you handle data validation, error handling, or s

Hello,Looking for some help on using http proxy in RDM. We are trying to perform HTTP POST to external endpoint which is accessible only via proxy. Below param were added in JAVA_OPTS in onlinectl.sh file however   -Dhttp.nonProxyHosts is ignored and ataccama is pushing all https requests via proxy.!--scriptorstartfragment-->   -Dhttp.proxyHost=outbound-service-proxy.gateway.aws-euw1-np.mydomain.com \  -Dhttp.proxyUser=svc_nonprod_service_proxy_fdplife \  -Dhttp.proxyPassword=xxxx \  -Dhttp.proxyPort=80 \  -Dhttp.nonProxyHosts=localhost|127.0.0.1|*.uk-dwh.nonprod.aws-euw1-np.mydomain.com" !--scriptorendfragment-->

Is Ataccama support integration with SharePoint?

I want to convert the instance export table values to a new table/view.The instance export contains 3 columns that I want to utiliseSharing an example-I have the following instance table structure :MASTER_ID SOURCE_SYSTEM SOURCE_ID 001 sys1 1234 001 sys2 12232 001 sys3 1292 001 sys4 13432 001 sys2 12334  5 records from 4 different source system make a master record, I want to group it in such a manner that there is a single row for each source_system id. If a source system participate twice(with two unique records) in formation of master record, I want two rows representing the different source_ids and a column with the source system that participates twice. Here is how I intend the output table to be: MASTER_ID SYS1_ID SYS2_ID SYS3_ID SYS4_ID MULTIPLE_REC 001 1234 12232 1292 13432 SYS2 001 1234 12234 1292 13432 SYS2  Can someone help me with the ONE Desktop step I can use for this?I have explored using Aggregating Column A

Sometimes we have monitoring project results where a DQ check returns 1000 records because of so many rule failures. We want to limit the amount of records in the monitoring project export file for each DQ rule. If I only want to show X invalid samples per DQ check, how can I go about doing this? I initially thought of using a sequence step then filtering the final result, but this does not work because each rule needs its own sequence or count. Basically, I think I may need to group each DQ rule and apply a sequence to each group separately. This is how I am thinking of solving the problem. Any suggestions on what I can do? Thank you in advance for your help!

Is there any list of APIs that I can refer for reading and writing of the Metadata ?

Hello Ataccama Community,We currently operate two Ataccama ONE environments: dev (for testing and experimentation) and prod (for business use). Our goal is to ensure that the dev environment closely mirrors prod, especially for configuration and metadata, so that testing is as realistic as possible.Ideally, we would like to perform a weekly migration from prod to dev—essentially overwriting the dev environment with the latest prod state. However, as I understand it, there is no automated way to fully clone the prod environment to dev, and migration of certain elements (like metadata model changes or monitoring projects) is either limited or requires manual intervention.Questions: Migration Feasibility: Is there any way to automate or script a full environment migration from prod to dev, or are we limited to manual processes for specific components? What are the main obstacles or unsupported features when trying to migrate Ataccama ONE environments? Best Practices for Environ

I am working on a requirement where I have to check that any values which were present in previous profiling/monitoring project run inside column_A of table_1 should not be absent in current/latest run of column_A table_1 if those are present I have to highlight those, requesting community to help me with this.

Let’s say I have a table that has 500,000 rows.I need to query this table using REST API (because I want to get both published records and records still in edited/waiting for publish states).I have some params to filter the data with, but even with params, the result set could be say, 10000.I tried using the REST API using JSON call step in a plan, setting “count” to 10000, and the API says maximum is 1000.I see that the REST API provides the offset param as well. Is there an example of how I can use that offset param to paginate and query all the records that I will need, but in one plan/component?This component will be a part of a complex set of components as a larger operation, and I’d prefer to not have to create an extra .ewf and iterator for it, otherwise this whole thing gets too complicate for anyone else to understand… Any ideas?

I'm working with a database table that contains a column storing complicated JSON/XML data structures. I need to implement data quality rules that will search for and validate specific values within these structures and compare them with values in other columns.My specific requirements: Need to search for particular patterns and values nested within JSON/XML structures Considering using regular expressions for this search capability Concerned about the performance impact on database resources Want to ensure this approach is sustainable as data volume grows Has anyone implemented data quality rules for searching/validating values within JSON or XML columns? Are regular expressions an appropriate approach, or are there better alternatives within Ataccama (Desktop?) for handling hierarchical data structures?I'm particularly concerned about performance impacts and would appreciate insights from those who have solved similar challenges.

Use Case;  to configure a scheduled profiling job daily for a specific schema of a data source within Ataccama Web application and not via Desktop? 

Hi, I am using Ataccama v15.4 web. My question is can we add a materialised view / normal view as a catalog item in Ataccama?

Need help with graphQL query. I need to bring in All the metrics like DQ scores, Overall quality for CIs that are part of monitoring projects. Is there a way to get it? Also, do we have document which tells us more about when to use edges and nodes appropriately.

Hello!Wondering if anyone has experience with creating data quality rules for values in joined tables.For example, we have 2 tables (Table A and B), related to each other through a shared attribute. I want a data quality rule where the value of a column in table A must be lower than the value of a column in Table B. My only idea for this is to create a SQL catalog item joining the two tables, and creating a dq rule on the SQL catalog item. This works, but has flaws, I can’t have this data quality rule contribute to the overall data quality of Table A, nor will users who find this table in the catalog know of all the identified data quality issues. Does anyone have a better way of doing this, or is there a built-in tool I’m not familiar with that anyone has used?Thanks! 

Hello all 🤓I would like to write my post processing data (export file of my DQ results) to One-Data (database) from One Desktop. Since one-data is not jdbc, I couldn’t use JDBC writer. It shows red icon when I want to try to use this step. Can anyone recommend what can I do here? Thanks ! 

I'm looking to add a datetime suffix to the filename of my JSON output using the JSON Writer, something like "file_name_2025-06-04 11_15_00.json". I came across a community post demonstrating how this can be done for a text file, but I haven’t been able to achieve the same for a JSON file.Appreciate any suggestions or best practices the community can share.Best Regards,Dhaval.

Happy Tuesday community! Today we are continuing with the Monitoring Projects functionalities. What’s on the menu? Reports!We'll walk you through the essential features and insights you can gain from DQ (Data Quality) Reports in this post, helping you keep a close eye on the health of your data. Overview of DQ ReportsDQ Reports display the DQ results and detected anomalies over time for all monitoring runs. They offer a comprehensive view of issues and statistics, allowing you to track changes in DQ across the entire monitoring project, catalog items, specific DQ dimensions, and checks assigned to attributes.As a DQ Steward, you'll be notified whenever a new report is available and have the ability to explore DQ issues and anomalies in greater detail. Viewing the ReportOnce monitoring is complete, you can access the Data Quality results in the Report tab of your project. The report provides different levels of granularity:Overall: A high-level summary of the entire monitoring project.

Hello,Is it possible to self-join tables in RDM to populate some information? I would like to try something like shown in the screenshot. Attribute 4 and 5 values are selected from RDM UI. So, dropdown should only show values from the same table where att2 = CAT2 for Att4 and att2 = CAT3 for Att4Table1                 Selection from RDM UI   Att1 Att2  Att3 Att4 (where att2 = CAT2) Att5 (where att2 = CAT3)   ID1 CAT1 val1 ID3 ID5   ID2 CAT1 val2 ID4 ID6   ID3 CAT2 val3       ID4 CAT2 val4       ID5 CAT3 val5       ID6 CAT3 val6                    I somehow tried to create self join in relationship like below. I was able toi upload configuration successfully on RDM with these relationships.  However, when edit the record on RDM the lookup is blank. it does not show any value although table is populated.   (this can also be understood as employee info vs manager info relationship.

Is there any option to group can be implemented at two different level? For example: I want to create rule which count number of districts for which has total revenue zero by each state. Such district Count should not more than 10. Hierarchy country > state > district > Territory.Kindly suggest how to create a rule for this using Ataccama Web one.

I am using Ataccama 14.5.3, everytime I open it, I get an error - The One-desktop executable launcher was unable to locate it's companion shared library. What could be the reason for this?