Data Quality & Catalog ⚙️

i have a sql catalog in one web and i have a file in sharepoint now what is the best way to compare the contents of sql catalog and file ?will virtual catalog help ? if yes how could i do it ?  my idea is to join sql catalog and file as full join in one desktop and use this joined data as a catalog in one web application . how to do it ?

Hello!My org wants to create a new column on the Terms overview page to display items from a referenced object array. Specifically, we want to display Data Protection Classification information there on the overview page in a column. At first, we were told this was not possible, but we have seen this done on another one of our overview pages that displays Policies, which is also a referenced object array.  This was created for us, and the json from the “Edit Page” screen looks like it is inherited from another entity. { "_type": "entity.page.listing", "children": { "_type": "entity.listing.v2" }} Here is what our current Terms overview page layout looks like:  And the JSON behind the layout: { "_type": "entity.page.listing", "children": { "_type": "relationships.hierarchyListing", "enableSelection": true, "columns": { "type": { "dataPath": [], "name": "Type", "after": "name", "renderer": { "_type": "glossary.termType.tableCell"

HI I need to find duplicate tables by comparing the row to row from two or more than two tables. i have 300 tables i need to find duplicate tables. Please help to find this out

Hello, I have a rule looking for unique vendors that is tied to a monitoring project.  The monitoring project is running on a regular basis; however, the report is not showing on the report tab of the monitoring project.  This is the only project I’m seeing this behavior.  Has anyone encountered this issue?  We are on version 16.1.

How to add notification to all the rules in monitoring Project for all the catalog items and set alert at 95% at once instead of doing it manually one by one?

Last week we noticed that the export files we created for the summary results of monitoring projects are no longer generating and landing in our S3 bucket. The component/scheduler/workflow were all created by an Ataccama consultant and so we never tamper with these in ONE Desktop. One thing that recently changed is the way the DPE works with the monitoring projects. We were having trouble with scheduled monitoring projects running (they would always fail). Our platform engineer determined that the scheduled runs were going to the wrong DPE so he forced it to go to the hybrid-DPE instead. The scheduled monitoring project runs are no longer failing, but coincidentally the summary export files stopped working the same day that the scheduled runs problem was fixed. Could the change with the hybrid-DPE be the cause of the issue?

Hi All,toDate(Input, “yyyy/MM/dd”) function is not throwing null when I am passing value “1/1/1”. Input datatype is string.can anybody help why it takes 1/1/1 as valid date value?Regards,Shefhali

Hey y’all, I was wondering if anyone had a quality rule or advice on how to construct a quality rule to check a date type field for formatting. I know there is the “matches” function for strings and that you can convert a date field to a string using “toString”, but that requires you to specify a format, which invalidates the point of the rule.The desired format is “MM-dd-yyyy”, as shown in what I’ve got so far.matches("^\d{4}-(0[1-9]|1[0-2])-(0[1-9]|[12][0-9]|3[01])$",toString(ATTRIBUTE_1, "MM-dd-yyyy"))

Can someone share the list of different types of APIs available for reading and writing of Metadata and Data that can be used along with their GraphQLs ?

Do we have any API that will trigger ONE Desktop jobs? We are doing some post DQ steps in databricks, we want to trigger ONE Desktop job from that notebook via API. Could anyone help me on this?

hi,I have a scenario where two columns ID and Value to be verified using DQ check together (like key value pair) against two columns of Table1 key (compared against ID) and name (compared against Value)I am using Atacama web, I see we can create lookup but it could be created only for one column and not both.Appreciate your suggestions here.Cheers!

I have a plan that reads a CSV file from my storage and writes the data to the Business Glossary page.What I Want to Achieve:I would like to enhance this plan to not only insert new terms, but also check for existing terms and update them if necessary to avoid duplicate If a term already exists and nothing has changed, it should be skipped. If the term exists but the definition (or any attribute) has been modified, it should update the existing entry with the new information. If the term does not exist in the glossary, it should be inserted as a new entry. Challenge:I noticed that some solutions in the community reference a unique ID for each term---community chat on bulk term update, but my business glossary terms currently do not have an ID field.Question:How can I structure the plan to perform insert, update, and skip logic effectively, What’s the best practice for comparing and managing term updates in this scenario?below is a snip of what my current plan that write only new pl

 Hi, I am using Ataccama One Desktop 15.4.0. In this case, I am creating a DQC (Data Quality Center) plan with an HANA database as the source. Now, in this database, I also have columns with GZIP data. I would like to unzip these in the DQC plan, but how? Unfortunately, the database does not have this feature. Such functionality does not exist in DQC either. Developing a custom step? It's possible, but apparently not encouraged by Ataccama. Perhaps you could recommend an approach. Best regards, Sergej

Hello, I am trying to make connectivity to ADLS in Azure subscription from One Desktop. What would be the Authentication token endpoin?

We would like to make a customised dashboard for observed data quality issues on a set of complex spreadsheets loaded into Ataccama via an S3 bucket. What are the best ways to create non standard dashboards rather than out of the box style data insights please?

Hi, I need to extract metadata using One Desktop and store in Parquet file format in ADLS. Do we have any recommendations on how this can be achieved in One Desktop?

I'm working on workflows on my local machine and have set up a scheduler to trigger every 10 minutes. Each time the workflow runs, I would like to capture the following details from the job execution history, such as: Execution Date, Execution State, Executed Action ID, Details. I am using Apache Derby as my database and would like to store this information there. Please let me know if there is a way to retrieve the above-mentioned details and store them in my database.Thank you for your assistance.Best regards,Dhaval

Hi I am new to Ataccama and would like to understand the Sql Catalog Item feature provided in Ataccama web v15.4.I am trying to create a sql catalog item on a table and unable to save it to workspace → new folderI am curious to know what level of access is needed on Ataccama to save the SCI. Also would like to know where exactly the SCI and it’s metadata is stored.

Hi everyone,I’m exploring ways to automate the import of Qlik reports (or datasets exported from Qlik Sense) into Ataccama’s data management platform using API-based workflows. My goal is to ensure that reference data or analytical results generated in Qlik can be seamlessly ingested into Ataccama for further processing, enrichment, or distribution to downstream systems.From what I understand, Qlik offers REST APIs for data export and integration, while Ataccama provides robust APIs for job execution and data ingestion. However, I’m looking for practical advice or examples on how to best orchestrate this integration—specifically: What is the recommended approach to export data from Qlik (e.g., via Qlik’s REST API or by generating CSV/Excel files from the load script) and then import it into Ataccama using its API? Are there any existing patterns, connectors, or scripts that community members have used to automate this process? How do you handle data validation, error handling, or s

Is Ataccama support integration with SharePoint?

Sometimes we have monitoring project results where a DQ check returns 1000 records because of so many rule failures. We want to limit the amount of records in the monitoring project export file for each DQ rule. If I only want to show X invalid samples per DQ check, how can I go about doing this? I initially thought of using a sequence step then filtering the final result, but this does not work because each rule needs its own sequence or count. Basically, I think I may need to group each DQ rule and apply a sequence to each group separately. This is how I am thinking of solving the problem. Any suggestions on what I can do? Thank you in advance for your help!

Is there any list of APIs that I can refer for reading and writing of the Metadata ?

Hello Ataccama Community,We currently operate two Ataccama ONE environments: dev (for testing and experimentation) and prod (for business use). Our goal is to ensure that the dev environment closely mirrors prod, especially for configuration and metadata, so that testing is as realistic as possible.Ideally, we would like to perform a weekly migration from prod to dev—essentially overwriting the dev environment with the latest prod state. However, as I understand it, there is no automated way to fully clone the prod environment to dev, and migration of certain elements (like metadata model changes or monitoring projects) is either limited or requires manual intervention.Questions: Migration Feasibility: Is there any way to automate or script a full environment migration from prod to dev, or are we limited to manual processes for specific components? What are the main obstacles or unsupported features when trying to migrate Ataccama ONE environments? Best Practices for Environ

I am working on a requirement where I have to check that any values which were present in previous profiling/monitoring project run inside column_A of table_1 should not be absent in current/latest run of column_A table_1 if those are present I have to highlight those, requesting community to help me with this.

I'm working with a database table that contains a column storing complicated JSON/XML data structures. I need to implement data quality rules that will search for and validate specific values within these structures and compare them with values in other columns.My specific requirements: Need to search for particular patterns and values nested within JSON/XML structures Considering using regular expressions for this search capability Concerned about the performance impact on database resources Want to ensure this approach is sustainable as data volume grows Has anyone implemented data quality rules for searching/validating values within JSON or XML columns? Are regular expressions an appropriate approach, or are there better alternatives within Ataccama (Desktop?) for handling hierarchical data structures?I'm particularly concerned about performance impacts and would appreciate insights from those who have solved similar challenges.