Data Quality & Catalog ⚙️

Hi, Can anyone please suggest the next level of certification after Ataccama ONE v15 | DQ&C Consumer Certification? Thanks in advance and Happy Learning!

Hi, I need to extract metadata using One Desktop and store in Parquet file format in ADLS. Do we have any recommendations on how this can be achieved in One Desktop?

Hello Ataccama Community, We currently operate two Ataccama ONE environments: dev (for testing and experimentation) and prod (for business use). Our goal is to ensure that the dev environment closely mirrors prod, especially for configuration and metadata, so that testing is as realistic as possible. Ideally, we would like to perform a weekly migration from prod to dev—essentially overwriting the dev environment with the latest prod state. However, as I understand it, there is no automated way to fully clone the prod environment to dev, and migration of certain elements (like metadata model changes or monitoring projects) is either limited or requires manual intervention. Questions: Migration Feasibility: Is there any way to automate or script a full environment migration from prod to dev, or are we limited to manual processes for specific components? What are the main obstacles or unsupported features when trying to migrate Ataccama ONE environments? Best Practices for Environment Syn

Can someone share the list of different types of APIs available for reading and writing of Metadata and Data that can be used along with their GraphQLs ?

I am working on a requirement where I have to check that any values which were present in previous profiling/monitoring project run inside column_A of table_1 should not be absent in current/latest run of column_A table_1 if those are present I have to highlight those, requesting community to help me with this.

I'm working with a database table that contains a column storing complicated JSON/XML data structures. I need to implement data quality rules that will search for and validate specific values within these structures and compare them with values in other columns. My specific requirements: Need to search for particular patterns and values nested within JSON/XML structures Considering using regular expressions for this search capability Concerned about the performance impact on database resources Want to ensure this approach is sustainable as data volume grows Has anyone implemented data quality rules for searching/validating values within JSON or XML columns? Are regular expressions an appropriate approach, or are there better alternatives within Ataccama (Desktop?) for handling hierarchical data structures? I'm particularly concerned about performance impacts and would appreciate insights from those who have solved similar challenges.

Use Case; to configure a scheduled profiling job daily for a specific schema of a data source within Ataccama Web application and not via Desktop?

Is there any list of APIs that I can refer for reading and writing of the Metadata ?

Hi, I am using Ataccama v15.4 web. My question is can we add a materialised view / normal view as a catalog item in Ataccama?

Hello!Wondering if anyone has experience with creating data quality rules for values in joined tables. For example, we have 2 tables (Table A and B), related to each other through a shared attribute. I want a data quality rule where the value of a column in table A must be lower than the value of a column in Table B. My only idea for this is to create a SQL catalog item joining the two tables, and creating a dq rule on the SQL catalog item. This works, but has flaws, I can’t have this data quality rule contribute to the overall data quality of Table A, nor will users who find this table in the catalog know of all the identified data quality issues. Does anyone have a better way of doing this, or is there a built-in tool I’m not familiar with that anyone has used?Thanks!

Hello all 🤓 I would like to write my post processing data (export file of my DQ results) to One-Data (database) from One Desktop. Since one-data is not jdbc, I couldn’t use JDBC writer. It shows red icon when I want to try to use this step. Can anyone recommend what can I do here? Thanks !

I'm looking to add a datetime suffix to the filename of my JSON output using the JSON Writer, something like " file_name_2025-06-04 11_15_00.json ". I came across a community post demonstrating how this can be done for a text file, but I haven’t been able to achieve the same for a JSON file. Appreciate any suggestions or best practices the community can share. Best Regards, Dhaval.

I'm working on workflows on my local machine and have set up a scheduler to trigger every 10 minutes. Each time the workflow runs, I would like to capture the following details from the job execution history, such as: Execution Date, Execution State, Executed Action ID, Details. I am using Apache Derby as my database and would like to store this information there. Please let me know if there is a way to retrieve the above-mentioned details and store them in my database. Thank you for your assistance. Best regards,Dhaval

Happy Tuesday community! Today we are continuing with the Monitoring Projects functionalities. What’s on the menu? Reports! We'll walk you through the essential features and insights you can gain from DQ (Data Quality) Reports in this post, helping you keep a close eye on the health of your data. Overview of DQ Reports DQ Reports display the DQ results and detected anomalies over time for all monitoring runs. They offer a comprehensive view of issues and statistics, allowing you to track changes in DQ across the entire monitoring project, catalog items, specific DQ dimensions, and checks assigned to attributes. As a DQ Steward, you'll be notified whenever a new report is available and have the ability to explore DQ issues and anomalies in greater detail. Viewing the Report Once monitoring is complete, you can access the Data Quality results in the Report tab of your project. The report provides different levels of granularity: Overall: A high-level summary of the entire monitoring proj

Hi everyone, I’m exploring ways to automate the import of Qlik reports (or datasets exported from Qlik Sense) into Ataccama’s data management platform using API-based workflows. My goal is to ensure that reference data or analytical results generated in Qlik can be seamlessly ingested into Ataccama for further processing, enrichment, or distribution to downstream systems. From what I understand, Qlik offers REST APIs for data export and integration, while Ataccama provides robust APIs for job execution and data ingestion. However, I’m looking for practical advice or examples on how to best orchestrate this integration—specifically: What is the recommended approach to export data from Qlik (e.g., via Qlik’s REST API or by generating CSV/Excel files from the load script) and then import it into Ataccama using its API? Are there any existing patterns, connectors, or scripts that community members have used to automate this process? How do you handle data validation, error handling, or sch

Hi Community, Don't know if you ever have made changes to the page layout in OneWeb, but sometimes it can be an uncomfortable task: while often there is a preview option, for ‘create’ and ‘edit’ pages this is not the case. So after having made the changes and pressing Ctrl-s to save them, if you made a mistake it can turn out your screen will go white, without option to make a correction afterwards (yes, speaking from experience). Lately we had a bit of an awkward situation, that the System Changes screen in the Global Settings area was no longer accessible, showing an error message about a screen layout error. But we never applied any layout changes to the System Changes screen, so we were rather puzzled. I consulted Ataccama Support about this and I would like to share their solution. First conclusion by Support was that this was caused by an erroneous page layout from another page. Indeed we had done quite some development and experimenting (dev environment), so finally we figured o

Is there any option to group can be implemented at two different level? For example: I want to create rule which count number of districts for which has total revenue zero by each state. Such district Count should not more than 10. Hierarchy country > state > district > Territory. Kindly suggest how to create a rule for this using Ataccama Web one.

I am using Ataccama 14.5.3, everytime I open it, I get an error - The One-desktop executable launcher was unable to locate it's companion shared library. What could be the reason for this?

In catalog item DQ evaluation, we are trying to run the DQ evaluation via API and it is working fine. Do we have an API to load the failed records to ONE data via API?

I'm facing an issue with selecting schemas to observe for schema change detection in Observability for one of our sources(Sybase). Context: In our SQL database source setup, we have a single connection that includes multiple schemas, and Observability allows us to select multiple schemas without issue, as shown below. However, for the Sybase source, we're unable to select multiple schemas under a single connection. I only get the option to choose one connection and one schema from the dropdown. (See screenshot below.) Ideally, I’d like to select all dbo across all connections to monitor for structural changes. Question: Has anyone experienced a similar limitation?Is there a recommended approach for configuring Observability for schema checks on sources that have multiple connections and schemas under a single source — especially in cases like a Sybase database, where multiple connections are used? Any guidance or best practices would be greatly appreciated.

Hello! My org wants to create a new column on the Terms overview page to display items from a referenced object array. Specifically, we want to display Data Protection Classification information there on the overview page in a column. At first, we were told this was not possible, but we have seen this done on another one of our overview pages that displays Policies, which is also a referenced object array. This was created for us, and the json from the “Edit Page” screen looks like it is inherited from another entity. { "_type": "entity.page.listing", "children": { "_type": "entity.listing.v2" }} Here is what our current Terms overview page layout looks like: And the JSON behind the layout: { "_type": "entity.page.listing", "children": { "_type": "relationships.hierarchyListing", "enableSelection": true, "columns": { "type": { "dataPath": [], "name": "Type", "after": "name", "renderer": { "_type": "glossary.termType.tableCell" } } }, "flatListingRenderer": { "_type": "entity.listing.v2

Hi, I have a table called ‘employee’ with an attribute called ‘employement’ which may contain the value ‘employed’. I have another table called ‘person’ with an attribute called ‘income’ which may contain data or is null. I want to create a DQ Check in ONE Web that can check if ‘employement’ is not only filled, but also is the same as ‘employed’ then income should be filled. If not, then invalid. So basically a DQ Check that checks when value A is present in table A then value B in table B should not be null. If it is null, then invalid. Also a requirement that it can be done in ONE Web. Please note that value A is not present in table B, nor value B is present in table A. Hope that was clear 😅 any ideas are welcome!

When creating a DQ rule, I need to specify an attribute and define it’s datatype. But what if I don’t care what data type something is? I want to create a rule that checks a combination of NULL/NOT NULL for two columns. So if column A is NULL and column B is not, this would result in an INVALID test. But I want to do this for various metrics. Sometimes I want to check if a string column is null against a float column, or a date against a string etc. Do I need to create every permutation of every datatype combination as a rule in order to accomplish this? Also, even if it is required to make all these duplicate tests. Is there a way to configure the rules so that they don’t show up as “Applied DQ Checks” for both columns selected in the configuration? Example. I care whether or not Column A is populated given column B, but I don’t care whether or not Column B is populated. Currently when making a rule like this, the tests gets affixed to both columns even if I only add it to a specific

Hi Everyone, I’m trying to set the correct AQL criteria to show related terms in a new Data Domain I have created. I can see the logic used for default domains like ‘Finance’, but I’m unable to replicate the outcome because I either don’t know how to find the need ID’s or where I can see an ID (like above the Relationship Type name), it’s the same ID anywhere it is present/visible. We’re using 15.4. Thank you for any help you can offer. Regards Stu

Hi All, At Bupa, within our Power BI environment we have a number of reports that have been tagged with a sensitivity label of ‘Confidential - Internal Use Only’ or ‘Highly Confidential: Internal Use Only’ using Microsoft’s sensitivity labels. https://learn.microsoft.com/en-us/purview/sensitivity-labels When reports have one of these labels applied, the data returned by the Export Report API in Power BI is encrypted. This is the main API call that the Ataccama scanner uses to extract metadata/lineage information for ingestion into the catalog. As the data returned is encrypted, the scanner is not currently processing it and skipping to the next report. Reports - Export Report In Group - REST API (Power BI Power BI REST APIs) | Microsoft Learn Has anyone come across scenario in their own environment and been able to identify any workarounds/ways forward to capture lineage for those reports with a higher sensitivity label? Either on the Ataccama side or the Microsoft side? Below is what