Skip to main content

Data Quality & Catalog ⚙️

Discuss, learn, ask, suggest, share all things DQ&C 🔍

  • 786 Topics
  • 2,012 Replies
786 Topics
C
Data Voyager
ckaushikData Voyager
asked in Data Quality & Catalog ⚙️
Ataccama ONE Certification Queries

What is the exam fee for  Ataccama ONE v13 Data Quality & Governance Foundation Level certification for attendees who exchange a minimum of 12 months hands-on experience for the must have training? How can we apply for the certification exam? Is the application process online or offline? Is the exam proctored? 

4559
A
H
Universe Traveller
Hanish NUniverse Traveller
asked in Data Quality & Catalog ⚙️
API to trigger ONE Desktop job

Do we have any API that will trigger ONE Desktop jobs? We are doing some post DQ steps in databricks, we want to trigger ONE Desktop job from that notebook via API. Could anyone help me on this?

361
ivan.kozlov
Ataccamer
Lisa Kovalskaia
Ataccamer
Lisa KovalskaiaAtaccamer
published in Data Quality & Catalog ⚙️
How to organize assets in ONE web app: adding columns and filters in Business Glossary

Adding more details to a list view and providing additional filtering options can help business users in their daily tasks as you scale Data Governance across multiple teams, geographies, or business functions.In this article we’ll customize the Business Glossary to show additional term attributes as columns in the list view and to enable filtering by those attributes. This approach generally works across the Ataccama ONE Web app, so you can use this article as a guide to customize other pages, for example Rules, Catalog Items, or Monitoring Projects.You don’t have to be a developer to follow this guide. If you come across any concepts you’re not familiar with, have a look at our documentation. Adding columns First, navigate to the Business Glossary’s Terms list. In the top right, find the 3-dot menu which features the option to Edit page. In the side bar that opens up, go to the Layout tab. You’ll see the JSON that describes how the objects are shown on this page when the web app load

72511
Lisa Kovalskaia
Ataccamer
M
Star Blazer L1
mp_ataccamauserStar Blazer L1
asked in Data Quality & Catalog ⚙️
Can we create a lookup with two columns and use it DQ check

hi,I have a scenario where two columns ID and Value to be verified using DQ check together (like key value pair) against two columns of Table1 key (compared against ID) and name (compared against Value)I am using Atacama web, I see we can create lookup but it could be created only for one column and not both.Appreciate your suggestions here.Cheers!

341
ivan.kozlov
Ataccamer
S
Universe Traveller
Susan24usUniverse Traveller
asked in Data Quality & Catalog ⚙️
Business Term Bulk Update

I have a plan that reads a CSV file from my storage and writes the data to the Business Glossary page.What I Want to Achieve:I would like to enhance this plan to not only insert new terms, but also check for existing terms and update them if necessary to avoid duplicate If a term already exists and nothing has changed, it should be skipped. If the term exists but the definition (or any attribute) has been modified, it should update the existing entry with the new information. If the term does not exist in the glossary, it should be inserted as a new entry. Challenge:I noticed that some solutions in the community reference a unique ID for each term---community chat on bulk term update, but my business glossary terms currently do not have an ID field.Question:How can I structure the plan to perform insert, update, and skip logic effectively, What’s the best practice for comparing and managing term updates in this scenario?below is a snip of what my current plan that write only new pl

351
Albert de Ruiter
Rocket Pioneer L1
V
Data Voyager
VertigoData Voyager
asked in Data Quality & Catalog ⚙️
unzip GZIP DB Column - attacama one desktop

 Hi, I am using Ataccama One Desktop 15.4.0. In this case, I am creating a DQC (Data Quality Center) plan with an HANA database as the source. Now, in this database, I also have columns with GZIP data. I would like to unzip these in the DQC plan, but how? Unfortunately, the database does not have this feature. Such functionality does not exist in DQC either. Developing a custom step? It's possible, but apparently not encouraged by Ataccama. Perhaps you could recommend an approach. Best regards, Sergej

140
V
Data Voyager
S
Data Pioneer
sumishaData Pioneer
asked in Data Quality & Catalog ⚙️
ADLS Connectivity from One Desktop

Hello, I am trying to make connectivity to ADLS in Azure subscription from One Desktop. What would be the Authentication token endpoin?

222
S
Data Pioneer
Nick Robberds
Data Voyager
Nick RobberdsData Voyager
asked in Data Quality & Catalog ⚙️
Customised Dashboards

We would like to make a customised dashboard for observed data quality issues on a set of complex spreadsheets loaded into Ataccama via an S3 bucket. What are the best ways to create non standard dashboards rather than out of the box style data insights please?

231
E
Ataccamer
S
Data Pioneer
sumishaData Pioneer
asked in Data Quality & Catalog ⚙️
Parquet File output

Hi, I need to extract metadata using One Desktop and store in Parquet file format in ADLS. Do we have any recommendations on how this can be achieved in One Desktop?

659
ivan.kozlov
Ataccamer
D
Data Pioneer
DhavalMData Pioneer
asked in Data Quality & Catalog ⚙️
How to Store Scheduler Job Execution History into Apache Derby?

I'm working on workflows on my local machine and have set up a scheduler to trigger every 10 minutes. Each time the workflow runs, I would like to capture the following details from the job execution history, such as: Execution Date, Execution State, Executed Action ID, Details. I am using Apache Derby as my database and would like to store this information there. Please let me know if there is a way to retrieve the above-mentioned details and store them in my database.Thank you for your assistance.Best regards,Dhaval

7011
D
Data Pioneer
M
Star Blazer L1
mp_ataccamauserStar Blazer L1
asked in Data Quality & Catalog ⚙️
IS the workspace that holds SQL Catalog Item (SCI) stored on Ataccama server? Or on the same database on which SCI is created

Hi I am new to Ataccama and would like to understand the Sql Catalog Item feature provided in Ataccama web v15.4.I am trying to create a sql catalog item on a table and unable to save it to workspace → new folderI am curious to know what level of access is needed on Ataccama to save the SCI. Also would like to know where exactly the SCI and it’s metadata is stored.

251
Lisa Kovalskaia
Ataccamer
O
Universe Traveller
onufryUniverse Traveller
asked in Data Quality & Catalog ⚙️
Qlik Reports

Hi everyone,I’m exploring ways to automate the import of Qlik reports (or datasets exported from Qlik Sense) into Ataccama’s data management platform using API-based workflows. My goal is to ensure that reference data or analytical results generated in Qlik can be seamlessly ingested into Ataccama for further processing, enrichment, or distribution to downstream systems.From what I understand, Qlik offers REST APIs for data export and integration, while Ataccama provides robust APIs for job execution and data ingestion. However, I’m looking for practical advice or examples on how to best orchestrate this integration—specifically: What is the recommended approach to export data from Qlik (e.g., via Qlik’s REST API or by generating CSV/Excel files from the load script) and then import it into Ataccama using its API? Are there any existing patterns, connectors, or scripts that community members have used to automate this process? How do you handle data validation, error handling, or s

291
R
Ataccamer
S
Data Voyager
surendraData Voyager
asked in Data Quality & Catalog ⚙️
Integration with SharePoint

Is Ataccama support integration with SharePoint?

331
R
Ataccamer
W
Universe Traveller
WesTUniverse Traveller
asked in Data Quality & Catalog ⚙️
How to limit number of each DQ rule in invalid sample exports from One Desktop

Sometimes we have monitoring project results where a DQ check returns 1000 records because of so many rule failures. We want to limit the amount of records in the monitoring project export file for each DQ rule. If I only want to show X invalid samples per DQ check, how can I go about doing this? I initially thought of using a sequence step then filtering the final result, but this does not work because each rule needs its own sequence or count. Basically, I think I may need to group each DQ rule and apply a sequence to each group separately. This is how I am thinking of solving the problem. Any suggestions on what I can do? Thank you in advance for your help!

674
W
Universe Traveller
A
Data Voyager
Apurva KapoorData Voyager
asked in Data Quality & Catalog ⚙️
Is there any list of APIs that I can refer for reading and wirting of the Metadata ?

Is there any list of APIs that I can refer for reading and writing of the Metadata ?

181
E
Ataccamer
O
Universe Traveller
onufryUniverse Traveller
asked in Data Quality & Catalog ⚙️
Migrating Production Environment to Development

Hello Ataccama Community,We currently operate two Ataccama ONE environments: dev (for testing and experimentation) and prod (for business use). Our goal is to ensure that the dev environment closely mirrors prod, especially for configuration and metadata, so that testing is as realistic as possible.Ideally, we would like to perform a weekly migration from prod to dev—essentially overwriting the dev environment with the latest prod state. However, as I understand it, there is no automated way to fully clone the prod environment to dev, and migration of certain elements (like metadata model changes or monitoring projects) is either limited or requires manual intervention.Questions: Migration Feasibility: Is there any way to automate or script a full environment migration from prod to dev, or are we limited to manual processes for specific components? What are the main obstacles or unsupported features when trying to migrate Ataccama ONE environments? Best Practices for Environ

955
ivan.kozlov
Ataccamer
A
Data Pioneer
Ayush kumarData Pioneer
asked in Data Quality & Catalog ⚙️
Getting values from previous ataccama run (for monitoring project or profiling runs) and comparing them

I am working on a requirement where I have to check that any values which were present in previous profiling/monitoring project run inside column_A of table_1 should not be absent in current/latest run of column_A table_1 if those are present I have to highlight those, requesting community to help me with this.

355
E
Ataccamer
O
Universe Traveller
onufryUniverse Traveller
asked in Data Quality & Catalog ⚙️
Best Practices for Searching JSON/XML Values in Database Columns Using Regular Expressions

I'm working with a database table that contains a column storing complicated JSON/XML data structures. I need to implement data quality rules that will search for and validate specific values within these structures and compare them with values in other columns.My specific requirements: Need to search for particular patterns and values nested within JSON/XML structures Considering using regular expressions for this search capability Concerned about the performance impact on database resources Want to ensure this approach is sustainable as data volume grows Has anyone implemented data quality rules for searching/validating values within JSON or XML columns? Are regular expressions an appropriate approach, or are there better alternatives within Ataccama (Desktop?) for handling hierarchical data structures?I'm particularly concerned about performance impacts and would appreciate insights from those who have solved similar challenges.

282
A
Catherine
Data Pioneer
CatherineData Pioneer
asked in Data Quality & Catalog ⚙️
How to schedule a profiling job for specific schema vs all schemas within the data source?

Use Case;  to configure a scheduled profiling job daily for a specific schema of a data source within Ataccama Web application and not via Desktop? 

1163
A
M
Star Blazer L1
mp_ataccamauserStar Blazer L1
asked in Data Quality & Catalog ⚙️
Can we add a materialised view / normal view as a catalog item in Ataccama?

Hi, I am using Ataccama v15.4 web. My question is can we add a materialised view / normal view as a catalog item in Ataccama?

211
T
Data Pioneer L2
B
Data Voyager
bobparryData Voyager
asked in Data Quality & Catalog ⚙️
Best Practices for Data Quality Rules based on joins

Hello!Wondering if anyone has experience with creating data quality rules for values in joined tables.For example, we have 2 tables (Table A and B), related to each other through a shared attribute. I want a data quality rule where the value of a column in table A must be lower than the value of a column in Table B. My only idea for this is to create a SQL catalog item joining the two tables, and creating a dq rule on the SQL catalog item. This works, but has flaws, I can’t have this data quality rule contribute to the overall data quality of Table A, nor will users who find this table in the catalog know of all the identified data quality issues. Does anyone have a better way of doing this, or is there a built-in tool I’m not familiar with that anyone has used?Thanks! 

585
A
S
Data Pioneer
sumeyraData Pioneer
asked in Data Quality & Catalog ⚙️
Writing data to One Data from One Desktop

Hello all 🤓I would like to write my post processing data (export file of my DQ results) to One-Data (database) from One Desktop. Since one-data is not jdbc, I couldn’t use JDBC writer. It shows red icon when I want to try to use this step. Can anyone recommend what can I do here? Thanks ! 

975
A
D
Data Pioneer
DhavalMData Pioneer
posted in Data Quality & Catalog ⚙️
Appending Datetime to JSON Output Filename in JSON Writer

I'm looking to add a datetime suffix to the filename of my JSON output using the JSON Writer, something like "file_name_2025-06-04 11_15_00.json". I came across a community post demonstrating how this can be done for a text file, but I haven’t been able to achieve the same for a JSON file.Appreciate any suggestions or best practices the community can share.Best Regards,Dhaval.

170
D
Data Pioneer
A
Ataccama Community AdminIntergalactic Expert
published in Data Quality & Catalog ⚙️
Monitoring Projects - Reports 📝Best Practice

Happy Tuesday community! Today we are continuing with the Monitoring Projects functionalities. What’s on the menu? Reports!We'll walk you through the essential features and insights you can gain from DQ (Data Quality) Reports in this post, helping you keep a close eye on the health of your data. Overview of DQ ReportsDQ Reports display the DQ results and detected anomalies over time for all monitoring runs. They offer a comprehensive view of issues and statistics, allowing you to track changes in DQ across the entire monitoring project, catalog items, specific DQ dimensions, and checks assigned to attributes.As a DQ Steward, you'll be notified whenever a new report is available and have the ability to explore DQ issues and anomalies in greater detail. Viewing the ReportOnce monitoring is complete, you can access the Data Quality results in the Report tab of your project. The report provides different levels of granularity:Overall: A high-level summary of the entire monitoring project.

1761
S
Data Voyager
A
Data Pioneer
akshayl09Data Pioneer
asked in Data Quality & Catalog ⚙️
Group by while creating the rule

Is there any option to group can be implemented at two different level? For example: I want to create rule which count number of districts for which has total revenue zero by each state. Such district Count should not more than 10. Hierarchy country > state > district > Territory.Kindly suggest how to create a rule for this using Ataccama Web one.

252
A
Data Pioneer

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings