Discuss, learn, ask, suggest, share all things DQ&C π
Recently active
Use Case;Β to configure a scheduled profiling job daily for a specific schema of a data source within Ataccama Web application and not via Desktop?Β
Hi, I am using Ataccama v15.4 web. My question is can we add aΒ materialised view / normal view as a catalog item in Ataccama?
Hello!Wondering if anyone has experience with creating data quality rules for values in joined tables.For example, we have 2 tables (Table A and B), related to each other through a shared attribute. I want a data quality rule where the value of a column in table A must be lower than the value of a column in Table B. My only idea for this is to create a SQL catalog item joining the two tables, and creating a dq rule on the SQL catalog item. This works, but has flaws, I canβt have this data quality rule contribute to the overall data quality of Table A, nor will users who find this table in the catalog know of all the identified data quality issues.Β Does anyone have a better way of doing this, or is there a built-in tool Iβm not familiar with that anyone has used?Thanks!Β
Hello allΒ π€I would like to write my post processing data (export file of my DQ results) to One-Data (database) from One Desktop. Since one-data is not jdbc, I couldnβt use JDBC writer. It shows red icon when I want to try to use this step.Β Can anyone recommend what can I do here?Β Thanks !Β
I'm looking to add a datetime suffix to the filename of my JSON output using the JSON Writer, something like "file_name_2025-06-04 11_15_00.json". I came across a community post demonstrating how this can be done for a text file, but I havenβt been able to achieve the same for a JSON file.Appreciate any suggestions or best practices the community can share.Best Regards,Dhaval.
Happy Tuesday community!Β Today we are continuing with theΒ Monitoring Projects functionalities. WhatβsΒ on the menu? Reports!We'll walk you through the essential features and insights you can gain from DQ (Data Quality) Reports in this post, helping you keep a close eye on the health of your data.Β Overview of DQ ReportsDQ Reports display the DQ results and detected anomalies over time for all monitoring runs. They offer a comprehensive view of issues and statistics, allowing you to track changes in DQ across the entire monitoring project, catalog items, specific DQ dimensions, and checks assigned to attributes.As a DQ Steward, you'll be notified whenever a new report is available and have the ability to explore DQ issues and anomalies in greater detail.Β Viewing the ReportOnce monitoring is complete, you can access the Data Quality results in the Report tab of your project. The report provides different levels of granularity:Overall: A high-level summary of the entire monitoring project.
Is there any option to group can be implemented at two different level?Β For example: I want to create rule which count number of districtsΒ for which has total revenue zero by each state. Such district Count should not more than 10.Β Hierarchy country > state > district > Territory.Kindly suggest how to create a rule for this using Ataccama Web one.
I am using Ataccama 14.5.3, everytime I open it, I get an error - The One-desktop executable launcher was unable to locate it's companion shared library. What could be the reason for this?
In catalog item DQ evaluation, we are trying to run the DQ evaluation via API and it is working fine. Do we have an API to load the failed records to ONE data via API?Β
I'm facing an issue with selecting schemas to observe for schema change detection in Observability for one of our sources(Sybase).Context:In our SQL database source setup, we have a single connection that includes multiple schemas, and Observability allows us to select multiple schemas without issue, as shown below.However, for the Sybase source, we're unable to select multiple schemas under a single connection. I only get the option to choose one connection and one schema from the dropdown. (See screenshot below.)Ideally, Iβd like to select all dboΒ across all connections to monitor for structural changes.Question:Has anyone experienced a similar limitation?Is there a recommended approach for configuring Observability for schema checks on sources that have multiple connections and schemas under a single source β especially in cases like a Sybase database, where multiple connections are used?Any guidance or best practices would be greatly appreciated.
Hi,I have a table called βemployeeβ with an attribute called βemployementβ which mayΒ contain the value βemployedβ. I have another table called βpersonβ with an attribute called βincomeβ whichΒ mayΒ contain data or is null.I want to create a DQ Check in ONE Web that can check if βemployementβ is not only filled, but also is the same as βemployedβ then income should be filled. If not, then invalid. So basically a DQ Check that checks when value A is present in table A then value B in table B should not be null. If it is null, then invalid. Also a requirement that it can be done in ONE Web. Please note that value A is not present in table B, nor value B is present in table A.Β Hope that was clearΒ π any ideas are welcome!
When creating a DQ rule, I need to specify an attribute and define itβs datatype. But what if I donβt care what data type something is?Β I want to create a rule that checks a combination of NULL/NOT NULL for two columns. So if column A is NULL and column B is not, this would result in an INVALID test.Β But I want to do this for various metrics. Sometimes I want to check if a string column is null against a float column, or a date against a string etc. Do I need to create every permutation of every datatype combination as a rule in order to accomplish this?Β Also, even if it is required to make all these duplicate tests. Is there a way to configure the rules so that they donβt show up as βApplied DQ Checksβ for both columns selected in the configuration? Example. I care whether or not Column A is populated given column B, but I donβt care whether or not Column B is populated. Currently when making a rule like this, the tests gets affixed to both columns even if I only add it to a specific
Hi Everyone,Β Iβm trying to set the correct AQL criteria to show related terms in a new Data Domain I have created. I can see the logic used for default domains like βFinanceβ, but Iβm unable to replicate the outcome because I either donβt know how to find the need IDβs or where I can see an ID (like above the Relationship Type name), itβs the same ID anywhere it is present/visible.Β Weβre using 15.4.Β Thank you for any help you can offer.Β RegardsStu
Hi All,At Bupa, within our Power BI environment we have a number of reports that have been tagged with a sensitivity label of βConfidential - Internal Use Onlyβ or βHighly Confidential: Internal Use Onlyβ using Microsoftβs sensitivity labels.https://learn.microsoft.com/en-us/purview/sensitivity-labelsWhenΒ reports have one of these labels applied, the data returned by the Export Report API in Power BI is encrypted. This is the main API call that the Ataccama scanner uses to extract metadata/lineage information for ingestion into the catalog. As the data returned is encrypted, the scanner is not currently processing it and skipping to the next report.Reports - Export Report In Group - REST API (Power BI Power BI REST APIs) | Microsoft LearnHas anyone come across scenario in their own environment and been able to identify any workarounds/ways forward to capture lineage for those reports with a higher sensitivity label? Either on the Ataccama side or the Microsoft side?Β Below is what is cu
Hi,In ONE Desktop > Servers > OnePlatform > Monitoring Projects > Create new > Post Processing Plan > client_dataset_invalidrecords (as a name to the component) > a new component will be created accordingly.Once created, is it possible to rename the component?
Hi Ataccama Community,Β IsΒ the data freshness feature is supported for data bricks database now?Β In the documentation it saysΒ Snowflake, PostgreSQL, BiqQuery, and Oracle are supported. I am using Ataccama version 15.4Β
Hello,Is this possible now in latest version? I am using 15.4.0. Requirement is to schedule profiling of specific schema in the database. Or subset of that schema if schema is too big (set of tables).Thanks in advance.
Hi Community,The first posts about the business glossary dealt about applying more term types (attribute and entity terms), and how they get context by adding relationship types. Following posts described an implementation for multilingualism and how to apply computed content. Especially the last one was rather tough to digest, so for my last post about the glossary I promise a soft landing.I think one thing needs some further attention and that regards synonyms.Defining a synonym for a term is existing functionality: you can define a synonym by pointing to another term.This means though that when you want to define a synonym for a term, you would have to define a new term first. For that term you would also have to define its metadata. In fact the new term including metadata would be redundant with the original term. Or would you leave out the additional metadata?We chose to use a different approach: for a synonym only its name is relevant, as the other metadata would be the same. So
Hello,I have two questions I would love to inquire about:1. Exporting Lookup Items in AtaccamaI would like to know if it's possible to configure exports for lookup items in Ataccama.When I try to export my lookup items, the export option is greyed out. When I hover over it, I see a message saying: "No export plan exists for the selected lookup items."Under Global Settings > Import and Export, I see an option to create a new export plan. I tried using this, but got to a stage where I need to input a code for the export plan. I found the following JSON online and was wondering if this would work as-is or if it needs any tweaks:{ "name": "Export_All_Lookup_Items", "description": "Exports all lookup items for backup or migration", "type": "LOOKUP_ITEM", "format": "JSON", "filters": { "lookupTypes": ["ALL"], "tags": [], "projects": [] }, "output": { "combineIntoSingleFile": true, "fileName": "lookup_export.json", "includeMetadata": true }}Would this JSON-based e
Hello,I am new to DQ and Ataccama. Our code is in development environment and soon to be deployed in Test/UAT for UAT testing and later to Prod once we get UAT signoff.My question is what is the way to export DQ monitoring project and its related components (like rules, etc) from Dev environment to UAT/Test environment? Is there anyΒ export capability? I have also heard that we may need to recreate it again in UAT environment.Β Really appreciate anyΒ direction in this.Thanks in advance.
Hi!I am profiling tables and am looking at the profiles. I noticed that for date and datetime the profile does not show the MIN orΒ MAX values. That is something I had expected though. Working on the data quality of this data, I really would like to know the MIN and MAX values for these attributes. Is there a way to change the configuration and include these profile statistics for these datatypes?Β kind regards, Jur DΓΆrdregter
Is there any mutation to create terms in Ataccama web using API.
Are you looking to connect toΒ SAP HANA using jdbc driver? Here are the simple stepsΒ Download and copy SAP HANA jdbc driver file into /opt/ataccama/one/dpe/lib/jdbc/ folder Add a set of properties for SAP HANA driver in /opt/ataccama/one/dpe/etc/application.properties.( Check the attached document for properties) Restart DPE & Β check logs of DPE service for any errors Go to ONE Web UI and new driver βSAP HANAβ is available under connections βSelect Connection type βdrop-down menu Β
on v15.4, can we customize the snowflake table overview page after cataloging, to show or hide certain properties? I donβt see edit page option in top right 3 dot.Β Β I do see the βedit page templateβ option for MDM data, but not for snowflake tables.Β is this intended product feature?Β Thanks.Β
Ataccama One Web:How to handle large dataset with 1 B rows in the data set while working on data profiling & Data quality evaluation? (Best Practices) What is expected Infrastructure configuration required with respect to infrastructure in case such huge datasets?
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.