Skip to main content

Learn & Share

Discuss data, share best practices, learn, and grow with Ataccama's Community.

1077 Topics
O
Star Blazer L1
OjaswiniStar Blazer L1
asked in Master Data Management & Reference Data Management 🛰️
Is self joining possible in RDM tables ?

Hello,Is it possible to self-join tables in RDM to populate some information? I would like to try something like shown in the screenshot. Attribute 4 and 5 values are selected from RDM UI. So, dropdown should only show values from the same table where att2 = CAT2 for Att4 and att2 = CAT3 for Att4Table1                 Selection from RDM UI   Att1 Att2  Att3 Att4 (where att2 = CAT2) Att5 (where att2 = CAT3)   ID1 CAT1 val1 ID3 ID5   ID2 CAT1 val2 ID4 ID6   ID3 CAT2 val3       ID4 CAT2 val4       ID5 CAT3 val5       ID6 CAT3 val6                    I somehow tried to create self join in relationship like below. I was able toi upload configuration successfully on RDM with these relationships.  However, when edit the record on RDM the lookup is blank. it does not show any value although table is populated.   (this can also be understood as employee info vs manager info relationship.

202
O
Star Blazer L1
A
Data Pioneer
akshayl09Data Pioneer
asked in Data Quality & Catalog ⚙️
Group by while creating the rule

Is there any option to group can be implemented at two different level? For example: I want to create rule which count number of districts for which has total revenue zero by each state. Such district Count should not more than 10. Hierarchy country > state > district > Territory.Kindly suggest how to create a rule for this using Ataccama Web one.

252
A
Data Pioneer
A
Data Pioneer
Ayush kumarData Pioneer
asked in Data Quality & Catalog ⚙️
Erro while opening Ataccama desktop

I am using Ataccama 14.5.3, everytime I open it, I get an error - The One-desktop executable launcher was unable to locate it's companion shared library. What could be the reason for this?

221
Lisa Kovalskaia
Ataccamer
H
Universe Traveller
Hanish NUniverse Traveller
asked in Data Quality & Catalog ⚙️
Load 'Failed records' to ONE Data via API

In catalog item DQ evaluation, we are trying to run the DQ evaluation via API and it is working fine. Do we have an API to load the failed records to ONE data via API? 

301
Lisa Kovalskaia
Ataccamer
G
Data Enthusiast
GersonData Enthusiast
asked in Data Quality & Catalog ⚙️
Why can’t I select multiple schemas under a single source with multiple connections in Data Observability?

I'm facing an issue with selecting schemas to observe for schema change detection in Observability for one of our sources(Sybase).Context:In our SQL database source setup, we have a single connection that includes multiple schemas, and Observability allows us to select multiple schemas without issue, as shown below.However, for the Sybase source, we're unable to select multiple schemas under a single connection. I only get the option to choose one connection and one schema from the dropdown. (See screenshot below.)Ideally, I’d like to select all dbo across all connections to monitor for structural changes.Question:Has anyone experienced a similar limitation?Is there a recommended approach for configuring Observability for schema checks on sources that have multiple connections and schemas under a single source — especially in cases like a Sybase database, where multiple connections are used?Any guidance or best practices would be greatly appreciated.

563
Lisa Kovalskaia
Ataccamer
JTH
Data Pioneer
JTHData Pioneer
asked in Data Quality & Catalog ⚙️
Validating Dependent Values Across Tables

Hi,I have a table called ‘employee’ with an attribute called ‘employement’ which may contain the value ‘employed’. I have another table called ‘person’ with an attribute called ‘income’ which may contain data or is null.I want to create a DQ Check in ONE Web that can check if ‘employement’ is not only filled, but also is the same as ‘employed’ then income should be filled. If not, then invalid. So basically a DQ Check that checks when value A is present in table A then value B in table B should not be null. If it is null, then invalid. Also a requirement that it can be done in ONE Web. Please note that value A is not present in table B, nor value B is present in table A. Hope that was clear 😅 any ideas are welcome!

111
E
Ataccamer
tziad
Data Voyager
tziadData Voyager
asked in Data Quality & Catalog ⚙️
Can I create a rule that doesn't consider Datatype?

When creating a DQ rule, I need to specify an attribute and define it’s datatype. But what if I don’t care what data type something is? I want to create a rule that checks a combination of NULL/NOT NULL for two columns. So if column A is NULL and column B is not, this would result in an INVALID test. But I want to do this for various metrics. Sometimes I want to check if a string column is null against a float column, or a date against a string etc. Do I need to create every permutation of every datatype combination as a rule in order to accomplish this? Also, even if it is required to make all these duplicate tests. Is there a way to configure the rules so that they don’t show up as “Applied DQ Checks” for both columns selected in the configuration? Example. I care whether or not Column A is populated given column B, but I don’t care whether or not Column B is populated. Currently when making a rule like this, the tests gets affixed to both columns even if I only add it to a specific

271
Lisa Kovalskaia
Ataccamer
S
Data Voyager
stuart.campbellData Voyager
asked in Data Quality & Catalog ⚙️
Find Term ID's (and all other type of IDs)

Hi Everyone, I’m trying to set the correct AQL criteria to show related terms in a new Data Domain I have created. I can see the logic used for default domains like ‘Finance’, but I’m unable to replicate the outcome because I either don’t know how to find the need ID’s or where I can see an ID (like above the Relationship Type name), it’s the same ID anywhere it is present/visible. We’re using 15.4. Thank you for any help you can offer. RegardsStu

202
S
Data Voyager
Raja Koushik
Data Enthusiast
Raja KoushikData Enthusiast
asked in Master Data Management & Reference Data Management 🛰️
Merge Realm Roles

We have multiple Realm roles created for our data domains in the below fashionData Domain 1 Realm Role - Data Owner Realm Role - Data Steward Data Domain 2 Realm Role - Data Owner Realm Role - Data Steward How can I merge Data Domain 1 and Data Domain 2 into one single New Domain and merge the corresponding Realm Roles?I.e.Data Domain 1 Realm Role - Data Owner Realm Role - Data Steward                                            = New Data Domain Data Domain 2                                                                                           New Realm Role - Data Owner Realm Role - Data Owner                                                              New Realm Role - Data Steward Realm Role - Data Steward

293
Lisa Kovalskaia
Ataccamer
C
Data Voyager
cmagnanoData Voyager
asked in Data Quality & Catalog ⚙️
Power BI Lineage Scanner - Lineage for 'Internal Use' Reports

Hi All,At Bupa, within our Power BI environment we have a number of reports that have been tagged with a sensitivity label of ‘Confidential - Internal Use Only’ or ‘Highly Confidential: Internal Use Only’ using Microsoft’s sensitivity labels.https://learn.microsoft.com/en-us/purview/sensitivity-labelsWhen reports have one of these labels applied, the data returned by the Export Report API in Power BI is encrypted. This is the main API call that the Ataccama scanner uses to extract metadata/lineage information for ingestion into the catalog. As the data returned is encrypted, the scanner is not currently processing it and skipping to the next report.Reports - Export Report In Group - REST API (Power BI Power BI REST APIs) | Microsoft LearnHas anyone come across scenario in their own environment and been able to identify any workarounds/ways forward to capture lineage for those reports with a higher sensitivity label? Either on the Ataccama side or the Microsoft side? Below is what is cu

463
F
Ataccamer
JTH
Data Pioneer
JTHData Pioneer
asked in Data Quality & Catalog ⚙️
Changing component name

Hi,In ONE Desktop > Servers > OnePlatform > Monitoring Projects > Create new > Post Processing Plan > client_dataset_invalidrecords (as a name to the component) > a new component will be created accordingly.Once created, is it possible to rename the component?

374
E
Ataccamer
S
Universe Traveller
sriniUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
read MDM workflow status using API in v15.4

How can we retrieve or read the workflow status (running, success, or failed. Etc) using a GET API after triggering the workflow via an Http service?

232
S
Universe Traveller
M
Data Voyager
manidharData Voyager
asked in Data Quality & Catalog ⚙️
data freshness support for databricks

Hi Ataccama Community, Is the data freshness feature is supported for data bricks database now? In the documentation it says Snowflake, PostgreSQL, BiqQuery, and Oracle are supported. I am using Ataccama version 15.4 

111
A
O
Star Blazer L1
OjaswiniStar Blazer L1
asked in Data Quality & Catalog ⚙️
How to schedule profiling of specific schema in the database Or subset of that schema if schema is too big.

Hello,Is this possible now in latest version? I am using 15.4.0. Requirement is to schedule profiling of specific schema in the database. Or subset of that schema if schema is too big (set of tables).Thanks in advance.

231
Lisa Kovalskaia
Ataccamer
Y
Data Voyager
Yasharth MisraData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Master data Layer matching- MDM

Hello, I wanted to know that how do we implement matching options in the master layer of the MDM project.I have used in the columns in the instance layer and then used the same in the master layer in the matching step just as used in the cdi example. and then I have used the same name in the matching step but still  nothing is  showing the UI part. Can someone help me with that.

453
O
Ataccamer
Albert de Ruiter
Rocket Pioneer L1
Albert de RuiterRocket Pioneer L1
published in Data Quality & Catalog ⚙️
Business glossary - synonyms (part 5)
Business glossary - synonyms (part 5)

Hi Community,The first posts about the business glossary dealt about applying more term types (attribute and entity terms), and how they get context by adding relationship types. Following posts described an implementation for multilingualism and how to apply computed content. Especially the last one was rather tough to digest, so for my last post about the glossary I promise a soft landing.I think one thing needs some further attention and that regards synonyms.Defining a synonym for a term is existing functionality: you can define a synonym by pointing to another term.This means though that when you want to define a synonym for a term, you would have to define a new term first. For that term you would also have to define its metadata. In fact the new term including metadata would be redundant with the original term. Or would you leave out the additional metadata?We chose to use a different approach: for a synonym only its name is relevant, as the other metadata would be the same. So

592
Albert de Ruiter
Rocket Pioneer L1
S
Universe Traveller
Susan24usUniverse Traveller
asked in Data Quality & Catalog ⚙️
Configure Export plan for DQ Lookup Items

Hello,I have two questions I would love to inquire about:1. Exporting Lookup Items in AtaccamaI would like to know if it's possible to configure exports for lookup items in Ataccama.When I try to export my lookup items, the export option is greyed out. When I hover over it, I see a message saying: "No export plan exists for the selected lookup items."Under Global Settings > Import and Export, I see an option to create a new export plan. I tried using this, but got to a stage where I need to input a code for the export plan. I found the following JSON online and was wondering if this would work as-is or if it needs any tweaks:{ "name": "Export_All_Lookup_Items", "description": "Exports all lookup items for backup or migration", "type": "LOOKUP_ITEM", "format": "JSON", "filters": { "lookupTypes": ["ALL"], "tags": [], "projects": [] }, "output": { "combineIntoSingleFile": true, "fileName": "lookup_export.json", "includeMetadata": true }}Would this JSON-based e

311
R
Universe Traveller
O
Star Blazer L1
OjaswiniStar Blazer L1
asked in Data Quality & Catalog ⚙️
DQ Monitoring project UAT/Test deployment

Hello,I am new to DQ and Ataccama. Our code is in development environment and soon to be deployed in Test/UAT for UAT testing and later to Prod once we get UAT signoff.My question is what is the way to export DQ monitoring project and its related components (like rules, etc) from Dev environment to UAT/Test environment? Is there any export capability? I have also heard that we may need to recreate it again in UAT environment. Really appreciate any direction in this.Thanks in advance.

1339
O
Star Blazer L1
jdordregter
Data Voyager
jdordregterData Voyager
asked in Data Quality & Catalog ⚙️
Profiling Date or Datetime

Hi!I am profiling tables and am looking at the profiles. I noticed that for date and datetime the profile does not show the MIN or MAX values. That is something I had expected though. Working on the data quality of this data, I really would like to know the MIN and MAX values for these attributes. Is there a way to change the configuration and include these profile statistics for these datatypes? kind regards, Jur Dördregter

366
A
S
Universe Traveller
Susan24usUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
Preparing for Ataccama Version Upgrade – What Should I Document and Test?

Hello everyone,My organization will soon be upgrading to a higher version of Ataccama, and I want to make sure the transition goes as smoothly as possible. I'm reaching out to ask:What should I be documenting or looking out for before, during, and after the upgrade?Some specific things I'm wondering: Are there key areas (like DQ rules, workflows, configurations, etc.) that I should definitely back up or document? What kind of testing should I plan for in UAT? Should I be validating things both before and after the upgrade? Are there any common issues or changes I should be aware of that might affect how things work in the new version? If anyone has experience with a recent version upgrade, I’d love to hear what worked well for you—or what you wish you had done differently!Also, if there are any official resources or checklists from Ataccama that you found useful, feel free to share.Thanks in advance!

311
R
Universe Traveller
H
Universe Traveller
Hanish NUniverse Traveller
asked in Data Quality & Catalog ⚙️
Write business terms using graphQL

Is there any mutation to create terms in Ataccama web using API.

311
Albert de Ruiter
Rocket Pioneer L1
V
Ataccamer
VaniAtaccamer
published in Data Quality & Catalog ⚙️
How to connect to SAP HANA using jdbc driver

Are you looking to connect to SAP HANA using jdbc driver? Here are the simple steps Download and copy SAP HANA jdbc driver file into /opt/ataccama/one/dpe/lib/jdbc/ folder Add a set of properties for SAP HANA driver in /opt/ataccama/one/dpe/etc/application.properties.( Check the attached document for properties) Restart DPE &  check logs of DPE service for any errors Go to ONE Web UI and new driver “SAP HANA” is available under connections “Select Connection type “drop-down menu  

940
V
Ataccamer
N
Data Enthusiast
NormanThink
asked in Data Quality & Catalog ⚙️
is catalog item overview page customizable?

on v15.4, can we customize the snowflake table overview page after cataloging, to show or hide certain properties? I don’t see edit page option in top right 3 dot.  I do see the “edit page template” option for MDM data, but not for snowflake tables.  is this intended product feature? Thanks. 

524
Albert de Ruiter
Rocket Pioneer L1
A
Data Pioneer
akshayl09Data Pioneer
asked in Data Quality & Catalog ⚙️
Handling Large Dataset while data profiling & Data Quality

Ataccama One Web:How to handle large dataset with 1 B rows in the data set while working on data profiling & Data quality evaluation? (Best Practices) What is expected Infrastructure configuration required with respect to infrastructure in case such huge datasets?

382
A
A
Data Voyager
Akashsingh1991Data Voyager
asked in Master Data Management & Reference Data Management 🛰️
While running adddress match componenet I am getting Persistence is not set error. Please help

07.05.2025 16:24:30 [INFO]     Using Ataccama DQC configuration file D:\ataccama\workspace1\General MDM project - CDI example\Files\engine\trans\address\address_match.comp07.05.2025 16:24:30 [INFO]     Using runtime configuration file C:\Users\AS001086183\AppData\Local\Temp\runtimeCfg31836356917877677.tmp07.05.2025 16:24:30 [INFO]     Ataccama DQC engine initialized.07.05.2025 16:24:30 [INFO]     Creating runtime...07.05.2025 16:24:31 [INFO]    [Address deduplication] parallel processing of partitions: false07.05.2025 16:24:31 [INFO]    [Address deduplication] parallel processing of key rules: false07.05.2025 16:24:31 [INFO]    [Address deduplication] parallel processing of matching rules: false07.05.2025 16:24:31 [INFO]     Starting runtime...07.05.2025 16:24:31 [INFO]     Running runtime...07.05.2025 16:24:31 [FATAL]    Internal error occurred during run of the plan: Persistence is not set (the standalone mode may not be configured)[STEP Address deduplication[Md Unify]]07.05.2025 16:

131
A

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings