Skip to main content

Data Quality & Catalog ⚙️

Discuss, learn, ask, suggest, share all things DQ&C 🔍

  • 605 Topics
  • 1,507 Replies
605 Topics
S
Data Pioneer
sumishaData Pioneer
asked in Data Quality & Catalog ⚙️
How to get terms tagged to attributes in Catalog in One desktop

How do I get Terms tagged to attributes to various catalog items in One Desktop?I need to get all catalog items which are tagged with a specific Glossary Term.

20
S
Data Pioneer
A
Data Voyager
AbbyData Voyager
asked in Data Quality & Catalog ⚙️
Flow of columns after using group Aggregator

Hello All,I am using group aggregator in our plan but I am not sure how to make all the columns flow from input till the end/output through group aggregator. 

1192
R
Data Voyager
S
Data Voyager
Susan24usData Voyager
asked in Data Quality & Catalog ⚙️
DATA STORIES

Hello, i am using a free version of the Data Stories , I cant seems to find where to upload or import dataset as seen from the demo --- Data Stories Demo does this free version not support creating a story , Dashboard or visualization ? if its does, is there something i’m not doing right 

51
Lisa Kovalskaia
Ataccamer
S
Data Enthusiast
shikoh.zData Enthusiast
asked in Data Quality & Catalog ⚙️
Creating rule for productline

Hi,Could someone guide me on creating rules for the Productline field? I am following the lab exercise but am unable to find the option for selecting "is not from reference data."Any guidance would be appreciated.Thanks,Shikoh Zaidi   

202
DannyRyan
Ataccamer
S
Data Voyager
SoniyaNData Voyager
asked in Data Quality & Catalog ⚙️
Combining Excel file

I have 10 excel sheets, which need to be combined in one single excel sheet. can this be done in Ataccama?

141
Lisa Kovalskaia
Ataccamer
Lazov
Data Voyager
LazovData Voyager
asked in Data Quality & Catalog ⚙️
Ranking numeric values in code query

Dear members,I am struggling with a step that rather reflects query/array logic than the logic of steps available in component editor.Task is to find the maximum from a range of values. I tried to retrieve it through a dynamic query written in a Representative Creator step, see details below:L1:= round((1-(levenshtein(W_CUA1,W_CUA1_MATCH)/(max(length(W_CUA1),length(W_CUA1_MATCH)))))*100,0);L2:= round((1-(levenshtein(W_CUA1,W_CUA2_MATCH)/(max(length(W_CUA1),length(W_CUA2_MATCH)))))*100,0);L3:= round((1-(levenshtein(W_CUA1,W_CUA3_MATCH)/(max(length(W_CUA1),length(W_CUA3_MATCH)))))*100,0);L4:= round((1-(levenshtein(W_CUA1,W_CUA4_MATCH)/(max(length(W_CUA1),length(W_CUA4_MATCH)))))*100,0);L5:= round((1-(levenshtein(W_CUA2,W_CUA1_MATCH)/(max(length(W_CUA2),length(W_CUA1_MATCH)))))*100,0);L6:= round((1-(levenshtein(W_CUA2,W_CUA2_MATCH)/(max(length(W_CUA2),length(W_CUA2_MATCH)))))*100,0);L7:= round((1-(levenshtein(W_CUA2,W_CUA3_MATCH)/(max(length(W_CUA2),length(W_CUA3_MATCH)))))*100,0);L8:= ro

455
Lazov
Data Voyager
S
Data Pioneer
sumishaData Pioneer
asked in Data Quality & Catalog ⚙️
Data Protection classification

I have a column in my catalog item which contains sensitive data. I have tagged this column with a Business Term. This business term is tagged as PII in Data Protection Classification section in Glossary terms. Is there a way to show at catalog item level that this table contains PII data?

516
S
Data Pioneer
T
Universe Traveller
TimBrown74Universe Traveller
asked in Data Quality & Catalog ⚙️
Confusing date data

The Business wants this date attribute validated.  I don’t know why, it’s a key field and I assume managed by the DB.  Nonetheless, I need to build a rule.But I think it’s strange that the Data Type is DATE while the date values are YYYY-MM-DD. I would expect to see DATE format data in the MM-DD-YYY HH:MM:SS AM format.I don’t know how to code it in the date functions since it doesn’t have the standard date format and it doesn’t work in any string functions.Any ideas?  

515
T
Universe Traveller
N
Space Explorer
NataliiaSpace Explorer
asked in Data Quality & Catalog ⚙️
SCD Type 2 using DQ rules

Hi everyone, Data Observability tab and AI functionality  are  not available. How can I check SCD Type 2 using DQ rules?Data Freshness. How can I check  using DQ rules? Datetime datatype is for eff_strt_dttm, it’s one column where data is, but I don’t know how make:   today() >>>as datetime  minus 1 day   

514
Lisa Kovalskaia
Ataccamer
D
Data Voyager
Data_VaultData Voyager
asked in Data Quality & Catalog ⚙️
Nested JSON with DAT file extension processing in Ataccama ONE

Hello,We recently started getting nested JSON event files with DAT file extension. We are getting an ‘Unknow Error’, when we try to import it.Can you help me in understanding, how nested JSON with .DAT extension can be processed in Ataccama.Thank you.   

61
Lisa Kovalskaia
Ataccamer
M
Data Voyager
manidharData Voyager
asked in Data Quality & Catalog ⚙️
How to export a Summary of DQ Monitoring Project results?

Hello Ataccama Community,I am trying to export the summary statistics of the DQ monitoring project?   I wanted to have a csv file with the columns like Date of the test results execution, Data_Catalog_Name, Attribute Name, DQ rule name, Data Source, DQ dimension, Total Number of Records, Number of records passed, and Number of records failed.To begin with I have tried using DQ monitoring projects step in One Desktop and the DQ Monitoring project is failing if I enable this post processing plan. Not sure why it was failing after enabling the below post processing plan. Any help is much appreciated. Thanks in Advance

321
C
Data Pioneer
N
Space Explorer
NataliiaSpace Explorer
asked in Data Quality & Catalog ⚙️
ONE Web Redshift freshness possibility

Hi guys! Is there any opportunity to check data freshness in case we have Redshift connection?I see there is no such driver in freshness configuration drivers list - https://docs.ataccama.com/one/latest/data-observability/data-freshness-custom-configuration.html.  

231
Cansu
Community Manager
S
Data Pioneer
sumishaData Pioneer
asked in Data Quality & Catalog ⚙️
How do we filter the terms (AOL) by relationship type

Need support with AQL expression to filter terms based on a particular relationship type. Referring to Relations section under Glossary Terms.  

344
S
Data Pioneer
S
Data Voyager
Susan24usData Voyager
asked in Data Quality & Catalog ⚙️
Connections Update

We recently updated the Data Sources connection, and all Catalog items that were using the old connection are no longer working in the monitoring projects. When I expand the catalog items, an error message appears: "You are looking at a deleted item."However, if I create a new catalog item and add it as an attribute in the monitoring project, it works perfectly fine.My question is: How can I update the existing catalog items to use the new connection? Do I need to manually recreate all these catalog items with the new connection, or is there a way to automatically switch all catalog items from the deleted connection to the new one

161
anna.spakova
Ataccamer
B
Universe Traveller
Bhuvaneshwari BalasubramaniamUniverse Traveller
asked in Data Quality & Catalog ⚙️
How to access “Monitoring projects” through API calls

Hi ,I am trying to access “Monitoring projects” through API calls. For this purpose , I have created service account in KeyCloak with ‘default” and “DQIT_admin” IAM role access. Able to generate tokens with the service account. But unable to access “Monitoring projects” API , receiving 401 “Unauthorized” response.2 questions:How to check whether this service account is able to access the Ataccama application or not ? Any other or what level of access rights need to be provided to access API calls for a service account?Please note I am using Ataccama web application version 14.4.  

304
Cansu
Community Manager
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
Collibra Integration in Ataccama ONE Desktop 🏹

Hi everyone, Today’s post is specifically on Collibra! So if you work with Collibra and are curious about how to integrate it with Ataccama ONE Desktop read on. This post will cover how you can harness the power of the Collibra Reader and Collibra Writer steps to effortlessly manage Data Quality (DQ) Rules. PrerequisitesBefore we dive in, ensure you have the following essentials:Ataccama ONE Desktop: Make sure it's installed on your machine with a valid license. Collibra: You need an active Collibra instance, complete with valid credentials for accessing and managing assets.Setting Up a Collibra Server ConnectionLet's establish a connection to Collibra from ONE Desktop:In ONE Desktop, right-click on Servers, and choose New > Server.   Fill in the details: Implementation: Choose Generic. Name: Give your connection a meaningful name. URL: Provide the URL of your Collibra instance. Authentication: Select Basic. Username: Enter your Collibra username. Password: Input your Collibra

5212
Cansu
Community Manager
N
Space Explorer
NataliiaSpace Explorer
asked in Data Quality & Catalog ⚙️
Boolean DQ

Hi guys, how did you check boolean date type in DQ rules? When I apply this rules  it  also make numbers, string, others value as correct.  

171
R
Ataccamer
R
Data Voyager
RadziahData Voyager
asked in Data Quality & Catalog ⚙️
Fuzzy Checks with No Unique Identifier

HiI would like to ask whether we could do fuzzy check in Ataccama that involves two different datasets let’s say Set 1 and Set 2 from different data sources. Please note that both datasets have different number of columns but fuzzy checks involved only customer name and address. However, these datasets don’t have any unique identifier. Is it achievable in Ataccama and what would be the possible steps to achieve the results after the fuzzy checks? Thanks.

374
Cansu
Community Manager
A
Universe Traveller
apejkoUniverse Traveller
asked in Data Quality & Catalog ⚙️
Assigning Data Usage Licensing Agreements (Policy) Through One Desktop

Hello everyone! I currently have a large group of catalog items that I am trying to assign a Data Usage Licensing Agreement too. I know that I can manually add these through Atacama online, however because of the large number I was wondering if it would be possible to create a plan to do this for me? I have all the catalogItem ids already compiled I simply do not know how to assign the policy.While I do see the option to write to policy, I cant seem to set the parent as a catalog item. Any help would be appreciated. Thank you!!! 

194
anna.spakova
Ataccamer
B
Universe Traveller
Bhuvaneshwari BalasubramaniamUniverse Traveller
asked in Data Quality & Catalog ⚙️
Creating rules for Name field

Hi ,Could someone guide me on creating rules for Name field.Rule : Name should not have any special characters but can have numbers and spaces. Ex: Jhon Leo - ValidJho1 Leo - ValidJho( Leo* - Not Valid  Regards,Bhuvi

313
Cansu
Community Manager
J
Data Voyager
jaygskData Voyager
asked in Data Quality & Catalog ⚙️
Creating Source in Ataccama One for Snowflake

I am creating new source connection from Ataccama ONE and I need help on how to connect Snowflake.From below screenshot I am trying to understand JDBC connection looks like.For e.g. I am using jdbc:snowflake://myorganization-myaccount.snowflakecomputing.com/, but it is not working.Any help is greatly appreciated.  

122
Cansu
Community Manager
S
Data Voyager
Susan24usData Voyager
asked in Data Quality & Catalog ⚙️
Semi Structured Data

Hello, i have a report that we usually saved to hard drive that i would like to bring into Ataccama, the report is in semi structured format . does ataccama accept or work with semi structure data ?or do i need to convert the report first before connecting to source ?

283
Cansu
Community Manager
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
Improving Data Quality: Turning insights into action

We are half-way into the end-to-end DQ guide! Just jumping on here? Read the first post of the series 👇Identifying data issues is just the beginning—what really matters is fixing them 🛠️Data quality improvement involves standardizing formats, removing duplicates, and setting up automated remediation workflows​. Whether it’s fixing customer records, cleansing addresses, or resolving inconsistencies, clean data means more reliable insights.Data transformation tools play a crucial role in making data fit for purpose, while matching and merging ensure that duplicate records don’t pollute your systems. Additionally, data remediation workflows enable businesses to track and resolve data quality issues efficiently​.Ultimately, improving data quality isn’t just about technology—it’s about creating a culture where teams take ownership of data health. Organizations that prioritize continuous data improvement see better business outcomes and reduced operational risks.How did you manage to build

70
Cansu
Community Manager
N
Space Explorer
NataliiaSpace Explorer
asked in Data Quality & Catalog ⚙️
Primary key/nullable/column size field disappears after refreshing catalog item

Hello, does anyone faced with issue when primary key/ nullable/ column size fields are gone after refreshing catalog item and rerun data select?I use ONE Web app v14, after setting attribute as primary key, nullable or defining column size then it disappears after  rerunning query.How did you solve this issue? 

132
N
Space Explorer
N
Space Explorer
NataliiaSpace Explorer
asked in Data Quality & Catalog ⚙️
List of functions for advanced builder DQ rules

Hello guys, does someone know where I can find the information about all functions list that are available from Advanced builder while creating DQ rules? Will appreciate any help or advice, thanks.

151
A
Ataccamer

Badge winners

  • First idea 💡
    BarbaraBhas earned the badge First idea 💡
  • First idea 💡
    jbinghas earned the badge First idea 💡
  • First idea 💡
    samsTmobilehas earned the badge First idea 💡
  • First idea 💡
    ViLashas earned the badge First idea 💡
  • First idea 💡
    ScottAndersonhas earned the badge First idea 💡
Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings