Skip to main content

Data Quality & Catalog ⚙️

Discuss, learn, ask, suggest, share all things DQ&C 🔍

  • 622 Topics
  • 1,542 Replies
622 Topics
S
Data Pioneer
sumishaData Pioneer
asked in Data Quality & Catalog ⚙️
How to get terms tagged to attributes in Catalog in One desktop

How do I get Terms tagged to attributes to various catalog items in One Desktop?I need to get all catalog items which are tagged with a specific Glossary Term.

372
S
Data Pioneer
T
Data Voyager
ThanujaData Voyager
asked in Data Quality & Catalog ⚙️
One desktop trans comoponent issue

When I try to open a Trans component on Ataccama One Desktop, I receive the error 'Index -1078132736 out of bounds for length 10.' Do you have any ideas or suggestions to resolve this issue?

122
T
Data Voyager
T
Data Voyager
ThanujaData Voyager
asked in Data Quality & Catalog ⚙️
Audit log configuration in ataccama one desktop for both backend/front end

Hi everyone, I was wondering if anyone could share how the i_event_log table is configured, as well as its details for the front-end (UI)? Also, could anyone provide guidance on how to configure the back-end audit log and retrieve it using pgAdmin? I’d really appreciate any insights. Thank you!

330
T
Data Voyager
A
Data Voyager
AbbyData Voyager
asked in Data Quality & Catalog ⚙️
Flow of columns after using group Aggregator

Hello All,I am using group aggregator in our plan but I am not sure how to make all the columns flow from input till the end/output through group aggregator. 

1222
R
Data Voyager
S
Data Enthusiast
shikoh.zData Enthusiast
asked in Data Quality & Catalog ⚙️
Creating rule for productline

Hi,Could someone guide me on creating rules for the Productline field? I am following the lab exercise but am unable to find the option for selecting "is not from reference data."Any guidance would be appreciated.Thanks,Shikoh Zaidi   

242
DannyRyan
Ataccamer
S
Data Voyager
SoniyaNData Voyager
asked in Data Quality & Catalog ⚙️
Combining Excel file

I have 10 excel sheets, which need to be combined in one single excel sheet. can this be done in Ataccama?

181
Lisa Kovalskaia
Ataccamer
Lazov
Data Voyager
LazovData Voyager
asked in Data Quality & Catalog ⚙️
Ranking numeric values in code query

Dear members,I am struggling with a step that rather reflects query/array logic than the logic of steps available in component editor.Task is to find the maximum from a range of values. I tried to retrieve it through a dynamic query written in a Representative Creator step, see details below:L1:= round((1-(levenshtein(W_CUA1,W_CUA1_MATCH)/(max(length(W_CUA1),length(W_CUA1_MATCH)))))*100,0);L2:= round((1-(levenshtein(W_CUA1,W_CUA2_MATCH)/(max(length(W_CUA1),length(W_CUA2_MATCH)))))*100,0);L3:= round((1-(levenshtein(W_CUA1,W_CUA3_MATCH)/(max(length(W_CUA1),length(W_CUA3_MATCH)))))*100,0);L4:= round((1-(levenshtein(W_CUA1,W_CUA4_MATCH)/(max(length(W_CUA1),length(W_CUA4_MATCH)))))*100,0);L5:= round((1-(levenshtein(W_CUA2,W_CUA1_MATCH)/(max(length(W_CUA2),length(W_CUA1_MATCH)))))*100,0);L6:= round((1-(levenshtein(W_CUA2,W_CUA2_MATCH)/(max(length(W_CUA2),length(W_CUA2_MATCH)))))*100,0);L7:= round((1-(levenshtein(W_CUA2,W_CUA3_MATCH)/(max(length(W_CUA2),length(W_CUA3_MATCH)))))*100,0);L8:= ro

485
Lazov
Data Voyager
S
Data Pioneer
sumishaData Pioneer
asked in Data Quality & Catalog ⚙️
Data Protection classification

I have a column in my catalog item which contains sensitive data. I have tagged this column with a Business Term. This business term is tagged as PII in Data Protection Classification section in Glossary terms. Is there a way to show at catalog item level that this table contains PII data?

606
S
Data Pioneer
T
Universe Traveller
TimBrown74Universe Traveller
asked in Data Quality & Catalog ⚙️
Confusing date data

The Business wants this date attribute validated.  I don’t know why, it’s a key field and I assume managed by the DB.  Nonetheless, I need to build a rule.But I think it’s strange that the Data Type is DATE while the date values are YYYY-MM-DD. I would expect to see DATE format data in the MM-DD-YYY HH:MM:SS AM format.I don’t know how to code it in the date functions since it doesn’t have the standard date format and it doesn’t work in any string functions.Any ideas?  

585
T
Universe Traveller
N
Universe Traveller
NataliiaUniverse Traveller
asked in Data Quality & Catalog ⚙️
SCD Type 2 using DQ rules

Hi everyone, Data Observability tab and AI functionality  are  not available. How can I check SCD Type 2 using DQ rules?Data Freshness. How can I check  using DQ rules? Datetime datatype is for eff_strt_dttm, it’s one column where data is, but I don’t know how make:   today() >>>as datetime  minus 1 day   

534
Lisa Kovalskaia
Ataccamer
N
Universe Traveller
NataliiaUniverse Traveller
asked in Data Quality & Catalog ⚙️
ONE Web Redshift freshness possibility

Hi guys! Is there any opportunity to check data freshness in case we have Redshift connection?I see there is no such driver in freshness configuration drivers list - https://docs.ataccama.com/one/latest/data-observability/data-freshness-custom-configuration.html.  

291
Cansu
Community Manager
S
Data Pioneer
sumishaData Pioneer
asked in Data Quality & Catalog ⚙️
How do we filter the terms (AOL) by relationship type

Need support with AQL expression to filter terms based on a particular relationship type. Referring to Relations section under Glossary Terms.  

394
S
Data Pioneer
B
Universe Traveller
Bhuvaneshwari BalasubramaniamUniverse Traveller
asked in Data Quality & Catalog ⚙️
How to access “Monitoring projects” through API calls

Hi ,I am trying to access “Monitoring projects” through API calls. For this purpose , I have created service account in KeyCloak with ‘default” and “DQIT_admin” IAM role access. Able to generate tokens with the service account. But unable to access “Monitoring projects” API , receiving 401 “Unauthorized” response.2 questions:How to check whether this service account is able to access the Ataccama application or not ? Any other or what level of access rights need to be provided to access API calls for a service account?Please note I am using Ataccama web application version 14.4.  

334
Cansu
Community Manager
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
Collibra Integration in Ataccama ONE Desktop 🏹

Hi everyone, Today’s post is specifically on Collibra! So if you work with Collibra and are curious about how to integrate it with Ataccama ONE Desktop read on. This post will cover how you can harness the power of the Collibra Reader and Collibra Writer steps to effortlessly manage Data Quality (DQ) Rules. PrerequisitesBefore we dive in, ensure you have the following essentials:Ataccama ONE Desktop: Make sure it's installed on your machine with a valid license. Collibra: You need an active Collibra instance, complete with valid credentials for accessing and managing assets.Setting Up a Collibra Server ConnectionLet's establish a connection to Collibra from ONE Desktop:In ONE Desktop, right-click on Servers, and choose New > Server.   Fill in the details: Implementation: Choose Generic. Name: Give your connection a meaningful name. URL: Provide the URL of your Collibra instance. Authentication: Select Basic. Username: Enter your Collibra username. Password: Input your Collibra

5432
Cansu
Community Manager
R
Data Voyager
RadziahData Voyager
asked in Data Quality & Catalog ⚙️
Fuzzy Checks with No Unique Identifier

HiI would like to ask whether we could do fuzzy check in Ataccama that involves two different datasets let’s say Set 1 and Set 2 from different data sources. Please note that both datasets have different number of columns but fuzzy checks involved only customer name and address. However, these datasets don’t have any unique identifier. Is it achievable in Ataccama and what would be the possible steps to achieve the results after the fuzzy checks? Thanks.

404
Cansu
Community Manager
A
Universe Traveller
apejkoUniverse Traveller
asked in Data Quality & Catalog ⚙️
Assigning Data Usage Licensing Agreements (Policy) Through One Desktop

Hello everyone! I currently have a large group of catalog items that I am trying to assign a Data Usage Licensing Agreement too. I know that I can manually add these through Atacama online, however because of the large number I was wondering if it would be possible to create a plan to do this for me? I have all the catalogItem ids already compiled I simply do not know how to assign the policy.While I do see the option to write to policy, I cant seem to set the parent as a catalog item. Any help would be appreciated. Thank you!!! 

204
anna.spakova
Ataccamer
B
Universe Traveller
Bhuvaneshwari BalasubramaniamUniverse Traveller
asked in Data Quality & Catalog ⚙️
Creating rules for Name field

Hi ,Could someone guide me on creating rules for Name field.Rule : Name should not have any special characters but can have numbers and spaces. Ex: Jhon Leo - ValidJho1 Leo - ValidJho( Leo* - Not Valid  Regards,Bhuvi

323
Cansu
Community Manager
S
Data Voyager
Susan24usData Voyager
asked in Data Quality & Catalog ⚙️
Semi Structured Data

Hello, i have a report that we usually saved to hard drive that i would like to bring into Ataccama, the report is in semi structured format . does ataccama accept or work with semi structure data ?or do i need to convert the report first before connecting to source ?

293
Cansu
Community Manager
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
Improving Data Quality: Turning insights into action

We are half-way into the end-to-end DQ guide! Just jumping on here? Read the first post of the series 👇Identifying data issues is just the beginning—what really matters is fixing them 🛠️Data quality improvement involves standardizing formats, removing duplicates, and setting up automated remediation workflows​. Whether it’s fixing customer records, cleansing addresses, or resolving inconsistencies, clean data means more reliable insights.Data transformation tools play a crucial role in making data fit for purpose, while matching and merging ensure that duplicate records don’t pollute your systems. Additionally, data remediation workflows enable businesses to track and resolve data quality issues efficiently​.Ultimately, improving data quality isn’t just about technology—it’s about creating a culture where teams take ownership of data health. Organizations that prioritize continuous data improvement see better business outcomes and reduced operational risks.How did you manage to build

90
Cansu
Community Manager
N
Universe Traveller
NataliiaUniverse Traveller
asked in Data Quality & Catalog ⚙️
Primary key/nullable/column size field disappears after refreshing catalog item

Hello, does anyone faced with issue when primary key/ nullable/ column size fields are gone after refreshing catalog item and rerun data select?I use ONE Web app v14, after setting attribute as primary key, nullable or defining column size then it disappears after  rerunning query.How did you solve this issue? 

132
N
Universe Traveller
N
Universe Traveller
NataliiaUniverse Traveller
asked in Data Quality & Catalog ⚙️
List of functions for advanced builder DQ rules

Hello guys, does someone know where I can find the information about all functions list that are available from Advanced builder while creating DQ rules? Will appreciate any help or advice, thanks.

171
A
Ataccamer
B
Universe Traveller
Bhuvaneshwari BalasubramaniamUniverse Traveller
asked in Data Quality & Catalog ⚙️
DQ - Monitoring project "Export"

Hi ,Kindly share your inputs on below scenario.I am trying to place the “Monitoring Projects” export  “.csv” file in a shared path/folder with in the organization. Purpose of this “Report need to accessed by different set of stakeholders who do not have Ataccama access” Is there a way to access this export file by any API calls or we can directly configure the shared folder path for example “S:/SharedPath/Ataccama/Exports” in output location field ?  Note : This is on Ataccama ONE 14.4 version. Any input is appreciated. Thanks,Bhuvi

191
anna.spakova
Ataccamer
B
Universe Traveller
Bhuvaneshwari BalasubramaniamUniverse Traveller
asked in Data Quality & Catalog ⚙️
Apply rules only to newly created records through any filter

Hi,Could anyone help me on below scenario. I am using Ataccama ONE web 14.4. Millions of records are populated in testing environment from Production real time data. However , for testing purpose manipulated few 1K records. Is there any way in Ataccama where we can apply rules and perform “Monitoring Projects” only to the new records 1K created by giving any date created filter? Regards,Bhuvi

332
B
Universe Traveller
A
Data Voyager
Anurag choubeData Voyager
asked in Data Quality & Catalog ⚙️
Clearing all special characters expect defined special characters

In the above image I want to clear all special characters expect .(dot) As their can be any thing in place of  ! number may have *, &, %, $, etc. I tried it using trashnondigit() function but it will remove all the characters from the number, Is their a way to do it?

282
A
Data Voyager
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
Monitoring Data Quality – The key to trustworthy data

Hi everyone,  Ready for the second part of our end-to-end DQ guide? Monitoring DQ is essential for building trust in your data assets.This post explores how data profiling, observability, and automated monitoring help organizations detect and address data quality issues in real-time, ensuring data remains accurate, complete, and reliable. Before starting, missed the first post? Check it out here 👇 Once your data is documented, the next step is understanding its quality. Without proper monitoring, data issues can go unnoticed, leading to poor decision-making. Data profiling helps by analyzing patterns, completeness, and accuracy, while data observability provides real-time monitoring to detect anomalies before they cause harm​. A data quality monitoring system tracks key dimensions such as validity, completeness, and consistency, helping organizations demonstrate progress and ROI. Automate this process, detecting unexpected changes and flagging them for review​. By continuously assessi

120
Cansu
Community Manager

Badge winners

  • First idea 💡
    Gloriahas earned the badge First idea 💡
  • First idea 💡
    farshid_mashaghhas earned the badge First idea 💡
  • First idea 💡
    sumishahas earned the badge First idea 💡
  • First idea 💡
    BarbaraBhas earned the badge First idea 💡
  • First idea 💡
    jbinghas earned the badge First idea 💡
Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings