Skip to main content

Data Quality & Catalog ⚙️

Discuss, learn, ask, suggest, share all things DQ&C 🔍

  • 567 Topics
  • 1,406 Replies
567 Topics
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Custom Entity Occurence

Hi Community,I have created a custom entity with parent type as Term as “Class”. Now when i linked it to the catalog items and attributes using Reference Array writer its showing in my Custom Class section in the attributes as well as in the Catalog Item. But unfortunately i am not able to see it in the occurrence tab of this Custom Entity. Is there any way to add some properties in the Occurrence tab so that i can see the link for custom reference arrays. Any help is highly appreciated. 

325
Cansu
Community Manager
14 hours ago
JTH
Data Pioneer
JTH
asked in Data Quality & Catalog ⚙️
Missing input attributes for DQ rule

Hi,In one of my Monitoring Projects I am apparently missing input attributes for a DQ rules which doesn't appear anymore in my MP. The error, however, is still there. How can I get rid of this?  

141
Cansu
Community Manager
14 hours ago
P
Data Pioneer L2
pdanpoonkijData Pioneer L2
asked in Data Quality & Catalog ⚙️
Retrive KeyCloak user information using Ataccama One plan

Hello community, I need to retrieve KeyCloak user information (e.g., email address) based on their username using Ataccama One Desktop. Has anyone done this before? If so, can you please share your experience or point me to some documentation?Thank you in advance for your help!

634
may_kwok
Star Blazer L3
18 hours ago
S
Data Voyager
Susan24usData Voyager
asked in Data Quality & Catalog ⚙️
Semi Structured Data

Hello, i have a report that we usually saved to hard drive that i would like to bring into Ataccama, the report is in semi structured format . does ataccama accept or work with semi structure data ?or do i need to convert the report first before connecting to source ?

20
S
Data Voyager
1 day ago
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
Data Reconciliation Best Practices 👾Best Practice

Hi Community! In the last few months the focus of our articles was majorly on features of ONE Web platform, from the basics to more complicated practices and now it’s time to move on to the next step. From next week we are moving on to ONE Desktop🖥️ Today we will focus on Data Reconciliation, and cover how you can utilize this feature effectively for seamless data consistency across multiple sources. Let’s get to it! In a nutshell, the Data Reconciliation feature confirms that your migrated data from one database to another is intact and accurate, without any data leaks or glitches. It conducts high-level checks on data consistency by comparing attribute profile statistics and even attributes fingerprints (except for Snowflake data). Step-by-Step Guide to Data Reconciliation 1. Create a Reconciliation Project in Data Quality:To kick off your data reconciliation journey, navigate to Data Quality and then select Reconciliation Projects. Here, you can either create a new project or edit

4534
B
Data Voyager
1 day ago
M
Data Pioneer
mahesh ArData Pioneer
asked in Data Quality & Catalog ⚙️
Ataccama and workday integration

By using one url we imported multiple  tables structure from workday into Ataccama. if we need to query any specific imported table in ataccama  is ataccam will dynamically updates the API endpoints ? 

663
Cansu
Community Manager
5 days ago
E
Data Enthusiast
evan.sasowskyData Enthusiast
asked in Data Quality & Catalog ⚙️
Date Field Format Data Quality Check

Hey y’all, I was wondering if anyone had a quality rule or advice on how to construct a quality rule to check a date type field for formatting. I know there is the “matches” function for strings and that you can convert a date field to a string using “toString”, but that requires you to specify a format, which invalidates the point of the rule.The desired format is “MM-dd-yyyy”, as shown in what I’ve got so far.matches("^\d{4}-(0[1-9]|1[0-2])-(0[1-9]|[12][0-9]|3[01])$",toString(ATTRIBUTE_1, "MM-dd-yyyy"))

403
E
Data Enthusiast
11 days ago
GastonQ
Data Voyager
GastonQData Voyager
asked in Data Quality & Catalog ⚙️
How to create a metric with decimal places in Data Story?

Hi, I’m working with data stories, and I’ve created a custom metric to represent by using percentage format.This is the metric expression:iff(sum("Valid") + sum("Invalid") > 0, round(sum("Valid") * 100/ (sum("Valid") + sum("Invalid")), 2) / 100, 0)Both “Valid” and “Invalid” are defined in Snowflake as REAL datatype.I’ve read this article Create Custom Attributes :: Ataccama ONE and I’m using round function, but it doesn’t work.Thanks in advance,Gaston 

141
GastonQ
Data Voyager
12 days ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Updating Terms and Terms Relationships from One Desktop in Bulk

Hi Team,Is there a way to update the existing Term name or description or any property like termInstance from One Desktop metadata writer? I can only see option to add or delete but no update option. Any idea is highly appreciated.

202
R
Data Voyager
16 days ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Assigning Business Terms To Custom Folders

Hi Team,I am trying to add my Business Terms in two separate child folders inside my Business Term Folder(Not Data Domains). Just wanted to know if its possible or not?I have created two child folders inside from navigation in settingsBusiness Glossary→ Terms →  Business Terms → Folder1Business Glossary→ Terms →  Business Terms → Folder2But unfortunately i am not sure how to add Business Terms in those two folders specifically, the normal Business Terms are added directly in the parent folders. Do i need to do some changes in the metadata model for this one or need to create any AQL filter for this folders(Same as Datadomains). Any tips or help is highly appreciated.

366
Albert de Ruiter
Star Blazer L2
18 days ago
Phil Holbrook
Ataccamer
Phil HolbrookAtaccamer
published in Data Quality & Catalog ⚙️
Building a nested GraphQL API call in ONE Desktop

ONE Desktop provides two ways to access the ONE platform data. Usually, it is easiest to use the Metadata Reader step, but sometimes you need a more complex query, or perhaps you are developing a Json API call to be used from another application entirely.  In this case, you will want to start from a Json Call step.The plan I will describe is this: I’ve used a random record generator to “inject” a single row into the data flow to get things started because the Json Call executes once for each row on its input.The “out” output from the Json Call carries all columns from the input; and can also be used to carry connection error messages. I’ve not set that up, so I just sent all that to Trash.I’ve named each of the remaining outputs using a sequential numbered prefix.  This manipulates the automatic alphanumeric sorting of the output connections so that the ordering is more logical than a list of element names would be. I’ve also set the layout of the step to horizontal so I can read the l

49610
Phil Holbrook
Ataccamer
18 days ago
B
Data Voyager
BhuviData Voyager
asked in Data Quality & Catalog ⚙️
Uniqueness DQ Evaluation rule

I am currently using 14.4.0.one-44751-landing-pa-230616-287787-f83b54a4 ONE web application version. While creating a Uniqueness Rule I am not getting WHEN condition as “is unique” and “is not unique” . Could someone help me understand why I am not getting the uniqueness condition  instead Validity condition.  

392
Cansu
Community Manager
19 days ago
OGordon100
Ataccamer
OGordon100Ataccamer
published in Data Quality & Catalog ⚙️
📚 Guide: How to run GraphQL requests - Part I

Hi community 👋 Ever wondered about the best ways to authenticate GraphQL requests while maintaining security and efficiency?Whether you’re new to Ataccama ONE or looking to optimize your workflows, here’s an approachable guide to using Service Principle and various authentication methods.In this first post of two part GraphQL series, I will share authentication types & which one you should use and how to authenticate GraphQL requests. Second part will be on how to work with MMM in GraphQL - so watch out this space for that!Let’s get into it👇 ⚙️API authentication User Accounts vs Service Principles User accounts and service principals serve different purposes in identity and access management. User accounts are designed for (unsurprisingly!) human users, providing them with access to applications and resources based on their roles and permissions. These accounts typically require interactive login with credentials like usernames and passwords. Service Principals, on the other hand

530
OGordon100
Ataccamer
19 days ago
T
Data Voyager
ThanujaData Voyager
asked in Data Quality & Catalog ⚙️
One desktop trans comoponent issue

When I try to open a Trans component on Ataccama One Desktop, I receive the error 'Index -1078132736 out of bounds for length 10.' Do you have any ideas or suggestions to resolve this issue?

20
T
Data Voyager
26 days ago
M
Data Pioneer
mahesh ArData Pioneer
asked in Data Quality & Catalog ⚙️
How can we handle csv output from API response

How can we handle csv output from API response?I tried to use json call ,SOAP call but it didn't work.Anyway, can we handle in One desktop csv output from API.

1428
Cansu
Community Manager
1 month ago
A
Universe Traveller
Ajeesh_GUniverse Traveller
asked in Data Quality & Catalog ⚙️
Execution Error

Hi,I am running a workflow that includes a task called 'Execute SQL'. This task updates some values in the SQL database, but the code is quite heavy. When the workflow reaches this task, I encounter the following error message. Can anyone assist?  

164
Cansu
Community Manager
1 month ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Tagging of terms to attributes

Hi Is it possible to tag Terms to the attribute metadata present in one web, while importing the terms in bulk from one desktop?Ask: Attributes and Tables are already present in one web. Importing business terms from csv file using one desktop.So while importing the business terms using one desktop is it possible to directly tag those business terms with their corresponding attributes?(The tagging list also i want to provide in a csv file and don’t want to use the automated tagging from ataccama)

757
Cansu
Community Manager
1 month ago
JTH
Data Pioneer
JTH
asked in Data Quality & Catalog ⚙️
DQ Rule Synchronise name with initials

Hi,I have two columns: first name and initials. # first_name initials 1 John J. 2 Robin Earl R.E. 3 Mark Tate Lynch M.T.L. 4 Bert Ern B.E. 5 Johan Flugg J.F. Is there a DQ rule that can check if the two columns are correctly in synch in what they should be? I understand checking the initials format is one thing, but I actually want to check if it is correctly formatted based on the first_name column. Looking for a preferred solution in ONE Web.

152
JTH
Data Pioneer
1 month ago
V
Data Voyager
Vaishali
asked in Data Quality & Catalog ⚙️
Create DQ rule to validate data in same column

Hi,I want to create DQ rule to check data within same column. For example, from below table, I want to check if Value of Category B is >= Value of Category D.How can I do this in the Ataccama One UI? ThanksCategory Value A 5 B 2 C 6 D 4

533
ivan.kozlov
Ataccamer
1 month ago
M
Data Enthusiast
mbiteyeData Enthusiast
asked in Data Quality & Catalog ⚙️
Monitoring Project Specific Notifications - Separated

I have been testing rule specific notifications within monitoring projects and it seems to add those notifications to the bottom part of the general notifications, but we are trying to see if we can receive separate emails due to different users needing to see specific issues.The documentation link is shown in the link below,https://docs.ataccama.com/one/latest/monitoring-projects/results-reports-notifications.html#specific-notifications  

292
M
Data Enthusiast
1 month ago
Prasad Rani
Data Pioneer
Prasad RaniData Pioneer
posted in Data Quality & Catalog ⚙️
I would like to get alert when any new data flagged with PII

Hello: I would like to create an alert - while scanning the datasets - if it flags any data to be PII (such as Social Security Number, Data of Birth, Tax Identification Number) etc., Is there a way to get alerted when a specific term is assigned to any catalog item attribute? 

483
W
Data Pioneer L2
1 month ago
C
Data Voyager
ckaushikData Voyager
asked in Data Quality & Catalog ⚙️
Ataccama ONE Certification Queries

What is the exam fee for  Ataccama ONE v13 Data Quality & Governance Foundation Level certification for attendees who exchange a minimum of 12 months hands-on experience for the must have training? How can we apply for the certification exam? Is the application process online or offline? Is the exam proctored? 

3177
DannyRyan
Ataccamer
1 month ago
K
Data Voyager
keithjankeData Voyager
asked in Data Quality & Catalog ⚙️
Personal Information (PI) Term and Detection Rule

I’m hoping someone can help.  I created a term called Personal Information (PI).  I’m trying to create a detection rule to find all columns that are considered PI.  Ideally, I would be looking at both the name and the data within.  Is that even possible?

201
T
Data Pioneer L2
1 month ago
D
Data Enthusiast
DhavalMData Enthusiast
asked in Data Quality & Catalog ⚙️
How to mark unique queries based on their structure?

I have data coming from a SQL database. For most queries, the structure of these queries remains the same, as shown in the picture, with only the attribute name changing. Now, I want to classify these queries as unique based on their structure rather than the attribute name.Demo DataThank you.Regards,Dhaval 

473
Cansu
Community Manager
1 month ago
R
Data Voyager
RoelantVosData Voyager
asked in Data Quality & Catalog ⚙️
Query the monitoring report results at item level

I’m hoping anyone has some good GraphQL examples to share. For us, it is necessary to integrate Ataccama into our standard reporting. To do so I’m trying to get a GraphQL working that returns the scores for each item in a monitoring project. Ideally, listing out all monitoring projects and items with their scores - for the latest processing (although I’ll take all at this point and filter the old ones later). This is all about the statistics (# records passed/failed etc. not the individual results - I am aware I can create post-processing plans to export data, but this is not applicable here).It’s basically the overview from the report tab in the monitoring project, at item level:I can get everything I need, including the total row count except the passed or failed figure. I have tried and looked at all GraphQL examples everywhere, including ONE API :: Ataccama ONE, and have pieced this together based on the structures visible in the desktop app. Things like DqAggregationResultOverTime

382
Cansu
Community Manager
1 month ago

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings