Skip to main content

Data Quality & Catalog ⚙️

Discuss, learn, ask, suggest, share all things DQ&C 🔍

  • 571 Topics
  • 1,417 Replies
571 Topics
B
Data Voyager
Bhuvaneshwari BalasubramaniamData Voyager
asked in Data Quality & Catalog ⚙️
Validating Date

Hi,I am trying to validate the date given between 100 years ago and 15 years ago are valid , everything else is invalid. I am able to achieve this validation in YEAR part. I am looking for validating complete date instead of only Year part.Below are few screenshots.  

51
A
Ataccamer
3 hours ago
B
Data Voyager
Bhuvaneshwari BalasubramaniamData Voyager
asked in Data Quality & Catalog ⚙️
Creating rules for Name field

Hi ,Could someone guide me on creating rules for Name field.Rule : Name should not have any special characters or numbers. Ex: Jhon Leo - ValidJho1 Leo* - Not Valid Regards,Bhuvi

20
B
Data Voyager
5 hours ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Policy Creation/Update Date

Hi Community,Is it possible to fetch the policy creation or last update date for Policies, in order to make a DQ rule around it in Ataccama One? My use case is to build a DQ rule which will notify the stakeholders based on a timeframe after which the policy has been created or last updated, but unfortunately i am not seeing any property to fetch the Created or Last Update date. 

232
R
Data Voyager
13 hours ago
S
Data Voyager
Susan24usData Voyager
asked in Data Quality & Catalog ⚙️
Semi Structured Data

Hello, i have a report that we usually saved to hard drive that i would like to bring into Ataccama, the report is in semi structured format . does ataccama accept or work with semi structure data ?or do i need to convert the report first before connecting to source ?

111
anna.spakova
Ataccamer
16 hours ago
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
#3 Business TermsGet certified with Ataccama

Glossary terms are used to add more metadata to different assets in the Ataccama ONE, they are necessary for data quality evaluation of Catalog Items after profiling. 👉 Get Certified with Ataccama article series#1 Adding Data Sources#2 Add a Data Source to the Catalog 🔎 LET’S TEST YOUR SKILLSUsing the ONE Web App, in the ONE Business Glossary module, create business terms for '<your_name>_Blood Type', '<your_name>_Rhesus Status', '<your_name>_Blood Group'. Using the ONE Web App, in the ONE Business Glossary module, configure the business terms '<your_name>_Blood Type' and '<your_name>_Rhesus Status' as child terms of the parent term '<your_name>_Blood Group'.💡 How to do it? Navigate to Business Glossary in the left navigation menu and click on Create in the top right menuSelect Type - Business Term, fill in Name and SaveYou will see that your business term has been successfully created, repeat the same process for remaining business termsOnce you

3859
Cansu
Community Manager
16 hours ago
A
Universe Traveller
Ajeesh_GUniverse Traveller
asked in Data Quality & Catalog ⚙️
Send files to sftp location

Hi, How can I send a file to SFTP folder using below task item? I am using Desktop version.Can someone help me how to get the required fields from the below screenshot? I have the location where I want to drop the file. 

60
A
Universe Traveller
18 hours ago
T
Data Voyager
ThanujaData Voyager
asked in Data Quality & Catalog ⚙️
One desktop trans comoponent issue

When I try to open a Trans component on Ataccama One Desktop, I receive the error 'Index -1078132736 out of bounds for length 10.' Do you have any ideas or suggestions to resolve this issue?

71
Cansu
Community Manager
4 days ago
JTH
Data Pioneer
JTH
asked in Data Quality & Catalog ⚙️
Missing input attributes for DQ rule

Hi,In one of my Monitoring Projects I am apparently missing input attributes for a DQ rules which doesn't appear anymore in my MP. The error, however, is still there. How can I get rid of this?  

213
Cansu
Community Manager
4 days ago
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
Data Reconciliation Best Practices 👾Best Practice

Hi Community! In the last few months the focus of our articles was majorly on features of ONE Web platform, from the basics to more complicated practices and now it’s time to move on to the next step. From next week we are moving on to ONE Desktop🖥️ Today we will focus on Data Reconciliation, and cover how you can utilize this feature effectively for seamless data consistency across multiple sources. Let’s get to it! In a nutshell, the Data Reconciliation feature confirms that your migrated data from one database to another is intact and accurate, without any data leaks or glitches. It conducts high-level checks on data consistency by comparing attribute profile statistics and even attributes fingerprints (except for Snowflake data). Step-by-Step Guide to Data Reconciliation 1. Create a Reconciliation Project in Data Quality:To kick off your data reconciliation journey, navigate to Data Quality and then select Reconciliation Projects. Here, you can either create a new project or edit

4625
anna.spakova
Ataccamer
5 days ago
E
Data Enthusiast
evan.sasowskyData Enthusiast
asked in Data Quality & Catalog ⚙️
Date Field Format Data Quality Check

Hey y’all, I was wondering if anyone had a quality rule or advice on how to construct a quality rule to check a date type field for formatting. I know there is the “matches” function for strings and that you can convert a date field to a string using “toString”, but that requires you to specify a format, which invalidates the point of the rule.The desired format is “MM-dd-yyyy”, as shown in what I’ve got so far.matches("^\d{4}-(0[1-9]|1[0-2])-(0[1-9]|[12][0-9]|3[01])$",toString(ATTRIBUTE_1, "MM-dd-yyyy"))

504
anna.spakova
Ataccamer
5 days ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Custom Entity Occurence

Hi Community,I have created a custom entity with parent type as Term as “Class”. Now when i linked it to the catalog items and attributes using Reference Array writer its showing in my Custom Class section in the attributes as well as in the Catalog Item. But unfortunately i am not able to see it in the occurrence tab of this Custom Entity. Is there any way to add some properties in the Occurrence tab so that i can see the link for custom reference arrays. Any help is highly appreciated. 

365
Cansu
Community Manager
6 days ago
P
Data Pioneer L2
pdanpoonkijData Pioneer L2
asked in Data Quality & Catalog ⚙️
Retrive KeyCloak user information using Ataccama One plan

Hello community, I need to retrieve KeyCloak user information (e.g., email address) based on their username using Ataccama One Desktop. Has anyone done this before? If so, can you please share your experience or point me to some documentation?Thank you in advance for your help!

654
may_kwok
Star Blazer L3
6 days ago
M
Data Pioneer
mahesh ArData Pioneer
asked in Data Quality & Catalog ⚙️
Ataccama and workday integration

By using one url we imported multiple  tables structure from workday into Ataccama. if we need to query any specific imported table in ataccama  is ataccam will dynamically updates the API endpoints ? 

663
Cansu
Community Manager
11 days ago
GastonQ
Data Voyager
GastonQData Voyager
asked in Data Quality & Catalog ⚙️
How to create a metric with decimal places in Data Story?

Hi, I’m working with data stories, and I’ve created a custom metric to represent by using percentage format.This is the metric expression:iff(sum("Valid") + sum("Invalid") > 0, round(sum("Valid") * 100/ (sum("Valid") + sum("Invalid")), 2) / 100, 0)Both “Valid” and “Invalid” are defined in Snowflake as REAL datatype.I’ve read this article Create Custom Attributes :: Ataccama ONE and I’m using round function, but it doesn’t work.Thanks in advance,Gaston 

201
GastonQ
Data Voyager
18 days ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Updating Terms and Terms Relationships from One Desktop in Bulk

Hi Team,Is there a way to update the existing Term name or description or any property like termInstance from One Desktop metadata writer? I can only see option to add or delete but no update option. Any idea is highly appreciated.

212
R
Data Voyager
21 days ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Assigning Business Terms To Custom Folders

Hi Team,I am trying to add my Business Terms in two separate child folders inside my Business Term Folder(Not Data Domains). Just wanted to know if its possible or not?I have created two child folders inside from navigation in settingsBusiness Glossary→ Terms →  Business Terms → Folder1Business Glossary→ Terms →  Business Terms → Folder2But unfortunately i am not sure how to add Business Terms in those two folders specifically, the normal Business Terms are added directly in the parent folders. Do i need to do some changes in the metadata model for this one or need to create any AQL filter for this folders(Same as Datadomains). Any tips or help is highly appreciated.

416
Albert de Ruiter
Star Blazer L2
24 days ago
Phil Holbrook
Ataccamer
Phil HolbrookAtaccamer
published in Data Quality & Catalog ⚙️
Building a nested GraphQL API call in ONE Desktop

ONE Desktop provides two ways to access the ONE platform data. Usually, it is easiest to use the Metadata Reader step, but sometimes you need a more complex query, or perhaps you are developing a Json API call to be used from another application entirely.  In this case, you will want to start from a Json Call step.The plan I will describe is this: I’ve used a random record generator to “inject” a single row into the data flow to get things started because the Json Call executes once for each row on its input.The “out” output from the Json Call carries all columns from the input; and can also be used to carry connection error messages. I’ve not set that up, so I just sent all that to Trash.I’ve named each of the remaining outputs using a sequential numbered prefix.  This manipulates the automatic alphanumeric sorting of the output connections so that the ordering is more logical than a list of element names would be. I’ve also set the layout of the step to horizontal so I can read the l

49710
Phil Holbrook
Ataccamer
24 days ago
B
Data Voyager
BhuviData Voyager
asked in Data Quality & Catalog ⚙️
Uniqueness DQ Evaluation rule

I am currently using 14.4.0.one-44751-landing-pa-230616-287787-f83b54a4 ONE web application version. While creating a Uniqueness Rule I am not getting WHEN condition as “is unique” and “is not unique” . Could someone help me understand why I am not getting the uniqueness condition  instead Validity condition.  

392
Cansu
Community Manager
25 days ago
OGordon100
Ataccamer
OGordon100Ataccamer
published in Data Quality & Catalog ⚙️
📚 Guide: How to run GraphQL requests - Part I

Hi community 👋 Ever wondered about the best ways to authenticate GraphQL requests while maintaining security and efficiency?Whether you’re new to Ataccama ONE or looking to optimize your workflows, here’s an approachable guide to using Service Principle and various authentication methods.In this first post of two part GraphQL series, I will share authentication types & which one you should use and how to authenticate GraphQL requests. Second part will be on how to work with MMM in GraphQL - so watch out this space for that!Let’s get into it👇 ⚙️API authentication User Accounts vs Service Principles User accounts and service principals serve different purposes in identity and access management. User accounts are designed for (unsurprisingly!) human users, providing them with access to applications and resources based on their roles and permissions. These accounts typically require interactive login with credentials like usernames and passwords. Service Principals, on the other hand

580
OGordon100
Ataccamer
25 days ago
M
Data Pioneer
mahesh ArData Pioneer
asked in Data Quality & Catalog ⚙️
How can we handle csv output from API response

How can we handle csv output from API response?I tried to use json call ,SOAP call but it didn't work.Anyway, can we handle in One desktop csv output from API.

1448
Cansu
Community Manager
1 month ago
A
Universe Traveller
Ajeesh_GUniverse Traveller
asked in Data Quality & Catalog ⚙️
Execution Error

Hi,I am running a workflow that includes a task called 'Execute SQL'. This task updates some values in the SQL database, but the code is quite heavy. When the workflow reaches this task, I encounter the following error message. Can anyone assist?  

164
Cansu
Community Manager
1 month ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Tagging of terms to attributes

Hi Is it possible to tag Terms to the attribute metadata present in one web, while importing the terms in bulk from one desktop?Ask: Attributes and Tables are already present in one web. Importing business terms from csv file using one desktop.So while importing the business terms using one desktop is it possible to directly tag those business terms with their corresponding attributes?(The tagging list also i want to provide in a csv file and don’t want to use the automated tagging from ataccama)

767
Cansu
Community Manager
1 month ago
JTH
Data Pioneer
JTH
asked in Data Quality & Catalog ⚙️
DQ Rule Synchronise name with initials

Hi,I have two columns: first name and initials. # first_name initials 1 John J. 2 Robin Earl R.E. 3 Mark Tate Lynch M.T.L. 4 Bert Ern B.E. 5 Johan Flugg J.F. Is there a DQ rule that can check if the two columns are correctly in synch in what they should be? I understand checking the initials format is one thing, but I actually want to check if it is correctly formatted based on the first_name column. Looking for a preferred solution in ONE Web.

152
JTH
Data Pioneer
1 month ago
V
Data Voyager
Vaishali
asked in Data Quality & Catalog ⚙️
Create DQ rule to validate data in same column

Hi,I want to create DQ rule to check data within same column. For example, from below table, I want to check if Value of Category B is >= Value of Category D.How can I do this in the Ataccama One UI? ThanksCategory Value A 5 B 2 C 6 D 4

543
ivan.kozlov
Ataccamer
1 month ago
M
Data Enthusiast
mbiteyeData Enthusiast
asked in Data Quality & Catalog ⚙️
Monitoring Project Specific Notifications - Separated

I have been testing rule specific notifications within monitoring projects and it seems to add those notifications to the bottom part of the general notifications, but we are trying to see if we can receive separate emails due to different users needing to see specific issues.The documentation link is shown in the link below,https://docs.ataccama.com/one/latest/monitoring-projects/results-reports-notifications.html#specific-notifications  

292
M
Data Enthusiast
1 month ago

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings