Skip to main content

Data Quality & Catalog ⚙️

Discuss, learn, ask, suggest, share all things DQ&C 🔍

  • 567 Topics
  • 1,403 Replies
567 Topics
M
Data Pioneer
mahesh ArData Pioneer
asked in Data Quality & Catalog ⚙️
Ataccama and workday integration

By using one url we imported multiple  tables structure from workday into Ataccama. if we need to query any specific imported table in ataccama  is ataccam will dynamically updates the API endpoints ? 

552
V
Data Voyager
1 day ago
E
Data Enthusiast
evan.sasowskyData Enthusiast
asked in Data Quality & Catalog ⚙️
Date Field Format Data Quality Check

Hey y’all, I was wondering if anyone had a quality rule or advice on how to construct a quality rule to check a date type field for formatting. I know there is the “matches” function for strings and that you can convert a date field to a string using “toString”, but that requires you to specify a format, which invalidates the point of the rule.The desired format is “MM-dd-yyyy”, as shown in what I’ve got so far.matches("^\d{4}-(0[1-9]|1[0-2])-(0[1-9]|[12][0-9]|3[01])$",toString(ATTRIBUTE_1, "MM-dd-yyyy"))

373
E
Data Enthusiast
4 days ago
GastonQ
Data Voyager
GastonQData Voyager
asked in Data Quality & Catalog ⚙️
How to create a metric with decimal places in Data Story?

Hi, I’m working with data stories, and I’ve created a custom metric to represent by using percentage format.This is the metric expression:iff(sum("Valid") + sum("Invalid") > 0, round(sum("Valid") * 100/ (sum("Valid") + sum("Invalid")), 2) / 100, 0)Both “Valid” and “Invalid” are defined in Snowflake as REAL datatype.I’ve read this article Create Custom Attributes :: Ataccama ONE and I’m using round function, but it doesn’t work.Thanks in advance,Gaston 

111
GastonQ
Data Voyager
5 days ago
P
Data Pioneer L2
pdanpoonkijData Pioneer L2
asked in Data Quality & Catalog ⚙️
Retrive KeyCloak user information using Ataccama One plan

Hello community, I need to retrieve KeyCloak user information (e.g., email address) based on their username using Ataccama One Desktop. Has anyone done this before? If so, can you please share your experience or point me to some documentation?Thank you in advance for your help!

593
Joeri
Universe Traveller
5 days ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Custom Entity Occurence

Hi Community,I have created a custom entity with parent type as Term as “Class”. Now when i linked it to the catalog items and attributes using Reference Array writer its showing in my Custom Class section in the attributes as well as in the Catalog Item. But unfortunately i am not able to see it in the occurrence tab of this Custom Entity. Is there any way to add some properties in the Occurrence tab so that i can see the link for custom reference arrays. Any help is highly appreciated. 

254
S
Space Explorer
7 days ago
JTH
Data Pioneer
JTH
asked in Data Quality & Catalog ⚙️
Missing input attributes for DQ rule

Hi,In one of my Monitoring Projects I am apparently missing input attributes for a DQ rules which doesn't appear anymore in my MP. The error, however, is still there. How can I get rid of this?  

120
JTH
Data Pioneer
7 days ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Updating Terms and Terms Relationships from One Desktop in Bulk

Hi Team,Is there a way to update the existing Term name or description or any property like termInstance from One Desktop metadata writer? I can only see option to add or delete but no update option. Any idea is highly appreciated.

172
R
Data Voyager
8 days ago
G
Universe Traveller
GloriaUniverse Traveller
asked in Data Quality & Catalog ⚙️
Folder Directory for Cognos and SSRS Report

 Can the list of reports be arranged on a folder basis. For example, from the image below, my preference would be to have a folder called ‘Cognos-UAT’ with a sub-folder ‘Users Common Folder’ containing all the reports. The current view lists out all the report and specifies the location. 

142
G
Universe Traveller
10 days ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Assigning Business Terms To Custom Folders

Hi Team,I am trying to add my Business Terms in two separate child folders inside my Business Term Folder(Not Data Domains). Just wanted to know if its possible or not?I have created two child folders inside from navigation in settingsBusiness Glossary→ Terms →  Business Terms → Folder1Business Glossary→ Terms →  Business Terms → Folder2But unfortunately i am not sure how to add Business Terms in those two folders specifically, the normal Business Terms are added directly in the parent folders. Do i need to do some changes in the metadata model for this one or need to create any AQL filter for this folders(Same as Datadomains). Any tips or help is highly appreciated.

336
Albert de Ruiter
Star Blazer L2
11 days ago
Phil Holbrook
Ataccamer
Phil HolbrookAtaccamer
published in Data Quality & Catalog ⚙️
Building a nested GraphQL API call in ONE Desktop

ONE Desktop provides two ways to access the ONE platform data. Usually, it is easiest to use the Metadata Reader step, but sometimes you need a more complex query, or perhaps you are developing a Json API call to be used from another application entirely.  In this case, you will want to start from a Json Call step.The plan I will describe is this: I’ve used a random record generator to “inject” a single row into the data flow to get things started because the Json Call executes once for each row on its input.The “out” output from the Json Call carries all columns from the input; and can also be used to carry connection error messages. I’ve not set that up, so I just sent all that to Trash.I’ve named each of the remaining outputs using a sequential numbered prefix.  This manipulates the automatic alphanumeric sorting of the output connections so that the ordering is more logical than a list of element names would be. I’ve also set the layout of the step to horizontal so I can read the l

49010
Phil Holbrook
Ataccamer
11 days ago
B
Data Voyager
BhuviData Voyager
asked in Data Quality & Catalog ⚙️
Uniqueness DQ Evaluation rule

I am currently using 14.4.0.one-44751-landing-pa-230616-287787-f83b54a4 ONE web application version. While creating a Uniqueness Rule I am not getting WHEN condition as “is unique” and “is not unique” . Could someone help me understand why I am not getting the uniqueness condition  instead Validity condition.  

362
Cansu
Community Manager
12 days ago
OGordon100
Ataccamer
OGordon100Ataccamer
published in Data Quality & Catalog ⚙️
📚 Guide: How to run GraphQL requests - Part I

Hi community 👋 Ever wondered about the best ways to authenticate GraphQL requests while maintaining security and efficiency?Whether you’re new to Ataccama ONE or looking to optimize your workflows, here’s an approachable guide to using Service Principle and various authentication methods.In this first post of two part GraphQL series, I will share authentication types & which one you should use and how to authenticate GraphQL requests. Second part will be on how to work with MMM in GraphQL - so watch out this space for that!Let’s get into it👇 ⚙️API authentication User Accounts vs Service Principles User accounts and service principals serve different purposes in identity and access management. User accounts are designed for (unsurprisingly!) human users, providing them with access to applications and resources based on their roles and permissions. These accounts typically require interactive login with credentials like usernames and passwords. Service Principals, on the other hand

330
OGordon100
Ataccamer
12 days ago
T
Data Voyager
ThanujaData Voyager
asked in Data Quality & Catalog ⚙️
One desktop trans comoponent issue

When I try to open a Trans component on Ataccama One Desktop, I receive the error 'Index -1078132736 out of bounds for length 10.' Do you have any ideas or suggestions to resolve this issue?

20
T
Data Voyager
19 days ago
M
Data Pioneer
mahesh ArData Pioneer
asked in Data Quality & Catalog ⚙️
How can we handle csv output from API response

How can we handle csv output from API response?I tried to use json call ,SOAP call but it didn't work.Anyway, can we handle in One desktop csv output from API.

1398
Cansu
Community Manager
29 days ago
A
Universe Traveller
Ajeesh_GUniverse Traveller
asked in Data Quality & Catalog ⚙️
Execution Error

Hi,I am running a workflow that includes a task called 'Execute SQL'. This task updates some values in the SQL database, but the code is quite heavy. When the workflow reaches this task, I encounter the following error message. Can anyone assist?  

154
Cansu
Community Manager
29 days ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Tagging of terms to attributes

Hi Is it possible to tag Terms to the attribute metadata present in one web, while importing the terms in bulk from one desktop?Ask: Attributes and Tables are already present in one web. Importing business terms from csv file using one desktop.So while importing the business terms using one desktop is it possible to directly tag those business terms with their corresponding attributes?(The tagging list also i want to provide in a csv file and don’t want to use the automated tagging from ataccama)

607
Cansu
Community Manager
29 days ago
JTH
Data Pioneer
JTH
asked in Data Quality & Catalog ⚙️
DQ Rule Synchronise name with initials

Hi,I have two columns: first name and initials. # first_name initials 1 John J. 2 Robin Earl R.E. 3 Mark Tate Lynch M.T.L. 4 Bert Ern B.E. 5 Johan Flugg J.F. Is there a DQ rule that can check if the two columns are correctly in synch in what they should be? I understand checking the initials format is one thing, but I actually want to check if it is correctly formatted based on the first_name column. Looking for a preferred solution in ONE Web.

152
JTH
Data Pioneer
1 month ago
V
Data Voyager
Vaishali
asked in Data Quality & Catalog ⚙️
Create DQ rule to validate data in same column

Hi,I want to create DQ rule to check data within same column. For example, from below table, I want to check if Value of Category B is >= Value of Category D.How can I do this in the Ataccama One UI? ThanksCategory Value A 5 B 2 C 6 D 4

523
ivan.kozlov
Ataccamer
1 month ago
M
Data Enthusiast
mbiteyeData Enthusiast
asked in Data Quality & Catalog ⚙️
Monitoring Project Specific Notifications - Separated

I have been testing rule specific notifications within monitoring projects and it seems to add those notifications to the bottom part of the general notifications, but we are trying to see if we can receive separate emails due to different users needing to see specific issues.The documentation link is shown in the link below,https://docs.ataccama.com/one/latest/monitoring-projects/results-reports-notifications.html#specific-notifications  

292
M
Data Enthusiast
1 month ago
Prasad Rani
Data Pioneer
Prasad RaniData Pioneer
posted in Data Quality & Catalog ⚙️
I would like to get alert when any new data flagged with PII

Hello: I would like to create an alert - while scanning the datasets - if it flags any data to be PII (such as Social Security Number, Data of Birth, Tax Identification Number) etc., Is there a way to get alerted when a specific term is assigned to any catalog item attribute? 

473
W
Data Pioneer L2
1 month ago
C
Data Voyager
ckaushikData Voyager
asked in Data Quality & Catalog ⚙️
Ataccama ONE Certification Queries

What is the exam fee for  Ataccama ONE v13 Data Quality & Governance Foundation Level certification for attendees who exchange a minimum of 12 months hands-on experience for the must have training? How can we apply for the certification exam? Is the application process online or offline? Is the exam proctored? 

3177
DannyRyan
Ataccamer
1 month ago
K
Data Voyager
keithjankeData Voyager
asked in Data Quality & Catalog ⚙️
Personal Information (PI) Term and Detection Rule

I’m hoping someone can help.  I created a term called Personal Information (PI).  I’m trying to create a detection rule to find all columns that are considered PI.  Ideally, I would be looking at both the name and the data within.  Is that even possible?

191
T
Data Pioneer L2
1 month ago
D
Data Enthusiast
DhavalMData Enthusiast
asked in Data Quality & Catalog ⚙️
How to mark unique queries based on their structure?

I have data coming from a SQL database. For most queries, the structure of these queries remains the same, as shown in the picture, with only the attribute name changing. Now, I want to classify these queries as unique based on their structure rather than the attribute name.Demo DataThank you.Regards,Dhaval 

473
Cansu
Community Manager
1 month ago
R
Data Voyager
RoelantVosData Voyager
asked in Data Quality & Catalog ⚙️
Query the monitoring report results at item level

I’m hoping anyone has some good GraphQL examples to share. For us, it is necessary to integrate Ataccama into our standard reporting. To do so I’m trying to get a GraphQL working that returns the scores for each item in a monitoring project. Ideally, listing out all monitoring projects and items with their scores - for the latest processing (although I’ll take all at this point and filter the old ones later). This is all about the statistics (# records passed/failed etc. not the individual results - I am aware I can create post-processing plans to export data, but this is not applicable here).It’s basically the overview from the report tab in the monitoring project, at item level:I can get everything I need, including the total row count except the passed or failed figure. I have tried and looked at all GraphQL examples everywhere, including ONE API :: Ataccama ONE, and have pieced this together based on the structures visible in the desktop app. Things like DqAggregationResultOverTime

382
Cansu
Community Manager
1 month ago
kayhan.turker
Ataccamer
kayhan.turkerAtaccamer
published in Data Quality & Catalog ⚙️
Passing a dynamic query into a JDBC reader

Hi community!Today, I have a quick tip to share on how to pass a dynamic query into a JDBC reader. If you are using ONE Desktop as part of your day-to-day this would be a good practice to implement when it comes to using the JDBC reader step.OverviewThe following is a working example of passing a dynamic query into a JDBC reader. Its overall structure consists of two plans that are run sequentially in a workflow. The idea is that the first plan will produce the query that the second plan (that includes our main logic) will use.In the above example, an audit table is read in the second DQC plan, but with a query that depends on information on the current state of the table (for example, the maximum of a particular record, record count, and latest refresh date). First Plan - Retrieving QueriesIn the first plan, functions and variables are applied to produce a .sql file that contains the JDBC reader query to be used.As an example, functions can include getting the current date to apply a

1102
kayhan.turker
Ataccamer
1 month ago
Community Terms of Use & ConditionsCookie settings