Skip to main content

Data Quality & Catalog ⚙️

Discuss, learn, ask, suggest, share all things DQ&C 🔍

  • 563 Topics
  • 1,388 Replies
563 Topics
B
Data Voyager
BhuviData Voyager
asked in Data Quality & Catalog ⚙️
Uniqueness DQ Evaluation rule

I am currently using 14.4.0.one-44751-landing-pa-230616-287787-f83b54a4 ONE web application version. While creating a Uniqueness Rule I am not getting WHEN condition as “is unique” and “is not unique” . Could someone help me understand why I am not getting the uniqueness condition  instead Validity condition.  

312
Cansu
Community Manager
16 minutes ago
E
Data Voyager
evan.sasowskyData Voyager
asked in Data Quality & Catalog ⚙️
Date Field Format Data Quality Check

Hey y’all, I was wondering if anyone had a quality rule or advice on how to construct a quality rule to check a date type field for formatting. I know there is the “matches” function for strings and that you can convert a date field to a string using “toString”, but that requires you to specify a format, which invalidates the point of the rule.The desired format is “MM-dd-yyyy”, as shown in what I’ve got so far.matches("^\d{4}-(0[1-9]|1[0-2])-(0[1-9]|[12][0-9]|3[01])$",toString(ATTRIBUTE_1, "MM-dd-yyyy"))

302
Cansu
Community Manager
17 minutes ago
G
Universe Traveller
GloriaUniverse Traveller
asked in Data Quality & Catalog ⚙️
Folder Directory for Cognos and SSRS Report

 Can the list of reports be arranged on a folder basis. For example, from the image below, my preference would be to have a folder called ‘Cognos-UAT’ with a sub-folder ‘Users Common Folder’ containing all the reports. The current view lists out all the report and specifies the location. 

41
Cansu
Community Manager
19 minutes ago
OGordon100
Ataccamer
OGordon100Ataccamer
published in Data Quality & Catalog ⚙️
📚 Guide: How to run GraphQL requests - Part I

Hi community 👋 Ever wondered about the best ways to authenticate GraphQL requests while maintaining security and efficiency?Whether you’re new to Ataccama ONE or looking to optimize your workflows, here’s an approachable guide to using Service Principle and various authentication methods.In this first post of two part GraphQL series, I will share authentication types & which one you should use and how to authenticate GraphQL requests. Second part will be on how to work with MMM in GraphQL - so watch out this space for that!Let’s get into it👇 ⚙️API authentication User Accounts vs Service Principles User accounts and service principals serve different purposes in identity and access management. User accounts are designed for (unsurprisingly!) human users, providing them with access to applications and resources based on their roles and permissions. These accounts typically require interactive login with credentials like usernames and passwords. Service Principals, on the other hand

70
OGordon100
Ataccamer
7 hours ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Assigning Business Terms To Custom Folders

Hi Team,I am trying to add my Business Terms in two separate child folders inside my Business Term Folder(Not Data Domains). Just wanted to know if its possible or not?I have created two child folders inside from navigation in settingsBusiness Glossary→ Terms →  Business Terms → Folder1Business Glossary→ Terms →  Business Terms → Folder2But unfortunately i am not sure how to add Business Terms in those two folders specifically, the normal Business Terms are added directly in the parent folders. Do i need to do some changes in the metadata model for this one or need to create any AQL filter for this folders(Same as Datadomains). Any tips or help is highly appreciated.

204
Cansu
Community Manager
3 days ago
Phil Holbrook
Ataccamer
Phil HolbrookAtaccamer
published in Data Quality & Catalog ⚙️
Building a nested GraphQL API call in ONE Desktop

ONE Desktop provides two ways to access the ONE platform data. Usually, it is easiest to use the Metadata Reader step, but sometimes you need a more complex query, or perhaps you are developing a Json API call to be used from another application entirely.  In this case, you will want to start from a Json Call step.The plan I will describe is this: I’ve used a random record generator to “inject” a single row into the data flow to get things started because the Json Call executes once for each row on its input.The “out” output from the Json Call carries all columns from the input; and can also be used to carry connection error messages. I’ve not set that up, so I just sent all that to Trash.I’ve named each of the remaining outputs using a sequential numbered prefix.  This manipulates the automatic alphanumeric sorting of the output connections so that the ordering is more logical than a list of element names would be. I’ve also set the layout of the step to horizontal so I can read the l

4709
N
Data Voyager
3 days ago
T
Data Voyager
ThanujaData Voyager
asked in Data Quality & Catalog ⚙️
One desktop trans comoponent issue

When I try to open a Trans component on Ataccama One Desktop, I receive the error 'Index -1078132736 out of bounds for length 10.' Do you have any ideas or suggestions to resolve this issue?

10
T
Data Voyager
7 days ago
M
Data Pioneer
mahesh ArData Pioneer
asked in Data Quality & Catalog ⚙️
How can we handle csv output from API response

How can we handle csv output from API response?I tried to use json call ,SOAP call but it didn't work.Anyway, can we handle in One desktop csv output from API.

1358
Cansu
Community Manager
17 days ago
A
Universe Traveller
Ajeesh_GUniverse Traveller
asked in Data Quality & Catalog ⚙️
Execution Error

Hi,I am running a workflow that includes a task called 'Execute SQL'. This task updates some values in the SQL database, but the code is quite heavy. When the workflow reaches this task, I encounter the following error message. Can anyone assist?  

144
Cansu
Community Manager
17 days ago
R
Data Voyager
RAZORXData Voyager
asked in Data Quality & Catalog ⚙️
Tagging of terms to attributes

Hi Is it possible to tag Terms to the attribute metadata present in one web, while importing the terms in bulk from one desktop?Ask: Attributes and Tables are already present in one web. Importing business terms from csv file using one desktop.So while importing the business terms using one desktop is it possible to directly tag those business terms with their corresponding attributes?(The tagging list also i want to provide in a csv file and don’t want to use the automated tagging from ataccama)

447
Cansu
Community Manager
17 days ago
JTH
Data Pioneer
JTH
asked in Data Quality & Catalog ⚙️
DQ Rule Synchronise name with initials

Hi,I have two columns: first name and initials. # first_name initials 1 John J. 2 Robin Earl R.E. 3 Mark Tate Lynch M.T.L. 4 Bert Ern B.E. 5 Johan Flugg J.F. Is there a DQ rule that can check if the two columns are correctly in synch in what they should be? I understand checking the initials format is one thing, but I actually want to check if it is correctly formatted based on the first_name column. Looking for a preferred solution in ONE Web.

142
JTH
Data Pioneer
23 days ago
V
Data Voyager
Vaishali
asked in Data Quality & Catalog ⚙️
Create DQ rule to validate data in same column

Hi,I want to create DQ rule to check data within same column. For example, from below table, I want to check if Value of Category B is >= Value of Category D.How can I do this in the Ataccama One UI? ThanksCategory Value A 5 B 2 C 6 D 4

483
ivan.kozlov
Ataccamer
23 days ago
M
Data Enthusiast
mbiteyeData Enthusiast
asked in Data Quality & Catalog ⚙️
Monitoring Project Specific Notifications - Separated

I have been testing rule specific notifications within monitoring projects and it seems to add those notifications to the bottom part of the general notifications, but we are trying to see if we can receive separate emails due to different users needing to see specific issues.The documentation link is shown in the link below,https://docs.ataccama.com/one/latest/monitoring-projects/results-reports-notifications.html#specific-notifications  

292
M
Data Enthusiast
28 days ago
Prasad Rani
Data Pioneer
Prasad RaniData Pioneer
posted in Data Quality & Catalog ⚙️
I would like to get alert when any new data flagged with PII

Hello: I would like to create an alert - while scanning the datasets - if it flags any data to be PII (such as Social Security Number, Data of Birth, Tax Identification Number) etc., Is there a way to get alerted when a specific term is assigned to any catalog item attribute? 

443
W
Data Pioneer L2
28 days ago
C
Data Voyager
ckaushikData Voyager
asked in Data Quality & Catalog ⚙️
Ataccama ONE Certification Queries

What is the exam fee for  Ataccama ONE v13 Data Quality & Governance Foundation Level certification for attendees who exchange a minimum of 12 months hands-on experience for the must have training? How can we apply for the certification exam? Is the application process online or offline? Is the exam proctored? 

3067
DannyRyan
Ataccamer
28 days ago
K
Data Voyager
keithjankeData Voyager
asked in Data Quality & Catalog ⚙️
Personal Information (PI) Term and Detection Rule

I’m hoping someone can help.  I created a term called Personal Information (PI).  I’m trying to create a detection rule to find all columns that are considered PI.  Ideally, I would be looking at both the name and the data within.  Is that even possible?

181
T
Data Pioneer L2
28 days ago
D
Data Enthusiast
DhavalMData Enthusiast
asked in Data Quality & Catalog ⚙️
How to mark unique queries based on their structure?

I have data coming from a SQL database. For most queries, the structure of these queries remains the same, as shown in the picture, with only the attribute name changing. Now, I want to classify these queries as unique based on their structure rather than the attribute name.Demo DataThank you.Regards,Dhaval 

453
Cansu
Community Manager
29 days ago
R
Data Voyager
RoelantVosData Voyager
asked in Data Quality & Catalog ⚙️
Query the monitoring report results at item level

I’m hoping anyone has some good GraphQL examples to share. For us, it is necessary to integrate Ataccama into our standard reporting. To do so I’m trying to get a GraphQL working that returns the scores for each item in a monitoring project. Ideally, listing out all monitoring projects and items with their scores - for the latest processing (although I’ll take all at this point and filter the old ones later). This is all about the statistics (# records passed/failed etc. not the individual results - I am aware I can create post-processing plans to export data, but this is not applicable here).It’s basically the overview from the report tab in the monitoring project, at item level:I can get everything I need, including the total row count except the passed or failed figure. I have tried and looked at all GraphQL examples everywhere, including ONE API :: Ataccama ONE, and have pieced this together based on the structures visible in the desktop app. Things like DqAggregationResultOverTime

372
Cansu
Community Manager
29 days ago
kayhan.turker
Ataccamer
kayhan.turkerAtaccamer
published in Data Quality & Catalog ⚙️
Passing a dynamic query into a JDBC reader

Hi community!Today, I have a quick tip to share on how to pass a dynamic query into a JDBC reader. If you are using ONE Desktop as part of your day-to-day this would be a good practice to implement when it comes to using the JDBC reader step.OverviewThe following is a working example of passing a dynamic query into a JDBC reader. Its overall structure consists of two plans that are run sequentially in a workflow. The idea is that the first plan will produce the query that the second plan (that includes our main logic) will use.In the above example, an audit table is read in the second DQC plan, but with a query that depends on information on the current state of the table (for example, the maximum of a particular record, record count, and latest refresh date). First Plan - Retrieving QueriesIn the first plan, functions and variables are applied to produce a .sql file that contains the JDBC reader query to be used.As an example, functions can include getting the current date to apply a

1082
kayhan.turker
Ataccamer
1 month ago
Albert de Ruiter
Star Blazer L2
Albert de RuiterStar Blazer L2
asked in Data Quality & Catalog ⚙️
Text File Writer: adding a datetime as suffix to an output file

Hey all,I was wondering if you ever came accross the following requirement and has some tips maybe to implement it.The Text File Writer step can be used to create for instance log files. For tracking or governance reasons it may be necessary to keep all log files. But because the output file name is fixed, each time the file will be overwritten whenever a new one is created. Of course it is possible to manually add a datetimestamp to the file name after its creation, but that is a rather cumbersome approach. So I would like to be able to add a datetimestamp to the file name automatically. Does anyone have a suggestion?Kind regards,Albert

1096
Albert de Ruiter
Star Blazer L2
1 month ago
O
Star Blazer L1
OjaswiniStar Blazer L1
asked in Data Quality & Catalog ⚙️
Environment variable $environment$ variable in the subject line in RDM notification

Hello,Has someone used $environment$ variable in the subject line in RDM notification or any other notification emails? We are experiencing an issue with the RDM when using the environment variable within our email notification template. When we configure the template to include $environment$ in the subject line, the received emails do not display the variable.  Thanks,Ojaswini

644
A
Ataccamer
1 month ago
K
Ataccamer
KaterinaAtaccamer
published in Data Quality & Catalog ⚙️
Enhancing Data Quality Evaluation with Component Rules in ONE Web

Speaking about data quality rules, we usually refer to DQ rule configuration in ONE web application. However, when it comes to referencing external sources or performing preliminary work or combining different sources, we may find that the capabilities within ONE Web are insufficient for our needs. For example, consider a scenario where we need to validate whether our data matches an external data source, such as ABN Lookup on https://abr.business.gov.au/. This is where component rules come in handy.The Task at Hand: Validate ABN Information.To implement this data quality (DQ) check, we require a component rule.Here's how you can configure the ABN validation component and use it for DQ evaluation: ​​​​​​​Configure a placeholder for the component Configuring Logic for the Component using ONE Desktop application Adding Changes to Runtime Configuration in ONE Web Application Configuring the DQ component rule Applying the Rule​​​​​​​Configure a placeholder for the componentNavigate to DQ s

2517
anna.spakova
Ataccamer
1 month ago
R
Data Voyager
ritguptaData Voyager
asked in Data Quality & Catalog ⚙️
Metadata Reader Plan to Export Column Names

Hi,I am looking for a plan to export column names for a catalog item in One Web. Can someone help me with it?Thanks

542
ivan.kozlov
Ataccamer
1 month ago
R
Data Voyager
RoelantVosData Voyager
asked in Data Quality & Catalog ⚙️
Reproducing the Term level Data Quality overview from GraphQL

Hi Ataccama community,I’m hoping someone with better grip on the Ataccama GraphQL model can shine a light on this. For internal reporting, we are looking to retrieve data quality details via the Ataccama GraphQL API. One of the requests it to produce an overview of the DQ score across the (rule’s) DQ dimensions. This is basically the same as is shown in the web UI when navigating to the ‘Data Quality’ tab for a Term. It shows the score broken down by dimensions, based on how the rules are defined.What I’m trying to do is retrieve the passed/failed rows at this level, so for each term and each dimension. This would allow me to summarise this into a score per dimension.However,  I am unable to get this out of the API.I’ve approached this from both the ‘terms’ and ‘rules’ pathway. In both approaches I always end up with the ‘Overall Quality’ score for each term - not the per dimension details.The ‘rules’ query looks promising, but ultimately only returns the passed/failed records for the

974
R
Data Voyager
1 month ago
R
Data Voyager
Raj YalakaData Voyager
asked in Data Quality & Catalog ⚙️
How to Add Date Parameter to output file extension

Hi, I’m trying to add the data value to the file extension in the component but I’m not able to get the expected results. I have added a new string column using alter format step (tostring(today(), 'yyyy-MM-dd'). When I pass the column as $date or ${date} in the output filename, I’m not seeing the data on the output filename. 

2034
S
Ataccamer
1 month ago

Badge winners

  • First idea 💡
    Roman Tobisekhas earned the badge First idea 💡
  • First idea 💡
    keithjankehas earned the badge First idea 💡
  • First idea 💡
    Elliehas earned the badge First idea 💡
  • First idea 💡
    David Suenhas earned the badge First idea 💡
  • First idea 💡
    clyormzhas earned the badge First idea 💡
Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings