Skip to main content

Data Quality & Catalog ⚙️

Discuss, learn, ask, suggest, share all things DQ&C 🔍

  • 786 Topics
  • 2,012 Replies
786 Topics
M
Star Blazer L1
mp_ataccamauserStar Blazer L1
asked in Data Quality & Catalog ⚙️
Questions regarding Ataccama v15.4 DQ&G Level 2 certification

 Hello,I’ve completed the level1 certification exam and all the 4 mandatory courses for Level 2. I’m not able to search for the Level2 certification exam on the Ataccama academy portal. Can someone please help/guide me with the required steps to complete Level2 certification exam.Thanks!

315
B
Ataccamer
M
Star Blazer L1
mp_ataccamauserStar Blazer L1
asked in Data Quality & Catalog ⚙️
In EMAIL notification, images are not loaded, any suggestions on outlook settings that could be applied?

Hi,I am using email notification option on completion of monitoring projects in Ataccama v15.4Somehow the images are not displayed and the email doesn’t look good. Can someone please help me with identifying any settings in my outlook to get the images loaded when I open the auto-generated emails.Thank you,  

403
anna.spakova
Ataccamer
JTH
Data Pioneer
JTHData Pioneer
asked in Data Quality & Catalog ⚙️
Integrity check using combination of attributes

Hi,In table ‘School’ I want to check two attributes, street and house number and see if they in combination appear in table ‘Address’. I know how to make a lookup which can check if street is in reference table Address, but I want to know if the combination street + house number as a record is in another table as a record.So below record 1 is valid, but record 2 and 3 both have house numbers in Address table, but not in combination with the street. Is this possible in ONE Web? School street house number 1 West street 45 2 West street 47 3 West street 49  Address street house number 1 West street 45 2 East street 47 3 North street 49  

263
konstantinos.patikas
Ataccamer
A
Data Voyager
AH5Data Voyager
asked in Data Quality & Catalog ⚙️
Community Spotlight - DQ

I attended this community spotlight yesterday. Will there be slides/materials from this presentation made available?

244
A
Lazov
Data Voyager
LazovData Voyager
asked in Data Quality & Catalog ⚙️
Ranking numeric values in code query

Dear members,I am struggling with a step that rather reflects query/array logic than the logic of steps available in component editor.Task is to find the maximum from a range of values. I tried to retrieve it through a dynamic query written in a Representative Creator step, see details below:L1:= round((1-(levenshtein(W_CUA1,W_CUA1_MATCH)/(max(length(W_CUA1),length(W_CUA1_MATCH)))))*100,0);L2:= round((1-(levenshtein(W_CUA1,W_CUA2_MATCH)/(max(length(W_CUA1),length(W_CUA2_MATCH)))))*100,0);L3:= round((1-(levenshtein(W_CUA1,W_CUA3_MATCH)/(max(length(W_CUA1),length(W_CUA3_MATCH)))))*100,0);L4:= round((1-(levenshtein(W_CUA1,W_CUA4_MATCH)/(max(length(W_CUA1),length(W_CUA4_MATCH)))))*100,0);L5:= round((1-(levenshtein(W_CUA2,W_CUA1_MATCH)/(max(length(W_CUA2),length(W_CUA1_MATCH)))))*100,0);L6:= round((1-(levenshtein(W_CUA2,W_CUA2_MATCH)/(max(length(W_CUA2),length(W_CUA2_MATCH)))))*100,0);L7:= round((1-(levenshtein(W_CUA2,W_CUA3_MATCH)/(max(length(W_CUA2),length(W_CUA3_MATCH)))))*100,0);L8:= ro

788
Lazov
Data Voyager
S
Data Voyager
stuart.campbellData Voyager
asked in Data Quality & Catalog ⚙️
Published Terms in limbo

Hi Everyone,On the Terms page, there is the views of ‘Published’, ‘Unpublished’, and ‘All’. We have an odd scenario where about 150 published Terms (of all types) are showing in ‘All’ but not in ‘Published’. When I search an abbreviation of these Terms, it doesn’t pick it up in Global Search.When I modify one of the Terms in limbo and the publish it, it appears in the ‘Published’ view and has all the expected Global Search functionality.Has anyone experienced this issue before, and identified an appropriate fix? I’m trying to avoid manually modifying and published 150 Term changes.Thanks for your time and support.Stu   

182
S
Data Voyager
Albert de Ruiter
Rocket Pioneer L1
Albert de RuiterRocket Pioneer L1
asked in Data Quality & Catalog ⚙️
'Deleted by' details via GraphQL

Hi all,Some time ago I posted a question ('Published by' details via GraphQL) about how to make visisble who published for instance a glossary term.I noticed that like this you can't show who may have deleted the asset.Does anyone have a clue how to retrieve this details via graphQL (or in a different manner)?Kind regards,Albert

647
Albert de Ruiter
Rocket Pioneer L1
W
Universe Traveller
WesTUniverse Traveller
asked in Data Quality & Catalog ⚙️
Issues with Ataccama's GitLab Files Running Properly

Hello, We’ve created three files, one component file that extracts metadata from Ataccama, one workflow file which helps coordinate communication with the runtime server, and one scheduler file to control the frequency of the runs for the extraction of the metadata. We’ve been running into issues when trying to get the files to run automatically from Ataccama’s GitLab cloud. Note - we did reach out to the tech support team to restart the orchestration server. The error message we’re currently getting is as follows: Process finished with result code 2. Detail: Unable to instantiate the given resource provider: com.ataccama.dqc.s3.resource.S3ResourceProvider$Type We’re unsure what this error means and how to troubleshoot it. We’ve already corrected the output location path for the text-writer steps in the component file to point to the proper s3 bucket within our organization. Any idea how we can fix this error and get the files to land in our s3 bucket?

242
W
Universe Traveller
M
Data Enthusiast
monkmachineData Enthusiast
asked in Data Quality & Catalog ⚙️
Json attributes with dollar sign

We have some json which contains dollar signs e.g.{ "$guid": "2d5f7c9c-8e72-4f23-9538-8e07d4c5dcbc", "user": { "name": "Alice", "$guid": "e891cba7-5565-4c48-a2e1-02cd07f81f54" }, "orders": [ { "$guid": "77e4e751-80e8-470e-92c6-493361a9484f", "total": 100.50 }, { "$guid": "b1263c77-4e5f-4c1e-88e0-6df67ee99f61", "total": 250.00 } ]}I can’t get the json call step to read the $guid attribute as it just says invaild json path. Is there any work around to this?

354
M
Data Enthusiast
M
Star Blazer L1
mp_ataccamauserStar Blazer L1
posted in Data Quality & Catalog ⚙️
Ataccama learning and Certification path for newcomers

Hi,Can anyone please suggest the next level of certification after Ataccama ONE v15 | DQ&C Consumer Certification?Thanks in advance and Happy Learning!

331
A
Albert de Ruiter
Rocket Pioneer L1
Albert de RuiterRocket Pioneer L1
published in Data Quality & Catalog ⚙️
How to find and restore faulty page layout in OneWeb

Hi Community,Don't know if you ever have made changes to the page layout in OneWeb, but sometimes it can be an uncomfortable task: while often there is a preview option, for ‘create’ and ‘edit’ pages this is not the case. So after having made the changes and pressing Ctrl-s to save them, if you made a mistake it can turn out your screen will go white, without option to make a correction afterwards (yes, speaking from experience). Lately we had a bit of an awkward situation, that the System Changes screen in the Global Settings area was no longer accessible, showing an error message about a screen layout error. But we never applied any layout changes to the System Changes screen, so we were rather puzzled. I consulted Ataccama Support about this and I would like to share their solution.First conclusion by Support was that this was caused by an erroneous page layout from another page. Indeed we had done quite some development and experimenting (dev environment), so finally we figured out

251
A
A
Data Pioneer
akshayl09Data Pioneer
asked in Data Quality & Catalog ⚙️
Multiple job selection to schedule disable/Enable

Is there any to select multiple schedule jobs (data profiling, lookup and monitoring project) and disabled at once or enabled them at once?

395
anna.spakova
Ataccamer
H
Universe Traveller
Hanish NUniverse Traveller
asked in Data Quality & Catalog ⚙️
Get updated data and created date of any entity via API

Is there any way to get updated date, created date and deleted date of any entity via API. Basically we should get the data whatever we are seeing in history tab.Please let me know if we have any API query for that.

250
H
Universe Traveller
M
Star Blazer L1
mp_ataccamauserStar Blazer L1
asked in Data Quality & Catalog ⚙️
How to add Custom DQ rules as auto suggested rule for any attribute

HelloCan we add custom DQ checks added by Ataccama users to the list of automatically suggested rules for a any attribute? If yes, how? 

383
Lisa Kovalskaia
Ataccamer
V
Data Voyager
vishnuData Voyager
asked in Data Quality & Catalog ⚙️
How to send multiple records to one email?

These are some sample records generating through the One desktop plan. Finally, these results will send to the Responsible persons who can resolve these issues. So in this results, we have three issues assigned to two users, instead of sending two emails, how can we send one email to Mohit?In the Send email step, we are using HTML. Please see the below code.This is a sample email received.  

503
anna.spakova
Ataccamer
L
Data Voyager
lokeshpottiData Voyager
asked in Data Quality & Catalog ⚙️
Compare sql caalog vs file

i have a sql catalog in one web and i have a file in sharepoint now what is the best way to compare the contents of sql catalog and file ?will virtual catalog help ? if yes how could i do it ?  my idea is to join sql catalog and file as full join in one desktop and use this joined data as a catalog in one web application . how to do it ?

293
L
Data Voyager
T
Data Enthusiast
tyler manawesData Enthusiast
asked in Data Quality & Catalog ⚙️
How to create a column on the Terms overview page to display a referenced object array

Hello!My org wants to create a new column on the Terms overview page to display items from a referenced object array. Specifically, we want to display Data Protection Classification information there on the overview page in a column. At first, we were told this was not possible, but we have seen this done on another one of our overview pages that displays Policies, which is also a referenced object array.  This was created for us, and the json from the “Edit Page” screen looks like it is inherited from another entity. { "_type": "entity.page.listing", "children": { "_type": "entity.listing.v2" }} Here is what our current Terms overview page layout looks like:  And the JSON behind the layout: { "_type": "entity.page.listing", "children": { "_type": "relationships.hierarchyListing", "enableSelection": true, "columns": { "type": { "dataPath": [], "name": "Type", "after": "name", "renderer": { "_type": "glossary.termType.tableCell"

786
anna.spakova
Ataccamer
P
Data Voyager
pickle21Data Voyager
asked in Data Quality & Catalog ⚙️
Duplicate table Detection

HI I need to find duplicate tables by comparing the row to row from two or more than two tables. i have 300 tables i need to find duplicate tables. Please help to find this out

231
Lisa Kovalskaia
Ataccamer
M
Star Blazer L1
mp_ataccamauserStar Blazer L1
asked in Data Quality & Catalog ⚙️
Is it possible to integrate MS Teams using office 365 workflows?

Hello,I want to integrate my Ataccama monitoring results with Teams notification.I checked the below link but Office 365 connectors within Teams are retiring, that's may be why I do not see Incoming webhook on my Teams. Is there any way to set up Teams with Atacamma using workflows instead?https://docs.ataccama.com/one/latest/notifications/ms-teams-integration.html#add-incoming-webhook-to-ms-teams-channel Please suggest.

353
Lisa Kovalskaia
Ataccamer
K
Universe Traveller
kellymremzilybUniverse Traveller
asked in Data Quality & Catalog ⚙️
Monitoring Project Missing Report

Hello, I have a rule looking for unique vendors that is tied to a monitoring project.  The monitoring project is running on a regular basis; however, the report is not showing on the report tab of the monitoring project.  This is the only project I’m seeing this behavior.  Has anyone encountered this issue?  We are on version 16.1.

111
Lisa Kovalskaia
Ataccamer
A
Data Pioneer
akshayl09Data Pioneer
asked in Data Quality & Catalog ⚙️
Adding Notification to Monitoring project for all the rules

How to add notification to all the rules in monitoring Project for all the catalog items and set alert at 95% at once instead of doing it manually one by one?

436
A
Data Pioneer
W
Universe Traveller
WesTUniverse Traveller
asked in Data Quality & Catalog ⚙️
Monitoring Project Summary Exports Not Generating/Landing in S3

Last week we noticed that the export files we created for the summary results of monitoring projects are no longer generating and landing in our S3 bucket. The component/scheduler/workflow were all created by an Ataccama consultant and so we never tamper with these in ONE Desktop. One thing that recently changed is the way the DPE works with the monitoring projects. We were having trouble with scheduled monitoring projects running (they would always fail). Our platform engineer determined that the scheduled runs were going to the wrong DPE so he forced it to go to the hybrid-DPE instead. The scheduled monitoring project runs are no longer failing, but coincidentally the summary export files stopped working the same day that the scheduled runs problem was fixed. Could the change with the hybrid-DPE be the cause of the issue?

433
A
S
Space Explorer
Shefhali singhSpace Explorer
asked in Data Quality & Catalog ⚙️
toDate function in Ataccama

Hi All,toDate(Input, “yyyy/MM/dd”) function is not throwing null when I am passing value “1/1/1”. Input datatype is string.can anybody help why it takes 1/1/1 as valid date value?Regards,Shefhali

323
S
Space Explorer
E
Universe Traveller
evan.sasowskyUniverse Traveller
asked in Data Quality & Catalog ⚙️
Date Field Format Data Quality Check

Hey y’all, I was wondering if anyone had a quality rule or advice on how to construct a quality rule to check a date type field for formatting. I know there is the “matches” function for strings and that you can convert a date field to a string using “toString”, but that requires you to specify a format, which invalidates the point of the rule.The desired format is “MM-dd-yyyy”, as shown in what I’ve got so far.matches("^\d{4}-(0[1-9]|1[0-2])-(0[1-9]|[12][0-9]|3[01])$",toString(ATTRIBUTE_1, "MM-dd-yyyy"))

1407
S
Space Explorer
A
Data Voyager
Apurva KapoorData Voyager
asked in Data Quality & Catalog ⚙️
What the different types of APIs available for read and write of Metadata and Data that can be used ?

Can someone share the list of different types of APIs available for reading and writing of Metadata and Data that can be used along with their GraphQLs ?

546
A

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings