Skip to main content

Data Quality & Catalog ⚙️

Discuss, learn, ask, suggest, share all things DQ&C 🔍

  • 786 Topics
  • 2,012 Replies
786 Topics
K
Data Enthusiast
kpillaiData Enthusiast
asked in Data Quality & Catalog ⚙️
Need Upper case Property

When I add a property cdeIndicator its displaying as Cde Indicator. I want it to display as “CDE Indicator” how to do that in metadata model?​@anna.spakova , ​@Catherine 

132
K
Data Enthusiast
Satya
Universe Traveller
SatyaUniverse Traveller
asked in Data Quality & Catalog ⚙️
Component created and published by me is not finable/searchable by my teammates either Desktop or Web. What could be causing this issue?

Hi,I have created a VCI along with its component though One Desktop and published it successfully.Now, my teammates are unable to find the component, but they could find the VCI in both Desktop and Web and they are able to utilize the VCI as well. Any information regarding this would be helpful. Thanks!Note: Ataccama V15.4 

456
anna.spakova
Ataccamer
E
Universe Traveller
EmmanuelFUniverse Traveller
asked in Data Quality & Catalog ⚙️
How to utilize CSRF Token which is returned in the header for JSON Call

Currently I have two plan files. The first one retrieves the CSRF Token (In the response debug file). The second one uses the response debug file and extracts the Cookie and the CSRF Token but when I pass these two to the JSON Call in the final step to write some data to SAP. I get the CSRF Token Validation failed.I am extracting these from the Response debug file and passing them in another JSON Call: Any suggestions on how to solve this issue?

162
E
Universe Traveller
T
Data Voyager
ThanujaData Voyager
asked in Data Quality & Catalog ⚙️
Design call back mechanism for MDM failures in Ataccama one desktop

whenever MDM encounters errors mdm needs to have call back mechanism where mdm sends out trace_id and source_id back to the queue for each failures.Is there a recommended approach to identify records that were not processed—along with their associated trace_id and source_id—and requeue them for reporting purposes?

110
T
Data Voyager
M
Star Blazer L1
mp_ataccamauserStar Blazer L1
asked in Data Quality & Catalog ⚙️
Unable to use the config file provided, exiting. - error

how to resolve ‘Unable to use the config file provided, exiting.’ error

384
K
Data Enthusiast
ViLas
Data Voyager
ViLasData Voyager
asked in Data Quality & Catalog ⚙️
Masking privacy data for certain users

Is it possible to mask data for some users, for example out of privacy reasons?I know masking was a feature in version 1 and for some reason was removed in Gen 2, but how could this still be achieved as it is a much asked requirement, that certain users should not see certain attributes and no, I don't want to create a VCI copy of each asset that has such columns and replace that column with some dummy value, that's not masking.

1454
ViLas
Data Voyager
M
Star Blazer L1
mp_ataccamauserStar Blazer L1
asked in Data Quality & Catalog ⚙️
In V15.4 Is there any way we can add weight/impact of any rule in overall data quality score other than score option.

Hello,I am using Ataccama V15.4 I am trying to set criticality of certain rules in monitoring projects based on which the overall quality of my datasets should be defined.I tried using score option but IDK it’s not as convincing as setting levels like sev 1,2 etc.Thanks.

494
anna.spakova
Ataccamer
A
Ataccama Community AdminIntergalactic Expert
published in Data Quality & Catalog ⚙️
Working with Data Quality (DQ) Rules - Part 2️⃣
Working with Data Quality (DQ) Rules - Part 2️⃣Best Practice

Hi community! We hope you’ve found some useful insights in the first part of our Working with Data Quality Rules article. Check it out below if you haven’t seen it already or if you need a refresher!In this post, we will focus on duplicating rules, scoring records, and creating rules from mask, patterns, and frequency analyses. Let's dive in! Duplicating RulesDuplicating rules can save you time and effort, especially when you have similar rules that need to be assigned to multiple lookup files. Follow these steps to duplicate a rule:Navigate to the rule you want to duplicate. Expand the "More Options" menu and select "Duplicate."   A copy of the rule will open in a new tab with the settings already populated.   Edit the information as required and click "Save."Power users can also perform this action via API. Scoring RecordsScoring records helps you assess the severity of data quality issues. The score represents the numeric expression of each record's invalidity according to the rul

4461
I
Data Voyager
S
Data Pioneer
sumishaData Pioneer
asked in Data Quality & Catalog ⚙️
Timestamp in file name

Hello. I am trying to create a workflow which runs DQC and send .csv file via email. And it works fine. Challenge is - I need to add current date in file name as well when it is sent via email. I need guidance on how to do that. Thanks.

252
D
Space Explorer
M
Universe Traveller
MelUniverse Traveller
asked in Data Quality & Catalog ⚙️
Loading Table in a Crosstable / Transposed way

I am looking for a way to load data that has many columns that keep changing.  For Example the first 2 columns would be the qualifier fields and all columns after that would be an attribute:  example fromto having it like this It is possible to create with an excel file reader and an Alter format step, but the columns will be different in the next file and if no Oranges were taken that column will not be in the file so the job will fail.  Also the actual number of ever changing columns can be anything from 20 to 400 - so setting your qualifier fields and automatically adding anything that comes after that as an Attribute field seems like the solution I need.Anyone have any ideas?

322
M
Universe Traveller
M
Star Blazer L1
mp_ataccamauserStar Blazer L1
asked in Data Quality & Catalog ⚙️
Question related to auto population of email recipients in Email notification in Ataccama v15.4

Hello, I am using the email notification option from Ataccama on completion of monitoring projects. At present, I am manually configuring the recipients list of the email notification but would like to know if it could be automatically populated using the ownership/stewardship details provided on the monitored data object? Let me know if it’s possible?Thanks!

261
anna.spakova
Ataccamer
O
Universe Traveller
onufryUniverse Traveller
asked in Data Quality & Catalog ⚙️
How to Change Column Order or Display Custom Table in Detailed Results of Monitoring Project Reports Tab?

Hi,I'm currently working on customizing the layout of the monitoring project reports, especially within the Reports tab that displays detailed DQ results and anomalies. I want to change the order of columns in the detailed results view—for example, I’d like the "Dimension" column to be the second column.I’ve tried editing the page template for the project.Reportpage, but there don't seem to be many options available after this point to control column order or presentation. Has anyone successfully reordered columns in this view? Is it possible through deeper configuration, or are we limited by the template’s default structure?If direct reordering isn’t supported, is it possible to create another table within Ataccama that contains the same data but in a custom order? If so, what’s the best approach?Any guidance or best practices from those who have dealt with similar requirements would be greatly appreciated!Thank you!

260
O
Universe Traveller
H
Universe Traveller
Hanish NUniverse Traveller
asked in Data Quality & Catalog ⚙️
Can we get results via API at column level where filter is applied in MP.

Can we get results at column level where filter is applied. For ex: For Ashville city total records are 6 and failed is 1. Similarly at each rule level passed and failed count.  Like this we have to get results of all the cities present in that column. 

303
anna.spakova
Ataccamer
jdordregter
Data Voyager
jdordregterData Voyager
asked in Data Quality & Catalog ⚙️
Get metadata from json blob

Hi!I want to extract json schema from a json blob that is stored in a binari datatype field in sql server database. A lot of the fields in my schema are optional, though I want a total overview of all available fields and the entity they belong to. All is now stored in one field, but I want to use the schema to create a data source structure through which I can navigate and ideally also get profile & dq insights from. How can I achieve this? Is there something out of the box available for this?Kind regards, Jur Dördregter

311
anna.spakova
Ataccamer
N
Data Voyager
NithaMData Voyager
asked in Data Quality & Catalog ⚙️
Data Quality Rules using API calls

Hi There, We would like to know if the below mentioned Data Quality rules can be exposed as an API through Ataccama One App or One Desktop. Data Quality rule which calls a third party service - say loqate for address validation. Our understanding is that we have to write a plan to invoke loqate. Is there a way to expose this plan as an API to front end application? The usecase here is for the application to call Ataccama for all data quality validations through API calls. If it can be, could you please share the steps? Are there any known challenges? Lookup data quality rules - Can lookup DQ rules be exposed as an API using the steps in DQ Firewalls :: Ataccama ONE

421
Maria Echeverria Maldonado
Ataccamer
A
Data Voyager
AchavvaData Voyager
asked in Data Quality & Catalog ⚙️
Rule failing on an monitoring Project

COE(Close) date must not be in future and must be after sales date.The COE date is in DATETIME and Sales date is in Date format in table. So I created a rule as [SALES Date] IS NOT NULL AND [SALES Date] <= toDate([COE DATE]), but the Monitoring project is failing when added this rule on sales date  

101
E
Ataccamer
Q
Data Voyager
Quamar HasanData Voyager
asked in Data Quality & Catalog ⚙️
How to Create Catalog items (to apply Ataccama Rule/Run Monitoring projects) while source is XML file.

I need to create Catalog items while my source is distinct XML file.Is there any existing process or we need to create new framework .Please explain detail solutions to work on this requirement.

231
I
Ataccamer
J
Data Voyager
Jukanti VishwasData Voyager
asked in Data Quality & Catalog ⚙️
Guidance Needed: Connecting to Microsoft Fabric in Ataccama Desktop

Hello Community,Could you please guide me on how to connect to Microsoft Fabric from Ataccama Desktop? What are the prerequisites or requirements for this connection? Could you also share the detailed steps involved in setting it up? Thank you in advance for your support!

370
J
Data Voyager
K
Data Voyager
karangalepranavData Voyager
asked in Data Quality & Catalog ⚙️
DQ rule on Date Validation

How can we write a data quality rule to check if given date in attribute falls on Sunday or not. If it falls on Sunday, it should pass else it should fail.

272
K
Data Voyager
OGordon100
Ataccamer
OGordon100Ataccamer
published in Data Quality & Catalog ⚙️
📚 Guide: How to run GraphQL requests - Part I
📚 Guide: How to run GraphQL requests - Part I

Hi community 👋 Ever wondered about the best ways to authenticate GraphQL requests while maintaining security and efficiency?Whether you’re new to Ataccama ONE or looking to optimize your workflows, here’s an approachable guide to using Service Principle and various authentication methods.In this first post of two part GraphQL series, I will share authentication types & which one you should use and how to authenticate GraphQL requests. Second part will be on how to work with MMM in GraphQL - so watch out this space for that!Let’s get into it👇 ⚙️API authentication User Accounts vs Service Principles User accounts and service principals serve different purposes in identity and access management. User accounts are designed for (unsurprisingly!) human users, providing them with access to applications and resources based on their roles and permissions. These accounts typically require interactive login with credentials like usernames and passwords. Service Principals, on the other hand

3451
T
Data Voyager
kayhan.turker
Ataccamer
kayhan.turkerAtaccamer
published in Data Quality & Catalog ⚙️
Adding a DQ Check to a Monitoring Project with ONE API
Adding a DQ Check to a Monitoring Project with ONE API

Hello everyone!With this post, I wanted to go through a use case that I found a solution for that may help others, so I thought I’d share. The goal with this is to assign DQ checks to Monitoring Projects using a ONE API call instead of doing it manually. I’m going to assume the following: that you’ve already made monitoring project and DQ rules you’re interested in, and a catalog item has already been added to the monitoring project.The GraphQL query will be a mutation that applies the DQ check to your attribute. It will use variables to indicate where this check should be applied. I’ll explain where to get all of these variables belowThe last section will briefly go through how to run the queries using Ataccama Playground. Query to Apply DQ CheckThe query used to apply the DQ check is provided in the file mutation SaveEntity_projectCatalogItemInstance.txt and the variables which will be necessary to include for this query to work, are in the mutation variables.txt file.In the variable

2451
T
Data Voyager
R
Data Voyager
RoelantVosData Voyager
asked in Data Quality & Catalog ⚙️
Query the monitoring report results at item level

I’m hoping anyone has some good GraphQL examples to share. For us, it is necessary to integrate Ataccama into our standard reporting. To do so I’m trying to get a GraphQL working that returns the scores for each item in a monitoring project. Ideally, listing out all monitoring projects and items with their scores - for the latest processing (although I’ll take all at this point and filter the old ones later). This is all about the statistics (# records passed/failed etc. not the individual results - I am aware I can create post-processing plans to export data, but this is not applicable here).It’s basically the overview from the report tab in the monitoring project, at item level:I can get everything I need, including the total row count except the passed or failed figure. I have tried and looked at all GraphQL examples everywhere, including ONE API :: Ataccama ONE, and have pieced this together based on the structures visible in the desktop app. Things like DqAggregationResultOverTime

893
A
Data Pioneer
B
Data Voyager
bobparryData Voyager
posted in Data Quality & Catalog ⚙️
Home Page/Landing Page for Data Consumers

Hello!Does anyone have any ideas for how to make a welcoming and useful Home page for Data Users coming to Ataccama just for data discovery? All of the widgets seem to be focused on Data Stewards, but the majority of users arriving on to Ataccama for us are looking to find data to work with, so widgets like Tasks, Processing Centre, Notifications, and even the Getting Started ones are just confusing to them. I’m looking into making a Report that just acts as a welcome page for those new users, but haven’t been able to make anything that nicely introduces the platform without putting too much in front of them. Let me know if anyone’s done something like this before!

40
B
Data Voyager
S
Data Pioneer
sgillaData Pioneer
asked in Data Quality & Catalog ⚙️
OmniGen - changes for change in server ip address

What steps do we take when the both omnigen and DQS are moved to a different IP address. I tried updating the .plf(license file) but it did not work. Seems like there are more steps associated when the application is moved.

102
S
Data Pioneer
B
Data Voyager
bobparryData Voyager
asked in Data Quality & Catalog ⚙️
Automating Group ID Retrieval via ONE Metadata Reader

Hi everyone! I’m currently working on importing terms from ONE Desktop into the ONE web application, and everything’s been going smoothly so far. However, I am running into some challenges related to the Groups metadata. Right now, we're using an excel reader, reading a reference table that contains our organization’s existing Group names and the Group IDs, and joining that to a glossary term intake spreadsheet. However, our organization is expected to create many more stewardship groups, and the current excel spreadsheet containing the group names and IDs will have to be updated each time a new group is created which can be timely and error-prone.  I wanted to test how we could reference Groups, especially when working with glossary term intake spreadsheets that list Group names but not their corresponding IDs. At the moment, I'm trying to read the Group entity type in the ONE Metadata Reader, which works well but the only output I can find is the Parent Group ID, rather than the requ

253
anna.spakova
Ataccamer

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings