Discuss, learn, ask, suggest, share all things DQ&C 🔍
Recently active
Hi,I have created a VCI along with its component though One Desktop and published it successfully.Now, my teammates are unable to find the component, but they could find the VCI in both Desktop and Web and they are able to utilize the VCI as well. Any information regarding this would be helpful. Thanks!Note: Ataccama V15.4
Currently I have two plan files. The first one retrieves the CSRF Token (In the response debug file). The second one uses the response debug file and extracts the Cookie and the CSRF Token but when I pass these two to the JSON Call in the final step to write some data to SAP. I get the CSRF Token Validation failed.I am extracting these from the Response debug file and passing them in another JSON Call: Any suggestions on how to solve this issue?
whenever MDM encounters errors mdm needs to have call back mechanism where mdm sends out trace_id and source_id back to the queue for each failures.Is there a recommended approach to identify records that were not processed—along with their associated trace_id and source_id—and requeue them for reporting purposes?
how to resolve ‘Unable to use the config file provided, exiting.’ error
Is it possible to mask data for some users, for example out of privacy reasons?I know masking was a feature in version 1 and for some reason was removed in Gen 2, but how could this still be achieved as it is a much asked requirement, that certain users should not see certain attributes and no, I don't want to create a VCI copy of each asset that has such columns and replace that column with some dummy value, that's not masking.
Hello,I am using Ataccama V15.4 I am trying to set criticality of certain rules in monitoring projects based on which the overall quality of my datasets should be defined.I tried using score option but IDK it’s not as convincing as setting levels like sev 1,2 etc.Thanks.
Hi community! We hope you’ve found some useful insights in the first part of our Working with Data Quality Rules article. Check it out below if you haven’t seen it already or if you need a refresher!In this post, we will focus on duplicating rules, scoring records, and creating rules from mask, patterns, and frequency analyses. Let's dive in! Duplicating RulesDuplicating rules can save you time and effort, especially when you have similar rules that need to be assigned to multiple lookup files. Follow these steps to duplicate a rule:Navigate to the rule you want to duplicate. Expand the "More Options" menu and select "Duplicate." A copy of the rule will open in a new tab with the settings already populated. Edit the information as required and click "Save."Power users can also perform this action via API. Scoring RecordsScoring records helps you assess the severity of data quality issues. The score represents the numeric expression of each record's invalidity according to the rul
Hello. I am trying to create a workflow which runs DQC and send .csv file via email. And it works fine. Challenge is - I need to add current date in file name as well when it is sent via email. I need guidance on how to do that. Thanks.
I am looking for a way to load data that has many columns that keep changing. For Example the first 2 columns would be the qualifier fields and all columns after that would be an attribute: example fromto having it like this It is possible to create with an excel file reader and an Alter format step, but the columns will be different in the next file and if no Oranges were taken that column will not be in the file so the job will fail. Also the actual number of ever changing columns can be anything from 20 to 400 - so setting your qualifier fields and automatically adding anything that comes after that as an Attribute field seems like the solution I need.Anyone have any ideas?
Hello, I am using the email notification option from Ataccama on completion of monitoring projects. At present, I am manually configuring the recipients list of the email notification but would like to know if it could be automatically populated using the ownership/stewardship details provided on the monitored data object? Let me know if it’s possible?Thanks!
Hi,I'm currently working on customizing the layout of the monitoring project reports, especially within the Reports tab that displays detailed DQ results and anomalies. I want to change the order of columns in the detailed results view—for example, I’d like the "Dimension" column to be the second column.I’ve tried editing the page template for the project.Reportpage, but there don't seem to be many options available after this point to control column order or presentation. Has anyone successfully reordered columns in this view? Is it possible through deeper configuration, or are we limited by the template’s default structure?If direct reordering isn’t supported, is it possible to create another table within Ataccama that contains the same data but in a custom order? If so, what’s the best approach?Any guidance or best practices from those who have dealt with similar requirements would be greatly appreciated!Thank you!
Can we get results at column level where filter is applied. For ex: For Ashville city total records are 6 and failed is 1. Similarly at each rule level passed and failed count. Like this we have to get results of all the cities present in that column.
Hi!I want to extract json schema from a json blob that is stored in a binari datatype field in sql server database. A lot of the fields in my schema are optional, though I want a total overview of all available fields and the entity they belong to. All is now stored in one field, but I want to use the schema to create a data source structure through which I can navigate and ideally also get profile & dq insights from. How can I achieve this? Is there something out of the box available for this?Kind regards, Jur Dördregter
Hi There, We would like to know if the below mentioned Data Quality rules can be exposed as an API through Ataccama One App or One Desktop. Data Quality rule which calls a third party service - say loqate for address validation. Our understanding is that we have to write a plan to invoke loqate. Is there a way to expose this plan as an API to front end application? The usecase here is for the application to call Ataccama for all data quality validations through API calls. If it can be, could you please share the steps? Are there any known challenges? Lookup data quality rules - Can lookup DQ rules be exposed as an API using the steps in DQ Firewalls :: Ataccama ONE
COE(Close) date must not be in future and must be after sales date.The COE date is in DATETIME and Sales date is in Date format in table. So I created a rule as [SALES Date] IS NOT NULL AND [SALES Date] <= toDate([COE DATE]), but the Monitoring project is failing when added this rule on sales date
I need to create Catalog items while my source is distinct XML file.Is there any existing process or we need to create new framework .Please explain detail solutions to work on this requirement.
Hello Community,Could you please guide me on how to connect to Microsoft Fabric from Ataccama Desktop? What are the prerequisites or requirements for this connection? Could you also share the detailed steps involved in setting it up? Thank you in advance for your support!
How can we write a data quality rule to check if given date in attribute falls on Sunday or not. If it falls on Sunday, it should pass else it should fail.
Hi community 👋 Ever wondered about the best ways to authenticate GraphQL requests while maintaining security and efficiency?Whether you’re new to Ataccama ONE or looking to optimize your workflows, here’s an approachable guide to using Service Principle and various authentication methods.In this first post of two part GraphQL series, I will share authentication types & which one you should use and how to authenticate GraphQL requests. Second part will be on how to work with MMM in GraphQL - so watch out this space for that!Let’s get into it👇 ⚙️API authentication User Accounts vs Service Principles User accounts and service principals serve different purposes in identity and access management. User accounts are designed for (unsurprisingly!) human users, providing them with access to applications and resources based on their roles and permissions. These accounts typically require interactive login with credentials like usernames and passwords. Service Principals, on the other hand
Hello everyone!With this post, I wanted to go through a use case that I found a solution for that may help others, so I thought I’d share. The goal with this is to assign DQ checks to Monitoring Projects using a ONE API call instead of doing it manually. I’m going to assume the following: that you’ve already made monitoring project and DQ rules you’re interested in, and a catalog item has already been added to the monitoring project.The GraphQL query will be a mutation that applies the DQ check to your attribute. It will use variables to indicate where this check should be applied. I’ll explain where to get all of these variables belowThe last section will briefly go through how to run the queries using Ataccama Playground. Query to Apply DQ CheckThe query used to apply the DQ check is provided in the file mutation SaveEntity_projectCatalogItemInstance.txt and the variables which will be necessary to include for this query to work, are in the mutation variables.txt file.In the variable
I’m hoping anyone has some good GraphQL examples to share. For us, it is necessary to integrate Ataccama into our standard reporting. To do so I’m trying to get a GraphQL working that returns the scores for each item in a monitoring project. Ideally, listing out all monitoring projects and items with their scores - for the latest processing (although I’ll take all at this point and filter the old ones later). This is all about the statistics (# records passed/failed etc. not the individual results - I am aware I can create post-processing plans to export data, but this is not applicable here).It’s basically the overview from the report tab in the monitoring project, at item level:I can get everything I need, including the total row count except the passed or failed figure. I have tried and looked at all GraphQL examples everywhere, including ONE API :: Ataccama ONE, and have pieced this together based on the structures visible in the desktop app. Things like DqAggregationResultOverTime
What steps do we take when the both omnigen and DQS are moved to a different IP address. I tried updating the .plf(license file) but it did not work. Seems like there are more steps associated when the application is moved.
Hi everyone! I’m currently working on importing terms from ONE Desktop into the ONE web application, and everything’s been going smoothly so far. However, I am running into some challenges related to the Groups metadata. Right now, we're using an excel reader, reading a reference table that contains our organization’s existing Group names and the Group IDs, and joining that to a glossary term intake spreadsheet. However, our organization is expected to create many more stewardship groups, and the current excel spreadsheet containing the group names and IDs will have to be updated each time a new group is created which can be timely and error-prone. I wanted to test how we could reference Groups, especially when working with glossary term intake spreadsheets that list Group names but not their corresponding IDs. At the moment, I'm trying to read the Group entity type in the ONE Metadata Reader, which works well but the only output I can find is the Parent Group ID, rather than the requ
Hello,I’ve completed the level1 certification exam and all the 4 mandatory courses for Level 2. I’m not able to search for the Level2 certification exam on the Ataccama academy portal. Can someone please help/guide me with the required steps to complete Level2 certification exam.Thanks!
Hi,I am using email notification option on completion of monitoring projects in Ataccama v15.4Somehow the images are not displayed and the email doesn’t look good. Can someone please help me with identifying any settings in my outlook to get the images loaded when I open the auto-generated emails.Thank you,
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.