Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Hello,I am using Ataccama V15.4Β I am trying to set criticality of certain rules in monitoring projects based on which the overall quality of my datasets should be defined.I tried using score option but IDK itβs not as convincing as setting levels like sev 1,2 etc.Thanks.
Hi community!Β We hope youβve found some useful insights in the first part of our Working with Data Quality Rules article. Check it out below if you havenβt seen it already or if you need a refresher!In this post, we will focus on duplicating rules, scoring records, and creating rules from mask, patterns, and frequency analyses. Let's dive in!Β Duplicating RulesDuplicating rules can save you time and effort, especially when you have similar rules that need to be assigned to multiple lookup files. Follow these steps to duplicate a rule:Navigate to the rule you want to duplicate. Expand the "More Options" menu and select "Duplicate." Β A copy of the rule will open in a new tab with the settings already populated. Β Edit the information as required and click "Save."Power users can also perform this action via API.Β Scoring RecordsScoring records helps you assess the severity of data quality issues. The score represents the numeric expression of each record's invalidity according to the rul
Hello. I am trying to create a workflow which runs DQC and send .csv file via email. And it works fine. Challenge is - I need to add current date in file name as well when it is sent via email. I need guidance on how to do that.Β Thanks.
I am looking for a way to load data that has many columns that keep changing.Β For Example the first 2 columns would be the qualifier fields and all columns after that would be an attribute:Β example fromto having it like thisΒ It is possible to create with an excel file reader and an Alter format step, but the columns will be different in the next file and if no Oranges were taken that column will not be in the file so the job will fail.Β Also the actual number of ever changing columns can be anything from 20 to 400 - so setting your qualifier fields and automatically adding anything that comes after that as an Attribute field seems like the solution I need.Anyone have any ideas?
Hello, I am using the email notification option from Ataccama on completion of monitoring projects. At present, I am manually configuring the recipients list of the email notification but would like to know if it could be automatically populated using the ownership/stewardship details provided on the monitored data object? Let me know if itβs possible?Thanks!
Hi,I'm currently working on customizing the layout of the monitoring project reports, especially within the Reports tab that displays detailed DQ results and anomalies. I want to change the order of columns in the detailed results viewβfor example, Iβd like the "Dimension" column to be the second column.Iβve tried editing the page template for the project.Reportpage, but there don't seem to be many options available after this point to control column order or presentation. Has anyone successfully reordered columns in this view? Is it possible through deeper configuration, or are we limited by the templateβs default structure?If direct reordering isnβt supported, is it possible to create another table within Ataccama that contains the same data but in a custom order? If so, whatβs the best approach?Any guidance or best practices from those who have dealt with similar requirements would be greatly appreciated!Thank you!
Can we get results at column level where filter is applied. For ex:Β For Ashville city total records are 6 and failed is 1. Similarly at each rule level passed and failed count.Β Β Like this we have to get results of all the cities present in that column.Β
Hi!I want to extract json schema from a json blob that is stored in a binari datatype field in sql server database. A lot of the fields in my schema are optional, though I want a total overview of all available fields and the entity they belong to. All is now stored in one field, but I want to use the schema to create a data source structure through which I can navigate and ideally also get profile & dq insights from.Β How can I achieve this? Is there something out of the box available for this?Kind regards, Jur DΓΆrdregter
Hi There,Β We would like to know if the below mentioned Data Quality rules can be exposed as an API through Ataccama One App or One Desktop.Β Data Quality rule which calls a third party service - say loqate for address validation. Our understanding is that we have to write a plan to invoke loqate. Is there a way to expose this plan as an API to front end application? The usecase here is for the application to call Ataccama for all data quality validations through API calls. If it can be, could you please share the steps? Are there any known challenges? Lookup data quality rules - Can lookup DQ rules be exposed as an API using the steps inΒ DQ Firewalls :: Ataccama ONE
COE(Close) date must not be in future and must be after sales date.The COE date is in DATETIME and Sales date is in Date format in table. So I created a rule asΒ [SALES Date] IS NOT NULL AND [SALES Date] <= toDate([COE DATE]), but the Monitoring project is failing when added this rule on sales dateΒ Β
Hi all,Iβm working on a Python script to fetch monitoring project results via GraphQL. My goal is to determine whether the monitoring project is 100% successful or if there are any issues.Iβve checked the documentation but canβt find the exact GraphQL query or fields that return the projectβs overall success status or completion percentage.Could anyone please share: A sample GraphQL query to get the monitoring project status (success, percentage, etc.) How to execute this query using Python (e.g., with requests or any GraphQL client) Tips on parsing the response to identify if the project is fully successful or not Thanks a lot!
I need to create Catalog items while my source is distinct XML file.Is there any existing process or we need to create new framework .Please explain detail solutionsΒ to work on this requirement.
I have a lot of categories in an RDM setup.Β In the Web UI, isΒ there anyway to setup βshortcutsβ or bookmarks so that users can see just the tables/views/datasets in their category?Looking for suggestions/best practices here on user navigation through many tables in the RDM Web UI please.Β
Letβs say we currently have some tables:TableATableBTableCTableDΒ TableA and TableB are parents of TableC, then TableC is parent of TableD.So we have:Relationship Parent Table Child Table Rel1 TableA TableC Rel2 TableB TableC Rel3 TableC TableD Β We are trying to get rid of Table C, so that the new relationships will be:Relationship Parent Table Child Table Rel4 TableA TableD Rel5 TableB TableD Β Iβve tried to deploy the model and I get validation messages of missing parent values. Trouble is TableD is quite big in RDM terms (in the magnitude of 200k rows) and I think the application is struggling to start at the moment with all these failed validations.Is there some specific alter hints that can be used or am I going to have to anticipate going into repair mode somehow?Β
Hello Community,Could you please guide me on how to connect to Microsoft Fabric from Ataccama Desktop? What are the prerequisites or requirements for this connection? Could you also share the detailed steps involved in setting it up? Thank you in advance for your support!
How can we write a data quality rule to check if given date in attribute falls on Sunday or not. If it falls on Sunday,Β it should pass else it should fail.
Hi community πΒ Ever wondered about the best ways to authenticate GraphQL requests while maintaining security and efficiency?Whether youβre new to Ataccama ONE or looking to optimize your workflows, hereβs an approachable guide to using Service PrincipleΒ and various authentication methods.In this first postΒ of two part GraphQL series, I will share authentication types & which one you should use and how to authenticate GraphQLΒ requests. Second part will be onΒ how to work with MMM in GraphQL - so watch out this space for that!Letβs get into itπΒ βοΈAPI authenticationΒ User Accounts vs Service PrinciplesΒ User accounts and service principals serve different purposes in identity and access management.Β User accounts are designed for (unsurprisingly!) human users, providing them with access to applications and resources based on their roles and permissions. These accounts typically require interactive login with credentials like usernames and passwords.Β Service Principals, on the other hand
Hello everyone!With this post, I wanted to go through a use case that I found a solution for that may help others, so I thought Iβd share. The goal with this is to assign DQ checks to Monitoring Projects usingΒ a ONE API call instead of doing it manually. Iβm going to assume the following: that youβve already made monitoring project and DQ rules youβre interested in, and a catalog item has already been added to the monitoring project.The GraphQL query will be a mutation that appliesΒ the DQ check to yourΒ attribute. It will useΒ variables to indicate where this check should be applied. Iβll explain where to get all of these variables belowThe last section will briefly go through how to run the queries using Ataccama Playground.Β Query to Apply DQ CheckThe query used to apply the DQ check is provided in the fileΒ mutation SaveEntity_projectCatalogItemInstance.txtΒ and the variables which will be necessary to include for this query to work, are in theΒ mutation variables.txtΒ file.In the variable
Dear Community,I have query regarding RDM approval workflow. In our project we have stages Initiator βΒ Review βΒ Publish .It has been noticed that when a record is invalid, its status is displayed as 'INVALID,' yet it progresses in the workflow for review. The reviewer has the option to accept this invalid record, and it moves to the Publish section. However, when the approver attempts to publish the record, an error occurs, stating that the record is invalid and cannot be published.The client is now requesting clarification on why an INVALID record is allowed to progress through these stages in the first place. They propose that it should not be permitted to move to the review state initially.Anyone faced this scenario before? Can we do something in approval workflow configuration that record should not move to review state if it is Invalid.Any help regarding this will be really helpful.Best regards,Ojaswini
Iβm hoping anyone has some good GraphQL examples to share. For us, it is necessaryΒ to integrate Ataccama into our standard reporting.Β To do so Iβm trying to get a GraphQL working that returnsΒ the scores for each item in a monitoring project. Ideally, listing out all monitoring projects and items with their scores - for the latest processing (although Iβll take all at this point and filter the old ones later).Β This is all about the statistics (# records passed/failed etc.Β notΒ the individual results - I am aware I can create post-processing plans to export data, but this is not applicable here).Itβs basically the overview from the report tab in the monitoring project, at item level:I can get everything I need, including the total row count except the passed or failed figure.Β I have tried and looked at all GraphQL examples everywhere, including ONE API :: Ataccama ONE, and have pieced this together based on the structures visible in the desktop app. Things likeΒ DqAggregationResultOverTime
What steps do we take when the both omnigen and DQS are moved to a different IP address. I tried updating the .plf(license file) but it did not work. Seems like there are more steps associated when the application is moved.
Hi everyone! Iβm currently working on importing terms from ONE Desktop into the ONE web application, and everythingβs been going smoothly so far. However, I am running into some challenges related to the Groups metadata.Β Right now, we're using an excel reader, reading a reference table that contains our organizationβs existing Group names and the Group IDs, and joining that to a glossary term intake spreadsheet. However, our organization is expected to create many more stewardship groups, and the current excel spreadsheet containing the group names and IDs will have to be updated each time a new group is created which can be timely and error-prone. Β I wanted to test how we could reference Groups, especially when working with glossary term intake spreadsheets that list Group names but not their corresponding IDs. At the moment, I'm trying to read the Group entity type in the ONE Metadata Reader, which works well but the only output I can find is the Parent Group ID, rather than the requ
Β Hello,Iβve completed the level1 certification exam and all the 4 mandatory courses for Level 2. Iβm not able to search for the Level2 certification exam on the Ataccama academy portal. Can someone please help/guideΒ me with the required steps to complete Level2 certification exam.Thanks!
Hi,I am using email notification option on completion of monitoring projects in Ataccama v15.4Somehow the images are not displayed and the email doesnβt look good. Can someone please help me with identifying any settings in my outlook to get the images loaded when I open the auto-generated emails.Thank you,Β Β
Hi,In table βSchoolβΒ I want to check two attributes, street and house number and see if they in combination appear in table βAddressβ. I know how to make a lookup which can check if street is in reference table Address, but I want to know if the combination street + house number as a record is in another table as a record.So below record 1 is valid, but record 2 and 3 both have house numbers in Address table, but not in combination with the street. Is this possible in ONE Web?Β School street house number 1 West street 45 2 West street 47 3 West street 49 Β Address street house number 1 West street 45 2 East street 47 3 North street 49 Β
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.