Discuss, learn, ask, suggest, share all things DQ&C π
Recently active
Can we get results at column level where filter is applied. For ex:Β For Ashville city total records are 6 and failed is 1. Similarly at each rule level passed and failed count.Β Β Like this we have to get results of all the cities present in that column.Β
Hi!I want to extract json schema from a json blob that is stored in a binari datatype field in sql server database. A lot of the fields in my schema are optional, though I want a total overview of all available fields and the entity they belong to. All is now stored in one field, but I want to use the schema to create a data source structure through which I can navigate and ideally also get profile & dq insights from.Β How can I achieve this? Is there something out of the box available for this?Kind regards, Jur DΓΆrdregter
Hi There,Β We would like to know if the below mentioned Data Quality rules can be exposed as an API through Ataccama One App or One Desktop.Β Data Quality rule which calls a third party service - say loqate for address validation. Our understanding is that we have to write a plan to invoke loqate. Is there a way to expose this plan as an API to front end application? The usecase here is for the application to call Ataccama for all data quality validations through API calls. If it can be, could you please share the steps? Are there any known challenges? Lookup data quality rules - Can lookup DQ rules be exposed as an API using the steps inΒ DQ Firewalls :: Ataccama ONE
COE(Close) date must not be in future and must be after sales date.The COE date is in DATETIME and Sales date is in Date format in table. So I created a rule asΒ [SALES Date] IS NOT NULL AND [SALES Date] <= toDate([COE DATE]), but the Monitoring project is failing when added this rule on sales dateΒ Β
I need to create Catalog items while my source is distinct XML file.Is there any existing process or we need to create new framework .Please explain detail solutionsΒ to work on this requirement.
Hello Community,Could you please guide me on how to connect to Microsoft Fabric from Ataccama Desktop? What are the prerequisites or requirements for this connection? Could you also share the detailed steps involved in setting it up? Thank you in advance for your support!
How can we write a data quality rule to check if given date in attribute falls on Sunday or not. If it falls on Sunday,Β it should pass else it should fail.
Hi community πΒ Ever wondered about the best ways to authenticate GraphQL requests while maintaining security and efficiency?Whether youβre new to Ataccama ONE or looking to optimize your workflows, hereβs an approachable guide to using Service PrincipleΒ and various authentication methods.In this first postΒ of two part GraphQL series, I will share authentication types & which one you should use and how to authenticate GraphQLΒ requests. Second part will be onΒ how to work with MMM in GraphQL - so watch out this space for that!Letβs get into itπΒ βοΈAPI authenticationΒ User Accounts vs Service PrinciplesΒ User accounts and service principals serve different purposes in identity and access management.Β User accounts are designed for (unsurprisingly!) human users, providing them with access to applications and resources based on their roles and permissions. These accounts typically require interactive login with credentials like usernames and passwords.Β Service Principals, on the other hand
Hello everyone!With this post, I wanted to go through a use case that I found a solution for that may help others, so I thought Iβd share. The goal with this is to assign DQ checks to Monitoring Projects usingΒ a ONE API call instead of doing it manually. Iβm going to assume the following: that youβve already made monitoring project and DQ rules youβre interested in, and a catalog item has already been added to the monitoring project.The GraphQL query will be a mutation that appliesΒ the DQ check to yourΒ attribute. It will useΒ variables to indicate where this check should be applied. Iβll explain where to get all of these variables belowThe last section will briefly go through how to run the queries using Ataccama Playground.Β Query to Apply DQ CheckThe query used to apply the DQ check is provided in the fileΒ mutation SaveEntity_projectCatalogItemInstance.txtΒ and the variables which will be necessary to include for this query to work, are in theΒ mutation variables.txtΒ file.In the variable
Iβm hoping anyone has some good GraphQL examples to share. For us, it is necessaryΒ to integrate Ataccama into our standard reporting.Β To do so Iβm trying to get a GraphQL working that returnsΒ the scores for each item in a monitoring project. Ideally, listing out all monitoring projects and items with their scores - for the latest processing (although Iβll take all at this point and filter the old ones later).Β This is all about the statistics (# records passed/failed etc.Β notΒ the individual results - I am aware I can create post-processing plans to export data, but this is not applicable here).Itβs basically the overview from the report tab in the monitoring project, at item level:I can get everything I need, including the total row count except the passed or failed figure.Β I have tried and looked at all GraphQL examples everywhere, including ONE API :: Ataccama ONE, and have pieced this together based on the structures visible in the desktop app. Things likeΒ DqAggregationResultOverTime
What steps do we take when the both omnigen and DQS are moved to a different IP address. I tried updating the .plf(license file) but it did not work. Seems like there are more steps associated when the application is moved.
Hi everyone! Iβm currently working on importing terms from ONE Desktop into the ONE web application, and everythingβs been going smoothly so far. However, I am running into some challenges related to the Groups metadata.Β Right now, we're using an excel reader, reading a reference table that contains our organizationβs existing Group names and the Group IDs, and joining that to a glossary term intake spreadsheet. However, our organization is expected to create many more stewardship groups, and the current excel spreadsheet containing the group names and IDs will have to be updated each time a new group is created which can be timely and error-prone. Β I wanted to test how we could reference Groups, especially when working with glossary term intake spreadsheets that list Group names but not their corresponding IDs. At the moment, I'm trying to read the Group entity type in the ONE Metadata Reader, which works well but the only output I can find is the Parent Group ID, rather than the requ
Β Hello,Iβve completed the level1 certification exam and all the 4 mandatory courses for Level 2. Iβm not able to search for the Level2 certification exam on the Ataccama academy portal. Can someone please help/guideΒ me with the required steps to complete Level2 certification exam.Thanks!
Hi,I am using email notification option on completion of monitoring projects in Ataccama v15.4Somehow the images are not displayed and the email doesnβt look good. Can someone please help me with identifying any settings in my outlook to get the images loaded when I open the auto-generated emails.Thank you,Β Β
Hi,In table βSchoolβΒ I want to check two attributes, street and house number and see if they in combination appear in table βAddressβ. I know how to make a lookup which can check if street is in reference table Address, but I want to know if the combination street + house number as a record is in another table as a record.So below record 1 is valid, but record 2 and 3 both have house numbers in Address table, but not in combination with the street. Is this possible in ONE Web?Β School street house number 1 West street 45 2 West street 47 3 West street 49 Β Address street house number 1 West street 45 2 East street 47 3 North street 49 Β
I attended this community spotlight yesterday. Will there be slides/materials from this presentation made available?
Dear members,I am struggling with a step that rather reflects query/array logic than the logic of steps available in component editor.Task is to find the maximum from a range of values. I tried to retrieve it through a dynamic query written in a Representative Creator step, see details below:L1:= round((1-(levenshtein(W_CUA1,W_CUA1_MATCH)/(max(length(W_CUA1),length(W_CUA1_MATCH)))))*100,0);L2:= round((1-(levenshtein(W_CUA1,W_CUA2_MATCH)/(max(length(W_CUA1),length(W_CUA2_MATCH)))))*100,0);L3:= round((1-(levenshtein(W_CUA1,W_CUA3_MATCH)/(max(length(W_CUA1),length(W_CUA3_MATCH)))))*100,0);L4:= round((1-(levenshtein(W_CUA1,W_CUA4_MATCH)/(max(length(W_CUA1),length(W_CUA4_MATCH)))))*100,0);L5:= round((1-(levenshtein(W_CUA2,W_CUA1_MATCH)/(max(length(W_CUA2),length(W_CUA1_MATCH)))))*100,0);L6:= round((1-(levenshtein(W_CUA2,W_CUA2_MATCH)/(max(length(W_CUA2),length(W_CUA2_MATCH)))))*100,0);L7:= round((1-(levenshtein(W_CUA2,W_CUA3_MATCH)/(max(length(W_CUA2),length(W_CUA3_MATCH)))))*100,0);L8:= ro
Hi Everyone,On the Terms page, there isΒ the views of βPublishedβ, βUnpublishedβ, and βAllβ. We have an odd scenario where about 150Β published Terms (of all types) are showing in βAllβ but not in βPublishedβ. When I search an abbreviation of these Terms, it doesnβt pick it up in Global Search.When I modify one of the Terms in limbo and the publish it, it appears in the βPublishedβ view and has all the expected Global Search functionality.Has anyone experienced this issue before, and identified an appropriate fix? Iβm trying to avoid manually modifying and published 150 Term changes.Thanks for your time and support.StuΒ Β Β
Hello,Β WeβveΒ created three files, one component file that extracts metadata from Ataccama, one workflow file which helpsΒ coordinate communication with the runtime server, and one scheduler file to control the frequency of the runs for the extraction of the metadata.Β Weβve been running into issues when trying to getΒ the files to run automatically from Ataccamaβs GitLab cloud. Note - we did reach out to the tech support team to restart the orchestration server.Β The error message weβre currently getting is as follows:Β Process finished with result code 2. Detail: Unable to instantiate the given resource provider: com.ataccama.dqc.s3.resource.S3ResourceProvider$TypeΒ Weβre unsure what this error means and how to troubleshoot it. Weβve already corrected the output location path for the text-writer steps in the component file to point to the proper s3 bucket within our organization. Any idea how we can fix this error and get the files to land in our s3 bucket?
We have some json which contains dollar signs e.g.{ "$guid": "2d5f7c9c-8e72-4f23-9538-8e07d4c5dcbc", "user": { "name": "Alice", "$guid": "e891cba7-5565-4c48-a2e1-02cd07f81f54" }, "orders": [ { "$guid": "77e4e751-80e8-470e-92c6-493361a9484f", "total": 100.50 }, { "$guid": "b1263c77-4e5f-4c1e-88e0-6df67ee99f61", "total": 250.00 } ]}I canβt get the json call step to read the $guid attribute as it just says invaild json path. Is there any work around to this?
Hi Community,Don't know if you ever have made changes to the page layout in OneWeb, but sometimes it can be an uncomfortable task: while often there is a preview option, for βcreateβ and βeditβ pages this is not the case. So after having made the changes and pressing Ctrl-s to save them, if you made a mistake it can turn out your screen will go white, without option to make a correction afterwards (yes, speaking from experience).Β Lately we had a bit of an awkward situation, that the System ChangesΒ screen in the Global Settings area was no longer accessible, showing an error message about a screen layout error. But we never applied any layout changes to the System Changes screen, so we were rather puzzled. I consulted Ataccama Support about this and I would like to share their solution.First conclusion by Support was that this was caused by an erroneous page layout from another page. Indeed we had done quite some development and experimenting (dev environment), so finally we figured out
Is there any to select multiple schedule jobs (data profiling, lookup and monitoring project) and disabled at once or enabled them at once?
Is there any way to get updated date, created date and deleted date of any entity via API. Basically we shouldΒ get the data whatever we are seeing in history tab.Please let me know if we have any API query forΒ that.
HelloCan we add custom DQ checks added by Ataccama users to the list of automatically suggested rules for a any attribute? If yes, how?Β
These are some sample records generating through the One desktop plan. Finally, these results will send to the Responsible persons who canΒ resolve these issues. So in this results, we have three issues assigned to two users, insteadΒ of sending two emails, how can we send one email to Mohit?In the Send email step, we are using HTML. Please see the below code.This is a sample email received.Β Β
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.