Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Hi!I want to extract json schema from a json blob that is stored in a binari datatype field in sql server database. A lot of the fields in my schema are optional, though I want a total overview of all available fields and the entity they belong to. All is now stored in one field, but I want to use the schema to create a data source structure through which I can navigate and ideally also get profile & dq insights from. How can I achieve this? Is there something out of the box available for this?Kind regards, Jur Dördregter
Hi There, We would like to know if the below mentioned Data Quality rules can be exposed as an API through Ataccama One App or One Desktop. Data Quality rule which calls a third party service - say loqate for address validation. Our understanding is that we have to write a plan to invoke loqate. Is there a way to expose this plan as an API to front end application? The usecase here is for the application to call Ataccama for all data quality validations through API calls. If it can be, could you please share the steps? Are there any known challenges? Lookup data quality rules - Can lookup DQ rules be exposed as an API using the steps in DQ Firewalls :: Ataccama ONE
COE(Close) date must not be in future and must be after sales date.The COE date is in DATETIME and Sales date is in Date format in table. So I created a rule as [SALES Date] IS NOT NULL AND [SALES Date] <= toDate([COE DATE]), but the Monitoring project is failing when added this rule on sales date
Hi all,I’m working on a Python script to fetch monitoring project results via GraphQL. My goal is to determine whether the monitoring project is 100% successful or if there are any issues.I’ve checked the documentation but can’t find the exact GraphQL query or fields that return the project’s overall success status or completion percentage.Could anyone please share: A sample GraphQL query to get the monitoring project status (success, percentage, etc.) How to execute this query using Python (e.g., with requests or any GraphQL client) Tips on parsing the response to identify if the project is fully successful or not Thanks a lot!
I need to create Catalog items while my source is distinct XML file.Is there any existing process or we need to create new framework .Please explain detail solutions to work on this requirement.
I have a lot of categories in an RDM setup. In the Web UI, is there anyway to setup “shortcuts” or bookmarks so that users can see just the tables/views/datasets in their category?Looking for suggestions/best practices here on user navigation through many tables in the RDM Web UI please.
Let’s say we currently have some tables:TableATableBTableCTableD TableA and TableB are parents of TableC, then TableC is parent of TableD.So we have:Relationship Parent Table Child Table Rel1 TableA TableC Rel2 TableB TableC Rel3 TableC TableD We are trying to get rid of Table C, so that the new relationships will be:Relationship Parent Table Child Table Rel4 TableA TableD Rel5 TableB TableD I’ve tried to deploy the model and I get validation messages of missing parent values. Trouble is TableD is quite big in RDM terms (in the magnitude of 200k rows) and I think the application is struggling to start at the moment with all these failed validations.Is there some specific alter hints that can be used or am I going to have to anticipate going into repair mode somehow?
Hello Community,Could you please guide me on how to connect to Microsoft Fabric from Ataccama Desktop? What are the prerequisites or requirements for this connection? Could you also share the detailed steps involved in setting it up? Thank you in advance for your support!
How can we write a data quality rule to check if given date in attribute falls on Sunday or not. If it falls on Sunday, it should pass else it should fail.
Hi community 👋 Ever wondered about the best ways to authenticate GraphQL requests while maintaining security and efficiency?Whether you’re new to Ataccama ONE or looking to optimize your workflows, here’s an approachable guide to using Service Principle and various authentication methods.In this first post of two part GraphQL series, I will share authentication types & which one you should use and how to authenticate GraphQL requests. Second part will be on how to work with MMM in GraphQL - so watch out this space for that!Let’s get into it👇 ⚙️API authentication User Accounts vs Service Principles User accounts and service principals serve different purposes in identity and access management. User accounts are designed for (unsurprisingly!) human users, providing them with access to applications and resources based on their roles and permissions. These accounts typically require interactive login with credentials like usernames and passwords. Service Principals, on the other hand
Hello everyone!With this post, I wanted to go through a use case that I found a solution for that may help others, so I thought I’d share. The goal with this is to assign DQ checks to Monitoring Projects using a ONE API call instead of doing it manually. I’m going to assume the following: that you’ve already made monitoring project and DQ rules you’re interested in, and a catalog item has already been added to the monitoring project.The GraphQL query will be a mutation that applies the DQ check to your attribute. It will use variables to indicate where this check should be applied. I’ll explain where to get all of these variables belowThe last section will briefly go through how to run the queries using Ataccama Playground. Query to Apply DQ CheckThe query used to apply the DQ check is provided in the file mutation SaveEntity_projectCatalogItemInstance.txt and the variables which will be necessary to include for this query to work, are in the mutation variables.txt file.In the variable
Dear Community,I have query regarding RDM approval workflow. In our project we have stages Initiator → Review → Publish .It has been noticed that when a record is invalid, its status is displayed as 'INVALID,' yet it progresses in the workflow for review. The reviewer has the option to accept this invalid record, and it moves to the Publish section. However, when the approver attempts to publish the record, an error occurs, stating that the record is invalid and cannot be published.The client is now requesting clarification on why an INVALID record is allowed to progress through these stages in the first place. They propose that it should not be permitted to move to the review state initially.Anyone faced this scenario before? Can we do something in approval workflow configuration that record should not move to review state if it is Invalid.Any help regarding this will be really helpful.Best regards,Ojaswini
I’m hoping anyone has some good GraphQL examples to share. For us, it is necessary to integrate Ataccama into our standard reporting. To do so I’m trying to get a GraphQL working that returns the scores for each item in a monitoring project. Ideally, listing out all monitoring projects and items with their scores - for the latest processing (although I’ll take all at this point and filter the old ones later). This is all about the statistics (# records passed/failed etc. not the individual results - I am aware I can create post-processing plans to export data, but this is not applicable here).It’s basically the overview from the report tab in the monitoring project, at item level:I can get everything I need, including the total row count except the passed or failed figure. I have tried and looked at all GraphQL examples everywhere, including ONE API :: Ataccama ONE, and have pieced this together based on the structures visible in the desktop app. Things like DqAggregationResultOverTime
What steps do we take when the both omnigen and DQS are moved to a different IP address. I tried updating the .plf(license file) but it did not work. Seems like there are more steps associated when the application is moved.
Hi everyone! I’m currently working on importing terms from ONE Desktop into the ONE web application, and everything’s been going smoothly so far. However, I am running into some challenges related to the Groups metadata. Right now, we're using an excel reader, reading a reference table that contains our organization’s existing Group names and the Group IDs, and joining that to a glossary term intake spreadsheet. However, our organization is expected to create many more stewardship groups, and the current excel spreadsheet containing the group names and IDs will have to be updated each time a new group is created which can be timely and error-prone. I wanted to test how we could reference Groups, especially when working with glossary term intake spreadsheets that list Group names but not their corresponding IDs. At the moment, I'm trying to read the Group entity type in the ONE Metadata Reader, which works well but the only output I can find is the Parent Group ID, rather than the requ
Hello,I’ve completed the level1 certification exam and all the 4 mandatory courses for Level 2. I’m not able to search for the Level2 certification exam on the Ataccama academy portal. Can someone please help/guide me with the required steps to complete Level2 certification exam.Thanks!
Hi,I am using email notification option on completion of monitoring projects in Ataccama v15.4Somehow the images are not displayed and the email doesn’t look good. Can someone please help me with identifying any settings in my outlook to get the images loaded when I open the auto-generated emails.Thank you,
Hi,In table ‘School’ I want to check two attributes, street and house number and see if they in combination appear in table ‘Address’. I know how to make a lookup which can check if street is in reference table Address, but I want to know if the combination street + house number as a record is in another table as a record.So below record 1 is valid, but record 2 and 3 both have house numbers in Address table, but not in combination with the street. Is this possible in ONE Web? School street house number 1 West street 45 2 West street 47 3 West street 49 Address street house number 1 West street 45 2 East street 47 3 North street 49
I attended this community spotlight yesterday. Will there be slides/materials from this presentation made available?
Dear members,I am struggling with a step that rather reflects query/array logic than the logic of steps available in component editor.Task is to find the maximum from a range of values. I tried to retrieve it through a dynamic query written in a Representative Creator step, see details below:L1:= round((1-(levenshtein(W_CUA1,W_CUA1_MATCH)/(max(length(W_CUA1),length(W_CUA1_MATCH)))))*100,0);L2:= round((1-(levenshtein(W_CUA1,W_CUA2_MATCH)/(max(length(W_CUA1),length(W_CUA2_MATCH)))))*100,0);L3:= round((1-(levenshtein(W_CUA1,W_CUA3_MATCH)/(max(length(W_CUA1),length(W_CUA3_MATCH)))))*100,0);L4:= round((1-(levenshtein(W_CUA1,W_CUA4_MATCH)/(max(length(W_CUA1),length(W_CUA4_MATCH)))))*100,0);L5:= round((1-(levenshtein(W_CUA2,W_CUA1_MATCH)/(max(length(W_CUA2),length(W_CUA1_MATCH)))))*100,0);L6:= round((1-(levenshtein(W_CUA2,W_CUA2_MATCH)/(max(length(W_CUA2),length(W_CUA2_MATCH)))))*100,0);L7:= round((1-(levenshtein(W_CUA2,W_CUA3_MATCH)/(max(length(W_CUA2),length(W_CUA3_MATCH)))))*100,0);L8:= ro
Hi Everyone,On the Terms page, there is the views of ‘Published’, ‘Unpublished’, and ‘All’. We have an odd scenario where about 150 published Terms (of all types) are showing in ‘All’ but not in ‘Published’. When I search an abbreviation of these Terms, it doesn’t pick it up in Global Search.When I modify one of the Terms in limbo and the publish it, it appears in the ‘Published’ view and has all the expected Global Search functionality.Has anyone experienced this issue before, and identified an appropriate fix? I’m trying to avoid manually modifying and published 150 Term changes.Thanks for your time and support.Stu
Hello, We’ve created three files, one component file that extracts metadata from Ataccama, one workflow file which helps coordinate communication with the runtime server, and one scheduler file to control the frequency of the runs for the extraction of the metadata. We’ve been running into issues when trying to get the files to run automatically from Ataccama’s GitLab cloud. Note - we did reach out to the tech support team to restart the orchestration server. The error message we’re currently getting is as follows: Process finished with result code 2. Detail: Unable to instantiate the given resource provider: com.ataccama.dqc.s3.resource.S3ResourceProvider$Type We’re unsure what this error means and how to troubleshoot it. We’ve already corrected the output location path for the text-writer steps in the component file to point to the proper s3 bucket within our organization. Any idea how we can fix this error and get the files to land in our s3 bucket?
We have some json which contains dollar signs e.g.{ "$guid": "2d5f7c9c-8e72-4f23-9538-8e07d4c5dcbc", "user": { "name": "Alice", "$guid": "e891cba7-5565-4c48-a2e1-02cd07f81f54" }, "orders": [ { "$guid": "77e4e751-80e8-470e-92c6-493361a9484f", "total": 100.50 }, { "$guid": "b1263c77-4e5f-4c1e-88e0-6df67ee99f61", "total": 250.00 } ]}I can’t get the json call step to read the $guid attribute as it just says invaild json path. Is there any work around to this?
Hi Community,Don't know if you ever have made changes to the page layout in OneWeb, but sometimes it can be an uncomfortable task: while often there is a preview option, for ‘create’ and ‘edit’ pages this is not the case. So after having made the changes and pressing Ctrl-s to save them, if you made a mistake it can turn out your screen will go white, without option to make a correction afterwards (yes, speaking from experience). Lately we had a bit of an awkward situation, that the System Changes screen in the Global Settings area was no longer accessible, showing an error message about a screen layout error. But we never applied any layout changes to the System Changes screen, so we were rather puzzled. I consulted Ataccama Support about this and I would like to share their solution.First conclusion by Support was that this was caused by an erroneous page layout from another page. Indeed we had done quite some development and experimenting (dev environment), so finally we figured out
Is there any to select multiple schedule jobs (data profiling, lookup and monitoring project) and disabled at once or enabled them at once?
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.