Discuss, learn, ask, suggest, share all things DQ&C 🔍
Recently active
what is the graphql mutation for creating a monitoring project in Ataccama Unable to open playground so need help with a direct graphql mutation query for creating Monitoring project
Hello Ataccama Community, I have a question regarding the possibility of using nested /consecutive backreferencing into an AQL filter . The actual question would be whether if we can create a filter on the ‘term’ entity to show only the terms which have 0 termInstances on rules . This was the initial issue because we have used this AQL Filter into a Term Report Page : @termInstance(target).count( )==0 . However, this was not enough because it did not filter only the term instances from the rules, but also the ones from the catalog item , attributes , etc. I have initially tried to place something like this : @rule.inputGroups.inputs.termInstance(target).count() = 0 , but I got an error and I am not sure if nested backreferencing is possible .After that, we changed the approach and we decided to add another entity ‘termsUsedOnRules’ and I configured it exactly the same as ‘termInstances' .Then I have added this entity as a property on the rule as an Embedded Object Array and filtering b
I am trying to create a transformation plan in DQ One Web that merges existing data in a One Data table to the most recent run from a Monitoring Project.The situation is difficult and I will try to be as concise as possible: We have a One Data table that is created from a Monitoring Project Data Remediation plan. We input notes on the One Data table that explains what needs to be done to that invalid record Every time the monitoring project is ran, the notes in that One Data table are deleted.The fix in my mind is that we could union what is currently in the One Data table (with notes) with the new remediation export in order to retain the notes on the “older” version of the One Data table, while allowing any new invalid records to be written into the One Data table.Essentially, I need to somehow create (within the transformation plans on One Web) a left outer join where everything with the current run coming in, but joining with those on the right (the older run) that has notes. Any
Hello,How to write the following condition in Ataccama Desktop (Join step):left join anl.productsjur p on (asd.creditpurpose = p.cp or coalesce(asd.creditpurpose, p.cp) is null) and (asd.creditpurpose2 = p.cp2 or coalesce(asd.creditpurpose2, p.cp2) is null) and (asd.creditobject = p.co or coalesce(asd.creditobject, p.co) is null)The difficulty is that in the join step only one field for left key and right key is available for selection..
Hi everyone! Welcome to the third (and the last) part of our introduction series! The continuing posts will be focused on diving deep into the functionalities of DQ. If you have missed the first two posts you can check them out here:In this post, we'll explore the best practices for monitoring data quality in Ataccama ONE. Monitoring your data quality allows you to track important metrics in real-time and identify potential issues. Creating a Monitoring ProjectTo create a new monitoring project, navigate to "Data Quality" and select "Monitoring Project." Click on "Create" and provide a name and description for your project. On the "Configuration & Results" tab, choose the catalog items you want to monitor. You can monitor multiple catalog items within a single project as long as it makes sense for your organization's data quality requirements. Customizing DQ DimensionsIn each monitoring project, you can customize the DQ dimensions that contribute to the overall data quality. Look f
Welcome to the first blog in a series exploring the concept and implementation of a Metadata Warehouse, hereafter referred to as MDWH.You are most likely already familiar with concepts that align with an MDWH, such as a data warehouse or a data lake. An MDWH is quite similar to a data warehouse, but focuses on exported metadata stored in another database—specifically, Ataccama’s metadata. In this scenario, there is no need to integrate data from multiple systems, because there is only one Ataccama implementation. (After all, why use more than one metadata application?😉) What are the drivers for having an MDWH?At Stater, our MDWH serves the following purposes:Reuse of metadataAtaccama is the golden source for metadata, so when details are required in different applications, they should not differ from those in Ataccama. Examples where reusing metadata is essential include Data modelsMany data models contain common entities/tables and attributes/columns, both across models and within a
Hi,I would like to know if it’s possible to automate rule creation in Ataccama without actually using UI maybe by running scripts or API calls from backend.
Hello All,I need your help on Ataccama One DQ issue.I created an accuracy rule for Zipcode using lkp table.In the lkp table, Zipcode is stored as an integer, but in the Catalog,src attribute as nvarchar(20).When building the rule, Ataccama forces me to choose integer as the data type because the lkp table uses integers.But since the Catalog attribute is nvarchar, the rule is not working. and tried with lkp as string and i/p attribute in lkp also as string which thrown an error while evaluation.I also cannot change the src attribute datatype from nvarchar(20) to integer because:If I convert it to integer using cast, NULL values will move to completeness checks,And I will not get the incorrect rows under accuracy.So I need a solution that allows the accuracy rule to work even though the lookup table uses an integer Zipcode and the Catalog column uses nvarchar.Thanks in advance.Deepali
This is my result in REST API call.I need to consume my entire REST API using the next record URL until done is set as true.How do I achieve this in Ataccama.
Hi All, We have a few SQL Catalog Items that represent data in a way that the users find intuitive (compared to the awkward way the data is stored in the source system). However, whenever I update the SQL in anyway, like to add or remove a column/attribute, all field definitions, terms, etc are removed. They can be seen in the previous version of the Catalog Item, but I have to either restore the old Catalog Item or re-enter all the definitions. Is there a way to update the SQL behind SQL Catalog Items and not impact the unchanged attributes?Thanks for any help you can provide. RegardsStu
Hello Ataccama Community,I’ve been exploring the Data Slicing feature in Ataccama 16.2 and it looks like a great tool for profiling large datasets. However, I noticed that Hive and Sybase are not listed as supported databases for slicing.Since we rely on Hive Data Lakes and Sybase in our environment, I wanted to ask if there are any plans to support these databases in future releases, or if anyone has found effective workarounds for slicing data from these sources before profiling.Looking forward to your insights! Create a Data Slice :: Ataccama ONE
Hi,We have implemented Pushdown in our application and have noticed that when we have a few DQ Rules that are not supported by Pushdown, are forced to run the whole Monitoring project in regular (non-Pushdown) mode. Even when the catalog items running pushdown un-supported rules are excluded from pushdown processing using Advanced settings on Monitoring project, still leads to those DQ Rules failing.Is there a hybrid approach to run Monitoring projects implementing a mixture of pushdown supported and unsupported DQ Rules ? Atacama should have the ability to selectively run pushdown supported DQ rules in Pushdown and non-supported in regular mode without forcing users to choose one. This should be done automatically. Please let us know if there are any suggestions.
How do I build a report to show data stewards the completeness of their respective business terms? For example, 57% of terms in the Customer domain have a Domain Owner assigned.
Hello,I need to make an API POST call where the endpoint expects multipart/form-data. The API accepts normal JSON fields as part of the multipart request, and it also requires a .csv file upload as a mandatory input.Right now, I am using a JSON call step, but that only lets me send application/json. Since the API requires multipart with both JSON and file, I’m not sure how to proceed.My Questions:1. How do I send JSON + a CSV file in a single multipart request?2. Do I need to switch from the JSON call step to a multipart/form-data step?3. If using Ataccama, which step/component should be used to construct multipart requests?
Exploring options for implementing a data pipeline from Ataccama ONE to a Power BI dashboard. Which approach is better: using the GraphQL API or leveraging the ONE Metadata Reader and DQ Monitoring Project Check Results?
Hello everyone,I am wondering if it is possible to using the catalog item reader step with the runtime server. I have a workflow that reads from two catalog items, joins them on a row and then emails the results. However, when I attempt to execute the workflow from the runtime server I receive this error: 2025-11-18 20:11:17 INFO: Validating model...2025-11-18 20:11:18 ERROR: Step is restricted to run on Environments with Launch Type: 'ONE Platform', but selected Environment has Launch Type: 'Local'. [Catalog Item Reader (Catalog Item Reader)]2025-11-18 20:11:18 ERROR: Step is restricted to run on Environments with Launch Type: 'ONE Platform', but selected Environment has Launch Type: 'Local'. [Catalog Item Reader 2 (Catalog Item Reader)]Is there a way to change my launch type on the runtime server environment or a different method I can use to read from the catalog items. Here are how my work flow and plan currently function:
i have installed ataccama one desktop but it is asking for license to execute anything. Can someone please help in providing free trial license.
I have a requirement to develop a rule that checks value of an attribute should be from a given list of values. The attribute should have at least one record of each of the list item. It should fail if any of the values don’t appear in the attribute. I cannot consider lookup as lookup will perform OR operation on the given list, instead I would like to have AND operation. e.g., list of values List1 = {1,2,3,4,’pqr’, ‘abc’}, column name = Col1Test case - Col1 should have at least one entry of each item from List1. It should fail if any of the 6 values from List1 fail to appear in Col1 values Thanks for the help in advance!
HelloI am trying to use monitoring project results to create a dashboard. OOTB functionality looks limited and allows me to create few visuals only like quality over time and failed records. But I can’t access the attributes created in report section of monitoring project: For Ex: I am looking at creating something like:
We would like to calculate weekly count of Id should not be more than +-2 standard deviation of the 6-week rolling average over week id.table attribute: week_id, id Is there any way to calculate this in ataccama One using advance expression?
!--startfragment>Hi everyone,I'm working on a plan in Ataccama Desktop where I want to automatically assign Data Quality (DQ) rules to attributes based on their associated tags (terms). My goal is to streamline DQ evaluation by leveraging the Business Glossary and ONE Metadata Writer.Here’s what I’m trying to achieve:Build a plan in Ataccama Desktop that:Reads metadata from ONE Applies DQ rules based on tags Writes back the results using the ONE Metadata WriterHas anyone implemented a similar setup?I’d love to hear best practices, tips on configuring the Metadata Writer, or examples of how you’ve mapped terms to rules effectively. Thanks in advance!Philipp !--endfragment>
Hello all,I am running into an issue when trying to grab terms from attribute items. My current use case is as follows. I have a list of catalog item that are tagged with a term (that we refer to as a jurisdiction) and I am attempting to first find all attributes associated with these catalog items and then find all terms that are tagged to these attributes. The order is as follows:Find all catalog items with term → get all attributes associated with catalog items → extract all terms on attributesMy plan looks like this: The issue that I am running into is that these plans take a very long time to run sometimes upwards of 30min to an hour depending on the term. I would like to know if there is a more efficient way to do this (either through graphql or some other components etc) or if I am simply stuck waiting with the current speed of the plan. Best Regards,Andrew
Hi,Previously we added Data Quality rules on Attribute Terms via Settings. The outcomes was not something we expected as customers could see the organisational Data Quality score. Where we expected they could see the DQ score on Attribute terms which were only available to them. Hence we removed the DQ rules on Attribute Terms, but the DQ score is still visible in certain Catalog Items. My question: how to get rid of this?
Hi,I added a DQ Rule on a boolean data type attribute inside a Monitoring Project (MP). After the attribute changed datatype I had to add a new DQ rule with string attribute, but the old DQ rule vanished. How do I get rid of the error?
Hi @anna.spakova @Lisa Kovalskaia @Ataccama Community Admin I looked into the documentation for Ataccama ONE (the Ataccama data-management platform) regarding source/connectors and could not find a clear statement that it directly supports a connector to Google Analytics 4 (GA4).Could you please confirm the possibility?
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.