Discuss, learn, ask, suggest, share all things DQ&C π
Recently active
In Ataccama One web we can downloadΒ Canada.lkp but on Ataccama Desktop we could not find this file (searched on drive C: as well).Where are these lookup tables stored?How to get a complete list of all of them?Thanks!
Heard about Ataccama x Snowflake pushdown and wondering how to leverage it?Youβre in the right place. In this guide, weβll walk through what Snowflake pushdown is, why it matters, and how to get started with it using Ataccama.What is Snowflake pushdown?Run processing directly in Snowflake by enabling pushdown. Pushdown allows Ataccama to offload data processing tasks directly to Snowflakeβright where your data lives. That means faster performance, better security, and less infrastructure overhead.Why use pushdown processing?Enabling pushdown unlocks multiple benefits:π Performance: Evaluate millions of records in seconds. No need to pull large datasets into external servers for processing. π Security: Processing is executed inside Snowflake. Results (and invalid samples, if configured) are returnedβno external data transfers required, all processes run on secured and governed Snowflake warehouses. π₯οΈ Infrastructure: Leverage your existing Snowflake environmentβno need to set up or m
Hi,ONE Web > Monitoring ProjectI have a MP A which contains 7 CIs, I want to copy this MP to create MP B. For MP B I only want to use 6 out of the 7 CIs as the last CI is unnecessary. I use the import configuration (great qol btw) and for the 7th CI I use same CI.After the import configuration has been completed I delete the 7th CI from the MP. Inside the Report tab I still see that same CI appear which is not ideal. You'd think clicking the three dots besides it lets me Delete it from the page, but to my surprise that option is greyed out. How do I get rid of this CI from the Report page?βββ
Hi everyone πBy default, Keycloak admin access is limited to a single account with fixed credentials provided by Ataccama. But just as we recommend using SSO for logging into the Ataccama platform, itβs also best practice for Keycloak administrators to log in the same wayβfor better security, auditability, and ease of access.Β Hereβs a quick guide to help you set up and enable SSO login for Keycloak admins πΒ 1οΈβ£ Set up admin access in KeycloakFirst, log in to your Keycloak instance using the default admin credentials at:<your_env>/authOnce logged in:Switch to the ataccamaone realm Go to the Realm Roles tab Decide whether to use an existing role (e.g., admin) or create a new one (e.g., Keycloak_Admin) based on your security requirements2οΈβ£ Assign the right permissionsOpen the role you've selected or created:Navigate to the Associated Roles tab and click Assign Role Under Filter by, select ClientsNow assign the appropriate permissions. At a minimum, these should include:manage-acc
Can weΒ fetch Rule and Catalog item metadata from a monitoring project usingΒ Graphql API ? If yes, can you share the Graphql query ? I could not find it on ONE API Documentation
Is anyone able to provide guidance on how to make the businessDefintion a required field when creating new terms?Β
Hi,In ONE Web Monitoring Project there's an export tab with an export funcationality build within ONE Desktop. In ONE Desktop there's an output location.Might be an easy question, but how can I select an output location for the invalid records in this case to be send to a location inside my file directory? So basically what I want is the .csv/.xlsx file that come from invalidRecords to be sent automatically to a file directory folder I created. I understand the file can be downloaded from the Ataccama ONE Web export tab, but our customers have no use for this as the downloaded file will be downloaded in a file directory outside their working environment. Automatically moving the export invalid records to a file directory which they can access is a better solution in this case.
Can we add reference data in case statement in Computed content?
Hi,I want to create DQ rule to check data within same column. For example, from below table, I want to check if Value of Category B is >= Value of Category D.How can I do this in the Ataccama One UI?Β ThanksCategory Value A 5 B 2 C 6 D 4
Hi everyone,Β Β We're excited to share highlights from our very first Community Spotlight event, where we heard directly from β@Albert de Ruiter, Lead Data Management at Stater, the largest mortgage service provider in the Netherlands.Albert took us on a deep dive into how his team tackled glossary customization in Ataccama ONE to better reflect their business logic and metadata needs. With over 25 years of experience in data, Albert brought both expertise and practical insights to the session.Β π‘ Here are some key takeaways: Why customize the glossary? Stater needed different metadata for catalog items and their attributesβcustomizing allowed them to reflect these distinctions clearly. Custom term types: They introduced entity terms, attribute terms, and business terms to better align with their logical data model. Reusability with relationships: Using relationship types ("roles"), they elegantly modeled attributes that appear in multiple entitiesβlike keys, foreign keys, and descri
We need to extract the Rule and other Metadata from Monitoring project. Below is the set of Metadata Information that is requiredDQ Rule UIDΒ - Ataccama system generated unique identifier of Data Quality rule Name of DQ Rule Definition of DQ Rule Threshold DQ Dimension DQR Owner DQ Rule Start DateΒ DQ Rule End Date DQ Rule CreationΒ Date DQ Rule Modified Date
Can we get the metadata of one rule instance. I have been using below query. It is giving all the dq checks. I want to pass only one DQ check ID and get the results.Β query{Β Β ruleInstances(versionSelector: {draftVersion: true}){Β Β edges {Β Β Β node {Β Β Β gidΒ Β Β draftVersion {Β Β Β Β nameΒ Β Β Β displayName,Β Β Β Β targetΒ Β Β Β {Β Β Β Β Β gidΒ Β Β Β }Β Β }Β Β }Β Β }Β }Β }Β Can anyone help me on this?
After testing manually createdΒ asset type/properties/relation in DEV environment, how to promote these change to high environment?
Hello!Does anyone have experience using the Iterate tool within the Ataccama Desktop, when creating a workflow? Iβve found a couple of old community posts referring to it, along with the files theyβve used, but I canβt get it to work in my environment. see the following:Iterating rows of a table (Record-by-record - SQL Iterator) in a workflowBased on that post and my testing, it seems like the Iterate tool needs to call another workflow, so Iβm calling another .ewf file that just has the Run DQC tool, which runs the .plan file. Iβm able to succeed in running the .plan file from the Run DQC .ewf, however i canβt seem to get the Iterate tool to run, without getting Configuration errors, like the following:12.03.2025 15:30:51 [INFO] Task 'Iterate' : failed with exception: com.ataccama.adt.internal.core.runtime.EwfConfigException: Configuration contains errors, exitingjava.lang.RuntimeException: com.ataccama.adt.internal.core.runtime.EwfConfigException: Configuration contains errors, e
Hello ,please advise on the steps required to perform a bulk upload of business or report terms to the Business Glossary page?Additionally, is it possible to deploy the glossary content to a higher environment (e.g., from Dev to QA or Prod), or do we need to manually replicate the same steps in each environment
in One Desktop we will get the summary of DQ checks like if the column is empty or if the column (salary) is having greaterΒ than defined. For each and every record it will show the record which got failed in the output of Data Quality indicator . My question here is How to achieve Primary key violated here ? i will show with an example.Β Β Β
Hi everyone,Β Β This weekβs last best practice is on how to import terms from ONE Desktop π₯οΈΒ In data governance, importing terms is a crucial step. Using ONE Desktop, you can streamline this process by batch-importing terms into your ONE Web Application instance. This guide walks you through the process of importing terms from a CSV file into your ONE instance using the Text File Reader and ONE Metadata Writer steps. Please note that while we use the Text File Reader in this example, you can choose alternative input steps like JDBC Reader or ONE Metadata Reader.Step 1: Prepare Your Term FileBegin by preparing your term file. In this example, we have a CSV file called party.csv, which contains several terms:Β Step 2: Create a New PlanCreate a new plan in ONE Desktop. Simply drag and drop your term file into the plan. This action will automatically generate a new Text File Reader step.Β Step 3: Edit Text File Reader PropertiesEdit the properties of the Text File Reader step:In the Columns s
Hello!Β I am trying to think of a way through building a single post processing plan and or component that is able to be applied to every monitoring project in my ecosystem. It is a very simple plan, I will just have a filter for when invalid_rules_explanation is not null, and export to a default CSV location. The issue I am running into is that in all documentation, it is project / catalog specific when setting up a post processing plan. For a company with numerous projects and catalogs (around 500 unique configurations and more coming), I do not want to manually have to create the same post processing plan for every project and catalog. Is there a way to automate this, or have something within the UI of the web version that would allow me to do this more seamlessly?
I am performing deduplication for which am using matching step. I have configured it using name attribute to find duplicate with jarowrinkler() but getting a runtime error.Here isΒ the configuration details -Β Here the error message -Β Not getting any error warnings on any step,Β configure window within my plan file.I appreciate any assistance you can provide.Thanks for taking the time to look into this.Your help is greatly appreciated.
Is there any way to give some logical name to the catalog item which is added in MonitoringΒ Project. Actual catalog name and the catalog instance name present in MP should be different. IsΒ that possible?
Hi I'm Srija, Solutions Consultant here at Ataccama.In this post, Iβll walk you through how to use a dynamic expression assigner.Β What is a dynamic expression assigner?The Dynamic Expression Assigner in Ataccama allows you to define dynamic expressions or rules to determine how values are extracted or assigned to specific attributes based on conditions present in your data.Β Use Case:The Monitoring project results will give the attributes , Invalid DQ rules and Invalid DQ Attributes for the failed rows. If we need to extract the DQ Error Attribute Value based on the Invalid DQ Attribute then Dynamic Expression Assigner can be used in the post processing plan.In the below example, I have a DQ_Error_Attribute which is causing the issue for that record. If I need to extract the respective value of the DQ_Error_Attribute then, I can use the Dynamic Expression Assigner.Β We can achieve this using a column assigner, but we must hardcode the attributes to extract the value. If any new attribute
I want to find out missing values in the columns.Β Use case, column called colors which has values as [βORANGEβ,βBLACKβ,βBLUEβ] and rule is if RED is not part of column values, then Rule should fail and alert that RED color is missing in table.Β
Hi,Β we are making use of reconciliation projects to compare two different dataset with eachother. Most of the data needs to be compared, but some fields we want to skip in the comparison.Β is it possible to skipp certain attributes in the comparison (we got some mutation dateΒ fields that show differences, but are no importance) is it possible to distinguish in notification between some attributes missing and data showing differences (Dataset A has a few extra attributes then Dataset B, but all other data should be exactly the same). I don't want daily notifications that I am missing these attributes, but I do want a notification when the data is showing differences.kind regards, Jur DΓΆrdregter
There is column called Sales Amount (Long Data type). It has values in decimal point. I wanted to create a DQ evaluation rule that It should have exact two places decimal point.Β I tried to create rule by converting long to string and validated length after decimal point as 2 but failed for values 1.00 or 2.10 or 0.00 as conversion to stringΒ change value from 0.00 to 0, 1.00 to 1 or 2.10 to 2.1Β Β Is there any way to implement this?
Hi, This file is comma separated with header and β text qualifiers and keeps failing as below with a long line error. The data is from an MSAccess table with specific column widths not the default 255 in length. I have tried a number of times to no avail.Any assistance would be most welcome.2025-04-10 16:27:04 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'properties.encryption.keystore' property not specified2025-04-10 16:27:04 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'internal.encryption.keystore' property not specified10.04.2025 16:27:04 [INFO] Using following licenses:10.04.2025 16:27:04 [INFO] /data/ataccama/one/dpe/license_axaUK_PROD-dpe-bde_v14_subscription_updated.plf10.04.2025 16:27:05 [INFO] running job 2f1568e2-0000-7000-0000-00000026b0c8 (14-CRESTDSS POLICY AND POPULATION.txt)10.04.2025 16:27:05 [DEB
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.