Data Quality & Catalog ⚙️

I am performing deduplication for which am using matching step. I have configured it using name attribute to find duplicate with jarowrinkler() but getting a runtime error. Here is the configuration details - Here the error message - Not getting any error warnings on any step, configure window within my plan file. I appreciate any assistance you can provide. Thanks for taking the time to look into this. Your help is greatly appreciated.

i have installed ataccama one desktop but it is asking for license to execute anything. Can someone please help in providing free trial license.

We need to extract the Rule and other Metadata from Monitoring project. Below is the set of Metadata Information that is required DQ Rule UID - Ataccama system generated unique identifier of Data Quality rule Name of DQ Rule Definition of DQ Rule Threshold DQ Dimension DQR Owner DQ Rule Start Date DQ Rule End Date DQ Rule Creation Date DQ Rule Modified Date

Hi, we are making use of reconciliation projects to compare two different dataset with eachother. Most of the data needs to be compared, but some fields we want to skip in the comparison. is it possible to skipp certain attributes in the comparison (we got some mutation date fields that show differences, but are no importance) is it possible to distinguish in notification between some attributes missing and data showing differences (Dataset A has a few extra attributes then Dataset B, but all other data should be exactly the same). I don't want daily notifications that I am missing these attributes, but I do want a notification when the data is showing differences. kind regards, Jur Dördregter

I triggered MP using below query: mutation startMonitoring { runMonitoringProject(projectId: "89b662a3-8ece-409f-b523-01aeba8240a2", partitionSettings: [ { catalogItemId: "7c4993f7-bb8c-4885-a4e5-d3930d043f8e", partitionType: LATEST } ] ) { loadMonitoringProjectId }} How do I get the status of this MP whether it is failed, passed? I want to trigger another API query once this MP is finished. For this I need to get the status as response of this MP run. Any help on this?

How to calculate last Friday or current day of the week as weekday function is available?

Hi, I want to create DQ rule to check data within same column. For example, from below table, I want to check if Value of Category B is >= Value of Category D. How can I do this in the Ataccama One UI? Thanks Category Value A 5 B 2 C 6 D 4

Is there any global setting at Monitoring Project level to get DQ issue detected warning if DQ percentage is less than 95%.? 14.5.3 version, warning seems to be given after below 60%. It means that if for catalog item in Monitoring project shows overall data quality less than 95%, it should be shown amber warning. instead of green ok.

Hi, This file is comma separated with header and “ text qualifiers and keeps failing as below with a long line error. The data is from an MSAccess table with specific column widths not the default 255 in length. I have tried a number of times to no avail. Any assistance would be most welcome. 2025-04-10 16:27:04 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'properties.encryption.keystore' property not specified2025-04-10 16:27:04 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'internal.encryption.keystore' property not specified10.04.2025 16:27:04 [INFO] Using following licenses:10.04.2025 16:27:04 [INFO] /data/ataccama/one/dpe/license_axaUK_PROD-dpe-bde_v14_subscription_updated.plf10.04.2025 16:27:05 [INFO] running job 2f1568e2-0000-7000-0000-00000026b0c8 (14-CRESTDSS POLICY AND POPULATION.txt)10.04.2025 16:27:05 [DEBUG] metrics will b

Data Observability currently looks for schema changes except field size change. ‘Schema field size change detection’ should be added as a feature as we see this as Prioritized requirement from our stakeholders.

Hi All, We are periodically cataloguing our Databricks environment and have encountered a scenario where a table in the underlying system has been deleted, however the metadata still remains present in the catalog after a re-scan. I understand this is the expected behaviour of Ataccama’s existing functionality, however it is not an ideal scenario for end users as they be viewing metadata for an object that no longer exists. Ideally we would want to tag the catalog item to indicate it has been deleted, or soft delete the catalog item in some way and hide it from data consumers to avoid any potential confusion. I am interested to understand whether others have encountered this scenario before and what mechanisms (if any) they were able to implement to help with this, either with native Ataccama functionality or with a custom workaround. Kind regards, Cristian

Thanks,

Can we add reference data in case statement in Computed content?

I am looking to track how many users log onto Ataccama, how many new terms or rules are created. My objective is to track user engagement and activity. How can this be achieved on Ataccama?

Hi all, In a JSON call-step in a Desktop component I use a query like this in order to retrieve the Version and Published on details. {"query":"query getDetails { product(gid: \"#IDAta#\") { gid draftVersion { name _effectiveFrom { id timestamp } } }}"} Does anyone know how to expand the query so that also Published by is retrieved? Kind regards, Albert

Hello everyone, How can I remove multiple characters, including the single quotation mark, for each row in the INPUT column with a string data type in OneWeb (advance expression) , e.g :- INPUT RETURN VALUE 'Tom Smith' 'Laura Jones' Tom Smith Laura Jones Tom's Toms NULL NULL Thanks in advance. Sabyasachi

There are 98 rules implemented in the monitoring project, and it typically takes about 20 minutes for the project to run and complete successfully, which was fine. I then tried to add an export plan on the Ataccama ONE Desktop to export the results of invalid rules into Excel on the web, but it kept failing. After removing the export plan I created, I'm still encountering the same error code 137. What could be causing this issue?

We are using dBT for our data pipelines, and for the tables and fields, there is description maintained in dBT that we would like to export (json) and update Ataccama Data Catalog. Is there a known, trusted, supported way to automate this? I already do have a desktop plan i created that can update catalog objects and attributes based on a excel input file. I may be able to modify that if thats the only option. Iam reaching out to the community to see if there is a preferred way to get descriptions and documentation from dBT to Ataccama.

Hello Team, I am trying to create a rule for a column “account_number” in a dev table. We are using version 14.5 and “One Desktop” to create the rule. The requirement is to create a rule which removes the leading and trailing whitespaces from the records of the column. I tried defining below expressions in the Column Assigner step of the plan. The final step of the plan is the JDBC Writer step. trim(account_number) squeezeSpaces(account_number) trimRight(account_number) Once I make the changes, I save it, run the plan and the plan executes successfully. BUT when I check the records in the database… the whitespaces are still there in the database table records. Can you please help me understand how to fix this? Which expression should help remove the whitespaces from the records? Thanks, Dhruba

Where can i see the ataccama one version from the webapp/one ui? I cant see a about page? Please guide

We want to evaluate Data Quality Score of Rule after applying the filter condition so that DQ Score gets calculated based on subset of records which are applicable for a rule rather on the whole set. For example, we want to execute the DQ checks only on the records satisfying the filter condition such as ‘Product_Type’ = ‘DS’ We have taken the approach of SQL Catalog item to filter the records. Is there any other workaround for this problem ? With the SQL Catalog option, we will have to create multiple SQL Catalog items to implement the different filter condition if needed for each rule. For example, if there are 2 rules, we need to use 2 SQL Catalog items and similarly would need to use 10 SQL Catalog items for 10 such rules. Therefore, we would like to understand if there is any workaround or alternate to deal with this situation ? Please suggest.

Adding more details to a list view and providing additional filtering options can help business users in their daily tasks as you scale Data Governance across multiple teams, geographies, or business functions. In this article we’ll customize the Business Glossary to show additional term attributes as columns in the list view and to enable filtering by those attributes. This approach generally works across the Ataccama ONE Web app, so you can use this article as a guide to customize other pages, for example Rules, Catalog Items, or Monitoring Projects. You don’t have to be a developer to follow this guide. If you come across any concepts you’re not familiar with, have a look at our documentation. Adding columns First, navigate to the Business Glossary’s Terms list. In the top right, find the 3-dot menu which features the option to Edit page. In the side bar that opens up, go to the Layout tab. You’ll see the JSON that describes how the objects are shown on this page when the web app lo

Audit logging should include all user activities within Policy Management.

Hello, Is there any way I can pull a list of catalog items that have been associated with a policy via graphQL given the policy gid? If not, is there another way I can access such a list ? The Policy is a data usage license agreement that is an array or references on ONE Desktop’s metadata reader. Thanks, Karine