Learn & Share

I want to find out missing values in the columns. Use case, column called colors which has values as [‘ORANGE’,’BLACK’,’BLUE’] and rule is if RED is not part of column values, then Rule should fail and alert that RED color is missing in table. 

Hi, we are making use of reconciliation projects to compare two different dataset with eachother. Most of the data needs to be compared, but some fields we want to skip in the comparison. is it possible to skipp certain attributes in the comparison (we got some mutation date fields that show differences, but are no importance) is it possible to distinguish in notification between some attributes missing and data showing differences (Dataset A has a few extra attributes then Dataset B, but all other data should be exactly the same). I don't want daily notifications that I am missing these attributes, but I do want a notification when the data is showing differences.kind regards, Jur Dördregter

There is column called Sales Amount (Long Data type). It has values in decimal point. I wanted to create a DQ evaluation rule that It should have exact two places decimal point. I tried to create rule by converting long to string and validated length after decimal point as 2 but failed for values 1.00 or 2.10 or 0.00 as conversion to string change value from 0.00 to 0, 1.00 to 1 or 2.10 to 2.1  Is there any way to implement this?

Hi, This file is comma separated with header and “ text qualifiers and keeps failing as below with a long line error. The data is from an MSAccess table with specific column widths not the default 255 in length. I have tried a number of times to no avail.Any assistance would be most welcome.2025-04-10 16:27:04 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'properties.encryption.keystore' property not specified2025-04-10 16:27:04 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'internal.encryption.keystore' property not specified10.04.2025 16:27:04 [INFO] Using following licenses:10.04.2025 16:27:04 [INFO] /data/ataccama/one/dpe/license_axaUK_PROD-dpe-bde_v14_subscription_updated.plf10.04.2025 16:27:05 [INFO] running job 2f1568e2-0000-7000-0000-00000026b0c8 (14-CRESTDSS POLICY AND POPULATION.txt)10.04.2025 16:27:05 [DEB

How to calculate last Friday or current day of the week? Is there any weekday function available?

Is there a way to manually or AI generate tags to classify columns based on the contents within columns of data? Also curious if there are any rule detection capabilities for column classification?

I triggered MP using below query: mutation startMonitoring {    runMonitoringProject(projectId: "89b662a3-8ece-409f-b523-01aeba8240a2",        partitionSettings: [          {            catalogItemId: "7c4993f7-bb8c-4885-a4e5-d3930d043f8e",            partitionType: LATEST          }        ]    ) {    loadMonitoringProjectId    }} How do I get the status of this MP whether it is failed, passed? I want to trigger another API query once this MP is finished. For this I need to get the status as response of this MP run. Any help on this?

Data Observability currently looks for schema changes except field size change.  ‘Schema field size change detection’ should be added as a feature as we see this as Prioritized requirement from our stakeholders.

Hi All,We are periodically cataloguing our Databricks environment and have encountered a scenario where a table in the underlying system has been deleted, however the metadata still remains present in the catalog after a re-scan.I understand this is the expected behaviour of Ataccama’s existing functionality, however it is not an ideal scenario for end users as they be viewing metadata for an object that no longer exists. Ideally we would want to tag the catalog item to indicate it has been deleted, or soft delete the catalog item in some way and hide it from data consumers to avoid any potential confusion.I am interested to understand whether others have encountered this scenario before and what mechanisms (if any) they were able to implement to help with this, either with native Ataccama functionality or with a custom workaround.Kind regards,Cristian 

I am looking to track how many users log onto Ataccama, how many new terms or rules are created. My objective is to track user engagement and activity. How can this be achieved on Ataccama?

Hi all,In a JSON call-step in a Desktop component I use a query like this in order to retrieve the Version and Published on details. {"query":"query getDetails {    product(gid: \"#IDAta#\") {        gid        draftVersion {           name            _effectiveFrom {                id                timestamp            }        }    }}"}Does anyone know how to expand the query so that also Published by is retrieved?Kind regards,Albert

Hello everyone,How can I  remove multiple characters, including the single quotation mark, for each row in the INPUT column  with a string data type in OneWeb (advance expression)  , e.g :-     INPUT   RETURN VALUE   'Tom Smith' 'Laura Jones'   Tom Smith Laura Jones   Tom's   Toms   NULL   NULL  Thanks in advance.Sabyasachi

There are 98 rules implemented in the monitoring project, and it typically takes about 20 minutes for the project to run and complete successfully, which was fine. I then tried to add an export plan on the Ataccama ONE Desktop to export the results of invalid rules into Excel on the web, but it kept failing. After removing the export plan I created, I'm still encountering the same error code 137. What could be causing this issue? 

We are using dBT for our data pipelines, and for the tables and fields, there is description maintained in dBT that we would like to export (json) and update Ataccama Data Catalog.Is there a known, trusted, supported way to automate this?I already do have a desktop plan i created that can update catalog objects and attributes based on a excel input file. I may be able to modify that if thats the only option. Iam reaching out to the community to see if there is a preferred way to get descriptions and documentation from dBT to Ataccama.

Hello Team,I am trying to create a rule for a column “account_number” in a dev table. We are using version 14.5 and “One Desktop” to create the rule.The requirement is to create a rule which removes the leading and trailing whitespaces from the records of the column. I tried defining below expressions in the Column Assigner step of the plan. The final step of the plan is the JDBC Writer step.trim(account_number) squeezeSpaces(account_number) trimRight(account_number)Once I make the changes, I save it, run the plan and the plan executes successfully. BUT when I check the records in the database…the whitespaces are still there in the database table records.Can you please help me understand how to fix this? Which expression should help remove the whitespaces from the records? Thanks,Dhruba

Where can i see the ataccama one version from the webapp/one ui? I cant see a about page? Please guide

Hello everyone,I’m working on a project that integrates a data masking tool with Ataccama, and I’m encountering some issues when trying to retrieve actual catalog item data (the row-level data) via the REST API. I’ve been testing both GraphQL and REST approaches, and here’s what I’ve found so far:GraphQL vs. REST for Data Retrieval:The GraphQL API appears to focus on metadata – attributes, versioning, policies, etc. However, based on my understanding, the actual table data (the rows and cells) isn’t available through GraphQL; it’s only accessible via a REST endpoint. Based on available documentation for MDM and RDM REST APIs, the REST endpoints follow a pattern using a fixed base path (/api/rest) on the default port (8051) and use basic HTTP authentication.Endpoint URL Confusion:Initially, I attempted to use an endpoint like:  https://teranet.test.ataccama.online/catalog/data/catalogItem/<gid>/datawhich returned a 404 error. Later, based on the docs, I switched to the documented

We want to evaluate Data Quality Score of Rule after applying the filter condition so that DQ Score gets calculated based on subset of records which are applicable for a rule rather on the whole set.For example, we want to execute the DQ checks only on the records satisfying the filter condition such as ‘Product_Type’ = ‘DS’We have taken the approach of SQL Catalog item to filter the records. Is there any other workaround for this problem ?With the SQL Catalog option, we will have to create multiple SQL Catalog items to implement the different filter condition if needed for each rule. For example, if there are 2 rules, we need to use 2 SQL Catalog items and similarly would need to use 10 SQL Catalog items for 10 such rules.Therefore, we would like to understand if there is any workaround or alternate to deal with this situation ?Please suggest.

Audit logging should include all user activities within Policy Management.

Hello, Is there any way I can pull a list of catalog items that have been associated with a policy via graphQL given the policy gid? If not, is there another way I can access such a list ? The Policy is a data usage license agreement that is an array or references on ONE Desktop’s metadata reader. Thanks,Karine 

Hi community,We have a usecase to set a property's value automatically: based on several conditions that property gets a value. First we considered creating a desktop plan for this. Then we figured it would be preferrable to have this value set automatically, something that can possibly be accomplished by applying computed content.We have used computed content before, mainly for concatenating values (like described in Computed Content: Show attribute values based on existing attributes (ataccama.com)). But in this case we would need to define a case statement to define the conditions and determine the value.So the question is, does someone know if sql-like case stamenent can be implemented as computed content? And if so, can an example be provided?Thanks for your attention and kind regards,Albert

In data observability, after configuring a source and setting up a schema for monitoring, the Schema Changes tab displays all detected issues. For each issue, recommendations such as "Update in Catalog Items" or "Import into Catalog" are provided. Is there a way to automate the process of updating newly added or missing catalog items in the Knowledge catalog section and need to view the Profiling results for the newly added attributes (When Change = ‘New Attribute’ in data observability).

I am able to fetch all the rule details like name, label, id, stewardship etc. But I am unable to get the dimension of the rule. I don’t find any entity relation between rule and DQ dimension. Could anyone please help me on this?