Learn & Share

Can we get the metadata of one rule instance. I have been using below query. It is giving all the dq checks. I want to pass only one DQ check ID and get the results. query{    ruleInstances(versionSelector: {draftVersion: true}){    edges {      node {      gid      draftVersion {        name        displayName,        target        {          gid        }    }    }    }  }  } Can anyone help me on this?

After testing manually created asset type/properties/relation in DEV environment, how to promote these change to high environment?

Hello!Does anyone have experience using the Iterate tool within the Ataccama Desktop, when creating a workflow? I’ve found a couple of old community posts referring to it, along with the files they’ve used, but I can’t get it to work in my environment. see the following:Iterating rows of a table (Record-by-record - SQL Iterator) in a workflowBased on that post and my testing, it seems like the Iterate tool needs to call another workflow, so I’m calling another .ewf file that just has the Run DQC tool, which runs the .plan file. I’m able to succeed in running the .plan file from the Run DQC .ewf, however i can’t seem to get the Iterate tool to run, without getting Configuration errors, like the following:12.03.2025 15:30:51 [INFO] Task 'Iterate' : failed with exception: com.ataccama.adt.internal.core.runtime.EwfConfigException: Configuration contains errors, exitingjava.lang.RuntimeException: com.ataccama.adt.internal.core.runtime.EwfConfigException: Configuration contains errors, e

Hello ,please advise on the steps required to perform a bulk upload of business or report terms to the Business Glossary page?Additionally, is it possible to deploy the glossary content to a higher environment (e.g., from Dev to QA or Prod), or do we need to manually replicate the same steps in each environment

in One Desktop we will get the summary of DQ checks like if the column is empty or if the column (salary) is having greater than defined. For each and every record it will show the record which got failed in the output of Data Quality indicator . My question here is How to achieve Primary key violated here ? i will show with an example.   

Hello! I am trying to think of a way through building a single post processing plan and or component that is able to be applied to every monitoring project in my ecosystem. It is a very simple plan, I will just have a filter for when invalid_rules_explanation is not null, and export to a default CSV location. The issue I am running into is that in all documentation, it is project / catalog specific when setting up a post processing plan. For a company with numerous projects and catalogs (around 500 unique configurations and more coming), I do not want to manually have to create the same post processing plan for every project and catalog. Is there a way to automate this, or have something within the UI of the web version that would allow me to do this more seamlessly?

I am performing deduplication for which am using matching step. I have configured it using name attribute to find duplicate with jarowrinkler() but getting a runtime error.Here is the configuration details - Here the error message - Not getting any error warnings on any step, configure window within my plan file.I appreciate any assistance you can provide.Thanks for taking the time to look into this.Your help is greatly appreciated.

Is there any way to give some logical name to the catalog item which is added in Monitoring Project. Actual catalog name and the catalog instance name present in MP should be different. Is that possible?

I want to find out missing values in the columns. Use case, column called colors which has values as [‘ORANGE’,’BLACK’,’BLUE’] and rule is if RED is not part of column values, then Rule should fail and alert that RED color is missing in table. 

Hi, we are making use of reconciliation projects to compare two different dataset with eachother. Most of the data needs to be compared, but some fields we want to skip in the comparison. is it possible to skipp certain attributes in the comparison (we got some mutation date fields that show differences, but are no importance) is it possible to distinguish in notification between some attributes missing and data showing differences (Dataset A has a few extra attributes then Dataset B, but all other data should be exactly the same). I don't want daily notifications that I am missing these attributes, but I do want a notification when the data is showing differences.kind regards, Jur Dördregter

There is column called Sales Amount (Long Data type). It has values in decimal point. I wanted to create a DQ evaluation rule that It should have exact two places decimal point. I tried to create rule by converting long to string and validated length after decimal point as 2 but failed for values 1.00 or 2.10 or 0.00 as conversion to string change value from 0.00 to 0, 1.00 to 1 or 2.10 to 2.1  Is there any way to implement this?

Hi, This file is comma separated with header and “ text qualifiers and keeps failing as below with a long line error. The data is from an MSAccess table with specific column widths not the default 255 in length. I have tried a number of times to no avail.Any assistance would be most welcome.2025-04-10 16:27:04 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'properties.encryption.keystore' property not specified2025-04-10 16:27:04 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'internal.encryption.keystore' property not specified10.04.2025 16:27:04 [INFO] Using following licenses:10.04.2025 16:27:04 [INFO] /data/ataccama/one/dpe/license_axaUK_PROD-dpe-bde_v14_subscription_updated.plf10.04.2025 16:27:05 [INFO] running job 2f1568e2-0000-7000-0000-00000026b0c8 (14-CRESTDSS POLICY AND POPULATION.txt)10.04.2025 16:27:05 [DEB

How to calculate last Friday or current day of the week? Is there any weekday function available?

Is there a way to manually or AI generate tags to classify columns based on the contents within columns of data? Also curious if there are any rule detection capabilities for column classification?

I triggered MP using below query: mutation startMonitoring {    runMonitoringProject(projectId: "89b662a3-8ece-409f-b523-01aeba8240a2",        partitionSettings: [          {            catalogItemId: "7c4993f7-bb8c-4885-a4e5-d3930d043f8e",            partitionType: LATEST          }        ]    ) {    loadMonitoringProjectId    }} How do I get the status of this MP whether it is failed, passed? I want to trigger another API query once this MP is finished. For this I need to get the status as response of this MP run. Any help on this?

Data Observability currently looks for schema changes except field size change.  ‘Schema field size change detection’ should be added as a feature as we see this as Prioritized requirement from our stakeholders.

Hi All,We are periodically cataloguing our Databricks environment and have encountered a scenario where a table in the underlying system has been deleted, however the metadata still remains present in the catalog after a re-scan.I understand this is the expected behaviour of Ataccama’s existing functionality, however it is not an ideal scenario for end users as they be viewing metadata for an object that no longer exists. Ideally we would want to tag the catalog item to indicate it has been deleted, or soft delete the catalog item in some way and hide it from data consumers to avoid any potential confusion.I am interested to understand whether others have encountered this scenario before and what mechanisms (if any) they were able to implement to help with this, either with native Ataccama functionality or with a custom workaround.Kind regards,Cristian 

I am looking to track how many users log onto Ataccama, how many new terms or rules are created. My objective is to track user engagement and activity. How can this be achieved on Ataccama?

Hi all,In a JSON call-step in a Desktop component I use a query like this in order to retrieve the Version and Published on details. {"query":"query getDetails {    product(gid: \"#IDAta#\") {        gid        draftVersion {           name            _effectiveFrom {                id                timestamp            }        }    }}"}Does anyone know how to expand the query so that also Published by is retrieved?Kind regards,Albert

Hello everyone,How can I  remove multiple characters, including the single quotation mark, for each row in the INPUT column  with a string data type in OneWeb (advance expression)  , e.g :-     INPUT   RETURN VALUE   'Tom Smith' 'Laura Jones'   Tom Smith Laura Jones   Tom's   Toms   NULL   NULL  Thanks in advance.Sabyasachi

There are 98 rules implemented in the monitoring project, and it typically takes about 20 minutes for the project to run and complete successfully, which was fine. I then tried to add an export plan on the Ataccama ONE Desktop to export the results of invalid rules into Excel on the web, but it kept failing. After removing the export plan I created, I'm still encountering the same error code 137. What could be causing this issue? 

We are using dBT for our data pipelines, and for the tables and fields, there is description maintained in dBT that we would like to export (json) and update Ataccama Data Catalog.Is there a known, trusted, supported way to automate this?I already do have a desktop plan i created that can update catalog objects and attributes based on a excel input file. I may be able to modify that if thats the only option. Iam reaching out to the community to see if there is a preferred way to get descriptions and documentation from dBT to Ataccama.

Hello Team,I am trying to create a rule for a column “account_number” in a dev table. We are using version 14.5 and “One Desktop” to create the rule.The requirement is to create a rule which removes the leading and trailing whitespaces from the records of the column. I tried defining below expressions in the Column Assigner step of the plan. The final step of the plan is the JDBC Writer step.trim(account_number) squeezeSpaces(account_number) trimRight(account_number)Once I make the changes, I save it, run the plan and the plan executes successfully. BUT when I check the records in the database…the whitespaces are still there in the database table records.Can you please help me understand how to fix this? Which expression should help remove the whitespaces from the records? Thanks,Dhruba