Data Quality & Catalog ⚙️

How to calculate last Friday or current day of the week? Is there any weekday function available?

Is there a way to manually or AI generate tags to classify columns based on the contents within columns of data? Also curious if there are any rule detection capabilities for column classification?

I triggered MP using below query: mutation startMonitoring {    runMonitoringProject(projectId: "89b662a3-8ece-409f-b523-01aeba8240a2",        partitionSettings: [          {            catalogItemId: "7c4993f7-bb8c-4885-a4e5-d3930d043f8e",            partitionType: LATEST          }        ]    ) {    loadMonitoringProjectId    }} How do I get the status of this MP whether it is failed, passed? I want to trigger another API query once this MP is finished. For this I need to get the status as response of this MP run. Any help on this?

Data Observability currently looks for schema changes except field size change.  ‘Schema field size change detection’ should be added as a feature as we see this as Prioritized requirement from our stakeholders.

Hi All,We are periodically cataloguing our Databricks environment and have encountered a scenario where a table in the underlying system has been deleted, however the metadata still remains present in the catalog after a re-scan.I understand this is the expected behaviour of Ataccama’s existing functionality, however it is not an ideal scenario for end users as they be viewing metadata for an object that no longer exists. Ideally we would want to tag the catalog item to indicate it has been deleted, or soft delete the catalog item in some way and hide it from data consumers to avoid any potential confusion.I am interested to understand whether others have encountered this scenario before and what mechanisms (if any) they were able to implement to help with this, either with native Ataccama functionality or with a custom workaround.Kind regards,Cristian 

I am looking to track how many users log onto Ataccama, how many new terms or rules are created. My objective is to track user engagement and activity. How can this be achieved on Ataccama?

Hi all,In a JSON call-step in a Desktop component I use a query like this in order to retrieve the Version and Published on details. {"query":"query getDetails {    product(gid: \"#IDAta#\") {        gid        draftVersion {           name            _effectiveFrom {                id                timestamp            }        }    }}"}Does anyone know how to expand the query so that also Published by is retrieved?Kind regards,Albert

Hello everyone,How can I  remove multiple characters, including the single quotation mark, for each row in the INPUT column  with a string data type in OneWeb (advance expression)  , e.g :-     INPUT   RETURN VALUE   'Tom Smith' 'Laura Jones'   Tom Smith Laura Jones   Tom's   Toms   NULL   NULL  Thanks in advance.Sabyasachi

There are 98 rules implemented in the monitoring project, and it typically takes about 20 minutes for the project to run and complete successfully, which was fine. I then tried to add an export plan on the Ataccama ONE Desktop to export the results of invalid rules into Excel on the web, but it kept failing. After removing the export plan I created, I'm still encountering the same error code 137. What could be causing this issue? 

We are using dBT for our data pipelines, and for the tables and fields, there is description maintained in dBT that we would like to export (json) and update Ataccama Data Catalog.Is there a known, trusted, supported way to automate this?I already do have a desktop plan i created that can update catalog objects and attributes based on a excel input file. I may be able to modify that if thats the only option. Iam reaching out to the community to see if there is a preferred way to get descriptions and documentation from dBT to Ataccama.

Hello Team,I am trying to create a rule for a column “account_number” in a dev table. We are using version 14.5 and “One Desktop” to create the rule.The requirement is to create a rule which removes the leading and trailing whitespaces from the records of the column. I tried defining below expressions in the Column Assigner step of the plan. The final step of the plan is the JDBC Writer step.trim(account_number) squeezeSpaces(account_number) trimRight(account_number)Once I make the changes, I save it, run the plan and the plan executes successfully. BUT when I check the records in the database…the whitespaces are still there in the database table records.Can you please help me understand how to fix this? Which expression should help remove the whitespaces from the records? Thanks,Dhruba

Where can i see the ataccama one version from the webapp/one ui? I cant see a about page? Please guide

We want to evaluate Data Quality Score of Rule after applying the filter condition so that DQ Score gets calculated based on subset of records which are applicable for a rule rather on the whole set.For example, we want to execute the DQ checks only on the records satisfying the filter condition such as ‘Product_Type’ = ‘DS’We have taken the approach of SQL Catalog item to filter the records. Is there any other workaround for this problem ?With the SQL Catalog option, we will have to create multiple SQL Catalog items to implement the different filter condition if needed for each rule. For example, if there are 2 rules, we need to use 2 SQL Catalog items and similarly would need to use 10 SQL Catalog items for 10 such rules.Therefore, we would like to understand if there is any workaround or alternate to deal with this situation ?Please suggest.

Audit logging should include all user activities within Policy Management.

Hello, Is there any way I can pull a list of catalog items that have been associated with a policy via graphQL given the policy gid? If not, is there another way I can access such a list ? The Policy is a data usage license agreement that is an array or references on ONE Desktop’s metadata reader. Thanks,Karine 

Hi community,We have a usecase to set a property's value automatically: based on several conditions that property gets a value. First we considered creating a desktop plan for this. Then we figured it would be preferrable to have this value set automatically, something that can possibly be accomplished by applying computed content.We have used computed content before, mainly for concatenating values (like described in Computed Content: Show attribute values based on existing attributes (ataccama.com)). But in this case we would need to define a case statement to define the conditions and determine the value.So the question is, does someone know if sql-like case stamenent can be implemented as computed content? And if so, can an example be provided?Thanks for your attention and kind regards,Albert

In data observability, after configuring a source and setting up a schema for monitoring, the Schema Changes tab displays all detected issues. For each issue, recommendations such as "Update in Catalog Items" or "Import into Catalog" are provided. Is there a way to automate the process of updating newly added or missing catalog items in the Knowledge catalog section and need to view the Profiling results for the newly added attributes (When Change = ‘New Attribute’ in data observability).

I am able to fetch all the rule details like name, label, id, stewardship etc. But I am unable to get the dimension of the rule. I don’t find any entity relation between rule and DQ dimension. Could anyone please help me on this?

Hello, I am trying to filter the monitoring project results based on filters value (Filter_val) and filter_id. The results sometime work fine, but sometime not. Is there a way out for this? Something to do with ‘Value Separator’ I believe. 

Is it possible to configure default value in Catalog item filter by admin? 

Hi folks,We’re on 14.5.3 right now, and we have a use case to display an embedded object in a grid view on a glossary term.Take my example here:glossaryTechnicalInformation is an embedded object array under my term entity. Inside glossaryTechnicalInformation are 4 simple string scalar properties. But yes I forgot to give it “name” property, my mistake.When I add some info in there, I get a guid. I know I can get it to display the “name” if I give it a property “name”, but then, I would only get the “name” to display in the page.Is there some way to make it display like this? (excuse my poor skills in Paint!) 

Is there any way to create a calculated attribute on existing data using “Add Attribute”. As there is no option to add existing attribute in the table while creating attribute using “Add Attribute”. Is there any example how to use it? I have created one it contains only blank values.