Data Quality & Catalog ⚙️

Hello!Does anyone have any ideas for how to make a welcoming and useful Home page for Data Users coming to Ataccama just for data discovery? All of the widgets seem to be focused on Data Stewards, but the majority of users arriving on to Ataccama for us are looking to find data to work with, so widgets like Tasks, Processing Centre, Notifications, and even the Getting Started ones are just confusing to them. I’m looking into making a Report that just acts as a welcome page for those new users, but haven’t been able to make anything that nicely introduces the platform without putting too much in front of them. Let me know if anyone’s done something like this before!

Hi Team, I have a requirement where I need to write the post processing results (post DQ, failed records) into snowflake database in a dedicated schema.If I set up a user X to perform this write operation in snowflake schema, does it also need to have read access to the data objects that I am monitoring for data quality.Let’s say data objects are on schema s1 of database ABC (snowflake) and post processing results are to be saved on schema s2 of database PQR (snowflake)Thanks for your response!

Hi all,I cannot find the filter pane (Filter) in version 15.4. Is there any chance it doesn't appear due to my access permissions?Also, is it possible to search for a custom value within the schema? If it exists, I need to identify the corresponding table, field, and row number.Thank you!

 Hello,I am new to Ataccama One and had a question around using the DQ rules in other ETL tools and integrations. It’s my understanding that a DQ rule returns whether the inputs are valid\invalid and it can be called as a web service using DQ firewalls. Is there a way to extend this logic to apply a fix to the input and returning this fix for invalid inputs ? Can this be exposed and reflected in the DQ firewall ? Do we need to build a component rule for this or can this be achieved using rule variables \ parameters ? It is not clear to me when parameters and variables are typically used in rule configuration. Regards,Ihab

Could anyone help me understand how to best create a collection or visualization for the dashboards? Currently when I go to create a new collection I cannot see any tables/attributes (that exist in the Knowledge Catalog) to select as part of the collection. Is this permission based or do I need to enable a setting for the data somewhere? Any help would be greatly appreciated, thanks!  I’m currently using Ataccama Web v15.4.0

HelloI am looking to create a One Desktop plan to extract records which are out of sync. I need to compare tables coming from different databases and sources. Or better suggestion to achieve the same.Need help with this. 

I have created a post processing plan in One Desktop, and when running the Monitoring Project in One Web, I’m unable to see any sheets contains results.  

Hi All, We’ve had a request from our data consumers to have the Last Update from the Data Freshness check appear in the catalog search. Users want to know if an item is stale or is receiving updates, and i think this would be the best way to do so.I can find the property of the the last update under modifyTime column of the freshnessChecks attribute in the catalogItem entity, however I can’t get that to show in the catalog Search. It doesn’t error out which makes me think the property is correct, but nothing appears in the cell for each catalogItem even when there is a freshness check.  "modifyDate": { "name": "modifyDate", "dataPath": [ "modifyDate" ] }Has anyone had any success doing this, or anything similar?

Hello Ataccama Team,I am using Ataccama One Web Application (v15.4.1) and need help setting up data quality rules to monitor data loads for three different tables.Each table has a Row create datetime column to capture the load times.Load schedules:•    Table A: weekly once (On Tuesday)•    Table B: 5th of the month•    Table C: 1st and 15th of monthWhat is the recommended data quality syntax for rules that check date freshness against weekly/monthly/semimonthly schedule?•    Table A: Verify the data was loaded during the current week (on Friday or Saturday)•    Table B: Check by the 10th of the month, to confirm data was loaded on / after 5th of month.•    Table C: Check by the 5th for the 1st month load and around 20th for the 15th load.I initially tried using datePart, but it looks like this function is not supported in our environment. Is there any alternative recommended approach for dynamically calculating offsets without hardcoding dates?I am using maximum(toDate(ROW_CREATE_DATET

Is Mongo DB data source supported to connect and profile?

Hi Community people!I have a question regarding data observability. I am especially interested in noticing changes in record volume and applying this observability functionality in the process of a data delivery. This delivery is orchestrated with a tool, Jams in our case, starting with data retrieval and ending with the actual data delivery. Somewhere in this data flow orchestration I want to check for anomalous changes in record volume. The orchestration tool could then, for instance just before file creation, trigger an observability job to check the underlying database tables for record volume.But when configuring data observability I see a scheduler, which does not match with the idea of an orchestrated flow.So question 1 is if data observablity can be triggered.Maybe in a scenario where the orchestration tool starts an Ataccama job via a command, like a workflow that starts the observability and reads the observability results and returns an OK or Not OK to the orchestration tool

Every time when a upgrade happens it resets the runtime config, and we are losing all the database connections and URLs and important configurations this is breaking our workflows to run successfully and its failing then we need to debug and its time-consuming process so looking how others are handling this situation 

Hi,Below are steps to reproduce my issue:I have created a data slice as below:   Added the Data slice to Monitoring project and enabled slice. After Monitoring is run, “is from list” is interpreted as “=” and condition is not applied as expected. I have tried all below syntaxes to provide list of values to data slice and nothing worked: {'CASH_IN','CASH_OUT'} ('CASH_IN','CASH_OUT') (CASH_IN,CASH_OUT) CASH_IN,CASH_OUT [CASH_IN,CASH_OUT] ['CASH_IN','CASH_OUT'] CASH_IN;CASH_OUT; Any information regarding this would be helpful. Thanks!Note: Ataccama V15.4 

How do i bulk dleete business terms that were written in error ? i have followed steps highlighted below , its not working for me as expected- and on eof the reason is that the transformation plan doesnt have the one metadata writer but the One data writer. Using ONE Desktop (Recommended for Bulk Deletes):This method offers a more robust approach for mass deletion. Create a New Data Transformation Plan: In ONE Desktop, create a new Data Transformation Plan.  Read Catalog Items: Add a Metadata Reader step to read the business terms you want to delete.  Filter for Terms: Apply filters in the Metadata Reader to identify and select the specific business terms for deletion.  Add Metadata Writer: Add a Metadata Writer step to the plan.  Set Workflow State to Deleted: In the Metadata Writer, configure the workflow state to Deleted. This marks the terms for removal.  Execute the Plan: Run the Data Transformation Plan to perform the bulk deletion of the selected business terms from your busines

Hi ​@anna.spakova I am using the version 15.4.1Is there any way we can add details such as - name of the monitoring project, catalog item, run information (specific duration like when it was run etc.), dimension of passed & failed records in addition to the default post processing export (which includes all attributes of the catalog item followed by details of invalid, valid rules and scores)?

Hi,I have created a Monitoring Project with a data slice enabled object applied necessary quality checks. Now, I executed the monitoring project and observed that the Over all percentage numbers doesn't show up for sliced objects as highligted in the below screenshot. Any information on how to get over all quality result for the data slices on Monitoring project would be helpful. Thanks!Note: Ataccama V15.4 

Is it possible to create a connection in the Ataccama One IDE to a FTP server because when I am trying to create a connection the following error is showing-Can someone help me with the following.

i need to read a snowflake view in ataccama either in one web or one desktop (preferably one web). but one problem here.View name - employee_salin order to see the records in snowflake we have to use the below 2 commandsset start_date=’2025-04-01’;select * from schema.employee_sal;how can i use the set command in sql catalog . i tried with the same command above but it is showing error as $start_date as error. Note : In snowflake it is view not a table . and the view is secure and we are not authorized for the definition of the view and also no access to the base tables. but we can access the view. In snowlfake itself in order to access the view we have to use set command . Solution for this is appreciated.

I have created a component in Desktop tool to extract the Monitoring Project results. I want to upload these details on Azure server as well schedule  this component to execute only weekly basis. This monitoring Project result is aggregated details all the monitoring Project. How to schedule and automate results extraction on weekly basis? 

Hi guys, I have a few use cases where I need to perform both row level DQ evaluations (like completeness/format check, etc.) and table level (aggregations on specific fields like sum of sales/count of products etc.) DQ evaluations on the same data set. When I applied both the types of checks on the catalog item, it’s taking a lot of time in running the profile + DQ checks. We are having data volume of few hundred millions (~450Million records). At present I have created two separate sql catalog items one for row level checks and second one for table level checks. I wanted to know if it could be achieved using single dataset without facing any performance issues. Please suggest. Version is 15.4.1

Hi There, Can we create data slice in monitoring projects when we have data objects created using virtual catalog items?I see create data slice option is disabled for virtual catalog items hence asking if it’s at all possible? Thanks in advance for ur inputs

Hi all, how can I export a single report from the monitoring project that includes two tables (more than 2), each containing different data quality (DQ) rules?

Does anyone know how to essentially recreate a freshness check rule with the data quality rules so we can assign the DQ rules to a monitoring project? We are working in Ataccama One Web and do not want to use Ataccama One Desktop currently. I have an attribute that has the date/time new records are loaded into our table. If we get at least one new record on the current date, then we want every single record in the table to pass. So with one record uploaded on the current date, the monitoring project will pass with 100% data quality. However, if no record is loaded on the current date, then the monitoring project will fail with 0% data quality.  What is the best approach to set up a rule like this? Thank you in advance!We want to use the monitoring projects automation capabilities vs manually running the freshness check from the knowledge catalog every single day. 

Hi there, I have created a sql catalog item and published, profiled as well and would want to check/update the query if needed corrections. I don’t see options anywhere on the tabs (e.g., Data Quality/Relationships etc.) available on catalog item. Please help. I am using v15.4.1

When I add a property cdeIndicator its displaying as Cde Indicator. I want it to display as “CDE Indicator” how to do that in metadata model?​@anna.spakova , ​@Catherine