Learn & Share

Hi All, We’ve had a request from our data consumers to have the Last Update from the Data Freshness check appear in the catalog search. Users want to know if an item is stale or is receiving updates, and i think this would be the best way to do so.I can find the property of the the last update under modifyTime column of the freshnessChecks attribute in the catalogItem entity, however I can’t get that to show in the catalog Search. It doesn’t error out which makes me think the property is correct, but nothing appears in the cell for each catalogItem even when there is a freshness check.  "modifyDate": { "name": "modifyDate", "dataPath": [ "modifyDate" ] }Has anyone had any success doing this, or anything similar?

Hello Ataccama Team,I am using Ataccama One Web Application (v15.4.1) and need help setting up data quality rules to monitor data loads for three different tables.Each table has a Row create datetime column to capture the load times.Load schedules:•    Table A: weekly once (On Tuesday)•    Table B: 5th of the month•    Table C: 1st and 15th of monthWhat is the recommended data quality syntax for rules that check date freshness against weekly/monthly/semimonthly schedule?•    Table A: Verify the data was loaded during the current week (on Friday or Saturday)•    Table B: Check by the 10th of the month, to confirm data was loaded on / after 5th of month.•    Table C: Check by the 5th for the 1st month load and around 20th for the 15th load.I initially tried using datePart, but it looks like this function is not supported in our environment. Is there any alternative recommended approach for dynamically calculating offsets without hardcoding dates?I am using maximum(toDate(ROW_CREATE_DATET

Is Mongo DB data source supported to connect and profile?

Hi Community people!I have a question regarding data observability. I am especially interested in noticing changes in record volume and applying this observability functionality in the process of a data delivery. This delivery is orchestrated with a tool, Jams in our case, starting with data retrieval and ending with the actual data delivery. Somewhere in this data flow orchestration I want to check for anomalous changes in record volume. The orchestration tool could then, for instance just before file creation, trigger an observability job to check the underlying database tables for record volume.But when configuring data observability I see a scheduler, which does not match with the idea of an orchestrated flow.So question 1 is if data observablity can be triggered.Maybe in a scenario where the orchestration tool starts an Ataccama job via a command, like a workflow that starts the observability and reads the observability results and returns an OK or Not OK to the orchestration tool

Every time when a upgrade happens it resets the runtime config, and we are losing all the database connections and URLs and important configurations this is breaking our workflows to run successfully and its failing then we need to debug and its time-consuming process so looking how others are handling this situation 

Hi,Below are steps to reproduce my issue:I have created a data slice as below:   Added the Data slice to Monitoring project and enabled slice. After Monitoring is run, “is from list” is interpreted as “=” and condition is not applied as expected. I have tried all below syntaxes to provide list of values to data slice and nothing worked: {'CASH_IN','CASH_OUT'} ('CASH_IN','CASH_OUT') (CASH_IN,CASH_OUT) CASH_IN,CASH_OUT [CASH_IN,CASH_OUT] ['CASH_IN','CASH_OUT'] CASH_IN;CASH_OUT; Any information regarding this would be helpful. Thanks!Note: Ataccama V15.4 

 How to get the catalog item related to the main catalog item via API? Please help me to get that API.

How do i bulk dleete business terms that were written in error ? i have followed steps highlighted below , its not working for me as expected- and on eof the reason is that the transformation plan doesnt have the one metadata writer but the One data writer. Using ONE Desktop (Recommended for Bulk Deletes):This method offers a more robust approach for mass deletion. Create a New Data Transformation Plan: In ONE Desktop, create a new Data Transformation Plan.  Read Catalog Items: Add a Metadata Reader step to read the business terms you want to delete.  Filter for Terms: Apply filters in the Metadata Reader to identify and select the specific business terms for deletion.  Add Metadata Writer: Add a Metadata Writer step to the plan.  Set Workflow State to Deleted: In the Metadata Writer, configure the workflow state to Deleted. This marks the terms for removal.  Execute the Plan: Run the Data Transformation Plan to perform the bulk deletion of the selected business terms from your busines

Hi ​@anna.spakova I am using the version 15.4.1Is there any way we can add details such as - name of the monitoring project, catalog item, run information (specific duration like when it was run etc.), dimension of passed & failed records in addition to the default post processing export (which includes all attributes of the catalog item followed by details of invalid, valid rules and scores)?

Hi,I have created a Monitoring Project with a data slice enabled object applied necessary quality checks. Now, I executed the monitoring project and observed that the Over all percentage numbers doesn't show up for sliced objects as highligted in the below screenshot. Any information on how to get over all quality result for the data slices on Monitoring project would be helpful. Thanks!Note: Ataccama V15.4 

Is it possible to create a connection in the Ataccama One IDE to a FTP server because when I am trying to create a connection the following error is showing-Can someone help me with the following.

i need to read a snowflake view in ataccama either in one web or one desktop (preferably one web). but one problem here.View name - employee_salin order to see the records in snowflake we have to use the below 2 commandsset start_date=’2025-04-01’;select * from schema.employee_sal;how can i use the set command in sql catalog . i tried with the same command above but it is showing error as $start_date as error. Note : In snowflake it is view not a table . and the view is secure and we are not authorized for the definition of the view and also no access to the base tables. but we can access the view. In snowlfake itself in order to access the view we have to use set command . Solution for this is appreciated.

I have created a component in Desktop tool to extract the Monitoring Project results. I want to upload these details on Azure server as well schedule  this component to execute only weekly basis. This monitoring Project result is aggregated details all the monitoring Project. How to schedule and automate results extraction on weekly basis? 

Hi guys, I have a few use cases where I need to perform both row level DQ evaluations (like completeness/format check, etc.) and table level (aggregations on specific fields like sum of sales/count of products etc.) DQ evaluations on the same data set. When I applied both the types of checks on the catalog item, it’s taking a lot of time in running the profile + DQ checks. We are having data volume of few hundred millions (~450Million records). At present I have created two separate sql catalog items one for row level checks and second one for table level checks. I wanted to know if it could be achieved using single dataset without facing any performance issues. Please suggest. Version is 15.4.1

Hi There, Can we create data slice in monitoring projects when we have data objects created using virtual catalog items?I see create data slice option is disabled for virtual catalog items hence asking if it’s at all possible? Thanks in advance for ur inputs

Hi all, how can I export a single report from the monitoring project that includes two tables (more than 2), each containing different data quality (DQ) rules?

Dear Colleagues, I am seeking a solution for looping over the data and also for using iteration.What I need to achieve: matching a 4-value string against another 4-value string for Levenshtein match score.Method is to match every 4 value in the string against every 4 value in the other string. It adds up to 16 combinations.Somehow like below I want to create a loop:String1:= L1+' '+L2+' '+L3+' '+L4;String2:=MATCH_L1+' '+MATCH_L2+' '+MATCH_L3+' '+MATCH_L4;MS:= null; //this will be the match string – a dynamically extending string as shown belowfor i := 0 to 3MV1 := set.subSequence(String1,i,1); //match value is L1 For i2 = 0 to 3MV2:= set.subSequence(String2,i2,1); //match value is MATCH_1MC:=levenshtein(MV1,MV2); //we have some score here as match case Next i2;MS:=MS+MC+'_MC'+toString(i)+';'; //match string value and case number stored here and in each loop, new values are getting added to the stringNext i;MS //here I use the final match string value as it is and that's al

Does anyone know how to essentially recreate a freshness check rule with the data quality rules so we can assign the DQ rules to a monitoring project? We are working in Ataccama One Web and do not want to use Ataccama One Desktop currently. I have an attribute that has the date/time new records are loaded into our table. If we get at least one new record on the current date, then we want every single record in the table to pass. So with one record uploaded on the current date, the monitoring project will pass with 100% data quality. However, if no record is loaded on the current date, then the monitoring project will fail with 0% data quality.  What is the best approach to set up a rule like this? Thank you in advance!We want to use the monitoring projects automation capabilities vs manually running the freshness check from the knowledge catalog every single day. 

Hi there, I have created a sql catalog item and published, profiled as well and would want to check/update the query if needed corrections. I don’t see options anywhere on the tabs (e.g., Data Quality/Relationships etc.) available on catalog item. Please help. I am using v15.4.1

When I add a property cdeIndicator its displaying as Cde Indicator. I want it to display as “CDE Indicator” how to do that in metadata model?​@anna.spakova , ​@Catherine 

Hi,I have created a VCI along with its component though One Desktop and published it successfully.Now, my teammates are unable to find the component, but they could find the VCI in both Desktop and Web and they are able to utilize the VCI as well. Any information regarding this would be helpful. Thanks!Note: Ataccama V15.4 

Currently I have two plan files. The first one retrieves the CSRF Token (In the response debug file). The second one uses the response debug file and extracts the Cookie and the CSRF Token but when I pass these two to the JSON Call in the final step to write some data to SAP. I get the CSRF Token Validation failed.I am extracting these from the Response debug file and passing them in another JSON Call: Any suggestions on how to solve this issue?

whenever MDM encounters errors mdm needs to have call back mechanism where mdm sends out trace_id and source_id back to the queue for each failures.Is there a recommended approach to identify records that were not processed—along with their associated trace_id and source_id—and requeue them for reporting purposes?

how to resolve ‘Unable to use the config file provided, exiting.’ error

Is it possible to mask data for some users, for example out of privacy reasons?I know masking was a feature in version 1 and for some reason was removed in Gen 2, but how could this still be achieved as it is a much asked requirement, that certain users should not see certain attributes and no, I don't want to create a VCI copy of each asset that has such columns and replace that column with some dummy value, that's not masking.