Learn & Share

I have created a component in Desktop tool to extract the Monitoring Project results. I want to upload these details on Azure server as well schedule  this component to execute only weekly basis. This monitoring Project result is aggregated details all the monitoring Project. How to schedule and automate results extraction on weekly basis? 

Hi guys, I have a few use cases where I need to perform both row level DQ evaluations (like completeness/format check, etc.) and table level (aggregations on specific fields like sum of sales/count of products etc.) DQ evaluations on the same data set. When I applied both the types of checks on the catalog item, it’s taking a lot of time in running the profile + DQ checks. We are having data volume of few hundred millions (~450Million records). At present I have created two separate sql catalog items one for row level checks and second one for table level checks. I wanted to know if it could be achieved using single dataset without facing any performance issues. Please suggest. Version is 15.4.1

Hi There, Can we create data slice in monitoring projects when we have data objects created using virtual catalog items?I see create data slice option is disabled for virtual catalog items hence asking if it’s at all possible? Thanks in advance for ur inputs

Hi all, how can I export a single report from the monitoring project that includes two tables (more than 2), each containing different data quality (DQ) rules?

Dear Colleagues, I am seeking a solution for looping over the data and also for using iteration.What I need to achieve: matching a 4-value string against another 4-value string for Levenshtein match score.Method is to match every 4 value in the string against every 4 value in the other string. It adds up to 16 combinations.Somehow like below I want to create a loop:String1:= L1+' '+L2+' '+L3+' '+L4;String2:=MATCH_L1+' '+MATCH_L2+' '+MATCH_L3+' '+MATCH_L4;MS:= null; //this will be the match string – a dynamically extending string as shown belowfor i := 0 to 3MV1 := set.subSequence(String1,i,1); //match value is L1 For i2 = 0 to 3MV2:= set.subSequence(String2,i2,1); //match value is MATCH_1MC:=levenshtein(MV1,MV2); //we have some score here as match case Next i2;MS:=MS+MC+'_MC'+toString(i)+';'; //match string value and case number stored here and in each loop, new values are getting added to the stringNext i;MS //here I use the final match string value as it is and that's al

Does anyone know how to essentially recreate a freshness check rule with the data quality rules so we can assign the DQ rules to a monitoring project? We are working in Ataccama One Web and do not want to use Ataccama One Desktop currently. I have an attribute that has the date/time new records are loaded into our table. If we get at least one new record on the current date, then we want every single record in the table to pass. So with one record uploaded on the current date, the monitoring project will pass with 100% data quality. However, if no record is loaded on the current date, then the monitoring project will fail with 0% data quality.  What is the best approach to set up a rule like this? Thank you in advance!We want to use the monitoring projects automation capabilities vs manually running the freshness check from the knowledge catalog every single day. 

Hi there, I have created a sql catalog item and published, profiled as well and would want to check/update the query if needed corrections. I don’t see options anywhere on the tabs (e.g., Data Quality/Relationships etc.) available on catalog item. Please help. I am using v15.4.1

When I add a property cdeIndicator its displaying as Cde Indicator. I want it to display as “CDE Indicator” how to do that in metadata model?​@anna.spakova , ​@Catherine 

Hi,I have created a VCI along with its component though One Desktop and published it successfully.Now, my teammates are unable to find the component, but they could find the VCI in both Desktop and Web and they are able to utilize the VCI as well. Any information regarding this would be helpful. Thanks!Note: Ataccama V15.4 

Currently I have two plan files. The first one retrieves the CSRF Token (In the response debug file). The second one uses the response debug file and extracts the Cookie and the CSRF Token but when I pass these two to the JSON Call in the final step to write some data to SAP. I get the CSRF Token Validation failed.I am extracting these from the Response debug file and passing them in another JSON Call: Any suggestions on how to solve this issue?

whenever MDM encounters errors mdm needs to have call back mechanism where mdm sends out trace_id and source_id back to the queue for each failures.Is there a recommended approach to identify records that were not processed—along with their associated trace_id and source_id—and requeue them for reporting purposes?

how to resolve ‘Unable to use the config file provided, exiting.’ error

Is it possible to mask data for some users, for example out of privacy reasons?I know masking was a feature in version 1 and for some reason was removed in Gen 2, but how could this still be achieved as it is a much asked requirement, that certain users should not see certain attributes and no, I don't want to create a VCI copy of each asset that has such columns and replace that column with some dummy value, that's not masking.

Hello,I am using Ataccama V15.4 I am trying to set criticality of certain rules in monitoring projects based on which the overall quality of my datasets should be defined.I tried using score option but IDK it’s not as convincing as setting levels like sev 1,2 etc.Thanks.

Hello. I am trying to create a workflow which runs DQC and send .csv file via email. And it works fine. Challenge is - I need to add current date in file name as well when it is sent via email. I need guidance on how to do that. Thanks.

I am looking for a way to load data that has many columns that keep changing.  For Example the first 2 columns would be the qualifier fields and all columns after that would be an attribute:  example fromto having it like this It is possible to create with an excel file reader and an Alter format step, but the columns will be different in the next file and if no Oranges were taken that column will not be in the file so the job will fail.  Also the actual number of ever changing columns can be anything from 20 to 400 - so setting your qualifier fields and automatically adding anything that comes after that as an Attribute field seems like the solution I need.Anyone have any ideas?

Hello, I am using the email notification option from Ataccama on completion of monitoring projects. At present, I am manually configuring the recipients list of the email notification but would like to know if it could be automatically populated using the ownership/stewardship details provided on the monitored data object? Let me know if it’s possible?Thanks!

Hi,I'm currently working on customizing the layout of the monitoring project reports, especially within the Reports tab that displays detailed DQ results and anomalies. I want to change the order of columns in the detailed results view—for example, I’d like the "Dimension" column to be the second column.I’ve tried editing the page template for the project.Reportpage, but there don't seem to be many options available after this point to control column order or presentation. Has anyone successfully reordered columns in this view? Is it possible through deeper configuration, or are we limited by the template’s default structure?If direct reordering isn’t supported, is it possible to create another table within Ataccama that contains the same data but in a custom order? If so, what’s the best approach?Any guidance or best practices from those who have dealt with similar requirements would be greatly appreciated!Thank you!

Can we get results at column level where filter is applied. For ex: For Ashville city total records are 6 and failed is 1. Similarly at each rule level passed and failed count.  Like this we have to get results of all the cities present in that column. 

Hi!I want to extract json schema from a json blob that is stored in a binari datatype field in sql server database. A lot of the fields in my schema are optional, though I want a total overview of all available fields and the entity they belong to. All is now stored in one field, but I want to use the schema to create a data source structure through which I can navigate and ideally also get profile & dq insights from. How can I achieve this? Is there something out of the box available for this?Kind regards, Jur Dördregter

Hi There, We would like to know if the below mentioned Data Quality rules can be exposed as an API through Ataccama One App or One Desktop. Data Quality rule which calls a third party service - say loqate for address validation. Our understanding is that we have to write a plan to invoke loqate. Is there a way to expose this plan as an API to front end application? The usecase here is for the application to call Ataccama for all data quality validations through API calls. If it can be, could you please share the steps? Are there any known challenges? Lookup data quality rules - Can lookup DQ rules be exposed as an API using the steps in DQ Firewalls :: Ataccama ONE

COE(Close) date must not be in future and must be after sales date.The COE date is in DATETIME and Sales date is in Date format in table. So I created a rule as [SALES Date] IS NOT NULL AND [SALES Date] <= toDate([COE DATE]), but the Monitoring project is failing when added this rule on sales date  

Hi all,I’m working on a Python script to fetch monitoring project results via GraphQL. My goal is to determine whether the monitoring project is 100% successful or if there are any issues.I’ve checked the documentation but can’t find the exact GraphQL query or fields that return the project’s overall success status or completion percentage.Could anyone please share: A sample GraphQL query to get the monitoring project status (success, percentage, etc.) How to execute this query using Python (e.g., with requests or any GraphQL client) Tips on parsing the response to identify if the project is fully successful or not Thanks a lot!

I need to create Catalog items while my source is distinct XML file.Is there any existing process or we need to create new framework .Please explain detail solutions to work on this requirement.