Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
How do i bulk dleete business terms that were written in error ? i have followed steps highlighted below , its not working for me as expected- and on eof the reason is that the transformation plan doesnt have the one metadata writer but the One data writer. Using ONE Desktop (Recommended for Bulk Deletes):This method offers a more robust approach for mass deletion. Create a New Data Transformation Plan: In ONE Desktop, create a new Data Transformation Plan. Read Catalog Items: Add a Metadata Reader step to read the business terms you want to delete. Filter for Terms: Apply filters in the Metadata Reader to identify and select the specific business terms for deletion. Add Metadata Writer: Add a Metadata Writer step to the plan. Set Workflow State to Deleted: In the Metadata Writer, configure the workflow state to Deleted. This marks the terms for removal. Execute the Plan: Run the Data Transformation Plan to perform the bulk deletion of the selected business terms from your busines
Hi @anna.spakova I am using the version 15.4.1Is there any way we can add details such as - name of the monitoring project, catalog item, run information (specific duration like when it was run etc.), dimension of passed & failed records in addition to the default post processing export (which includes all attributes of the catalog item followed by details of invalid, valid rules and scores)?
Hi,I have created a Monitoring Project with a data slice enabled object applied necessary quality checks. Now, I executed the monitoring project and observed that the Over all percentage numbers doesn't show up for sliced objects as highligted in the below screenshot. Any information on how to get over all quality result for the data slices on Monitoring project would be helpful. Thanks!Note: Ataccama V15.4
Is it possible to create a connection in the Ataccama One IDE to a FTP server because when I am trying to create a connection the following error is showing-Can someone help me with the following.
i need to read a snowflake view in ataccama either in one web or one desktop (preferably one web). but one problem here.View name - employee_salin order to see the records in snowflake we have to use the below 2 commandsset start_date=’2025-04-01’;select * from schema.employee_sal;how can i use the set command in sql catalog . i tried with the same command above but it is showing error as $start_date as error. Note : In snowflake it is view not a table . and the view is secure and we are not authorized for the definition of the view and also no access to the base tables. but we can access the view. In snowlfake itself in order to access the view we have to use set command . Solution for this is appreciated.
I have created a component in Desktop tool to extract the Monitoring Project results. I want to upload these details on Azure server as well schedule this component to execute only weekly basis. This monitoring Project result is aggregated details all the monitoring Project. How to schedule and automate results extraction on weekly basis?
Hi guys, I have a few use cases where I need to perform both row level DQ evaluations (like completeness/format check, etc.) and table level (aggregations on specific fields like sum of sales/count of products etc.) DQ evaluations on the same data set. When I applied both the types of checks on the catalog item, it’s taking a lot of time in running the profile + DQ checks. We are having data volume of few hundred millions (~450Million records). At present I have created two separate sql catalog items one for row level checks and second one for table level checks. I wanted to know if it could be achieved using single dataset without facing any performance issues. Please suggest. Version is 15.4.1
Hi There, Can we create data slice in monitoring projects when we have data objects created using virtual catalog items?I see create data slice option is disabled for virtual catalog items hence asking if it’s at all possible? Thanks in advance for ur inputs
Hi all, how can I export a single report from the monitoring project that includes two tables (more than 2), each containing different data quality (DQ) rules?
Dear Colleagues, I am seeking a solution for looping over the data and also for using iteration.What I need to achieve: matching a 4-value string against another 4-value string for Levenshtein match score.Method is to match every 4 value in the string against every 4 value in the other string. It adds up to 16 combinations.Somehow like below I want to create a loop:String1:= L1+' '+L2+' '+L3+' '+L4;String2:=MATCH_L1+' '+MATCH_L2+' '+MATCH_L3+' '+MATCH_L4;MS:= null; //this will be the match string – a dynamically extending string as shown belowfor i := 0 to 3MV1 := set.subSequence(String1,i,1); //match value is L1 For i2 = 0 to 3MV2:= set.subSequence(String2,i2,1); //match value is MATCH_1MC:=levenshtein(MV1,MV2); //we have some score here as match case Next i2;MS:=MS+MC+'_MC'+toString(i)+';'; //match string value and case number stored here and in each loop, new values are getting added to the stringNext i;MS //here I use the final match string value as it is and that's al
Does anyone know how to essentially recreate a freshness check rule with the data quality rules so we can assign the DQ rules to a monitoring project? We are working in Ataccama One Web and do not want to use Ataccama One Desktop currently. I have an attribute that has the date/time new records are loaded into our table. If we get at least one new record on the current date, then we want every single record in the table to pass. So with one record uploaded on the current date, the monitoring project will pass with 100% data quality. However, if no record is loaded on the current date, then the monitoring project will fail with 0% data quality. What is the best approach to set up a rule like this? Thank you in advance!We want to use the monitoring projects automation capabilities vs manually running the freshness check from the knowledge catalog every single day.
Hi there, I have created a sql catalog item and published, profiled as well and would want to check/update the query if needed corrections. I don’t see options anywhere on the tabs (e.g., Data Quality/Relationships etc.) available on catalog item. Please help. I am using v15.4.1
When I add a property cdeIndicator its displaying as Cde Indicator. I want it to display as “CDE Indicator” how to do that in metadata model?@anna.spakova , @Catherine
Hi,I have created a VCI along with its component though One Desktop and published it successfully.Now, my teammates are unable to find the component, but they could find the VCI in both Desktop and Web and they are able to utilize the VCI as well. Any information regarding this would be helpful. Thanks!Note: Ataccama V15.4
Currently I have two plan files. The first one retrieves the CSRF Token (In the response debug file). The second one uses the response debug file and extracts the Cookie and the CSRF Token but when I pass these two to the JSON Call in the final step to write some data to SAP. I get the CSRF Token Validation failed.I am extracting these from the Response debug file and passing them in another JSON Call: Any suggestions on how to solve this issue?
whenever MDM encounters errors mdm needs to have call back mechanism where mdm sends out trace_id and source_id back to the queue for each failures.Is there a recommended approach to identify records that were not processed—along with their associated trace_id and source_id—and requeue them for reporting purposes?
how to resolve ‘Unable to use the config file provided, exiting.’ error
Is it possible to mask data for some users, for example out of privacy reasons?I know masking was a feature in version 1 and for some reason was removed in Gen 2, but how could this still be achieved as it is a much asked requirement, that certain users should not see certain attributes and no, I don't want to create a VCI copy of each asset that has such columns and replace that column with some dummy value, that's not masking.
Hello,I am using Ataccama V15.4 I am trying to set criticality of certain rules in monitoring projects based on which the overall quality of my datasets should be defined.I tried using score option but IDK it’s not as convincing as setting levels like sev 1,2 etc.Thanks.
Hi community! We hope you’ve found some useful insights in the first part of our Working with Data Quality Rules article. Check it out below if you haven’t seen it already or if you need a refresher!In this post, we will focus on duplicating rules, scoring records, and creating rules from mask, patterns, and frequency analyses. Let's dive in! Duplicating RulesDuplicating rules can save you time and effort, especially when you have similar rules that need to be assigned to multiple lookup files. Follow these steps to duplicate a rule:Navigate to the rule you want to duplicate. Expand the "More Options" menu and select "Duplicate." A copy of the rule will open in a new tab with the settings already populated. Edit the information as required and click "Save."Power users can also perform this action via API. Scoring RecordsScoring records helps you assess the severity of data quality issues. The score represents the numeric expression of each record's invalidity according to the rul
Hello. I am trying to create a workflow which runs DQC and send .csv file via email. And it works fine. Challenge is - I need to add current date in file name as well when it is sent via email. I need guidance on how to do that. Thanks.
I am looking for a way to load data that has many columns that keep changing. For Example the first 2 columns would be the qualifier fields and all columns after that would be an attribute: example fromto having it like this It is possible to create with an excel file reader and an Alter format step, but the columns will be different in the next file and if no Oranges were taken that column will not be in the file so the job will fail. Also the actual number of ever changing columns can be anything from 20 to 400 - so setting your qualifier fields and automatically adding anything that comes after that as an Attribute field seems like the solution I need.Anyone have any ideas?
Hello, I am using the email notification option from Ataccama on completion of monitoring projects. At present, I am manually configuring the recipients list of the email notification but would like to know if it could be automatically populated using the ownership/stewardship details provided on the monitored data object? Let me know if it’s possible?Thanks!
Hi,I'm currently working on customizing the layout of the monitoring project reports, especially within the Reports tab that displays detailed DQ results and anomalies. I want to change the order of columns in the detailed results view—for example, I’d like the "Dimension" column to be the second column.I’ve tried editing the page template for the project.Reportpage, but there don't seem to be many options available after this point to control column order or presentation. Has anyone successfully reordered columns in this view? Is it possible through deeper configuration, or are we limited by the template’s default structure?If direct reordering isn’t supported, is it possible to create another table within Ataccama that contains the same data but in a custom order? If so, what’s the best approach?Any guidance or best practices from those who have dealt with similar requirements would be greatly appreciated!Thank you!
Can we get results at column level where filter is applied. For ex: For Ashville city total records are 6 and failed is 1. Similarly at each rule level passed and failed count. Like this we have to get results of all the cities present in that column.
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.