Discuss, learn, ask, suggest, share all things DQ&C π
Recently active
Every time when a upgrade happens it resets the runtime config, and we are losing all the database connections and URLs and important configurations this is breaking our workflows to run successfully and its failing then we need to debug and its time-consuming process so looking how others are handling this situationΒ
Hi,Below are steps to reproduce my issue:I have created a data slice as below: Β Added the Data slice to Monitoring project and enabled slice. After Monitoring is run, βis from listβ is interpreted as β=β and condition is not applied as expected. I have tried all below syntaxes to provide list of values to data slice and nothing worked: {'CASH_IN','CASH_OUT'} ('CASH_IN','CASH_OUT') (CASH_IN,CASH_OUT) CASH_IN,CASH_OUT [CASH_IN,CASH_OUT] ['CASH_IN','CASH_OUT'] CASH_IN;CASH_OUT; Any information regarding this would be helpful. Thanks!Note:Β Ataccama V15.4Β
How do i bulk dleete business terms that were written in error ? i have followed steps highlighted below , its not working for me as expected- and on eof the reason is that the transformation plan doesnt have the one metadata writer but the One data writer.Β Using ONE Desktop (Recommended for Bulk Deletes):This method offers a more robust approach for mass deletion.Β Create a New Data Transformation Plan:Β In ONE Desktop, create a new Data Transformation Plan.Β Read Catalog Items:Β Add aΒ Metadata ReaderΒ step to read the business terms you want to delete.Β Filter for Terms:Β Apply filters in the Metadata Reader to identify and select the specific business terms for deletion.Β Add Metadata Writer:Β Add aΒ Metadata WriterΒ step to the plan.Β Set Workflow State to Deleted:Β In the Metadata Writer, configure the workflow state toΒ Deleted.Β This marks the terms for removal.Β Execute the Plan:Β Run the Data Transformation Plan to perform the bulk deletion of the selected business terms from your busines
Hi β@anna.spakovaΒ I am using the version 15.4.1Is there any way we can add details such as - name of the monitoring project, catalog item, run information (specific duration like when it was run etc.), dimension of passed & failed recordsΒ in addition to the default post processing export (which includes all attributes of the catalog item followed by details ofΒ invalid, valid rules and scores)?
Hi,I have created a Monitoring ProjectΒ with a data slice enabled object applied necessary quality checks. Now, I executed the monitoring project and observed that the Over all percentage numbers doesn't show up for sliced objects as highligted in the below screenshot.Β Any informationΒ on how to get over all quality result for the data slices on Monitoring project would be helpful. Thanks!Note:Β Ataccama V15.4Β
Is it possible to create a connection in the Ataccama One IDE to a FTP server because when I am trying to create a connection the following error is showing-Can someone help me with the following.
i need to read a snowflake viewΒ in ataccama either in one web or one desktop (preferably one web). but one problem here.View name - employee_salin order to see the records in snowflake we have to use the below 2 commandsset start_date=β2025-04-01β;select * from schema.employee_sal;how can i use the set command in sql catalog . i tried with the same command above but it is showing error as $start_date as error.Β Note :Β In snowflake it is view not a table . and the view is secure and we are not authorized forΒ the definition of the view and also no access to the base tables. but we can access the view. In snowlfake itself in order to access the view we have to use set command . Solution for this is appreciated.
I have created a component in Desktop tool to extract the Monitoring Project results. I want to upload these details on Azure server as well scheduleΒ this component to execute only weekly basis. This monitoring Project result is aggregated details all the monitoring Project.Β How to schedule and automate results extraction on weekly basis?Β
Hi guys, I have a few use cases where I need to perform both row level DQ evaluations (like completeness/format check, etc.) and table level (aggregations on specific fields like sum of sales/count of products etc.) DQ evaluations on the same data set. When I applied both the types of checks on the catalog item, itβs taking a lot of time in running the profile + DQ checks. We are having data volume of few hundred millions (~450Million records). At present I have created two separate sql catalog items one for row level checks and second one for table level checks. I wanted to know if it could be achieved using single dataset without facing any performance issues. Please suggest.Β Version is 15.4.1
Hi There,Β Can we create data slice in monitoring projects when we have data objects created using virtual catalog items?I see create data slice option is disabled for virtual catalog items hence asking if itβs at all possible?Β Thanks in advance for ur inputs
Hi all, how can I export a single report from the monitoring project that includes two tables (more than 2), each containing different data quality (DQ) rules?
Does anyone know how to essentially recreate a freshness check rule with the data quality rules so we can assign the DQ rules to a monitoring project? We are working in Ataccama One Web and do not want to use Ataccama One Desktop currently.Β I have an attribute that has the date/time new records are loaded into our table. If we get at least one new record on the current date, then we want every single record in the table to pass. So with one record uploaded on the current date, the monitoring project will pass with 100% data quality. However, if no record is loaded on the current date, then the monitoring project will fail with 0% data quality.Β Β What is the best approach to set up a rule like this? Thank you in advance!We want to use the monitoring projects automation capabilities vs manually running the freshness check from the knowledge catalog every single day.Β
Hi there, I have created a sql catalog item and published, profiled as well and would want to check/update the query if needed corrections. I donβt see options anywhere on the tabs (e.g., Data Quality/Relationships etc.) available on catalog item. Please help. I am using v15.4.1
When I add a property cdeIndicator its displaying as Cde Indicator. I want it to display as βCDE Indicatorβ how to do that in metadata model?β@anna.spakovaΒ , β@CatherineΒ
Hi,I have created a VCIΒ along with its component though One Desktop and published it successfully.Now, my teammates are unable to find the component, but they could find the VCI in both Desktop and Web and they are able to utilizeΒ the VCI as well.Β Any information regarding this would be helpful. Thanks!Note:Β Ataccama V15.4Β
Currently I have two plan files. The first one retrieves the CSRF Token (In the response debug file). The second one uses the response debug file and extracts the Cookie and the CSRF Token but when I pass these two to the JSON Call in the final step to write some data to SAP. I get the CSRF Token Validation failed.I am extracting these from the Response debug file and passing them in another JSON Call:Β Any suggestions on how to solve this issue?
whenever MDM encounters errors mdm needs to have call back mechanism where mdm sends out trace_id and source_id back to the queue for each failures.Is there a recommended approach to identify records that were not processedβalong with their associatedΒ trace_idΒ andΒ source_idβand requeue them for reporting purposes?
how to resolve βUnable to use the config file provided, exiting.β error
Is it possible to mask data for some users, for example out of privacy reasons?I know masking was a feature in version 1 and for some reason was removed in Gen 2, but how could this still be achieved as it is a much asked requirement, that certain users should not see certain attributes and no, I don't want to create a VCI copy of eachΒ asset that has such columns and replace that column with some dummy value, that's not masking.
Hello,I am using Ataccama V15.4Β I am trying to set criticality of certain rules in monitoring projects based on which the overall quality of my datasets should be defined.I tried using score option but IDK itβs not as convincing as setting levels like sev 1,2 etc.Thanks.
Hi community!Β We hope youβve found some useful insights in the first part of our Working with Data Quality Rules article. Check it out below if you havenβt seen it already or if you need a refresher!In this post, we will focus on duplicating rules, scoring records, and creating rules from mask, patterns, and frequency analyses. Let's dive in!Β Duplicating RulesDuplicating rules can save you time and effort, especially when you have similar rules that need to be assigned to multiple lookup files. Follow these steps to duplicate a rule:Navigate to the rule you want to duplicate. Expand the "More Options" menu and select "Duplicate." Β A copy of the rule will open in a new tab with the settings already populated. Β Edit the information as required and click "Save."Power users can also perform this action via API.Β Scoring RecordsScoring records helps you assess the severity of data quality issues. The score represents the numeric expression of each record's invalidity according to the rul
Hello. I am trying to create a workflow which runs DQC and send .csv file via email. And it works fine. Challenge is - I need to add current date in file name as well when it is sent via email. I need guidance on how to do that.Β Thanks.
I am looking for a way to load data that has many columns that keep changing.Β For Example the first 2 columns would be the qualifier fields and all columns after that would be an attribute:Β example fromto having it like thisΒ It is possible to create with an excel file reader and an Alter format step, but the columns will be different in the next file and if no Oranges were taken that column will not be in the file so the job will fail.Β Also the actual number of ever changing columns can be anything from 20 to 400 - so setting your qualifier fields and automatically adding anything that comes after that as an Attribute field seems like the solution I need.Anyone have any ideas?
Hello, I am using the email notification option from Ataccama on completion of monitoring projects. At present, I am manually configuring the recipients list of the email notification but would like to know if it could be automatically populated using the ownership/stewardship details provided on the monitored data object? Let me know if itβs possible?Thanks!
Hi,I'm currently working on customizing the layout of the monitoring project reports, especially within the Reports tab that displays detailed DQ results and anomalies. I want to change the order of columns in the detailed results viewβfor example, Iβd like the "Dimension" column to be the second column.Iβve tried editing the page template for the project.Reportpage, but there don't seem to be many options available after this point to control column order or presentation. Has anyone successfully reordered columns in this view? Is it possible through deeper configuration, or are we limited by the templateβs default structure?If direct reordering isnβt supported, is it possible to create another table within Ataccama that contains the same data but in a custom order? If so, whatβs the best approach?Any guidance or best practices from those who have dealt with similar requirements would be greatly appreciated!Thank you!
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.