Unanswered questions

In Monitoring Project Data quality rule suggestion works sometimes and it give rules already used or as per term assigned to catalog item but most of the time it doesn't work. At point of time, rule suggestions appear, and they disappear when you want to check again. How the rule suggestions work in Monitoring Project of Ataccama? Is there any pattern or do we have to do something so that we can rule suggestions?

For example, if there are multiple rules applied on an Attribute that is CDE then would it show filtered Data Quality Score based on the nested rule that is implemented. Can it be checked or configured in Ataccama One WebApp or it would need to be done in Ataccama One Desktop ?

Hello everyone, I was looking through the email templates and was wondering if it would be possible to create one for the tasks dashboard? I know its possible to enable these for monitoring projects, but would like to know if there's any way to also enable them for updates to tasks, ie task assigned, task status changed, task deleted etc. Searching through the documentation I haven't seen anything relating to this, Any help would be very much appreciated!

I am able to fetch all the rule details like name, label, id, stewardship etc. But I am unable to get the dimension of the rule. I don’t find any entity relation between rule and DQ dimension. Could anyone please help me on this?

Dear members, I am struggling with a step that rather reflects query/array logic than the logic of steps available in component editor. Task is to find the maximum from a range of values. I tried to retrieve it through a dynamic query written in a Representative Creator step, see details below: L1:= round((1-(levenshtein(W_CUA1,W_CUA1_MATCH)/(max(length(W_CUA1),length(W_CUA1_MATCH)))))*100,0);L2:= round((1-(levenshtein(W_CUA1,W_CUA2_MATCH)/(max(length(W_CUA1),length(W_CUA2_MATCH)))))*100,0);L3:= round((1-(levenshtein(W_CUA1,W_CUA3_MATCH)/(max(length(W_CUA1),length(W_CUA3_MATCH)))))*100,0);L4:= round((1-(levenshtein(W_CUA1,W_CUA4_MATCH)/(max(length(W_CUA1),length(W_CUA4_MATCH)))))*100,0);L5:= round((1-(levenshtein(W_CUA2,W_CUA1_MATCH)/(max(length(W_CUA2),length(W_CUA1_MATCH)))))*100,0);L6:= round((1-(levenshtein(W_CUA2,W_CUA2_MATCH)/(max(length(W_CUA2),length(W_CUA2_MATCH)))))*100,0);L7:= round((1-(levenshtein(W_CUA2,W_CUA3_MATCH)/(max(length(W_CUA2),length(W_CUA3_MATCH)))))*100,0);L8:=

Is there a way to identify usage stats, last login etc easily? or if someone has built a query to show this information? I would think the admin would have an easy where to manage users access / licenses etc

Another enhancement request to add to the list is for Observability - In version 15.4 (that we currently have in Prod), the "Schema" check currently allows drill-down only to the 'Schema/Dataset' level. Can the drill down be extended to the table level, similar to how catalogs can be downloaded from the source?

While importing the configuration in Monitoring Project from different monitoring Project, we can map catalog item but unable to it on column level. Here column names are getting changed in databrick layers (foundation, Enriched, curated). Is there any way to import configuration from one project to another project with column mapping as names gets changed?

Architectural Diagram for Data Quality and Governance

Hello, I am trying to filter the monitoring project results based on filters value (Filter_val) and filter_id. The results sometime work fine, but sometime not. Is there a way out for this? Something to do with ‘Value Separator’ I believe.

How do we create a detection rule which either using both data and metadata option in same rule or ability to add multiple detection rules on business glossary with AND and OR conditions both working together and not just one option?

Is it possible to configure default value in Catalog item filter by admin?

I have created a plan for data quality checks using Data Quality Indicator, and it will produce an excel file which flags each records with error_messages corresponding to each checks, and a summary txt file. Now, I have created a workflow using Run DQC and Send Mail step. The requirement is to soft code the below values in the email template. Summary excel file Below is the email body: Dear Business Users, Please find the attached Error Result (Error_Report.csv), which details the records that failed validation and their respective error types. Summary: Total Processed Records(Total): Total Error Records(Success_Count): Error Types(Code): We recommend reviewing the attached file and taking the necessary corrective actions. If you need further clarification or assistance, please feel free to reach out. Best regards,

Is there a method to create a single rule for identifying duplicate records based on all columns in a table? This rule should be applicable to all tables, regardless of the number of columns they contain. Current situation we need to add the column to use aggregated rule. It is very difficult if the columns are more than 10 or 15 in table.

Hello, I am looking for guidance on ensuring automatic data masking/hiding during data exports to csv/excel files based on Data Protection Classification in Ataccama ONE.From the documentation, it appears that access to sensitive attributes (ones tagged with terms that have data classification tags applied to them) can be restricted for unauthorized users, but I would like to confirm:1. How can we configure permissions to ensure that unauthorized users can still export data but only receive masked/hidden values for classified attributes? What permissions do we give them?2. Is it possible to automatically apply masking transformations based on classification tags, so that even authorized users exporting data only receive masked values instead of raw sensitive data?3. Are there any recommended workflows for enforcing automatic masking at the export level while leveraging Data Protection Classification? Thank you, Karine

Is there any way to create a calculated attribute on existing data using “Add Attribute”. As there is no option to add existing attribute in the table while creating attribute using “Add Attribute”. Is there any example how to use it? I have created one it contains only blank values.

I'm working with a database table that contains a column storing complicated JSON/XML data structures. I need to implement data quality rules that will search for and validate specific values within these structures and compare them with values in other columns. My specific requirements: Need to search for particular patterns and values nested within JSON/XML structures Considering using regular expressions for this search capability Concerned about the performance impact on database resources Want to ensure this approach is sustainable as data volume grows Has anyone implemented data quality rules for searching/validating values within JSON or XML columns? Are regular expressions an appropriate approach, or are there better alternatives within Ataccama (Desktop?) for handling hierarchical data structures? I'm particularly concerned about performance impacts and would appreciate insights from those who have solved similar challenges.

What is the AQL to filter all catalog items’ attributes tagged with a particular term?

Is there a way to retrieve all the workflows deployed on the Ataccama runtime server? For instance, we can obtain all the monitoring projects and post-processing details from the Ataccama metadata model. Additionally, I would like to get the workflow names along with their associated plans and component files from the runtime server.

Hi all, Can anyone help me with what this Add location feature do which is available in overview tab of Source connection?

I applied two rules to a monitoring project, but I only want to export the results for one of the rules. In the post-deployment plan, I initially used a filter where the column is not null, and it worked fine. However, it exported all results where the column was not null, meaning the results of both rules were included. I would like to update the filter to only export specific invalid samples, but it's not working, as no data is being exported. Is this filter correct? Previously, it was "Column Name IS NOT NULL," and I updated it to "Column Name IS NOT NULL AND Column Name = 'XYZ specified rule’ How can i resolve this ?

Hi Ataccama community I am trying to do the export of DQ monitoring project the results and use the filters in the export. I a post on this one ONE Desktop: Data Quality Results 🧑‍ on using the filters in the export data. I am able to get the filters extracted using the DQ monitoring project filter values but couldn't get the corresponding monitoring project results using the DQ Monitoring project check results. I am getting an empty file with just the column names in the file in the output file which I have checked the output into a CSV file just after the DQ monitoring project check results step. And I have enabled only one filter in the DQ monitoring project as I read in the community forum that two filter wouldn’t work with this setup.Are there any changes I need to make the way I am using the filter in DQ monitoring project check results step ? I am attaching the screenshots below for reference.

Hello, Can we create nested sql catalog items. Meaning, can I use a SQL catalog item in the query as a source to another sql catalog item?

Hi Can we have multiple workflows in single scheduler? I tried to add multiple workflows but I am getting error. is there any way to do this? Thanks in advance

Hi, I am able tot connect Bigquery from Ataccama ONE Desktop application but getting below error while inserting data in table - com.ataccama.dqc.commons.sql.atc.WrappedSqlException: [Simba][BigQueryJDBCDriver](100032) Error executing query job. Message: Transaction control statements are supported only in scripts or sessionswhile executing INSERT INTO ……..