Learn & Share

I have created a plan for data quality checks using Data Quality Indicator, and it will produce an excel file which flags each records with error_messages corresponding to each checks, and a summary txt file. Now, I have created  a workflow using Run DQC and Send Mail step. The requirement is to soft code the below values in the email template.Summary excel fileBelow is the email body:Dear Business Users,Please find the attached Error Result (Error_Report.csv), which details the records that failed validation and their respective error types.Summary:Total Processed Records(Total): Total Error Records(Success_Count): Error Types(Code): We recommend reviewing the attached file and taking the necessary corrective actions. If you need further clarification or assistance, please feel free to reach out.Best regards, 

Is there a method to create a single rule for identifying duplicate records based on all columns in a table? This rule should be applicable to all tables, regardless of the number of columns they contain.Current situation we need to add the column to use aggregated rule. It is very difficult if the columns are more than 10 or 15 in table.  

I am making a DQ evaluation rule in ataccama one ui where I have to subtract each long value of catalogue item from its corresponding long value in lookup and if the difference is greater than 100, I want to raise that particular value as invalid sample, so far I am not able to achieve this, it would be great if anyone can help me with this.

Is there any way to get notification for data Profiling schedule failure with log details or successful.

We made changes into the clean operation of an entity. it will take effects for new transactions.How can we apply this to the current records that we already have into the database? We are exploring use a full reprocess of this entity:but we have some doubts about the setup. For example:What is the difference between a reprocess vs rematch checkbox? We tried to read the documentation but there is not detail explanation about it. Thanks in advance!

HiI have a sub-query in Snowflake that is using the function of LISTAGG and PARTITION BY in multiple SELECT DISTINCT statements for example LISTAGG(DISTINCT TRIM(SUBJECT_REF), ' | ') OVER (PARTITION BY IDENTIFIER) AS EN_NUM_AGG, kindly see attachment to see the full SQL statement. Example of one of the subqueries: …en AS(SELECT DISTINCT     IDENTIFIER,    ID,    LISTAGG(DISTINCT ID, ' | ') OVER (PARTITION BY IDENTIFIER) AS ID_AGG,    TRIM(SUBJECT_REF) AS EN_NUM,    LISTAGG(DISTINCT TRIM(SUBJECT_REF), ' | ') OVER (PARTITION BY IDENTIFIER) AS EN_NUM_AGG,    DQ_EN_CARD,    LISTAGG(DISTINCT DQ_EN_CARD, ' | ') OVER (PARTITION BY IDENTIFIER) AS DQ_EN_CARD_AGG,    DATA_SOURCE,    ORIGINAL_SOURCEFROM    db.schema.view1    WHERE     subj_type = 'English') ...I wanted to replicate the same in Ataccama ONE Desktop using the Group Aggregator step, whereI allocate each sub-query in one aggregation set with a condition of subj_type = '<value>' in the When condition. For each column in the SELE

We’re using version 15.4, mostly in the web tool.We’re trying to a subset of our input tables for testing before implementation the full table(s) in Production.We looked at using Data Slices, but we found that the ROWNUM feature of SQL met our purpose better: select * from (select * from dbname.tblname) where ROWNUM <=10000Our primary question is how do we link/connect the SQL View and/or the Data Slice to the DQ Rule.  We believe that it occurs in the Monitoring Project. I looked thorough the Ataccama online documentation, and the Community, but I can’t find the options to make these either of these connections.Any ideas!Thanks!Tim 

What is the AQL to filter all catalog items’ attributes tagged with a particular term?

Hi all,I would like to share the guidance of Ataccama Support regarding a question that I had with respect to using relationship types. I suppose the question will become relevant for us all at some point. So hereby the question and Ataccama's response. Question“In the metadata model we can define relations between entities by means of references, or we can embed properties from other entities etc.Another way to define relations between entities is by means of relationship types. The latter option allows us to visualize the relation in for instance a relationship tab, like there is for terms.Suppose you are to model new entities. There is no requirement to have this visualized in a relationship tab. So you define a reference from one entity to the other. Later a requirement pops up from a new project, that the relation should be depicted in the relationship tab. So, unfortunately, not possible. Changing the reference into a relationship type is a major system change. Then always choose

Hi all, Can anyone help me with what this Add location feature do which is available in overview tab of Source connection? 

Is there a way to quickly select only distinct rows in Ataccama One Desktop? (I now used a record descriptor and filter with Regex find(“.:.:1”, rd_column)

I applied two rules to a monitoring project, but I only want to export the results for one of the rules. In the post-deployment plan, I initially used a filter where the column is not null, and it worked fine. However, it exported all results where the column was not null, meaning the results of both rules were included. I would like to update the filter to only export specific invalid samples, but it's not working, as no data is being exported. Is this filter correct? Previously, it was "Column Name IS NOT NULL," and I updated it to "Column Name IS NOT NULL AND Column Name = 'XYZ specified rule’How can i resolve this ?

How do we activate Business Domain Analysis option in Profiling section. 

Hi Ataccama communityI am trying to do the export of DQ monitoring project the results and use the filters in the export. I a post on this one ONE Desktop: Data Quality Results 🧑‍ on using the filters in the export data. I am able to get the filters extracted using the DQ monitoring project filter values but couldn't get the corresponding monitoring project results using the DQ Monitoring project check results. I am getting an empty file with just the column names in the file in the output file which I have checked the output into a CSV file just after the DQ monitoring project check results step. And I have enabled only one filter in the DQ monitoring project as I read in the community forum that two filter wouldn’t work with this setup.Are there any changes I need to make the way I am using the filter in DQ monitoring project check results step ? I am attaching the screenshots below for reference. 

Hi Ataccama Community, I want to upload a CSV file which is an export of DQ monitoring project results to SharePoint folder. I couldn’t see the Task SFTP upload file step in my OneDesktop (version 15.4). Is this step not available in the current version of Ataccama OneDesktop ? Or is there any work around to upload the CSV files to the Share Point server. CheersManidhar

Hi,I am attempting to connect to Collibra using the Collibra reader (refer to the page: Collibra Integration in Ataccama ONE Desktop 🏹).However, I am encountering the following error message when I execute the plan. Could someone please assist me?  I have set up a server without a username/password because I don't need to enter a username/password when accessing Collibra.  

Hello, Can we create nested sql catalog items.  Meaning, can I use a SQL catalog item in the query as a source to another sql catalog item?  

Hi all,Suppose you have 2 tables that relate as 1:n. When joining the tables in a query without filtering, the result will be n rows. My requirement is to have just one row returned, with the values of the n-table shown as an array. In SQL Server you could use a query likeSELECT     p.PK_ONETEST,    p.Name,    p.Description,    (SELECT         c.Name     FROM ODS.NTEST c     WHERE c.FK_ONETEST = p.PK_ONETEST     FOR JSON PATH) AS ChildrenFROM ODS.ONETEST p;resulting in My question is if we can also achieve this in one or more steps in One Desktop.Kind regards,Albert

Two records as same correation id and same version number one should process another one should error out how to implement this logic in ataccama 

Hello, i am using a free version of the Data Stories , I cant seems to find where to upload or import dataset as seen from the demo --- Data Stories Demo does this free version not support creating a story , Dashboard or visualization ? if its does, is there something i’m not doing right 

Hello,We recently started getting nested JSON event files with DAT file extension. We are getting an ‘Unknow Error’, when we try to import it.Can you help me in understanding, how nested JSON with .DAT extension can be processed in Ataccama.Thank you.