Recently active topics

Can the API response generated from the Data Quality Firewall feature be edited?

Hello community, I’m creating a Power BI source on Ataccama One and have a few queries: Is the built-in Power BI connection allow One to retrieve a Power BI datasets? Or this is strictly for only bringing the Power BI reports to One? The imported catalog items from this connection shows “0” number of attributes and “-” number of records (screenshots below). This is also presents in the the screenshot from the Ataccama support page (link). Is this behave as intended or am I missing anything here? Thank you in advance. Ben

Adding more details to a list view and providing additional filtering options can help business users in their daily tasks as you scale Data Governance across multiple teams, geographies, or business functions. In this article we’ll customize the Business Glossary to show additional term attributes as columns in the list view and to enable filtering by those attributes. This approach generally works across the Ataccama ONE Web app, so you can use this article as a guide to customize other pages, for example Rules, Catalog Items, or Monitoring Projects. You don’t have to be a developer to follow this guide. If you come across any concepts you’re not familiar with, have a look at our documentation. Adding columns First, navigate to the Business Glossary’s Terms list. In the top right, find the 3-dot menu which features the option to Edit page. In the side bar that opens up, go to the Layout tab. You’ll see the JSON that describes how the objects are shown on this page when the web app lo

Hi I have with great success been using your free desktop version of DQ Analyzer. But the license has run out. Last time I had this issue a new download and a re-installation solved it. I have tried to do the same, but it did not work. See issue “DQ analyzer windows version update” for further details. Any advice what to do?

The Business wants this date attribute validated. I don’t know why, it’s a key field and I assume managed by the DB. Nonetheless, I need to build a rule. But I think it’s strange that the Data Type is DATE while the date values are YYYY-MM-DD. I would expect to see DATE format data in the MM-DD-YYY HH:MM:SS AM format. I don’t know how to code it in the date functions since it doesn’t have the standard date format and it doesn’t work in any string functions. Any ideas?

Is it possible to configure default value in Catalog item filter by admin?

I have created a plan for data quality checks using Data Quality Indicator, and it will produce an excel file which flags each records with error_messages corresponding to each checks, and a summary txt file. Now, I have created a workflow using Run DQC and Send Mail step. The requirement is to soft code the below values in the email template. Summary excel file Below is the email body: Dear Business Users, Please find the attached Error Result (Error_Report.csv), which details the records that failed validation and their respective error types. Summary: Total Processed Records(Total): Total Error Records(Success_Count): Error Types(Code): We recommend reviewing the attached file and taking the necessary corrective actions. If you need further clarification or assistance, please feel free to reach out. Best regards,

Is there a method to create a single rule for identifying duplicate records based on all columns in a table? This rule should be applicable to all tables, regardless of the number of columns they contain. Current situation we need to add the column to use aggregated rule. It is very difficult if the columns are more than 10 or 15 in table.

Hello, I am looking for guidance on ensuring automatic data masking/hiding during data exports to csv/excel files based on Data Protection Classification in Ataccama ONE.From the documentation, it appears that access to sensitive attributes (ones tagged with terms that have data classification tags applied to them) can be restricted for unauthorized users, but I would like to confirm:1. How can we configure permissions to ensure that unauthorized users can still export data but only receive masked/hidden values for classified attributes? What permissions do we give them?2. Is it possible to automatically apply masking transformations based on classification tags, so that even authorized users exporting data only receive masked values instead of raw sensitive data?3. Are there any recommended workflows for enforcing automatic masking at the export level while leveraging Data Protection Classification? Thank you, Karine

I am making a DQ evaluation rule in ataccama one ui where I have to subtract each long value of catalogue item from its corresponding long value in lookup and if the difference is greater than 100, I want to raise that particular value as invalid sample, so far I am not able to achieve this, it would be great if anyone can help me with this.

Is there any way to get notification for data Profiling schedule failure with log details or successful.

We made changes into the clean operation of an entity. it will take effects for new transactions. How can we apply this to the current records that we already have into the database? We are exploring use a full reprocess of this entity: but we have some doubts about the setup. For example: What is the difference between a reprocess vs rematch checkbox? We tried to read the documentation but there is not detail explanation about it. Thanks in advance!

I'm working with a database table that contains a column storing complicated JSON/XML data structures. I need to implement data quality rules that will search for and validate specific values within these structures and compare them with values in other columns. My specific requirements: Need to search for particular patterns and values nested within JSON/XML structures Considering using regular expressions for this search capability Concerned about the performance impact on database resources Want to ensure this approach is sustainable as data volume grows Has anyone implemented data quality rules for searching/validating values within JSON or XML columns? Are regular expressions an appropriate approach, or are there better alternatives within Ataccama (Desktop?) for handling hierarchical data structures? I'm particularly concerned about performance impacts and would appreciate insights from those who have solved similar challenges.

Hi I have a sub-query in Snowflake that is using the function of LISTAGG and PARTITION BY in multiple SELECT DISTINCT statements for example LISTAGG(DISTINCT TRIM(SUBJECT_REF), ' | ') OVER (PARTITION BY IDENTIFIER) AS EN_NUM_AGG, kindly see attachment to see the full SQL statement. Example of one of the subqueries: … en AS ( SELECT DISTINCT IDENTIFIER, ID, LISTAGG(DISTINCT ID, ' | ') OVER (PARTITION BY IDENTIFIER) AS ID_AGG, TRIM(SUBJECT_REF) AS EN_NUM, LISTAGG(DISTINCT TRIM(SUBJECT_REF), ' | ') OVER (PARTITION BY IDENTIFIER) AS EN_NUM_AGG, DQ_EN_CARD, LISTAGG(DISTINCT DQ_EN_CARD, ' | ') OVER (PARTITION BY IDENTIFIER) AS DQ_EN_CARD_AGG, DATA_SOURCE, ORIGINAL_SOURCE FROM db.schema.view1 WHERE subj_type = 'English' ) ... I wanted to replicate the same in Ataccama ONE Desktop using the Group Aggregator step, where I allocate each sub-query in one aggregation set with a condition of subj_type = '<value>' in the When condition. For each column in the SELECT DISTINCT subquery if it is a non-

We’re using version 15.4, mostly in the web tool. We’re trying to a subset of our input tables for testing before implementation the full table(s) in Production. We looked at using Data Slices, but we found that the ROWNUM feature of SQL met our purpose better: select * from (select * from dbname.tblname) where ROWNUM <=10000 Our primary question is how do we link/connect the SQL View and/or the Data Slice to the DQ Rule. We believe that it occurs in the Monitoring Project. I looked thorough the Ataccama online documentation, and the Community, but I can’t find the options to make these either of these connections. Any ideas! Thanks! Tim

What is the AQL to filter all catalog items’ attributes tagged with a particular term?

We are using dBT for our data pipelines, and for the tables and fields, there is description maintained in dBT that we would like to export (json) and update Ataccama Data Catalog. Is there a known, trusted, supported way to automate this? I already do have a desktop plan i created that can update catalog objects and attributes based on a excel input file. I may be able to modify that if thats the only option. Iam reaching out to the community to see if there is a preferred way to get descriptions and documentation from dBT to Ataccama.

Hi all, I would like to share the guidance of Ataccama Support regarding a question that I had with respect to using relationship types. I suppose the question will become relevant for us all at some point. So hereby the question and Ataccama's response. Question “In the metadata model we can define relations between entities by means of references, or we can embed properties from other entities etc. Another way to define relations between entities is by means of relationship types. The latter option allows us to visualize the relation in for instance a relationship tab, like there is for terms. Suppose you are to model new entities. There is no requirement to have this visualized in a relationship tab. So you define a reference from one entity to the other. Later a requirement pops up from a new project, that the relation should be depicted in the relationship tab. So, unfortunately, not possible. Changing the reference into a relationship type is a major system change. Then always ch

Welcome to the Data People Community 👋 We are very glad you’re here. This is a great space for you to introduce yourself to your fellow community members and offer up a fun fact (or three). Let me start! I’m Cansu, I’m a Community Manager at Ataccama. You’ll see me here a lot; managing the forums, chatting, and generally helping out. A little more about me: I’m based in the City of a Hundred Spires ️🗺️ I have two black cats named Goblin & Monkey🐈‍⬛ I am an amateur surfer ‍🏄‍♀️ Please don’t hesitate to share details about what you're looking to achieve with Ataccama, and what you hope to get from your experience in the Data People Community. See you in the forums 👀

Hi all, Can anyone help me with what this Add location feature do which is available in overview tab of Source connection?