Data Quality & Catalog ⚙️

Hello,I want to integrate my Ataccama monitoring results with Teams notification.I checked the below link but Office 365 connectors within Teams are retiring, that's may be why I do not see Incoming webhook on my Teams. Is there any way to set up Teams with Atacamma using workflows instead? https://docs.ataccama.com/one/latest/notifications/ms-teams-integration.html#add-incoming-webhook-to-ms-teams-channel Please suggest.

Hello folks, I am creating a new connection on web application for OneDrive/SharePoint using Microsoft Entra ID; while doing so there's this field (Drive Id) which is optional if you have multiple drives and you want to limit the connection to a specific drive, we enter the ID of the drive you want to connect to. Without Drive Id I am able to access the root folders and their content but I want to target a specific child folder. We tried the actual drive ID, folder name, web URL for that particular folder but faced below mentioned error Error - com.ataccama.extension.onedrive.connector.api.OneDriveConnectorException: Unable to connect to OneDrive This is the error message I get if we provide Drive Id

I need to create a complex duplicate check rule. I am familiar with the aggregation rule; however, in this case it won’t work for me. Here is the logic to determine duplicates: If the name, unit of measure, location, and type are all the SAME but the code (not a PK) is DIFFERENT then it is considered a duplicate. These would be considered duplicates: Code Name UOM Location Type 123 Trek LBS Houston Bike 234 Trek LBS Houston Bike This is not considered a duplicate because we can extend products to different locations instead of creating a new row: Code Name UOM Location Type 678 Razor LBS Houston Scooter 678 Razor LBS San Antonio Scooter When I write the rule, I use the aggregation rule to select name, uom, location type is not unique; however, that can give me false positives for the scenario above (Code = 678). I don’t see a way to say these fields are the same while this field is different. I am doing this in one web; however, I’m open to writing something in the desktop if there is

Is it possible to create and assign DQ rules from one desktop without using/taking any rules from one Web. I also want to know if we could assign dimension information to rules in desktop.

I have an Excel file that contains the SCI names, corresponding queries, folder name(workspace name), source connection name for each catalog item. I want to create a desktop plan which will help to generate the SCI though ONE Metadata writer or graphql query. Is there any possibilities to do that?

Hi, I have created a simple monitoring project with 12 catalog items for which I do only one dq check per catalog item + anomaly detection for this one attribute. However it seems that for this the system runs a full profile of every catalog item. Therefor this project is very heavy for the system to process. Can we adjust some settings so that the profiling is only run for this one attribute per table? Seems like a waste of resources this way. kind regards, Jur Dördregter

The Problem I need to connect to a Collibra API that has a tricky two-step login process: First, I get a temporary access token using a standard Client ID and Secret. Then, to actually get data, every API call must include two headers: the temporary token and a second, custom header called XFeedAuth that acts like a static password. The issue is that the standard Ataccama connectors (like the Collibra Reader or a generic server connection) don't seem to have a way to add that second, custom XFeedAuth header. My Plan & My Question My plan is to build the connection manually using two chained Json Call steps: the first step gets the token, and the second step uses that token and manually adds both the required headers. My question for you is: Does this sound like the right way to do it? Or is there a simpler, more built-in way in Ataccama to handle an API that requires both a bearer token and a second custom authentication header?

Is there a way to disable the “Create Task” option for Data Consumers (view only users)?

Can we restrict Admins to view sample data in Catalog or Invalid records in Monitoring Projects.

Hi ​@anna.spakova My manager wanted to get a metric on how many rules each person created. Is it possible to take the metric from ONE Desktop Plan?

Is there a way to implement data slices or leverage other techniques on Salesforce tables to monitor only specific attributes, rather than profiling the entire table? Our Salesforce tables are quite large, and attempting to profile the full dataset is causing our on-prem DPM service to crash. We're looking for a more targeted approach to reduce the load and improve stability. Any guidance or best practices you can share would be greatly appreciated.

Hi I am using v15.4.0 on windows 11 cloud pc and trying to run a small metadata reader project from Advanced DQ training projects that come along with ataccama installation. I’m getting the warning -’Status Tracking Issue’ when tried running it with correct Ataccama Environment selected. The result of the plan are not rendered but the job status is shown as completed on Admin Server. What could be the issue here? Any resolution that you can think of pls advise? cc: ​@Ataccama Community Admin

Hi ​@anna.spakova, Would Ataccama provides REST APIs to read metadata of rules, catalog items and monitoring projects? We would like to use python API capabilities and read the metadata from API in the form of JSON. Please let us know if this is a possibility.

hi Team, I would like to understand a couple of things related to implementation of slices directly on catalog item v/s filtering out records in sql or virtual catalog items and then using these items in monitoring projects (MPs) I am adding a data slice on a data catalog item X having e.g., 300 millions of records in total, sliced subset is having records around 30-35 millions - Question: when I run the MP, will it first pull all 300 records and then filter out those 30 million records based on slice and then do the DQ evaluation? Also, In case I use SQL catalog item (SCI), I am already cutting down undesired records, so I’m directly applying DQ evaluation on 30 million records, will it be faster in this case than above scenario? In any case, Slice / SCI/ VCI - how are we calculating the overall quality of the data catalog item here? Are there any guidelines on calculation of DQ on the whole dataset using output/score from DQ of subset of data. Really looking forward for your inputs h

Hey Community! I would like to create an overview with One Desktop that provides me insight in which assets have been shared with which groups/persons with which type of access. I have been checking the metadata model, but cannot exactly locate the relevant entities that I could use for this purpose. Does anyone have an idea? Maybe only possible with GraphQL? Kind regards, Albert

I need some assistance creating a AQL query for finding a table within a database and schema. How would this be written?

I have few monitoring projects in web but I would want to add them as components in workflows and run from desktop on schedule. Is it possible and if so what are the steps to do? Are there any pre-requisites for this? Thanks in advance!

Hi, Via ONE Desktop I created an invalid records component file which can be extracted in the Monitoring Projects → Export tab. It is in regards to a Float attribute. However, when I download the .xlsx file and open to check the invalid records it shows blanks. While if I check the database I see values. How do I show Float attributes within the .xlsx file?

Our team has just started using reconciliation project in Ataccama ONE UI, just wanted to confirm if we can apply a DQ rule on reconciliation projects, you can take a requirement e.g. if source data is having Wed as a record in an attribute and target is having Wednesday as a record in an attribute with same name, it shouldn't be highlighted as a different record.

We have environment with 14.5 and now we have established totally new environment with new Ataccama 15.4. We want to migrate all the object from one environment to another without manually re-creation of objects. Is possible to use metadata database & Audit Database of 14.5 in 15.4 Environment with some upgrade process so that all the objects can be accessed in 15.4 without any issues? What are the steps to be taken for this?

In Ataccama Monitoring projects, the email notifications currently provide summary details (e.g., number of failed rules, scores, etc.). Is it possible to customize the email notification content so that it also includes a snippet or sample set of failed records directly in the email body (instead of just attaching or linking to error tables)? If yes, what would be the recommended approach or configuration to achieve this in V15.4.1?

I have two BDE DPEs pointing to different Hadoop clusters. They have different cluster ids set in the configuration. In the DPM they both show up separately with their own configuration. In ONE Web I have a connection that uses DPE 1, which is working fine when only DPE 1 is connected. However, when both DPEs are connected I get the following error when I try to browse this connection: It seems to me that ONE Web can't seem to differentiate between the two DPEs. I have tried all kinds of different constraints in the application.properties files of both DPEs, but nothing has worked so far. Does anyone know if this is possible and if so, how I can get this done? Please let me know.

In One Web, with invalid sample records uploaded to ONE Data, we would like to filter data that failed on a particular DQ (Data Quality) rule and download it. However, at present, there is no way to download a filtered view. The system currently only allows us to download the entire table. This means that when we download the whole table, all the DQ rule filters are lost, and there is no way to figure out which rows failed on which DQ rule. This is quite problematic as we want to be able to download records that errored on a particular rule so we can send them to the appropriate team for corrections specific to that rule. Also, we often perform DQ evaluations on spreadsheets and setting up post processing or remediation plan on an excel sheet is not the most efficient approach. This is because each time there is a new version of the excel data, we would need to rebuild the whole plan again. Considering that the download functionality is already available, I believe adding an option to

Hi ​@anna.spakova Is it possible to download the list of rules (maybe using metadata reader if not from UI)? Also, anything/any links related to functionality of Export List Of Items option could help here. Thanks!

Hi I see we can configure PowerBI as data source in connections but want to know if it’s possible to use the BI report to be treated as catalog item to apply DQ checks and profile these.