Data Quality & Catalog ⚙️

Hi all, how can I export a single report from the monitoring project that includes two tables (more than 2), each containing different data quality (DQ) rules?

When I add a property cdeIndicator its displaying as Cde Indicator. I want it to display as “CDE Indicator” how to do that in metadata model?​@anna.spakova , ​@Catherine

Hi guys, I have a few use cases where I need to perform both row level DQ evaluations (like completeness/format check, etc.) and table level (aggregations on specific fields like sum of sales/count of products etc.) DQ evaluations on the same data set. When I applied both the types of checks on the catalog item, it’s taking a lot of time in running the profile + DQ checks. We are having data volume of few hundred millions (~450Million records). At present I have created two separate sql catalog items one for row level checks and second one for table level checks. I wanted to know if it could be achieved using single dataset without facing any performance issues. Please suggest. Version is 15.4.1

Hi there, I have created a sql catalog item and published, profiled as well and would want to check/update the query if needed corrections. I don’t see options anywhere on the tabs (e.g., Data Quality/Relationships etc.) available on catalog item. Please help. I am using v15.4.1

Hi, I have created a VCI along with its component though One Desktop and published it successfully. Now, my teammates are unable to find the component, but they could find the VCI in both Desktop and Web and they are able to utilize the VCI as well. Any information regarding this would be helpful. Thanks! Note: Ataccama V15.4

Currently I have two plan files. The first one retrieves the CSRF Token (In the response debug file). The second one uses the response debug file and extracts the Cookie and the CSRF Token but when I pass these two to the JSON Call in the final step to write some data to SAP. I get the CSRF Token Validation failed.I am extracting these from the Response debug file and passing them in another JSON Call: Any suggestions on how to solve this issue?

whenever MDM encounters errors mdm needs to have call back mechanism where mdm sends out trace_id and source_id back to the queue for each failures. Is there a recommended approach to identify records that were not processed—along with their associated trace_id and source_id—and requeue them for reporting purposes?

how to resolve ‘Unable to use the config file provided, exiting.’ error

Does anyone know how to essentially recreate a freshness check rule with the data quality rules so we can assign the DQ rules to a monitoring project? We are working in Ataccama One Web and do not want to use Ataccama One Desktop currently. I have an attribute that has the date/time new records are loaded into our table. If we get at least one new record on the current date, then we want every single record in the table to pass. So with one record uploaded on the current date, the monitoring project will pass with 100% data quality. However, if no record is loaded on the current date, then the monitoring project will fail with 0% data quality. What is the best approach to set up a rule like this? Thank you in advance! We want to use the monitoring projects automation capabilities vs manually running the freshness check from the knowledge catalog every single day.

Is it possible to mask data for some users, for example out of privacy reasons? I know masking was a feature in version 1 and for some reason was removed in Gen 2, but how could this still be achieved as it is a much asked requirement, that certain users should not see certain attributes and no, I don't want to create a VCI copy of each asset that has such columns and replace that column with some dummy value, that's not masking.

Every time when a upgrade happens it resets the runtime config, and we are losing all the database connections and URLs and important configurations this is breaking our workflows to run successfully and its failing then we need to debug and its time-consuming process so looking how others are handling this situation

Hi Community people! I have a question regarding data observability. I am especially interested in noticing changes in record volume and applying this observability functionality in the process of a data delivery. This delivery is orchestrated with a tool, Jams in our case, starting with data retrieval and ending with the actual data delivery. Somewhere in this data flow orchestration I want to check for anomalous changes in record volume. The orchestration tool could then, for instance just before file creation, trigger an observability job to check the underlying database tables for record volume. But when configuring data observability I see a scheduler, which does not match with the idea of an orchestrated flow. So question 1 is if data observablity can be triggered.Maybe in a scenario where the orchestration tool starts an Ataccama job via a command, like a workflow that starts the observability and reads the observability results and returns an OK or Not OK to the orchestration t

Hello, I am using Ataccama V15.4 I am trying to set criticality of certain rules in monitoring projects based on which the overall quality of my datasets should be defined. I tried using score option but IDK it’s not as convincing as setting levels like sev 1,2 etc. Thanks.

Hello. I am trying to create a workflow which runs DQC and send .csv file via email. And it works fine. Challenge is - I need to add current date in file name as well when it is sent via email. I need guidance on how to do that. Thanks.

Is it possible to create a connection in the Ataccama One IDE to a FTP server because when I am trying to create a connection the following error is showing- Can someone help me with the following.

I am looking for a way to load data that has many columns that keep changing. For Example the first 2 columns would be the qualifier fields and all columns after that would be an attribute: example from to having it like this It is possible to create with an excel file reader and an Alter format step, but the columns will be different in the next file and if no Oranges were taken that column will not be in the file so the job will fail. Also the actual number of ever changing columns can be anything from 20 to 400 - so setting your qualifier fields and automatically adding anything that comes after that as an Attribute field seems like the solution I need. Anyone have any ideas?

Hello, I am using the email notification option from Ataccama on completion of monitoring projects. At present, I am manually configuring the recipients list of the email notification but would like to know if it could be automatically populated using the ownership/stewardship details provided on the monitored data object? Let me know if it’s possible? Thanks!

Hi, I'm currently working on customizing the layout of the monitoring project reports, especially within the Reports tab that displays detailed DQ results and anomalies. I want to change the order of columns in the detailed results view—for example, I’d like the "Dimension" column to be the second column. I’ve tried editing the page template for the project.Reportpage, but there don't seem to be many options available after this point to control column order or presentation. Has anyone successfully reordered columns in this view? Is it possible through deeper configuration, or are we limited by the template’s default structure? If direct reordering isn’t supported, is it possible to create another table within Ataccama that contains the same data but in a custom order? If so, what’s the best approach? Any guidance or best practices from those who have dealt with similar requirements would be greatly appreciated! Thank you!

Can we get results at column level where filter is applied. For ex: For Ashville city total records are 6 and failed is 1. Similarly at each rule level passed and failed count. Like this we have to get results of all the cities present in that column.

Hi! I want to extract json schema from a json blob that is stored in a binari datatype field in sql server database. A lot of the fields in my schema are optional, though I want a total overview of all available fields and the entity they belong to. All is now stored in one field, but I want to use the schema to create a data source structure through which I can navigate and ideally also get profile & dq insights from. How can I achieve this? Is there something out of the box available for this? Kind regards, Jur Dördregter

Hi There, We would like to know if the below mentioned Data Quality rules can be exposed as an API through Ataccama One App or One Desktop. Data Quality rule which calls a third party service - say loqate for address validation. Our understanding is that we have to write a plan to invoke loqate. Is there a way to expose this plan as an API to front end application? The usecase here is for the application to call Ataccama for all data quality validations through API calls. If it can be, could you please share the steps? Are there any known challenges? Lookup data quality rules - Can lookup DQ rules be exposed as an API using the steps in DQ Firewalls :: Ataccama ONE

COE(Close) date must not be in future and must be after sales date.The COE date is in DATETIME and Sales date is in Date format in table. So I created a rule as [SALES Date] IS NOT NULL AND [SALES Date] <= toDate([COE DATE]), but the Monitoring project is failing when added this rule on sales date

I need to create Catalog items while my source is distinct XML file.Is there any existing process or we need to create new framework . Please explain detail solutions to work on this requirement.

Hello Community, Could you please guide me on how to connect to Microsoft Fabric from Ataccama Desktop? What are the prerequisites or requirements for this connection? Could you also share the detailed steps involved in setting it up? Thank you in advance for your support!