Data Quality & Catalog ⚙️

How can I map custom input parameter for Validation component in Ataccama One Web UI?   

I have a workflow that runs multiple components. In the workflow I have a parameter called load_id that I would like to use to query all kinds of tables later in the flow. But if you use a JDBC Reader in your component you can't use the parameter in the query. You could if you were able to do an Alter Format before the JDBC Reader, but JDBC Reader allows no input.I've seen some tips here in the Community, like these: But initially I still ran into some issues before I got it working. So I decided to share a working example.This is my very simple workflow.It only has a Run DQC task that will run the component.But let me show the global variables in my workflow. I hardcoded the load_id, so my query would get rows back. Now lets look at the configuration of the Run DQC task: As you can see, I run the parameterinquery.comp component and pass on the load_id with the expression """"+load_id+"""" .On to my component:The Random Record Generator is the start of this, because with the JDBC Reade

Hi Community,In a term's listing (overview) page you can click on the term's name after which the detail page for that term opens. If you click beside the term's name a kind of preview pane or side window opens, also showing details for that particular term. So like this:In the details screen it is possible to change the page layout, which is especially important after having added custom properties, so that a logical layout can be retained.It looks though that for this preview pane the layout cannot be changed. Does anyone of you know how to accomplish this?Kind regards,Albert

Please advise if you have any documentation that provides a short description on each Ataccama functions pertaining to user access:  for exampleAtaccama Function Description  Administrator Data Owner Data Steward Custodian System   Full access       User Management   Full access Editing access View metadata access View metadata access Source   Full access Full access Full access View metadata access Connection   Full access Full access Full access View metadata access Folder Folders in Workspace are intended for storing SQL catalog items and virtual catalog items (VCIs).  Full access Full access Full access Full access Location   Full access Full access Full access View metadata access Catalog Item   Full access Full access Full access View metadata access Term   Full access Full access Full access View metadata access Rule   Full access Full access Full access View metadata acc

Hello everyone!In the new version of Ataccama 14.5, Is it possible to add comments on tables and fields from the database automatically to the Description field in Ataccama ONE, if the Description is empty and the Comment from the database is not empty?I will be very grateful for your help🤗Thank you!

I know that it is possible to use variables in filenames in a Text Writer (see here: Text File Writer: adding a datetime as suffix to an output file (ataccama.com)). But what about the Request and Response Debug File in a Json Call?I have a component for ServiceNow integration and I want to reuse another component to retrieve incident details. But when I run the main component I get this error:File file://d:/Ataccama/workspace/SNOW/distribution/debug/03_getincdetails_request_debug.txt must not be multiplicatively accessed in writing mode.The only way to get it all working, is by removing the Request and Response Debug File in the Json Call that gets incident details. A possible way around this would be if I could use variables in the filenames. But this does not seem to work in the same way that variables work in Text Writer steps (by putting the variable name between { } ).Is there another way?

Hello everyone,I’d like to set up access permissions in Ataccama One so that users within a particular stewardship group are limited to making changes only to that specific group (e.g., adding/removing users from certain roles within that group)?For example, HR users should only be allowed to make user related changes within the confine of the HR group.However, the user management seems to be a global page and does not have stewardship-specific access. If anyone has insights on how to achieve this restriction, could you kindly share your workaroundThank you in advance!Ben

Hi everyone, and happy Thursday!As I’ve mentioned starting this week, this post will be the last of the Ataccama ONE Web Best Practice Series for a while because…… we are moving on to ONE Desktop next week on! In this post, we’ll cover Workflows, and I highly suggest checking out the Tasks article from yesterday before reading it if you haven’t checked that out. It will help out with laying the foundation for workflows.Let's explore how these workflows supercharge your access and review request processes. Demystifying WorkflowsIn the realm of Ataccama ONE, workflows are your dynamic companions for handling access and review requests.Access Request Workflows automate data access change requests. Imagine needing higher access to an asset – this workflow empowers you to request and assigns the task to an approver, who can then give it the green light or a gentle decline.Review Request Workflows introduce automation to review changes made to data assets and get them published. If you hold

Hello:I really appreciate the commnity helping me solve more use cases and get value out of the investment we made in Ataccama. Now - i have another area that i need help with.We have a vendor that drops a file every night - this is not comma delimited and not fixed length. Based on the first character of the line, it decides the format of that lineFor ex: if char(1) is - 1 - then the lenght of the file will be 10 characters with first 5 characters as identfier and next five char as status.But if the first character is 2 - that means it is a different type record (type 2), that has 100 characters in length - and each of them fixed length positions. Now - when i scan that file through Ataccama, it is thinking the file attributes based on the first row. But is there a way i can give the metadata to the profiler?And by the way, i need this to be a monitoring project that runs DQ on a demand basis (that i would like to trigger through Airflow when the file arrives)can some one give me some

Term Detection Rule: Based on metadataRules based on metadata use information about asset, e.g. description, Catalog Item or data source name.Is there an option to expand this function to detect our “add custom metadata”?  For example:  On the Catalog Item level: Data Classification, Criticality, and Data Asset Type  

Hello Community. I have a vendor who shared their data through Snowflake Data Sharing. We added it as a data source and scanned the source to add the objects into my Data Catalog. I even have a sccheduled job that scans this source everyday (end of day) for sample profiling.Today, we had an issue that 10 of the tables that were previously present in the shared data source, were dropped, two new tables created, and some of the tables, have new fields added, existing fields removed, some fields renamed.This source is about 300 tables, but some of the tables ahve about 700+ fields. So, I would like to know best way for me to get a report/alert/notification onany new tables added to the source any existing tables dropped any existing table modified with new fields added any existing table modified with existing fields dropped/removed. What is the best way to accomplish this?For the dropped tables that previously existed, my end of day profile job is showing error in the DPM (because the ta

Data Quality checks on catalog item can they automatically come into monitoring project when that item is added to MP? Here is my challenge:I have catalog items with 20 or more checks. If i add them to monitoring project - it does not automatically show as “Data Quality” for that catalog item itself. And when i add the checks to the Catalog item, they are not coming to monitoring project when i add that catalog item to the MP.Iam needing to add/configure all the rules separaely - both at Catalog item level (to get DQ percent score for that object), and also at the Monitoring project level. Is it possible to add the DQ rules - just to the Catalog item, and when I add that catalog item to the MP, it should automatically bring the existing rules on that object into the MP?​​​​

HiWe are interested to export metadata information into excel or CSV using “Export list of Items” option (see attached image).However, this is disabled in some screens.While there are ways to use desktop components to read metadata and export to CSV, this process is highly cumbersome and still doesn’t solve the purpose.Are there anyother alternatives?

Hello: I have a data source with 300+ tables. I have a daily profiling job (sample data).Sometimes, when a table gets changed, and a new field added/existing field dropped, when i open that table in Data Catalog, and in the “Data” tab, it shows that “N” number of metadata changes happened that are marked with a “yellow triangle” symbol (warning/alert).But, Iam able to see the list of fields that got changes, but iam not able to figure out if it is a new field added or existing field dropped or existing field changed??How can i get this data? 

How can I enable connection page to show glossary/business terms along with other properties. I tried editing the page template but not sure what details to add for fetching those details. 

Hello Dears,Who went through migration from 13.9 to 14.5  or even to 15.2? How did it go?We were planning to upgrade soon to 14.5, but were surprised realizing how much manual activities it will take from our side. Such as recreating all monitoring projects, lookup files, post processing… My question: will migration to newer version always required so much manual intervention or it is only when it comes to migration from 13.9 to 14.5? Thank you in advance.Kind regards,Maria 

Is it possible to customise the subject (screenshot below) and add things like DQ rule or Project name by any chance? Currently it just returns “Project run finished”.  I have some groups with several monitoring projects and would like to know the project name in the subject line itself.And having the ability to add overall Data QUality results of that MP in the subject line will be a definite plus.For Ex: “Project run finished for Security Master Start of Day at 5:05AM PST on 4/2/2024 with overall Data Quality of 84%”(the bold and underlined above would be variables available for that monitoring project)

We need  the change datetime of rules, catalog items, attributes and monitor projects. How can we extract these using one Desktop. In One Web for these assets the history can viewed, but I don't see where I can get these change dates from. Where is the version information stored and how can we read that info?

Can we create a lineage in Ataccamma which shows the lineage from source till the target?There are many stages involved before reaching the target. This lineage should help me in doing root cause analysis when a column has a different value in the target(Delivery). can someone help me on this?

Hi everyone! This week we continue to explore different features of Monitoring Projects ✨Each day this week, we will share a best practice post on Monitoring Projects. We are kicking it off with a popular feature - notifications 🔔 General NotificationsThere are two types of notifications available: General and Specific. General notifications cover various scenarios such as monitoring failures, critical structure errors, new results availability, data quality issues, and anomalies. Specific notifications offer even greater granularity, allowing you to set custom data quality thresholds and filter conditions for triggering notifications.Adding General NotificationsTo set up notifications for predefined scenarios:Navigate to the Notifications tab of your project.   Under General, select Add Notification to create a new notification or Edit an existing one. Provide a name for the notification. Choose the events that should trigger notifications (e.g., Monitoring failed, New version of re

Hi Community, Is it possible to customise the subject (screenshot below) and add things like DQ rule or Project name by any chance? Currently it just returns “Project run finished”.  

Dear community,In the overview screen of an entity, like the business terms screen, each column has some predefined width. Some of the term names are long and are cut off because the column is too small.Is there a way to define the width of a column yourself?Thanks and kind regards!Albert

I have an Ataccama workflow (EWF file) developed in ONE Desktop that executes after an ETL job. The workflow kicks off multiple data quality monitoring projects, extracts and aggregates their results, generates a Tableau hyper file from those results and publishes it to Tableau server. I’m currently executing that workflow on a dedicated server, but would prefer to deploy it to Ataccama server and execute it via an API call.Is there a way to deploy and execute workflows on Ataccama server?

We are on 14.5.1.We have a custom property on our terms, that currently is mandatory.We want to find out if we can change it to non-mandatory. When I click on edit on the property, it only allows me to edit the name.Is it possible to turn off the mandatory flag?