Data Quality & Catalog ⚙️

Hi everyone! Welcome to the third (and the last) part of our introduction series! The continuing posts will be focused on diving deep into the functionalities of DQ. If you have missed the first two posts you can check them out here: In this post, we'll explore the best practices for monitoring data quality in Ataccama ONE. Monitoring your data quality allows you to track important metrics in real-time and identify potential issues. Creating a Monitoring Project To create a new monitoring project, navigate to "Data Quality" and select "Monitoring Project." Click on "Create" and provide a name and description for your project. On the "Configuration & Results" tab, choose the catalog items you want to monitor. You can monitor multiple catalog items within a single project as long as it makes sense for your organization's data quality requirements. Customizing DQ Dimensions In each monitoring project, you can customize the DQ dimensions that contribute to the overall data quality. Look fo

Hello! My team and I are working on connectivity to be able to pull rules down from the web version into the Desktop version, make some minor tweaks, and then reupload them back to the Web version. Is this possible? We have our ONE platform connected to our desktop and can see all of our catalog items and rules, but when I try and drag a rule into a component / plan or make any changes, we get an error and we can only view the rule. Has anyone ran into similar issues? Or are we attempting to do something that the Desktop version does not support? Any answers would be appreciated, thanks!

Hi, In Ataccama web there's a way to set a certain treshold about validity when monitoring (default is 70% I believe). Is there a way instead of percentages to have it as raw number of records? Basically the idea is that I want to see the treshold met when (example) 100 records are met. The amount of records added to the dataset varies hence percentages might not work for me. Currently I have 1000 records. 100 are invalid. Treshold could be set to 10%.But if overnight 4000 records are added totalling 5000 records then 2% is invalid, assuming the invalid numbers stay the same. In the ideal world I want to be able to make a choice whether I want the treshold to be set through percentages or raw number. Because in this scenario I'd still like to be given a notice 100 records are invalid.

Hi All, I would like to map keycloak roles present in gen1(12.8) to gen2(13.9/14.3). Has anyone done this activity while migrating Ataccama 12.8 to 13.9/14.3 version? Thanks, Parvesh Soni

I am trying to apply a rule on a boolean type attribute to find if the value is “Ja” or "Nee”. However I couldn’t achieve the expected outcome with advanced expression as its a bolean type. Also looked in to the documentation for one expression. Any suggestions to get the similar results with boolean type attribute?

Hi, Situation: I wrote a(n) SQL catalog item joining multiple tables and in Ataccama I'm using rules to compare the values if they are the same. LONG = LONG, check if the nr_loan = the same a.nr_loan, etc. My question is if there's an easier way to see if two tables are identical. I'm doing this to check the integrity. I couldn't find anything relatable asked in the community.

Hello all, is there anyone who knows about creating a rule to detect the duplicate records of a particular attribute and mark it as duplicate using one web?

How do you extract the catalog item with their associated terms (final) in a report?

How can I set-up email in workflow? I am using Microsoft 365 Please help

Hi everyone! This week, we are continuing to explore the Ataccama ONE platform basics. Today, we are looking into Tasks and Collaboration. Collaborate with Your Team Collaboration plays a vital role in any project, and ONE DG makes it simple for you. You can easily comment and initiate conversations with your team members by using the comment section. To notify someone specifically, just tag them using the "@" symbol. You can even add emojis and gifs to make your discussions more lively! Don't worry about missing any updates - you'll receive in-app notifications whenever someone tags you or responds to your comments. Streamline Your Workflow with Tasks The Task management system in the Ataccama ONE Platform helps you keep track of your work and ensures efficient progress management. The system organizes tasks into a Kanban Board, providing a visual representation of your workload. With tasks, you can perform the following actions: Create and manage tasks and their subtasks. Assign task

Hi Everyone, My DQ and KeyCloak is running integrated for authentication but the password in the attribute name=”truststore-password” is using password without encryption. I tried to encrypt via command encrypt.bat on DQ but without success. I just have a success in the authentication using clear password. Is there someone that have success to encrypt the value for the property truststore-password with keycloak? <config class="com.ataccama.server.keycloak.KeycloakDeploymentContributor"> <keycloakConfigs> <keycloakConfig name="keycloak-admin-center.json"> <!-- Define common parameters for all clients. They can be overridden by client-specific settings.--> <url>https://srvkeycloak:8446/auth</url> <realm>ataccamaone</realm> <attributes> <!--<attribute name="ssl-required" value="external"/> --> <attribute name="enable-basic-auth" value="true"/> <attribute name="ssl-required" value="all"/> <attribute name="truststore" value="C:/dqs_12.6.3_win_x86_64/keycloak/standalone/configuration/keycloa

Hi all! Hope you are enjoying our getting started series 😎 In this post, we will cover Business Glossary and learn more about Business Terms. Business terms play a crucial role in analyzing data, as they provide the basis for evaluation and quality checks. You can establish expected values and gain deeper insights by assigning terms to specific data elements. The Business Glossary automatically maps these terms to real data sources, ensuring that your catalog is always up to date and synchronized with the latest assigned terms. Plus, an unlimited hierarchy structure lets you visualize the relationships among different data elements, systems, and processes. Let's explore the different types of terms you'll encounter in the Business Glossary: Business Terms: These are predefined labels that help you understand and organize your data. They are assigned based on set conditions. Custom-Created Terms: This term group allows you to create your own terms according to your specific needs. For

Hello all, I have a task of detecting duplicate records from particular tables. So is there anyone who know about creating rule for this, a rule to detect duplicate values and mark it using One Web and One Desktop?

I have a workflow(.ewf file) which in turn calls several components and workflows. How do i run the workflow and get to know the trace of which all components and workflows are executed? Is there any property that can be enabled which will give the components and workflows that are getting executed? If there is some kind of information like input to each step and output from the step that also would be useful

From the ataccama one url, click environment settings, create environment we have the below properties executor endpoint admin center execution mode then we have the option to add a datamart, with a jdbc string. What exactly is the executor endpoint, admin center and execution mode? is the datamart a place(database) to store something from the executor(server)? Please provide some links which explains this.

I need the jar files to create a neo4j database connection from ONE desktop.Can anyone please help?

Hello, I want to use “SFTP Download File” and use a wildcard for the filename and a date. Is that possible ? For example : /<mydirectory>/input/MYFILE_<TODAY_YYMMDD>_*.txt When i enter an asterisk symbol in the “File or Directory” section, I get an error. Thanks, Rene Requenes

Can anyone provide a document or link on how to effectively navigate and interpret the logs in the OperSearch Discovery portal? Our client is using Ataccama PAAS. And sometimes we go to OperSearch Discovery for logs. I find challenging to understand. For instance, to locate runtime errors, I need to input "Kubernetes.container_name = runtime-server" in the filter section, followed by "error" in the search section. This will display any errors related to the runtime server. Otherwise, the log page appears to be quite intricate. Any help or link is very much appreciated.

Hi I’m Using the Windows DQ Analyzer - free version. I have used the business rules functionality, but I have been wondering what the idea behind the “null” value is? And what makes data fall into the “null” value? Br. Gregers

Which ONE Metadata Reader entity type will let me read the all suggested business terms against all items?

DPM and DPE - Ataccama ONE Gen2 Platform Latest Once DPE connects to a data source, it creates metadata and optional sampling of records that do not satisfy DQ rules. Could you please answer the following questions or direct me to a link that can answer the below questions?1. Does DPE create other temporary files as a result of processing as well?2. What happens to the metadata, sample records that do not satisfy DQ rules and any temporary files generated during processing after the connection to the data source get closed?3. How does purging of data works in Ataccama?