Skip to main content

Data Quality & Catalog ⚙️

Discuss, learn, ask, suggest, share all things DQ&C 🔍

  • 788 Topics
  • 2,012 Replies
788 Topics
M
Data Voyager
mdaflucasData Voyager
asked in Data Quality & Catalog ⚙️
How do I evaluate multiple columns for possible composite primary key?

I have a legacy database without primary keys.  I know how to evaluate a single column for uniqueness, and thus a primary key. How do I evaluate multiple columns which together would be unique and thus be a composite primary key?

711
DannyRyan
Ataccamer
G
Data Voyager
GregersData Voyager
asked in Data Quality & Catalog ⚙️
DQ analyzer windows version update

HiI’m running your free version of DQ Analyzer, but when I want to run my profiles this can’t be done.   As I understand it, it is due to a needed version update.Can you advice how I get my license key updated and not losing my existing profiles and still running the free version?I do not want to install Ataccama One.

3924
A
A
Ataccama Community AdminIntergalactic Expert
published in Data Quality & Catalog ⚙️
Lookup Items and Rules ✍️Best Practice

Hi Community!We are starting the week by exploring best practices for effectively working with Lookup Items and integrating them into your Data Quality (DQ) rules. Lookups are essential in ONE Web Application as they provide a list of predefined values for attributes, enhancing data validation and detection capabilities.If you remember we have previously covered how to create Lookup files in rules in our Working with DQ Rules series, today we will expand on the lookup items feature. Overview of Lookup ItemsLookup Files in ONE Web Application enable you to use reference data, offering a catalog of predefined values for an attribute. You can utilize Lookup Files in both DQ Evaluation rules and Detection rules. To find Lookup Files, go to Data Quality → Lookup Items.  Uploading and Creating Lookup FilesCreating Lookup FilesTo create a Lookup File, follow these steps:In Knowledge Catalog, navigate to Data Quality. Select Lookup Items and click Create. Provide the required details, such as

3040
A
anna.spakova
Ataccamer
anna.spakovaAtaccamer
published in Data Quality & Catalog ⚙️
Migration of permissions from version 13 to version 14Tutorial

Hello everyone, Anna here! I work as a projects consultant in Ataccama and today I put together a guide for you on how to migrate permissions after upgrade of v13 to v14. In v14, we introduced a fresh new permissions model introducing Groups and Stewardship. The downside is, though, that after the upgrade the old permissions model cannot be automatically migrated into the new setup.Attached to this guide is a migration package – a set of plans that you can use that will help you through the process of migrating the old permissions into the new setup in more automated way. It is not meant for fresh v14 installations.The article is split to two parts:Preparation phase – steps you need to do BEFORE you upgrade your environment to v14. Post-upgrade phase – steps you need to do AFTER the upgrade, meaning in your new v14 environment.Preparation phaseFollowing steps should be run on version 13 prior running the migration scripts and upgrade of the environment.1. Create server connection in ON

2780
anna.spakova
Ataccamer
A
Ataccama Community AdminIntergalactic Expert
published in Data Quality & Catalog ⚙️
Introduction to Working with Components - Desktop Edition⛏️Best Practice

Happy Wednesday Community!Today’s post will cover how to work with component rules on ONE Desktop Application. If you missed yesterday’s article we had an introduction to working with components on ONE Web. Check it out here: Component rules play a crucial role in tackling complex data validation tasks that may go beyond what standard DQ rules in the web application can handle. By leveraging component rules, you can define custom validation logic tailored to your specific data quality requirements.To ensure accurate and effective results, follow these best practices when working with component rules:1. Creating a Component Rule on ONE DesktopTo create a component rule, follow these steps: Open ONE Desktop and add Ataccama ONE Platform Server by creating a new server connection. Navigate to the ONE Metadata Explorer tab. Select the component you've created in ONE Web Application (e.g., "Email Check" in this example). For more information on creating a component in ONE Web Applicatio

2010
A
A
Ataccama Community AdminIntergalactic Expert
published in Data Quality & Catalog ⚙️
Introduction to Working with Components ⛏️
Introduction to Working with Components ⛏️Best Practice

Hello everyone! Welcome back to our Data Quality (DQ) series. Today, we're diving into component rules!We're also excited to announce that we'll be hosting a live training session on component rules on July 27th. Don't miss the opportunity to learn from our certified trainer and engage in live Q&A. Register now here!  Component Rules, also known as components, are a powerful feature in the ONE Desktop application. They serve three key data processing purposes: Post-processing components: These components allow you to perform various actions on your data after processing it based on predefined rules. You can easily apply transformations, validations, or any other required post-processing steps. Transformation components: With transformation components, you can automate the process of transforming data records according to specific rules. For instance, you can standardize gender markers to "M" and "F" while transforming any other variations to these standard values. Validation co

1630
A
R
Data Voyager
ritguptaData Voyager
asked in Data Quality & Catalog ⚙️
Row Count Comparison Between Source and Target

Hi,I want to compare the number of not null records in source (custom sql using JDBC writer) and target (salesforce object) using a VCI. Is there any way to do that in Ataccama version 14.1.0. The aim is to get the records which are in source and not in target and records which are in target but not in source.Thanks.

1863
anna.spakova
Ataccamer
A
Universe Traveller
Ajeesh_GUniverse Traveller
asked in Data Quality & Catalog ⚙️
How to run WorkflowInstanceState file

I am using desktop app, and I want to schedule the workflow. Can anyone give some idea of scheduling workflows? I am trying to achieve the task ie. run the flows as per scheduled time(either weekly or monthly - like 5th day of each month)Below is the screenshot that I am having the file, but some how it is not working for me.Thanks in advance. 

291
A
S
Data Pioneer
suryakanth.EmishaData Pioneer
asked in Data Quality & Catalog ⚙️
Ataccama IDE - Postman Api tool integration tutorial?

Hello all, i have a task of validating email with the help of api. I want to know is there any documentation which properly explains the integration of postman api to ataccama desktop? or is there any tutorial for working on with apis' using ataccama. Graphql is there but i'm in need of a very basic one to execute and practice.Thank you!

1792
S
Data Pioneer
A
Ataccama Community AdminIntergalactic Expert
published in Data Quality & Catalog ⚙️
Introduction to Aggregation Rules
Introduction to Aggregation RulesBest Practice

Hi all! We hope you’re enjoying our DQ Rules best practice series and finding useful tips & tricks to implement in your day-to-day work. In this post, we will cover aggregation rules and give an overview of creating and configuring aggregation rules to unlock the grouping capabilities.Aggregation rules in Ataccama's ONE can be used in various types of data quality rules, such as Validity, Uniqueness, Completeness, Timeliness, and Accuracy. Let's dive in! How to create aggregation rules?To create an aggregation rule, follow these steps:Select "Aggregation rule" as the rule type in the ONE web application.   The "Group by" section will now be available, allowing you to define the grouping criteria.You can create aggregation rules using either the condition builder or ONE expressions, both of which offer flexibility and ease of use. These methods allow you to select input attributes, apply transformations to create variables, and aggregate data based on the desired grouping. No Code

2780
A
DannyRyan
Ataccamer
DannyRyanHead of Technical Training
published in Data Quality & Catalog ⚙️
121. Managing Comments

In this tutorial video, you will learn how to efficiently manage comments in the Ataccama ONE platform. Discover the step-by-step process of closing, reopening, and deleting comments, allowing you to keep your comment sections organized and up to date.In this video, we will guide you through the key features of comment management in Ataccama ONE. You will learn how to close a comment when its content has been resolved, providing clarity and closure. We will show you how to navigate to the "Closed" tab to access and view previously closed comments, ensuring easy reference and tracking.Reopening a closed comment is made simple in Ataccama ONE. We will demonstrate how to reopen closed comments, making them visible again in the "Open" tab. Keep in mind that if a comment has replies, the entire thread will be reopened, maintaining context and continuity.Additionally, we will explain how to delete comments that are no longer necessary or if a mistake has been made. You will learn the criteri

190
DannyRyan
Ataccamer
K
Data Pioneer L2
KundanData Pioneer L2
asked in Data Quality & Catalog ⚙️
How to connect to One Data

How to connect ONE DATA as a source  ?What's the URL value that is required to connect ? 

583
DannyRyan
Ataccamer
A
Ataccama Community AdminIntergalactic Expert
published in Data Quality & Catalog ⚙️
Working with Data Quality (DQ) Rules - Part 1️⃣
Working with Data Quality (DQ) Rules - Part 1️⃣Best Practice

Hi community! In this post, we will explore how to create and implement DQ rules effectively. Rules play a crucial role in ensuring data quality, and understanding the process is essential for data management. So let’s get started! Creating Rules Manually To create a rule from scratch, follow these steps:Navigate to the Data Quality > Rules page. Click on Create in the upper-right corner. Provide the necessary information: Name: Give your rule a descriptive name. Description (optional): Add a brief description of the rule and its purpose. Rule definition source (optional): Specify the associated data source for the rule. Stewardship: Select the owner group responsible for the rule's accuracy and approval. Click Save to create a draft of the rule.     Before publishing or submitting for approval, you need to define the rule logic. Proceed to the Implementation tab for further steps. Implementing Rule Logic On the Implementation tab, you can perform the following tasks:Add a descr

4020
A
A
Data Pioneer
aiwaliaData Pioneer
asked in Data Quality & Catalog ⚙️
Parsing XML with repeated tags containing data

I am trying to parse an XML File that has data related to employees in the following format<TABLES>        <DATA>            <item>                <WA>Emplyee1No Employee1Name Employee1PhNo Employee1Email</WA>            </item>            <item>                 <WA>Emplyee2No Employee2Name Employee2PhNo Employee2Email</WA>            </item>            ….            ….       </DATA></TABLES>I am using XML parser to parse this but it does not give any result.I think the issue is with the same tag containing multiple records.As I am able to parse it when there is just one record i.e. one <WA> and <item> tag.Can anyone please help me with this?

4998
A
Data Pioneer
A
Ataccama Community AdminIntergalactic Expert
published in Data Quality & Catalog ⚙️
Understanding Detection and Data Quality (DQ) Rules in Ataccama ONE 🟣
Understanding Detection and Data Quality (DQ) Rules in Ataccama ONE 🟣Best Practice

Hi everyone, We are continuing with our Data Quality best practice series! In the next several posts we will cover everything from Rules to Monitoring Projects in Data Quality. If you have missed the introduction series to DQ you can start here:In this post, we'll explore the concepts of Detection rules and Data Quality (DQ) rules in Ataccama ONE's web application. Understanding these rules is crucial for effective data management. Let's dive in! Detection Rules Detection rules in Ataccama ONE are divided into two categories: Data-based detection rules and Metadata-based detection rules. These rules serve different purposes and can be accessed and created from the "Data Quality > Rules" section. Let's take a closer look:Data-based Detection Rules: These rules evaluate attribute data and are used to assign terms to attributes based on predefined conditions. For example, you can create a rule to assign the term "First Name" to attributes that contain values found in a specific lookup

6190
A
M
Data Voyager
maneelloydsData Voyager
asked in Data Quality & Catalog ⚙️
Update CDE of a rule

Hi All, Our requirement is to use an api call for removing a cde term and adding another cde term associated to a rule.we thought of using PUT /rule-versions/{id} api. However some points we noted. in one webapp for the ruke, if we remove cde and add another cde, the rule gets created as a newer version. We just want to update the existing version Please let us know which api we can use?

463
A
A
Ataccama Community AdminIntergalactic Expert
published in Data Quality & Catalog ⚙️
A Beginner's Guide to Data Quality: Introduction 101 - Part 3 ✨Best Practice

Hi everyone! Welcome to the third (and the last) part of our introduction series! The continuing posts will be focused on diving deep into the functionalities of DQ. If you have missed the first two posts you can check them out here:In this post, we'll explore the best practices for monitoring data quality in Ataccama ONE. Monitoring your data quality allows you to track important metrics in real-time and identify potential issues. Creating a Monitoring ProjectTo create a new monitoring project, navigate to "Data Quality" and select "Monitoring Project." Click on "Create" and provide a name and description for your project. On the "Configuration & Results" tab, choose the catalog items you want to monitor. You can monitor multiple catalog items within a single project as long as it makes sense for your organization's data quality requirements. Customizing DQ DimensionsIn each monitoring project, you can customize the DQ dimensions that contribute to the overall data quality. Look f

2450
A
T
Data Voyager
thomas.prociukData Voyager
asked in Data Quality & Catalog ⚙️
Desktop: Pulling down rules from Web, change rule logic in Desktop version, then reupload back to web version

Hello!My team and I are working on connectivity to be able to pull rules down from the web version into the Desktop version, make some minor tweaks, and then reupload them back to the Web version. Is this possible? We have our ONE platform connected to our desktop and can see all of our catalog items and rules, but when I try and drag a rule into a component / plan or make any changes, we get an error and we can only view the rule. Has anyone ran into similar issues? Or are we attempting to do something that the Desktop version does not support? Any answers would be appreciated, thanks!

651
anna.spakova
Ataccamer
JTH
Data Pioneer
JTHData Pioneer
asked in Data Quality & Catalog ⚙️
Set treshold through raw numbers

Hi, In Ataccama web there's a way to set a certain treshold about validity when monitoring (default is 70% I believe). Is there a way instead of percentages to have it as raw number of records?Basically the idea is that I want to see the treshold met when (example) 100 records are met. The amount of records added to the dataset varies hence percentages might not work for me.Currently I have 1000 records. 100 are invalid. Treshold could be set to 10%.But if overnight 4000 records are added totalling 5000 records then 2% is invalid, assuming the invalid numbers stay the same. In the ideal world I want to be able to make a choice whether I want the treshold to be set through percentages or raw number. Because in this scenario I'd still like to be given a notice 100 records are invalid.

331
A
P
Data Voyager
parveshsoniData Voyager
asked in Data Quality & Catalog ⚙️
Mapping role keycloak roles from Gen1(12.8) to Gen2(13.9/14.3)

Hi All,I would like to map keycloak roles present in gen1(12.8) to gen2(13.9/14.3).Has anyone done this activity while migrating Ataccama 12.8 to 13.9/14.3 version? Thanks,Parvesh Soni

591
A
G
Data Enthusiast
GersonData Enthusiast
asked in Data Quality & Catalog ⚙️
Apply DQ rule on a boolean type

I am trying to apply a rule on a boolean type attribute to find if the value is “Ja” or "Nee”. However I couldn’t  achieve the expected outcome with advanced expression as its a bolean type. Also looked in to the documentation for one expression.Any suggestions to get the similar results with boolean type attribute?

1481
M
Ataccamer
A
Ataccama Community AdminIntergalactic Expert
published in Data Quality & Catalog ⚙️
A Beginner's Guide to Data Quality: Introduction 101 - Part 2 🟠
A Beginner's Guide to Data Quality: Introduction 101 - Part 2 🟠Best Practice

Happy Wednesday community ☀️ Welcome back to our Data Quality series! In today's post, we'll delve deeper into configuring detection and validation rules in Ataccama ONE. If you missed our previous post, we recommend checking it out before continuing.Configure Detection LogicTo define your detection rule's logic, navigate to the "Implementation" tab when creating or editing a rule. If you're starting from scratch, select "Detection" as the rule logic. You can add multiple conditions using the Condition Builder, with each record needing to fulfill all conditions by default (using the logical operator AND). For less strict rules with the logical operator OR, try the Advanced Expression mode. Take advantage of Pattern Analysis results to create detection rules quickly. For instance, open the "Profile & DQ Insights" tab for the catalog item "customers," select the "email" attribute, and utilize the detected patterns by choosing "Use results in rule." Save your changes and don't forget

2910
A
JTH
Data Pioneer
JTHData Pioneer
asked in Data Quality & Catalog ⚙️
Comparing values from two tables

Hi,Situation: I wrote a(n) SQL catalog item joining multiple tables and in Ataccama I'm using rules to compare the values if they are the same. LONG = LONG, check if the nr_loan = the same a.nr_loan, etc.My question is if there's an easier way to see if two tables are identical. I'm doing this to check the integrity.I couldn't find anything relatable asked in the community.  

2434
A
S
Data Pioneer
suryakanth.EmishaData Pioneer
asked in Data Quality & Catalog ⚙️
How to detect duplicate records from a particular attribute in One Web?

Hello all, is there anyone who knows about creating a rule to detect the duplicate records of a particular attribute and mark it as duplicate using one web?

1102
A
Catherine
Data Pioneer
CatherineData Pioneer
asked in Data Quality & Catalog ⚙️
Catalog Item with associated Term assigned reporting

How do you extract the catalog item with their associated terms (final) in a report?

1034
Catherine
Data Pioneer

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings