Discuss, learn, ask, suggest, share all things DQ&C π
Recently active
HiIβm running your free version of DQ Analyzer, but when I want to run my profiles this canβt be done.Β Β Β As I understand it, it isΒ due to a needed version update.Can you advice how I get my license key updated and not losing my existing profiles and still running the free version?I do not want to install Ataccama One.
HiΒ Community!We are starting the week byΒ exploringΒ best practices for effectively working with Lookup Items and integrating them into your Data Quality (DQ) rules. Lookups are essential in ONE Web Application as they provide a list of predefined values for attributes, enhancing data validation and detection capabilities.If you remember we have previously covered how to create Lookup files in rules in our Working with DQ Rules series, today we will expand on theΒ lookup items feature.Β Overview of Lookup ItemsLookup Files in ONE Web Application enable you to use reference data, offering a catalog of predefined values for an attribute. You can utilize Lookup Files in both DQ Evaluation rules and Detection rules. To find Lookup Files, go to Data Quality β Lookup Items.Β Β Uploading and Creating Lookup FilesCreating Lookup FilesTo create a Lookup File, follow these steps:In Knowledge Catalog, navigate to Data Quality. Select Lookup Items and click Create. Provide the required details, such as
Hello everyone, Anna here! I work as a projects consultant in Ataccama and today I put together a guide for you on how to migrate permissions after upgrade of v13 to v14. In v14, we introduced a fresh new permissions model introducing Groups and Stewardship. The downside is, though, that after theΒ upgrade the old permissions model cannot be automatically migrated into the new setup.Attached to this guide is a migration package β a set of plans that you can use that willΒ help you through the process of migrating the old permissions into the new setup in more automated way. It is not meant for fresh v14 installations.The article is split to two parts:Preparation phase β steps you need to do BEFORE you upgrade your environment to v14. Post-upgrade phase β steps you need to do AFTER the upgrade, meaning in your new v14 environment.Preparation phaseFollowing steps should be run on version 13 prior running the migration scripts and upgrade of the environment.1. Create server connection in ON
Happy Wednesday Community!Todayβs post will cover how to work with component rules on ONE Desktop Application. If youΒ missed yesterdayβs article we had an introduction toΒ working with components on ONE Web. Check it out here:Β Component rules play a crucial role in tackling complex data validation tasks that may go beyond what standard DQ rules in the web application can handle. By leveraging component rules, you can define custom validation logic tailored to your specific data quality requirements.To ensure accurate and effective results, follow these best practices when working with component rules:1. Creating a Component Rule on ONE DesktopTo create a component rule, follow these steps: Open ONE Desktop and add Ataccama ONE Platform Server by creating a new server connection. Navigate to the ONE Metadata Explorer tab. Select the component you've created in ONE Web Application (e.g., "Email Check" in this example). For more information on creating a component in ONE Web Applicatio
Hello everyone!Β Welcome back to our Data Quality (DQ) series. Today, we're diving into component rules!We're also excited to announce that we'll be hosting a live training session on component rules on July 27th. Don't miss the opportunity to learn from our certified trainer and engage in live Q&A. Register now here!Β Β Component Rules, also known as components, are a powerful feature in the ONE Desktop application. They serve three key data processing purposes: Post-processing components: These components allow you to perform various actions on your data after processing it based on predefined rules. You can easily apply transformations, validations, or any other required post-processing steps. Transformation components: With transformation components, you can automate the process of transforming data records according to specific rules. For instance, you can standardize gender markers to "M" and "F" while transforming any other variations to these standard values. Validation co
Hi,I want to compare the number of not null records in source (custom sql using JDBC writer) and target (salesforce object) using a VCI. Is there any way to do that in Ataccama version 14.1.0.Β The aim is to get the records which are in source and not in target and records which are in target but not in source.Thanks.
I am using desktop app, and I want to schedule the workflow. Can anyone give some idea of scheduling workflows?Β I am trying to achieve the task ie.Β run the flows as per scheduled time(either weekly or monthly - like 5th day of each month)Below is the screenshot that I am having the file, but some how it is not working for me.Thanks in advance.Β
Hello all, i have a task of validating email with the help of api. I want to know is there any documentation which properly explains the integration of postman api to ataccama desktop? or is there any tutorial for working on with apis' using ataccama. Graphql is there but i'm in need of a very basic one to execute and practice.Thank you!
Hi all!Β We hope youβre enjoying our DQ Rules best practice series and finding useful tips & tricks to implement in your day-to-day work.Β In this post, we will cover aggregation rules and give an overview ofΒ creating and configuring aggregation rules to unlock the grouping capabilities.Aggregation rules in Ataccama's ONEΒ can be used in various types of data quality rules, such as Validity, Uniqueness, Completeness, Timeliness, and Accuracy.Β Let's dive in!Β How to create aggregation rules?To create an aggregation rule, follow these steps:Select "Aggregation rule" as the rule type in the ONE web application. Β The "Group by" section will now be available, allowing you to define the grouping criteria.You can create aggregation rules using either the condition builder or ONE expressions, both of which offer flexibility and ease of use. These methods allow you to select input attributes, apply transformations to create variables, and aggregate data based on the desired grouping.Β No Code
In this tutorial video, you will learn how to efficiently manage comments in the Ataccama ONE platform. Discover the step-by-step process of closing, reopening, and deleting comments, allowing you to keep your comment sections organized and up to date.In this video, we will guide you through the key features of comment management in Ataccama ONE. You will learn how to close a comment when its content has been resolved, providing clarity and closure. We will show you how to navigate to the "Closed" tab to access and view previously closed comments, ensuring easy reference and tracking.Reopening a closed comment is made simple in Ataccama ONE. We will demonstrate how to reopen closed comments, making them visible again in the "Open" tab. Keep in mind that if a comment has replies, the entire thread will be reopened, maintaining context and continuity.Additionally, we will explain how to delete comments that are no longer necessary or if a mistake has been made. You will learn the criteri
How to connect ONE DATA as a sourceΒ ?What's the URL value that is required to connect ?Β
Hi community!Β In this post, we will explore how to create and implement DQ rules effectively. Rules play a crucial role in ensuring data quality, and understanding the process is essential for data management. So letβs get started!Β Creating Rules ManuallyΒ To create a rule from scratch, follow these steps:Navigate to the Data Quality > Rules page. Click on Create in the upper-right corner. Provide the necessary information: Name: Give your rule a descriptive name. Description (optional): Add a brief description of the rule and its purpose. Rule definition source (optional): Specify the associated data source for the rule. Stewardship: Select the owner group responsible for the rule's accuracy and approval. Click Save to create a draft of the rule. Β Β Before publishing or submitting for approval, you need to define the rule logic. Proceed to the Implementation tab for further steps.Β Implementing Rule LogicΒ On the Implementation tab, you can perform the following tasks:Add a descr
I am trying to parse an XML File that has data related to employees in the following format<TABLES>Β Β Β Β <DATA>Β Β Β Β Β Β <item>Β Β Β Β Β Β Β Β <WA>Emplyee1No Employee1Name Employee1PhNo Employee1Email</WA>Β Β Β Β Β Β </item>Β Β Β Β Β Β <item>Β Β Β Β Β Β Β Β Β <WA>Emplyee2No Employee2Name Employee2PhNo Employee2Email</WA>Β Β Β Β Β Β </item>Β Β Β Β Β Β β¦.Β Β Β Β Β Β β¦.Β Β Β Β </DATA></TABLES>I am using XML parser to parse this but it does not give any result.I think the issue is with the same tag containing multiple records.As I am able to parse it when there is just one record i.e. one <WA> and <item> tag.Can anyone please help me with this?
Hi everyone,Β We are continuing with our Data Quality best practice series! In the next several posts we will cover everything from Rules to Monitoring Projects in Data Quality.Β If you have missed the introduction series to DQ you can start here:In this post, we'll explore the concepts of Detection rules and Data Quality (DQ) rules in Ataccama ONE's web application. Understanding these rules is crucial for effective data management. Let's dive in!Β Detection RulesΒ Detection rules in Ataccama ONE are divided into two categories: Data-based detection rules and Metadata-based detection rules. These rules serve different purposes and can be accessed and created from the "Data Quality > Rules" section. Let's take a closer look:Data-based Detection Rules: These rules evaluate attribute data and are used to assign terms to attributes based on predefined conditions. For example, you can create a rule to assign the term "First Name" to attributes that contain values found in a specific lookup
Hi All,Β Our requirement is to use an api call for removing a cde term and adding another cde term associated to a rule.we thought of using PUT /rule-versions/{id} api. However some points we noted.Β in one webapp for the ruke, if we remove cde and add another cde, the rule gets created as a newer version. We just want to update the existing versionΒ Please let us know which api we can use?
Hello!My team and I are working on connectivity to be able to pull rules down from the web version into the Desktop version, make some minor tweaks, and then reupload them back to the Web version. Is this possible? We have our ONE platform connected to our desktop and can see all of our catalog items and rules, but when I try and drag a rule into a component / plan or make any changes, we get an error and we can only view the rule.Β Has anyone ran into similar issues? Or are we attempting to do something that the Desktop version does not support?Β Any answers would be appreciated, thanks!
Hi,Β In Ataccama web there's a way to set a certain treshold about validity when monitoring (default is 70% I believe). Is there a way instead of percentages to have it as raw number of records?Basically the idea is that I want to see the treshold met when (example) 100 records are met. The amount of records added to the dataset varies hence percentages might not work for me.Currently I have 1000 records. 100 are invalid. Treshold could be set to 10%.But if overnight 4000 records are added totalling 5000 records then 2% is invalid, assuming the invalid numbers stay the same. In the ideal world I want to be able to make a choice whether I want the treshold to be set through percentages or raw number. Because in this scenario I'd still like to be given a notice 100 records are invalid.
Hi All,I would like to map keycloak roles present in gen1(12.8) to gen2(13.9/14.3).Has anyone done this activity while migrating Ataccama 12.8 to 13.9/14.3 version?Β Thanks,Parvesh Soni
I am trying to apply a rule on a boolean type attribute to find if the value is βJaβ or "Neeβ. However IΒ couldnβt Β achieve the expected outcomeΒ with advanced expression as its a bolean type. Also looked in to the documentation for one expression.Any suggestions to get the similar results with boolean type attribute?
Happy Wednesday community βοΈΒ Welcome back to our Data Quality series! In today's post, we'll delve deeper into configuring detection and validation rules in Ataccama ONE. If you missed our previous post, we recommend checking it outΒ before continuing.Configure Detection LogicTo define your detection rule's logic, navigate to the "Implementation" tab when creating or editing a rule. If you're starting from scratch, select "Detection" as the rule logic. You can add multiple conditions using the Condition Builder, with each record needing to fulfill all conditions by default (using the logical operator AND). For less strict rules with the logical operator OR, try the Advanced Expression mode. Take advantage of Pattern Analysis results to create detection rules quickly. For instance, open the "Profile & DQ Insights" tab for the catalog item "customers," select the "email" attribute, and utilize the detected patterns by choosing "Use results in rule." Save your changes and don't forget
Hi,Situation: I wrote a(n) SQL catalog item joining multiple tablesΒ and in Ataccama I'm using rules to compare the values if they are the same. LONG = LONG, check if the nr_loan = the same a.nr_loan, etc.My question is if there's an easier way to see if two tables are identical. I'm doing this to check the integrity.I couldn't find anything relatable asked in the community.Β Β
Hello all, is there anyone who knows about creating a rule to detect the duplicate records of a particular attribute and mark it as duplicate using one web?
How do you extract the catalog item with their associated terms (final) in a report?
Hi everyone,In this post, we continue our discussion on Data Observability configurations today! Let's dive into some advanced settings, terms, and rules that will enhance your data observability experience.Β Observing Data with Selected TermsChoose your preferred method to select the data you want to observe. If you select Terms: Click on Add terms and select terms associated with important data from the available list. Once you've selected the terms, all associated catalog items will be chosen for monitoring. If necessary, you can exclude individual catalog items by selecting Edit selection. After choosing Edit selection, you will see all catalog items associated with the selected terms. Use the more options icon and select Exclude to exclude any of these items from monitoring. When you're ready, click Save. If you select AQL: Use Ataccama Query Language to define the data you want to observe. Once you've selected the terms, all associated catalog items will be chosen for
How can I set-up email in workflow? I am using Microsoft 365Β Please help
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.