Data Quality & Catalog ⚙️

Hi everyone, In this post, we will talk about Virtual Catalog Items 🦋 You might have participated in our live training session that took place a few months back where we talked about how to create and work with VCIs. You can always watch back the session and check out the live demo here 👇🏻 Virtual Catalog Items (VCIs) provide flexibility and efficiency when working with data in the ONE Desktop platform and in this article you can find best practices for creating and transforming Virtual Catalog Items to make the most of your data management efforts. Let’s start with the basics: Why Use Virtual Catalog Items? VCIs are particularly useful in several scenarios: Applying Transformation Logic: When you need to apply ONE Desktop and in-source (SQL) transformation logic before working with raw data. This includes tasks such as filtering data, joining tables, and standardizing values. Integrating Non-Native Sources: When you want to integrate data from sources that are not natively supporte

Hi everyone, happy Monday! In this post, we will go through a few best practices on how you can work with data in ONE Desktop. Before getting into it, don’t forget to check out some posts you might find useful: Browsing Data in ONE Explorer From ONE Explorer, you have the ability to access various components of your data, much like you would in the Knowledge Catalog of the ONE Web Application. ONE Explorer in ONE Desktop includes: Catalog Items Components Lookup Items Monitoring Projects Rules Terms This seamless access to your data provides a comprehensive overview of your information, enabling you to manage your data assets with precision. Working with Data in ONE Desktop There are two primary methods for reading and working with your data within ONE Desktop: 1. Catalog Item Reader Step: This step allows you to access data from different sources defined in the Metadata Management Module (MMM). When you drag and drop a Catalog Item from MMM into your plan, the Catalog Item Reader step

Hi everyone, One of the core capabilities of ONE Desktop is metadata handling through ONE Metadata Reader and ONE Metadata Writer Steps. These steps allow users to read and write data from the Web Application, enabling a range of use cases and implementations. In this post, you’ll find out how to read & write metadata using the steps in ONE Desktop 👇🏽👀 ONE Metadata Reader The ONE Metadata Reader Step serves as a tool to read data from the Web Application, offering flexibility in usage: Common Implementations: Enriching data for external Business Intelligence tools (e.g., Tableau, Cognos) to create customized reports with additional attributes such as description, owner, and custom properties. Easily incorporating DQ rules into DQC plans, simplifying the process of finding and integrating rules based on name and input attributes. Constructing DQC plans with data transformations by utilizing data sources from the Metadata Management Module (MMM). Generating comprehensive HTML document

Hi community! In this post, we are covering working and searching in metadata. Efficiently working with metadata is crucial for ensuring data quality, governance, and effective decision-making. Ataccama has several tools within ONE Desktop to assist in metadata management, including the ONE Metadata Reader and ONE Metadata Writer Steps for reading and writing metadata, as well as the ONE Metadata Explorer for seamless navigation. Let’s dive in 👀 Navigating with ONE Metadata Explorer ONE Metadata Explorer allows you to connect directly to your Ataccama ONE Platform server from ONE Desktop, granting you access to your critical metadata and even "Meta Metadata" for more in-depth analysis. Metadata Exploration by Default When you first access ONE Metadata Explorer, it's configured for exploring your primary metadata. Delving into Meta Metadata However, if you wish to explore your "Meta Metadata," you can easily adjust the settings: In the ONE Metadata Explorer, click the "View Menu" icon.

Hi Community! This week on the menu we have how to work with the Ataccama ONE Platform. We will cover basics like how to connect your ONE Desktop to a bit more advanced topics like working with metadata. Connecting your ONE Desktop to the Ataccama ONE Platform allows you to seamlessly work with metadata, create data quality rules, and utilize virtual catalog items. Create a New Connection Prerequisites: Ensure ONE Desktop is properly set up and running. Your ONE instance should be running and accessible from the server where ONE Desktop is installed. Ensure that both ONE Desktop and ONE are using the same version. Follow these steps to create a new connection: Open ONE Desktop. In the ONE Explorer, select Create a new server. If you are adding a second ONE server, follow these steps instead: In File Explorer > Servers, right-click Servers and select New > ONE Platform. You can also find the same option in the Servers and Databases tab, which is part of your workspace by default. Provid

Hi everyone, In this post we will cover databases that play a vital role in Ataccama solutions, serving as data sources, and repositories, and enabling data profiling. Here are some tips & tricks to help you effectively work with databases in Ataccama. Connecting to a Database To establish a connection with a database, right-click the Databases node in the File Explorer and select New Database Connection. Configure the connection by providing the following information: Database type: Specify the database connection type. Connection name: Define a name for the new database connection. Host: Specify the hostname or IP of the database host. Port: Provide the port allocated for the database connection. Database name: Catalog: Specify the name of the database instance located on the host. Username: Enter the username to connect to the database. Password: Enter the password to connect to the database. Use the Edit Driver Properties... option to set additional JDBC properties for this data so

Happy Wednesday everyone! We are halfway through the week and wrapping up our profiling best practices with this post (but honestly are you ever done with profiling?). So let’s dive in to learn how to read a DQ profile, column analyses, and advanced analyses. Data quality profiles are crucial tools for understanding and improving the quality of your data. Once you've generated a profile, it's important to know how to read and interpret the information it provides. 1. Accessing the Profile Viewer After running a profiling plan or creating a one-time profile, a file with a .profile extension will appear in your File Explorer. Double-clicking this file opens the Profile Viewer. 2. Inputs and Roll Ups The Profiling Step may have multiple inputs, each of which may have associated "roll ups" that group the data by specific parameters. Understanding these inputs and roll ups is vital to gaining a comprehensive view of your data. For detailed information on adding inputs and configuring roll u

Hi community! In this post, we will cover a fundamental practice of configuring the profiling step 👣 If you have missed it you can check the first post on the introduction to data profiling here👇🏽 The Profiling Step When you create a profile using a plan, the Profiling step becomes a pivotal part of your data journey, connecting your data source to insights. Let's explore how to make the most of it. General Category Basic Tab In the Basic tab, you can set the step's name, output file name, location, and the default locale for generated files. Masks Tab The Masks tab is where you define and edit masks. Masks help reveal data structure without displaying the actual content. For instance, you can use "D" to represent a digit and "L" for a letter. Configure characters, symbols, repeated symbols, and thresholds for your masks here. Right-click on the row to add, delete, or edit the characters: Drill-through Tab The Drill-through tab enables drill-through functionality, allowing you to in

Happy Monday everyone! This week we are delving deep into one of the most important steps in working with data - profiling 🚀 We will start with the basics and move on to more advanced practices so don’t forget to follow the forum by hitting the Subscribe button to get the latest article in your inbox 🔔 When embarking on a data project, understanding your data's current state is paramount. It's the compass that guides you through the winding path of data cleansing and transformation. This understanding also serves as a yardstick to measure the effectiveness of your cleansing rules. Enter the Data Quality Profile – a snapshot of your data's health. It unveils duplicates, dependencies, business rule evaluations, data patterns, and much more. In this post, we will cover how to create and configure a data quality profile, complete with additional analyses like masks, dependencies, and business rules. Step 1: Select Data to Profile Launch ONE Desktop. In the File Explorer view, pick one or

Hi everyone! This week’s last best practice is also the final post on components! Check out yesterday’s post to catch on if you have missed the series so far: Nested components are like puzzle pieces that fit together to create sophisticated data transformations within a single entity. In this guide, we'll explore how to work with nested components in Ataccama ONE Desktop, focusing on their creation, import, configuration, and use cases. Understanding Nested Components Imagine having a main (parent) component that uses multiple component files to achieve complex data transformations. Nested components enable you to do just that. This approach allows you to maintain the original data while applying intricate logic to your datasets. For instance, you can use predefined components provided by Ataccama ONE Desktop to cleanse, filter, or standardize specific data attributes, all while preserving the integrity of your original data. Configuring a Nested Component in ONE Desktop In Ataccama O