Data Quality & Catalog ⚙️

Hi everyone, One of the core capabilities of ONE Desktop is metadata handling through ONE Metadata Reader and ONE Metadata Writer Steps. These steps allow users to read and write data from the Web Application, enabling a range of use cases and implementations. In this post, you’ll find out how to read & write metadata using the steps in ONE Desktop 👇🏽👀 ONE Metadata ReaderThe ONE Metadata Reader Step serves as a tool to read data from the Web Application, offering flexibility in usage:Common Implementations:Enriching data for external Business Intelligence tools (e.g., Tableau, Cognos) to create customized reports with additional attributes such as description, owner, and custom properties. Easily incorporating DQ rules into DQC plans, simplifying the process of finding and integrating rules based on name and input attributes. Constructing DQC plans with data transformations by utilizing data sources from the Metadata Management Module (MMM). Generating comprehensive HTML documen

Hi community! In this post, we are covering working and searching in metadata. Efficiently working with metadata is crucial for ensuring data quality, governance, and effective decision-making.Ataccama has several tools within ONE Desktop to assist in metadata management, including the ONE Metadata Reader and ONE Metadata Writer Steps for reading and writing metadata, as well as the ONE Metadata Explorer for seamless navigation. Let’s dive in 👀 Navigating with ONE Metadata ExplorerONE Metadata Explorer allows you to connect directly to your Ataccama ONE Platform server from ONE Desktop, granting you access to your critical metadata and even "Meta Metadata" for more in-depth analysis. Metadata Exploration by DefaultWhen you first access ONE Metadata Explorer, it's configured for exploring your primary metadata.Delving into Meta MetadataHowever, if you wish to explore your "Meta Metadata," you can easily adjust the settings:In the ONE Metadata Explorer, click the "View Menu" icon. Selec

Hi Community!This week on the menu we have how to work with the Ataccama ONE Platform. We will cover basics like how to connect your ONE Desktop to a bit more advanced topics like working with metadata.Connecting your ONE Desktop to the Ataccama ONE Platform allows you to seamlessly work with metadata, create data quality rules, and utilize virtual catalog items. Create a New ConnectionPrerequisites:Ensure ONE Desktop is properly set up and running. Your ONE instance should be running and accessible from the server where ONE Desktop is installed. Ensure that both ONE Desktop and ONE are using the same version.Follow these steps to create a new connection: Open ONE Desktop. In the ONE Explorer, select Create a new server.   If you are adding a second ONE server, follow these steps instead: In File Explorer > Servers, right-click Servers and select New > ONE Platform. You can also find the same option in the Servers and Databases tab, which is part of your workspace by default.

Hi everyone,In this post we will cover databases that play a vital role in Ataccama solutions, serving as data sources, and repositories, and enabling data profiling. Here are some tips & tricks to help you effectively work with databases in Ataccama. Connecting to a Database To establish a connection with a database, right-click the Databases node in the File Explorer and select New Database Connection.   Configure the connection by providing the following information: Database type: Specify the database connection type. Connection name: Define a name for the new database connection. Host: Specify the hostname or IP of the database host. Port: Provide the port allocated for the database connection. Database name: Catalog: Specify the name of the database instance located on the host. Username: Enter the username to connect to the database. Password: Enter the password to connect to the database.   Use the Edit Driver Properties... option to set additional JDBC propert

Happy Wednesday everyone! We are halfway through the week and wrapping up our profiling best practices with this post (but honestly are you ever done with profiling?). So let’s dive in to learn how to read a DQ profile, column analyses, and advanced analyses. Data quality profiles are crucial tools for understanding and improving the quality of your data. Once you've generated a profile, it's important to know how to read and interpret the information it provides. 1. Accessing the Profile ViewerAfter running a profiling plan or creating a one-time profile, a file with a .profile extension will appear in your File Explorer. Double-clicking this file opens the Profile Viewer. 2. Inputs and Roll UpsThe Profiling Step may have multiple inputs, each of which may have associated "roll ups" that group the data by specific parameters. Understanding these inputs and roll ups is vital to gaining a comprehensive view of your data. For detailed information on adding inputs and configuring roll ups

Hi community! In this post, we will cover a fundamental practice of configuring the profiling step 👣If you have missed it you can check the first post on the introduction to data profiling here👇🏽 The Profiling StepWhen you create a profile using a plan, the Profiling step becomes a pivotal part of your data journey, connecting your data source to insights. Let's explore how to make the most of it.General CategoryBasic TabIn the Basic tab, you can set the step's name, output file name, location, and the default locale for generated files. Masks TabThe Masks tab is where you define and edit masks. Masks help reveal data structure without displaying the actual content. For instance, you can use "D" to represent a digit and "L" for a letter. Configure characters, symbols, repeated symbols, and thresholds for your masks here. Right-click on the row to add, delete, or edit the characters: Drill-through TabThe Drill-through tab enables drill-through functionality, allowing you to inspect i

Happy Monday everyone! This week we are delving deep into one of the most important steps in working with data - profiling 🚀 We will start with the basics and move on to more advanced practices so don’t forget to follow the forum by hitting the Subscribe button to get the latest article in your inbox 🔔 When embarking on a data project, understanding your data's current state is paramount. It's the compass that guides you through the winding path of data cleansing and transformation. This understanding also serves as a yardstick to measure the effectiveness of your cleansing rules. Enter the Data Quality Profile – a snapshot of your data's health. It unveils duplicates, dependencies, business rule evaluations, data patterns, and much more. In this post, we will cover how to create and configure a data quality profile, complete with additional analyses like masks, dependencies, and business rules. Step 1: Select Data to Profile Launch ONE Desktop. In the File Explorer view, pick one

Hi everyone! This week’s last best practice is also the final post on components! Check out yesterday’s post to catch on if you have missed the series so far:  Nested components are like puzzle pieces that fit together to create sophisticated data transformations within a single entity. In this guide, we'll explore how to work with nested components in Ataccama ONE Desktop, focusing on their creation, import, configuration, and use cases. Understanding Nested ComponentsImagine having a main (parent) component that uses multiple component files to achieve complex data transformations. Nested components enable you to do just that. This approach allows you to maintain the original data while applying intricate logic to your datasets. For instance, you can use predefined components provided by Ataccama ONE Desktop to cleanse, filter, or standardize specific data attributes, all while preserving the integrity of your original data. Configuring a Nested Component in ONE DesktopIn Ataccama ON

Happy Monday community! Today we are going to talk about Remote Plans. Let’s start with the basics, what are remote plan executions? The remote plan execution lets you run any ONE plan on the Ataccama ONE Platform. Plans are typically developed and tested on small data sets or on dedicated environments. This helps you validate the plans and assess how well they perform so that you can make the necessary adjustments before applying them on your actual data. Once the plan works as expected, you can run it remotely on production data in ONE.Jobs are first sent to the Data Processing Manager (DPM) module, which forwards the job information to a suitable Data Processing Engine (DPE). Actual data processing takes place only in DPE instances. How to configure Remote Plan ExecutionRemote plan execution leverages existing controls and concepts of ONE Desktop. Once you connect to the Ataccama ONE Platform, you can choose between the following launch options:Local: A suitable DPE is selected auto