Learn & Share

Hi everyone,  We are here with Part II of our VCIs best practice series and today we will delve deeper into two significant aspects of working with VCIs - connecting to natively supported data sources and non-natively supported data sources.In the first post, we explored the creation and transformation of Virtual Catalog Items (VCIs) within Ataccama ONE. You can check it out here 👇🏻 Connecting to Natively Supported SourcesAtaccama ONE makes it simple to connect with data sources that are natively supported by following these steps: Create a VCI, as explained in the previous section. To read data from a natively supported source, add the "JDBC Reader" step to your plan. Depending on your transformation requirements, you can use the JDBC Reader step alone or combine it with existing catalog items. Configure the "JDBC Reader" step as follows: On the "General" tab, in "Data Source Name," provide the source identifier of the connected database. You can find the source identifier in

Hi everyone,In this post, we will talk about Virtual Catalog Items 🦋 You might have participated in our live training session that took place a few months back where we talked about how to create and work with VCIs. You can always watch back the session and check out the live demo here  👇🏻Virtual Catalog Items (VCIs) provide flexibility and efficiency when working with data in the ONE Desktop platform and in this article you can find best practices for creating and transforming Virtual Catalog Items to make the most of your data management efforts. Let’s start with the basics: Why Use Virtual Catalog Items?VCIs are particularly useful in several scenarios: Applying Transformation Logic: When you need to apply ONE Desktop and in-source (SQL) transformation logic before working with raw data. This includes tasks such as filtering data, joining tables, and standardizing values. Integrating Non-Native Sources: When you want to integrate data from sources that are not natively supporte

Hi everyone, happy Monday! In this post, we will go through a few best practices on how you can work with data in ONE Desktop. Before getting into it, don’t forget to check out some posts you might find useful: Browsing Data in ONE ExplorerFrom ONE Explorer, you have the ability to access various components of your data, much like you would in the Knowledge Catalog of the ONE Web Application. ONE Explorer in ONE Desktop includes:Catalog Items Components Lookup Items Monitoring Projects Rules Terms   This seamless access to your data provides a comprehensive overview of your information, enabling you to manage your data assets with precision.Working with Data in ONE DesktopThere are two primary methods for reading and working with your data within ONE Desktop:1. Catalog Item Reader Step:This step allows you to access data from different sources defined in the Metadata Management Module (MMM). When you drag and drop a Catalog Item from MMM into your plan, the Catalog Item Reader step is

Hi everyone, One of the core capabilities of ONE Desktop is metadata handling through ONE Metadata Reader and ONE Metadata Writer Steps. These steps allow users to read and write data from the Web Application, enabling a range of use cases and implementations. In this post, you’ll find out how to read & write metadata using the steps in ONE Desktop 👇🏽👀 ONE Metadata ReaderThe ONE Metadata Reader Step serves as a tool to read data from the Web Application, offering flexibility in usage:Common Implementations:Enriching data for external Business Intelligence tools (e.g., Tableau, Cognos) to create customized reports with additional attributes such as description, owner, and custom properties. Easily incorporating DQ rules into DQC plans, simplifying the process of finding and integrating rules based on name and input attributes. Constructing DQC plans with data transformations by utilizing data sources from the Metadata Management Module (MMM). Generating comprehensive HTML documen

Hi community! In this post, we are covering working and searching in metadata. Efficiently working with metadata is crucial for ensuring data quality, governance, and effective decision-making.Ataccama has several tools within ONE Desktop to assist in metadata management, including the ONE Metadata Reader and ONE Metadata Writer Steps for reading and writing metadata, as well as the ONE Metadata Explorer for seamless navigation. Let’s dive in 👀 Navigating with ONE Metadata ExplorerONE Metadata Explorer allows you to connect directly to your Ataccama ONE Platform server from ONE Desktop, granting you access to your critical metadata and even "Meta Metadata" for more in-depth analysis. Metadata Exploration by DefaultWhen you first access ONE Metadata Explorer, it's configured for exploring your primary metadata.Delving into Meta MetadataHowever, if you wish to explore your "Meta Metadata," you can easily adjust the settings:In the ONE Metadata Explorer, click the "View Menu" icon. Selec

Hi Community!This week on the menu we have how to work with the Ataccama ONE Platform. We will cover basics like how to connect your ONE Desktop to a bit more advanced topics like working with metadata.Connecting your ONE Desktop to the Ataccama ONE Platform allows you to seamlessly work with metadata, create data quality rules, and utilize virtual catalog items. Create a New ConnectionPrerequisites:Ensure ONE Desktop is properly set up and running. Your ONE instance should be running and accessible from the server where ONE Desktop is installed. Ensure that both ONE Desktop and ONE are using the same version.Follow these steps to create a new connection: Open ONE Desktop. In the ONE Explorer, select Create a new server.   If you are adding a second ONE server, follow these steps instead: In File Explorer > Servers, right-click Servers and select New > ONE Platform. You can also find the same option in the Servers and Databases tab, which is part of your workspace by default.

Hi everyone,In this post we will cover databases that play a vital role in Ataccama solutions, serving as data sources, and repositories, and enabling data profiling. Here are some tips & tricks to help you effectively work with databases in Ataccama. Connecting to a Database To establish a connection with a database, right-click the Databases node in the File Explorer and select New Database Connection.   Configure the connection by providing the following information: Database type: Specify the database connection type. Connection name: Define a name for the new database connection. Host: Specify the hostname or IP of the database host. Port: Provide the port allocated for the database connection. Database name: Catalog: Specify the name of the database instance located on the host. Username: Enter the username to connect to the database. Password: Enter the password to connect to the database.   Use the Edit Driver Properties... option to set additional JDBC propert

Happy Wednesday everyone! We are halfway through the week and wrapping up our profiling best practices with this post (but honestly are you ever done with profiling?). So let’s dive in to learn how to read a DQ profile, column analyses, and advanced analyses. Data quality profiles are crucial tools for understanding and improving the quality of your data. Once you've generated a profile, it's important to know how to read and interpret the information it provides. 1. Accessing the Profile ViewerAfter running a profiling plan or creating a one-time profile, a file with a .profile extension will appear in your File Explorer. Double-clicking this file opens the Profile Viewer. 2. Inputs and Roll UpsThe Profiling Step may have multiple inputs, each of which may have associated "roll ups" that group the data by specific parameters. Understanding these inputs and roll ups is vital to gaining a comprehensive view of your data. For detailed information on adding inputs and configuring roll ups

Hi community! In this post, we will cover a fundamental practice of configuring the profiling step 👣If you have missed it you can check the first post on the introduction to data profiling here👇🏽 The Profiling StepWhen you create a profile using a plan, the Profiling step becomes a pivotal part of your data journey, connecting your data source to insights. Let's explore how to make the most of it.General CategoryBasic TabIn the Basic tab, you can set the step's name, output file name, location, and the default locale for generated files. Masks TabThe Masks tab is where you define and edit masks. Masks help reveal data structure without displaying the actual content. For instance, you can use "D" to represent a digit and "L" for a letter. Configure characters, symbols, repeated symbols, and thresholds for your masks here. Right-click on the row to add, delete, or edit the characters: Drill-through TabThe Drill-through tab enables drill-through functionality, allowing you to inspect i

Happy Monday everyone! This week we are delving deep into one of the most important steps in working with data - profiling 🚀 We will start with the basics and move on to more advanced practices so don’t forget to follow the forum by hitting the Subscribe button to get the latest article in your inbox 🔔 When embarking on a data project, understanding your data's current state is paramount. It's the compass that guides you through the winding path of data cleansing and transformation. This understanding also serves as a yardstick to measure the effectiveness of your cleansing rules. Enter the Data Quality Profile – a snapshot of your data's health. It unveils duplicates, dependencies, business rule evaluations, data patterns, and much more. In this post, we will cover how to create and configure a data quality profile, complete with additional analyses like masks, dependencies, and business rules. Step 1: Select Data to Profile Launch ONE Desktop. In the File Explorer view, pick one

Hi everyone! This week’s last best practice is also the final post on components! Check out yesterday’s post to catch on if you have missed the series so far:  Nested components are like puzzle pieces that fit together to create sophisticated data transformations within a single entity. In this guide, we'll explore how to work with nested components in Ataccama ONE Desktop, focusing on their creation, import, configuration, and use cases. Understanding Nested ComponentsImagine having a main (parent) component that uses multiple component files to achieve complex data transformations. Nested components enable you to do just that. This approach allows you to maintain the original data while applying intricate logic to your datasets. For instance, you can use predefined components provided by Ataccama ONE Desktop to cleanse, filter, or standardize specific data attributes, all while preserving the integrity of your original data. Configuring a Nested Component in ONE DesktopIn Ataccama ON