Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Hi everyone, and happy Monday! In this post, we will cover Ataccama’s Reference Data Management solution with a short introduction, follow us for part 2 and check out our MDM Series below 👇🏻 First things first. What is RDM?Reference data is data that defines the values that are used to classify and characterize other data. This is sometimes known - not always correctly - as Master Data, Golden Record, Golden Copy, or Single Source of Truth.RDM is an essential component of Master Data Management (MDM) that has evolved to become a mature data management discipline in its own right. Who's It For?At the heart of the RDM web application are three key player roles:Reference Data Stewards Analysts ManagersDesigned with precision, the RDM web application caters to these roles, ensuring a user-friendly and efficient experience. What Can You Do?The RDM web application empowers you with a rich set of features: View, Edit, and Manage: Seamlessly view, edit, and manage reference data, putting yo
Happy Tuesday community 🙋♀️ This week we have a series of best practices on all things components on ONE Desktop. Component steps, often referred to as simply "components," are instrumental tools that come with unique capabilities. Here, we'll explore what makes components special and how to make the most of them in your data projects. What Sets Components ApartComponents are akin to plans but with distinctive attributes: Reusable: Components can be employed repeatedly, functioning like steps within other plan files. Parameterization: Components can have properties within their constituent steps mapped as parameters, allowing external plans to interact with them (learn more in the section on "Mapping Properties as Parameters"). Console Launch: Components can be executed directly from the console, with parameters for added flexibility. Example: The Component in ActionComponent files are identifiable by their ".comp" extension and can play pivotal roles within your data workflows.
WE are trying to do some HandsOn by ourself. As part of it, we wanted the Atacama free version to be installed in Azure and our team can access it. Not sure whether it is possible and how to Install.
Hello folks, I am new for working atacccama tool. we are planned into data migration from ataccama 12.4.1 into 12.9.0 version. If anyone please guide me for tool upgrading
Hi everyone, Welcome back to our best practice series on MDM. In this post, we're diving deep into the features that make MDM - so buckle up 🚘 MDM’s primary feature is its model-driven architecture. It's a domain-agnostic MDM that empowers developers to craft domain-specific MDM models. Let's break down its high-level features by type. Model-Driven ArchitectureMDM's domain-agnostic approach is complemented by vertical models (metadata templates) designed to be domain-specific. These models are not cast in stone; they are customizable and extendable to meet the unique needs of your project. To delve deeper into this model-driven marvel, check out the Model. Internal Workflow and Processing PerfectionMDM boasts a remarkable set of features:Out-of-the-box change detection on load: MDM is a keen observer. It can detect changes in source instance records by tracking their unique source IDs. If a record has changed, it triggers the MDM process for that specific record. The granularity of de
Hi everyone, In this post, we will continue our introduction to Master Data Management (MDM), if you have missed our first post you can find it here 👇🏻This article will focus on the architectural details of MDM, breaking down the components, dependencies, and practical management tips ✨ The Pillars of MDMAt the heart of MDM, we find four essential components:Keycloak: Our third-party identity management tool. MDM Server (formerly known as MDC): The robust Ataccama MDM processing engine. MDM Webapp (formerly known as MDA): The user-friendly Ataccama MDM web application. Relational Database: The sturdy backend database, supporting PostgreSQL, MS SQL, or Oracle.Each of these components is configured as a Linux service, allowing independent restarts and individual log access for issue identification. The Backbone of DatabasesMDM is compatible with PostgreSQL, MS SQL, and Oracle relational databases. However, it's important to note that Ataccama officially supports only PostgreSQL Standal
Hi everyone, happy Monday 👋🏻 After publishing more than 20 articles on ONE Desktop best practices, I’m happy to share that we are ready to take the next step into Ataccama's Master Data Management (MDM), a robust, scalable, and highly available platform designed to simplify and enhance your master data management tasks. Let’s start with the basics ⚡ What is MDM and how is it different? Unlike the traditional "data flow driven" Data Quality Center (DQC), Ataccama MDM stands out as a fully metadata-driven data processing system. It incorporates an array of powerful tools, including the Advanced Metadata Editor (AME), a cutting-edge data processing engine (NME), and the DQC Plan Executor (complete with its steps and components).By doing so, MDM naturally extends the capabilities of the DQC, offering comprehensive data quality management functionality. In essence, MDM combines Master Data Management with a strong emphasis on Data Quality as a fundamental part of the process, providing a
Hi I am not able to configure Ataccama Server. Can anyone help me on this? I am getting below message when I double click on ‘start-server.bat’ Using java at: "C:\ataccama-one-desktop-14.5.0\jre\bin\java.exe"Using DQC at: "C:\ataccama-one-desktop-14.5.0\runtime"Using java at: "C:\ataccama-one-desktop-14.5.0\jre\bin\java.exe"Using DQC at: "C:\ataccama-one-desktop-14.5.0\runtime"Picked up _JAVA_OPTIONS: -Djavax.net.ssl.trustStore=C:\Windows\Sun\Java\Deployment\trusted.certsPicked up _JAVA_OPTIONS: -Djavax.net.ssl.trustStore=C:\Windows\Sun\Java\Deployment\trusted.certsWed Nov 01 16:25:19 IST 2023 : Could not listen on port 1529 on host localhost: java.net.BindException: Address already in use: bind2023-11-01 16:25:20 [INFO] com.ataccama.dqc.server.bin.OnlineCtl messageId=generic_msg message=Starting server on localhost2023-11-01 16:25:21 [ERROR] com.ataccama.dqc.commons.license.LicenseManager messageId=generic_msg message=DQC license not verified! Program will exit.2023-11-01 16:2
I am following the tutorial to install and run the latest MDM example project on Windows.When I am starting the MDM Server using start-mdm-server.bat, I am facing the below error: Can anyone guide me on how to add a user role to Keycloak for this ? Keycloak demo version is being used in this case ( Keycloak 21.0.1)
I’ve created a basic workflow that utilizes the API to execute an existing project/plan. The project had an post process component that writes the invalids to an Excel spreadsheet.The other steps in the workflow wait for the file to be created and load it into DQIT. We can write directly to DQIT due to an issue with Databricks/Spark. The workflow works great, but I need to manually execute it. I’d like to us Admin Center to “Scheduler” to execute the workflow.How do I do that?The environment is Azure / Linux.
I am trying to use Splitter to transform the stringExample : Input: BeWhoYouAreSplitter output - ‘e ho ou re’ - skipping the first letter as ‘Upper case’ is the separatorDesired output - ‘Be Who You Are’How do I achieve this? Also if the string is all lower how to split it?Example: Input: ‘bewhoyouare’desired output - ‘Be Who You Are’
Hi everyone, happy Wednesday! In this post, we will walk you through Model projects! Model projects play a crucial role in configuring various Ataccama products like DQ Issue Tracker, ONE RDM, and ONE MDM. These model projects are structured based on model templates, which define a specific set of nodes, folders, and files during project creation or import. It's important to note that you cannot modify or remove nodes created by a template.The configuration within model projects is developed using the Advanced Metadata Editor (AME). In this context, metadata refers to the configurations made within the model project nodes, which are used to generate plans, components, web service configurations, XML files, and other necessary components for a particular solution.Developing solutions based on metadata is carried out in the Model Explorer view, and detailed instructions for each product can be found in the respective Developer Guides.Every Ataccama build includes a default model project
📌 Links to the legacy documentation portal are no longer available. Read about the changes and how to access our documentation here.Hi community!In this post, we will discover how to create server connections in ONE Desktop for various tasks and workflow steps. Read on to find out more 👀 How to register a new server?To set up a new server connection, follow these steps:Right-click Servers in the File Explorer and select New Server. Choose the desired Environment. Learn more about Environments. Provide a unique server Name and select the appropriate Implementation. Configure the server connection according to your implementation, and click Finish.Once registered, the new server connection will appear in the File Explorer tree.Please note that, during development, right-clicking the server connection and selecting Connect is not considered a valid connectivity test, and it's not necessary for enabling step communication. Implementation TypesGenericUse this implementation to conn
Hello. i have a general material data csv file, and in that i have to check for duplicates based on material data. Currently i'm trying with the matching step by creating partitions and key rules but still i'm not sure about it. So is there anyone knows about solving this process?? Thanks!
Hi everyone, We are here with Part II of our VCIs best practice series and today we will delve deeper into two significant aspects of working with VCIs - connecting to natively supported data sources and non-natively supported data sources.In the first post, we explored the creation and transformation of Virtual Catalog Items (VCIs) within Ataccama ONE. You can check it out here 👇🏻 Connecting to Natively Supported SourcesAtaccama ONE makes it simple to connect with data sources that are natively supported by following these steps: Create a VCI, as explained in the previous section. To read data from a natively supported source, add the "JDBC Reader" step to your plan. Depending on your transformation requirements, you can use the JDBC Reader step alone or combine it with existing catalog items. Configure the "JDBC Reader" step as follows: On the "General" tab, in "Data Source Name," provide the source identifier of the connected database. You can find the source identifier in
Hi everyone,In this post, we will talk about Virtual Catalog Items 🦋 You might have participated in our live training session that took place a few months back where we talked about how to create and work with VCIs. You can always watch back the session and check out the live demo here 👇🏻Virtual Catalog Items (VCIs) provide flexibility and efficiency when working with data in the ONE Desktop platform and in this article you can find best practices for creating and transforming Virtual Catalog Items to make the most of your data management efforts. Let’s start with the basics: Why Use Virtual Catalog Items?VCIs are particularly useful in several scenarios: Applying Transformation Logic: When you need to apply ONE Desktop and in-source (SQL) transformation logic before working with raw data. This includes tasks such as filtering data, joining tables, and standardizing values. Integrating Non-Native Sources: When you want to integrate data from sources that are not natively supporte
📌 Links to the legacy documentation portal are no longer available. Read about the changes and how to access our documentation here. Hi there! Lisa from Ataccama here. I’m a Solution Consultant and I love exploring the different ways our platform can become part of the business and technology ecosystem for our customers.In this post, I will share a framework for integrating Ataccama with a work management or issue tracking software like Jira. Delivering data quality insights and alerts from Ataccama to an issue tracking tool can help to maintain transparency and accountability, and to facilitate cross-functional team work. Let’s explore an example! Use case Ataccama’s Data Quality Monitoring Projects are a powerful tool for regular data quality evaluation and reporting on the results. You can configure DQM Projects to run periodic evaluation of data against DQ Rules, and provide various insights to the business. Do you need to send a digest whenever fresh DQM results are ready? Or do
Hi everyone, happy Monday! In this post, we will go through a few best practices on how you can work with data in ONE Desktop. Before getting into it, don’t forget to check out some posts you might find useful: Browsing Data in ONE ExplorerFrom ONE Explorer, you have the ability to access various components of your data, much like you would in the Knowledge Catalog of the ONE Web Application. ONE Explorer in ONE Desktop includes:Catalog Items Components Lookup Items Monitoring Projects Rules Terms This seamless access to your data provides a comprehensive overview of your information, enabling you to manage your data assets with precision.Working with Data in ONE DesktopThere are two primary methods for reading and working with your data within ONE Desktop:1. Catalog Item Reader Step:This step allows you to access data from different sources defined in the Metadata Management Module (MMM). When you drag and drop a Catalog Item from MMM into your plan, the Catalog Item Reader step is
Hello,We are trying to give access for invalid samples in our monitoring projects to our colleagues. The coleagues are in a role that they have data access to the Catalog items, and data access in the monitoring project, but they still are not able to see the invalid rows.Which access type should be granded for invalid samples in monitoring project ?
Needed to know how to create a rule having an attribute of STRING datatype for extracting current date and past date in One Web. Tried using date functions in string using advanced expression (today() is ATTRIBUTE) ..showing error in testcase. But when tried using same functions for DATETIME datatype working fine. Can anyone help?
I have scheduled certain workflows and running on daily. Due to change in component/ plan optimisation I expect run time changes in the workflow comparing to previous version of the workflow., similarly I did for many workflows and would like to see overall performance improvement in the workflow run. Is there any way I can go ahead and download or view the finished instances run times for all the workflow in a single place?
How I can use create sql catalog on s3 files (csv, parquet) in Ataccama One Web Knowledge Catalog.Do Ataccama use AWS S3 CData drivers
Whenever I run the plan file the output file get updated and the older output file data get lost . Is there any way ataccama can keep the files that is generated for all the time the plan file ran ?
Hi everyone, One of the core capabilities of ONE Desktop is metadata handling through ONE Metadata Reader and ONE Metadata Writer Steps. These steps allow users to read and write data from the Web Application, enabling a range of use cases and implementations. In this post, you’ll find out how to read & write metadata using the steps in ONE Desktop 👇🏽👀 ONE Metadata ReaderThe ONE Metadata Reader Step serves as a tool to read data from the Web Application, offering flexibility in usage:Common Implementations:Enriching data for external Business Intelligence tools (e.g., Tableau, Cognos) to create customized reports with additional attributes such as description, owner, and custom properties. Easily incorporating DQ rules into DQC plans, simplifying the process of finding and integrating rules based on name and input attributes. Constructing DQC plans with data transformations by utilizing data sources from the Metadata Management Module (MMM). Generating comprehensive HTML documen
Hi community! In this post, we are covering working and searching in metadata. Efficiently working with metadata is crucial for ensuring data quality, governance, and effective decision-making.Ataccama has several tools within ONE Desktop to assist in metadata management, including the ONE Metadata Reader and ONE Metadata Writer Steps for reading and writing metadata, as well as the ONE Metadata Explorer for seamless navigation. Let’s dive in 👀 Navigating with ONE Metadata ExplorerONE Metadata Explorer allows you to connect directly to your Ataccama ONE Platform server from ONE Desktop, granting you access to your critical metadata and even "Meta Metadata" for more in-depth analysis. Metadata Exploration by DefaultWhen you first access ONE Metadata Explorer, it's configured for exploring your primary metadata.Delving into Meta MetadataHowever, if you wish to explore your "Meta Metadata," you can easily adjust the settings:In the ONE Metadata Explorer, click the "View Menu" icon. Selec
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.