Master Data Management & Reference Data Management 🛰️

Discuss, learn, ask, suggest, share all things MDM and RDM 🔍

  • 159 Topics
  • 268 Replies

159 Topics

M
MayureshSpace Explorer
asked in Master Data Management & Reference Data Management 🛰️

pgsql not working in MDM template project.

I am working on template project for MDM and i am not able to run the pgsql script in it and i did followed the steps mentioned in this  MDM Example Project - Ataccama ONE Gen2 Platform Latest Kindly let me know if you have any solution for this.   

2
M
5 hours ago
K
KundanSpace Explorer II
asked in Master Data Management & Reference Data Management 🛰️

Ataccama MDM setup

Hi Team ,Can anyone please help me setup my MDM environment locally .Please help me with the plugins and folder structure .Regards,Kundan 

1
A
Ataccamer
1 day ago
DannyRyan
Community Manager
DannyRyanHead of Technical Training
published in Master Data Management & Reference Data Management 🛰️

RDM Record ValidityBlog

When working with Reference Data table there may be a business requirement to control what kind of values can be input into a given attribute which are checked whenever a user creates or edits records within the RDM application. There are two kinds of validations:  The first kind are called Instantaneous validations. These conditions, e.g., regular expressions or string size are checked automatically when you enter an attribute value. When the input value fails to meet these condition, an INVALID message appears next to the attribute field. The second kind are called Online validations. These are more complex conditions, which are triggered by clicking Validate in the Create detail/Edit detail dialogue or upon closing them. Such validations are performed by DQC plans (using, e.g., phone number or address lookups) or SQL queries in RDM. When the input value fails to meet these condition, a Warning message appears next to the attribute field.Records which do not satisfy online conditions

723
Joeri
1 day ago
A
AkashSpace Explorer II
asked in Master Data Management & Reference Data Management 🛰️

Integrated Login for database

Hi Team,In Ataccama IDE, while connecting to database we need to provide connection string. Also, username and password. In other tools like SQL server, we can use windows authentication to login so no need to enter username and password.Could you please help me how we can achieve the same integrated login for database connection. 

4
Cansu
Community Manager
4 days ago
N
NatarajanSpace Explorer
asked in Master Data Management & Reference Data Management 🛰️

RDM web admin console connection issue

HTTP ERROR 404 Not FoundURI: /rdm STATUS: 404 MESSAGE: Not Found SERVLET: com.ataccama.server.http.ServletContextDispatcher-5eefa415

2
Cansu
Community Manager
7 days ago
M
MayKwokStarship Crew Member
published in Master Data Management & Reference Data Management 🛰️

Ataccama Admin Centre: ServerConfig and RuntimeConfig for beginners (Self-managed installations) 1/2Tutorial

Introduction What is the Ataccama Admin Centre? Where is Ataccama Admin Centre? What are the serverConfig and runtimeConfig files? Where do I start? Where are these configuration files? Sample project structure What is inside the configuration files? ServerConfig RuntimeConfig IntroductionThis is an introduction to the Ataccama Admin Centre serverConfig and runtimeConfig files:What the files are and where to find them How to setup security on the Admin Centre UI itself How to setup an online service endpoint on Admin Centre How to setup Admin Centre to enable the run of schedulers, workflows and plans / componentsThe intended audience for this article are Power Users for Ataccama ONE. Power Users may have built some plans / components / workflows / schedulers / online services, and are now looking to host them on a server environment. What is the Ataccama Admin Centre?The Atacccama Admin Centre can also be referred to as the “ONE Runtime Server”. For the purposes of this document, we

4112
Cansu
Community Manager
9 days ago
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️

Introduction to RDM - Part 3️⃣

Hi everyone,In the last post of our RDM best practice series, we will go through an example Project configuration, uncovering the key nodes and functionalities. I’ll be linking further reads if you are interested in a deep dive and try testing your skills ⚡ 1. RDM Logical ModeAt the heart of the RDM model project lies the RDM Logical Model. This node is the epicenter for configuring reference data, its entities, relationships, and organizational structures. With support for a myriad of tables and relationships, you can effortlessly model data, define attributes, and establish complex hierarchies. Dive into the details at Creating the RDM Data Model.  2. Connected SystemsIn the realm of Connected Systems, databases and servers take center stage. Efficiently import/export data to/from RDM by configuring connections to external databases and remote servers. Explore detailed instructions at Adding Databases Synchronized with RDM and Adding Remote Servers for File Transfers. 3. Workflow Con

210
Cansu
Community Manager
14 days ago
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️

Introduction to RDM - Features 🤹🏻

Hi all!In today’s post, we will go a step further and briefly touch on the main features of the RDM. RDM and its features are without a doubt much more layered so I’ll be sharing links to further reading on each of the features mentioned 🖇️Before starting, I suggest you take a look at the first two posts of our RDM Best Practice series to get familiar with the solution if you aren’t already 🔎  1. Model and Metadata ConfigurationThe RDM metadata is the core configuration of the RDM project. The central reference data model swiftly configures critical processes, from integration interfaces to synchronization processes and relationships.Through the metadata model it defines all entities, structures, workflows, synchronization jobs, and more. For detailed instructions, refer to RDM Configuration. 2. Data Management RDM seamlessly supports the complete lifecycle of reference data. It serves as the central authority for changes, ensuring consistency across diverse systems. Create, modify,

230
Cansu
Community Manager
15 days ago
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️

Introduction to RDM - Part 2️⃣

Hi everyone! We are back with the second part of the introduction to RDM series. If you missed our first post you can find it here 👇🏻In this post, we'll delve into the fundamentals of RDM—creating new reference data, editing existing records, publishing changes, and exploring advanced features like viewing modes and hierarchies. Let's get started 🏃🏻‍♀️ How to Create New Reference DataLet’s go through a quick example to demonstrate. Navigate to 102: Branch Table: Open the DATA section in the left menu. Choose Tables and open the 102: Branch table, showcasing a list of banking branches.  Create New Record:Hit the Create button, unveiling an empty form. Fill in required fields, leaving Code blank. Validate your entries, correcting any issues. Hit Enrich to auto-populate certain fields based on predefined logic. Before saving, ensure your Address lacks the number 9. Save the record, acknowledging the warning prompt. Explore the option to create a new record from an existing one for ef

90
Cansu
Community Manager
17 days ago
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️

Introduction to RDM - Part 1️⃣

Hi everyone, and happy Monday! In this post, we will cover Ataccama’s Reference Data Management solution with a short introduction, follow us for part 2 and check out our MDM Series below 👇🏻 First things first. What is RDM?Reference data is data that defines the values that are used to classify and characterize other data. This is sometimes known - not always correctly - as Master Data, Golden Record, Golden Copy, or Single Source of Truth.RDM is an essential component of Master Data Management (MDM) that has evolved to become a mature data management discipline in its own right.  Who's It For?At the heart of the RDM web application are three key player roles:Reference Data Stewards Analysts ManagersDesigned with precision, the RDM web application caters to these roles, ensuring a user-friendly and efficient experience. What Can You Do?The RDM web application empowers you with a rich set of features: View, Edit, and Manage: Seamlessly view, edit, and manage reference data, putting yo

190
Cansu
Community Manager
17 days ago
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️

Efficient Bulk Profiling for Large Databases 💾

Hi everyone, In this post, we will cover how to do Bulk Profiling 💾Profiling vast databases with numerous tables can be a daunting task, but Ataccama's Bulk Profiling extension streamlines the process. This extension simplifies the profiling of database data sources with multiple tables. Instead of configuring analyses individually for each table, it enables you to import data structures directly from the database dictionary.Bulk Profiling then automatically generates a profiling plan for each table. To top it off, the tool creates an execution batch file that can run the individual plans. This means you can perform the entire profiling process unattended, whether overnight or at a scheduled time using a task scheduler. Step 1: Creating a Bulk Profiling ProjectIn the Model Explorer view, click on New Model Project in the toolbar. This will open the New Model Project dialog. In the dialog, select the Bulk Profiling model template. Click Finish.   This initiates the process of creating

534
Cansu
Community Manager
21 days ago
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️

MDM Model ❇️

Hi everyone!We are wrapping up our introduction to the MDM series with this post delving into the core of MDM—the Model. MDM is a model-driven implementation, where the model takes center stage, driving the generation of structures and orchestrating crucial processes. Let’s dive in 😎 Unlocking the MDM Model MagicThe MDM Model is the maestro orchestrating the symphony of Ataccama MDM's capabilities. Here's a glimpse of how it weaves its magic: Automated Database Structures: Say goodbye to manual database creation. Ataccama MDM automatically generates database structures based on your model. MDM Workflow Wizardry: Cleansing, matching, and merging—the three crucial phases—are seamlessly handled by the MDM Workflow, automating the orchestration of these intricate processes. Native MDM Services Creation: The model isn't just a blueprint; it's a generator. Native MDM services spring to life based on your model, simplifying service creation and eliminating unnecessary complexities. Con

160
Cansu
Community Manager
22 days ago
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️

Introduction to the MDM Features ✨

Hi everyone, Welcome back to our best practice series on MDM. In this post, we're diving deep into the features that make MDM - so buckle up 🚘 MDM’s primary feature is its model-driven architecture. It's a domain-agnostic MDM that empowers developers to craft domain-specific MDM models. Let's break down its high-level features by type. Model-Driven ArchitectureMDM's domain-agnostic approach is complemented by vertical models (metadata templates) designed to be domain-specific. These models are not cast in stone; they are customizable and extendable to meet the unique needs of your project. To delve deeper into this model-driven marvel, check out the Model. Internal Workflow and Processing PerfectionMDM boasts a remarkable set of features:Out-of-the-box change detection on load: MDM is a keen observer. It can detect changes in source instance records by tracking their unique source IDs. If a record has changed, it triggers the MDM process for that specific record. The granularity of de

320
Cansu
Community Manager
23 days ago
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️

Introduction to Master Data Management (MDM) - Part 2️⃣

Hi everyone, In this post, we will continue our introduction to Master Data Management (MDM), if you have missed our first post you can find it here 👇🏻This article will focus on the architectural details of MDM, breaking down the components, dependencies, and practical management tips ✨ The Pillars of MDMAt the heart of MDM, we find four essential components:Keycloak: Our third-party identity management tool. MDM Server (formerly known as MDC): The robust Ataccama MDM processing engine. MDM Webapp (formerly known as MDA): The user-friendly Ataccama MDM web application. Relational Database: The sturdy backend database, supporting PostgreSQL, MS SQL, or Oracle.Each of these components is configured as a Linux service, allowing independent restarts and individual log access for issue identification. The Backbone of DatabasesMDM is compatible with PostgreSQL, MS SQL, and Oracle relational databases. However, it's important to note that Ataccama officially supports only PostgreSQL Standal

470
Cansu
Community Manager
24 days ago
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️

Introduction to Master Data Management (MDM) - Part 1️⃣

Hi everyone, happy Monday 👋🏻 After publishing more than 20 articles on ONE Desktop best practices, I’m happy to share that we are ready to take the next step into Ataccama's Master Data Management (MDM), a robust, scalable, and highly available platform designed to simplify and enhance your master data management tasks. Let’s start with the basics ⚡  What is MDM and how is it different? Unlike the traditional "data flow driven" Data Quality Center (DQC), Ataccama MDM stands out as a fully metadata-driven data processing system. It incorporates an array of powerful tools, including the Advanced Metadata Editor (AME), a cutting-edge data processing engine (NME), and the DQC Plan Executor (complete with its steps and components).By doing so, MDM naturally extends the capabilities of the DQC, offering comprehensive data quality management functionality. In essence, MDM combines Master Data Management with a strong emphasis on Data Quality as a fundamental part of the process, providing a

480
Cansu
Community Manager
24 days ago
D
Deepak ParmarSpace Explorer II
asked in Master Data Management & Reference Data Management 🛰️

Facing the error "Role "mdc" does not exist" when starting mdm-server in One Desktop.

I am following the tutorial to install and run the latest MDM example project on Windows.When I am starting the MDM Server using start-mdm-server.bat, I am facing the below error: Can anyone guide me on how to add a user role to Keycloak for this ? Keycloak demo version is being used in this case ( Keycloak 21.0.1)

3
Cansu
Community Manager
28 days ago
R
rober_tallitschSpace Explorer
asked in Master Data Management & Reference Data Management 🛰️

How to schedule a Workflow in Ataccama Admin Center - GEN1

I’ve created a basic workflow that utilizes the API to execute an existing project/plan.  The project had an post process component that writes the invalids to an Excel spreadsheet.The other steps in the workflow wait for the file to be created and load it into DQIT.  We can write directly to DQIT due to an issue with Databricks/Spark. The workflow works great, but I need to manually execute it.  I’d like to us Admin Center to “Scheduler” to execute the workflow.How do I do that?The environment is Azure / Linux.  

9
Cansu
Community Manager
28 days ago
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️

How to create model projects?

Hi everyone, happy Wednesday! In this post, we will walk you through Model projects! Model projects play a crucial role in configuring various Ataccama products like DQ Issue Tracker, ONE RDM, and ONE MDM. These model projects are structured based on model templates, which define a specific set of nodes, folders, and files during project creation or import. It's important to note that you cannot modify or remove nodes created by a template.The configuration within model projects is developed using the Advanced Metadata Editor (AME). In this context, metadata refers to the configurations made within the model project nodes, which are used to generate plans, components, web service configurations, XML files, and other necessary components for a particular solution.Developing solutions based on metadata is carried out in the Model Explorer view, and detailed instructions for each product can be found in the respective Developer Guides.Every Ataccama build includes a default model project

100
Cansu
Community Manager
1 month ago
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️

How to create new server connections? 🔗

Hi community!In this post, we will discover how to create server connections in ONE Desktop for various tasks and workflow steps. Read on to find out more 👀 How to register a new server?To set up a new server connection, follow these steps:Right-click Servers in the File Explorer and select New Server.   Choose the desired Environment. Learn more about Environments.   Provide a unique server Name and select the appropriate Implementation. Configure the server connection according to your implementation, and click Finish.Once registered, the new server connection will appear in the File Explorer tree.Please note that, during development, right-clicking the server connection and selecting Connect is not considered a valid connectivity test, and it's not necessary for enabling step communication. Implementation TypesGenericUse this implementation to connect to:Servers running RDM or DQIT web applications. Learn more about Importing and Exporting Issues and RDM Synchronization. Generic

280
Cansu
Community Manager
1 month ago
R
rene.requenesSpace Explorer
asked in Master Data Management & Reference Data Management 🛰️

Monitoring Project - Integer and Dates

When I use Monitoring Projects and try and apply a rule to a DATE or INTEGER it is not allowed.  For Date Rule, I want to check for NULL or a DATE range.  For Integer, I want to check from a referenced lookup table.     Why is this check only allowed for Strings ?  Will DATE and INTEGER be added at a later time ? Rene Requenes

1
Cansu
Community Manager
1 month ago
O
OjaswiniRocket Pioneer II
asked in Master Data Management & Reference Data Management 🛰️

Too many components / steps in a single onPublishHandler.plan file.

Hello Ataccamer,I have a question regarding the "onPublishHandler.plan" file. This file contains components and steps for on-publish synchronization for all the RDM tables, which results in numerous components corresponding to each RDM table. As the project progresses, the number of RDM tables keeps increasing, causing this file to continuously grow in complexity.I'd like to inquire whether it's possible to segregate these components based on projects example diff file for domain or any other way. Is there a way to create separate "onPublishHandler.plan" files for different project domains? This could help reduce confusion, especially when multiple developers are working simultaneously. Just a thought. Thanks and regards,Ojaswini

1
Cansu
Community Manager
2 months ago
O
OjaswiniRocket Pioneer II
asked in Master Data Management & Reference Data Management 🛰️

How to append data into Parquet file in RDM on-publish event.

Hello,I have a requirement to append the records in parquet file in the event of RDM on-publish synchronization. Does anyone know, how can we append data into Parquet file in RDM on-publish event?I believe parquet file writer will write data in the file, but if the new record created in the RDM, will it append the data in the same file or will replace the file completely and create new one.Thanks for any help.-Ojaswini

2
Cansu
Community Manager
2 months ago
J
Jason.SupticSpace Explorer II
posted in Master Data Management & Reference Data Management 🛰️

Permission/Security setup via the OneDesktop IDE (RDM)

Setting permissions for groups via the IDE.Ensure your groups exists in KeyCloak first In the IDE go to your RDM Project and complete the following under "Security" Right click on Roles Select New role   Add the name and description of the role (be sure to use the same names that you setup in KeyCloak) then click Apply and OK Expand the new role, and right click on Entities then select Edit…  Add the Tables and the Table level permissions in the next window  NOTE: Table permissions do not give column level permissions. Double click the number next to the table that you wish to setup permissions for Notice that there are options for "View for All Columns" and "Modify for All Columns." However, if you want to select only certain columns, you can do that below with the following steps. Add the column names you want permissions to be given for, and select View and/or Modify for the given column   When complete, click Apply then OKTo ensure these permissions are applied to the Web Admin do

1
Cansu
Community Manager
2 months ago
O
OjaswiniRocket Pioneer II
asked in Master Data Management & Reference Data Management 🛰️

How to write data to Parquet file when it is a record deletion event on RDM UI. (in on-publish)

Hello Ataccamer,I am dealing with Parquet file writing in on-publish mode. Could you please suggest how to write data to Parquet file when it is a record deletion event on RDM UI (in on-publish) . As in case of Parquet file it is always first delete the file and then created the file again.How the CHANGE_TYPE is in {'DELETED'} will work in this case. Any suggestions, please share.Thanks and regards,Ojaswini

1
O
2 months ago
G
GersonSpace Explorer
asked in Master Data Management & Reference Data Management 🛰️

Property with name 'KafkaResources' doesn't exist in com.ataccama.dqc.streaming.KafkaProviderComponent!

Hello Ataccama Community,I'm currently using Ataccama One Desktop version 13.9.1, and I'm encountering an error while trying to execute a plan that involves a Kafka Reader component. I have configured a Kafka server(kafka integration) with the following properties:ssl.truststore.location=LOCATION_TO_TRUSTSTOREssl.truststore.password=TRUSTSTORE_PASSWORDssl.protocol=TLSsecurity.protocol=SASL_SSLsasl.mechanism=GSSAPIsasl.kerberos.service.name=kafkasasl.jaas.config=com.sun.security.auth.module.Krb5LoginModule required \        useKeyTab=true \        storeKey=true \        keyTab="LOCATION_OF_THE_KEYTAB" \        principal="USERNAME_HERE@EUROPE.XYZXYZ.CORP"; The error message I'm seeing is: "Property with name 'KafkaResources' doesn't exist in com.ataccama.dqc.streaming.KafkaProviderComponent!"I've reviewed my configuration, but I'm still unable to resolve this issue. Can someone please provide guidance on how to troubleshoot and resolve this error? Any insights or suggestions would be gre

1
Cansu
Community Manager
2 months ago

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Terms & ConditionsCookie settings