Skip to main content

Master Data Management & Reference Data Management 🛰️

Discuss, learn, ask, suggest, share all things MDM and RDM 🔍

  • 261 Topics
  • 603 Replies
263 Topics
Y
Data Voyager
Yasharth MisraData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Master data Layer matching- MDM

Hello, I wanted to know that how do we implement matching options in the master layer of the MDM project.I have used in the columns in the instance layer and then used the same in the master layer in the matching step just as used in the cdi example. and then I have used the same name in the matching step but still  nothing is  showing the UI part. Can someone help me with that.

201
O
Ataccamer
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️
Introduction to RDM - Part 3️⃣

Hi everyone,In the last post of our RDM best practice series, we will go through an example Project configuration, uncovering the key nodes and functionalities. I’ll be linking further reads if you are interested in a deep dive and try testing your skills ⚡ 1. RDM Logical ModeAt the heart of the RDM model project lies the RDM Logical Model. This node is the epicenter for configuring reference data, its entities, relationships, and organizational structures. With support for a myriad of tables and relationships, you can effortlessly model data, define attributes, and establish complex hierarchies. Dive into the details at Creating the RDM Data Model.  2. Connected SystemsIn the realm of Connected Systems, databases and servers take center stage. Efficiently import/export data to/from RDM by configuring connections to external databases and remote servers. Explore detailed instructions at Adding Databases Synchronized with RDM and Adding Remote Servers for File Transfers. 3. Workflow Con

1411
Elena Bu
Data Enthusiast
K
Data Enthusiast
karine.davtyanData Enthusiast
asked in Master Data Management & Reference Data Management 🛰️
Accessing Data of Catalog Item via Rest API or GraphQL

Hello everyone,I’m working on a project that integrates a data masking tool with Ataccama, and I’m encountering some issues when trying to retrieve actual catalog item data (the row-level data) via the REST API. I’ve been testing both GraphQL and REST approaches, and here’s what I’ve found so far:GraphQL vs. REST for Data Retrieval:The GraphQL API appears to focus on metadata – attributes, versioning, policies, etc. However, based on my understanding, the actual table data (the rows and cells) isn’t available through GraphQL; it’s only accessible via a REST endpoint. Based on available documentation for MDM and RDM REST APIs, the REST endpoints follow a pattern using a fixed base path (/api/rest) on the default port (8051) and use basic HTTP authentication.Endpoint URL Confusion:Initially, I attempted to use an endpoint like:  https://teranet.test.ataccama.online/catalog/data/catalogItem/<gid>/datawhich returned a 404 error. Later, based on the docs, I switched to the documented

677
Cansu
Community Manager
Elena Bu
Data Enthusiast
Elena BuData Enthusiast
asked in Master Data Management & Reference Data Management 🛰️
RDM users in Approval workflow without email notifications

Hi All,I have a question regarding RDM approval workflow. In our project, we have stages Initiator → Review → Publish. We have a customer request to allow RDM_admin users to participate in the approval process (i.e., they must be able to review and publish records) but not receive any email notifications.We tried removing RDM_admin role from Notifications section, but that didn’t help because this role remains in Workflows section. We can’t remove RDM_admin role from Workflows section, since that would prevent RDM_admin users from reviewing or rejecting records at all, they wouldn’t be able to participate in Approval workflow.The following settings don’t work, RDM_admin users still receive emails:Is there a way to keep RDM_admin’s ability to review and publish without receiving emails? Perhaps by checking user’s role or username in the Conditions section, so that Approval workflow gets skipped for certain users?The documentation for version 15.4 mentions something like meta.username, b

312
Elena Bu
Data Enthusiast
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️
Ataccama Academy Learning Journey: Master Data & Reference Data Management

Hi everyone 👋 Following up on our first post about getting started with Data Quality & Catalog, we’re excited to guide you through another key path in your learning journey—Master Data Management (MDM) and Reference Data Management (RDM). Whether you’re a business user, technical implementer, or solution architect, the MDM & RDM On-Demand Learning Path in Ataccama Academy will give you the essential skills to design, configure, and operate these critical components of the Ataccama platform. 📚Start with the basics to get familiar with MDM & RDM:Managing Master DataGain a foundational understanding of Ataccama’s MDM capabilities, platform UI, and core data concepts.Managing Reference DataExplore how reference data is governed and maintained in Ataccama to ensure consistency and control. 🧱Build on your foundation with practical configuration, workflows, and deeper implementation techniques:ONE Desktop CoreLearn to design data flows, transformations, and rules using the ONE

80
Cansu
Community Manager
M
Data Voyager
MayureshData Voyager
asked in Master Data Management & Reference Data Management 🛰️
MDM Validation

 I am trying to do validation on Tin , on which score and explanation are getting populated but the records which are invalid are not getting highlighted in red and i have enabled validation in the Tin columnAttaching the snapshots of the steps which i have done while configuring the validation:  How should i fix this.

121
Phil Holbrook
Ataccamer
alexAguilarMx
Data Pioneer
alexAguilarMxData Pioneer
asked in Master Data Management & Reference Data Management 🛰️
how to apply new changes into clean operation for records already in the db?

We made changes into the clean operation of an entity. it will take effects for new transactions.How can we apply this to the current records that we already have into the database? We are exploring use a full reprocess of this entity:but we have some doubts about the setup. For example:What is the difference between a reprocess vs rematch checkbox? We tried to read the documentation but there is not detail explanation about it. Thanks in advance!

805
Ales
Ataccamer
A
Star Blazer L1
aish_TFStar Blazer L1
posted in Master Data Management & Reference Data Management 🛰️
Usage of Rematch and Reprocess jobs

I have been trying to explore the Reprocess and Rematch options in MDM.From this post I understand that Reprocess is used to reprocess the records. For example, lets say, after an initial load where the email values were not being modified in contact_clean.comp, we are now to determine which emails have the domain company-name.com and are now being updated to have domain companyname.com . So, I need to run the reprocess job.Rematch is to run the match step on top of the reprocess since the email values have been modified. What I do not understand is do I run a rematch job only if the email value participates in determining the master record or do I need to run it whenever the reprocess jobs is run irrespective of the changes that took place due to a reprocess?There is another question I have. When we run a load job, the change detection is done right. Does this change detection run on all the records or just the delta records. Post the change detection, matching and merging is run only

446
Cansu
Community Manager
A
Data Voyager
A_NData Voyager
asked in Master Data Management & Reference Data Management 🛰️
How to delete the classification types from the tables and attributes level through One Desktop Plan?

Hello all,I’m using the Ataccama v14.5 there we have created the custom entity for classifications and created the classification types (Internal, Public etc) and added them with tables and attributes through the One Desktop plan. But when i am using the same plan to delete it from table or attributes just by changing the One Metadata Writer property in General tab “workflow state as deleted” and in the Columns tab providing the “Id Column Name as table_id” then it is not deleting anything. Any guidance or suggestions is really helpful. Thanks.General tab Screenshot:Columns tab screenshot: 

212
Cansu
Community Manager
K
Data Pioneer L2
KundanData Pioneer L2
asked in Master Data Management & Reference Data Management 🛰️
Schedule load in MDM

I have MDM setup and records are loaded using a Full Laod configuration. I need to create a load such that all the records that were added into the source are moved into to MDM hub on a daily basis. The approach being used is to identify all the records updated today and load them into MDM. Can you please suggest if I need to create a Delta Load for this or Full Load works. Also, I need to schedule a run of the load file on daily basis.How can I do it?

516
A
Star Blazer L1
A
Star Blazer L1
aish_TFStar Blazer L1
asked in Master Data Management & Reference Data Management 🛰️
Run MDM Export workflow task does not recognize the export component

The Workflow task Run MDM Export does not recognize the export component and and gives error message.I am assuming it is because there is no path variable set for the Export folder.Can someone please help me identify the issue?

133
A
Star Blazer L1
H
Data Voyager
HMJohnData Voyager
asked in Master Data Management & Reference Data Management 🛰️
File iterator task fails when workflow deployed to server

I have a workflow with a file iterator step. It runs without any issues in the IDE on my local machine, but whenever I deploy it my company’s RDM server, I get the following error:2025-01-07 09:05:31 INFO: starting...2025-01-07 09:05:31 ERROR: Problem during initialization of iterator valuejava.io.IOException: An unexpected network error occurred    at java.io.WinNTFileSystem.canonicalize0(Native Method)    at java.io.WinNTFileSystem.canonicalize(Unknown Source)    at java.io.File.getCanonicalPath(Unknown Source)    at com.ataccama.dqc.resources.local.FileResource.getCanonicalPath(FileResource.java:40)    at com.ataccama.dqc.resources.impl.DelegatingResourceBase.getCanonicalPath(DelegatingResourceBase.java:41)    at com.ataccama.adt.task.iterators.FileIterator$FileIteratorInstance.iterate(FileIterator.java:133)    at com.ataccama.adt.task.iterators.TaskIteratorInstance.initAndIterate(TaskIteratorInstance.java:36)    at com.ataccama.adt.task.exec.EwfForEachTaskInstance.run(EwfForEachTas

304
H
Data Voyager
OGordon100
Ataccamer
OGordon100Ataccamer
published in Master Data Management & Reference Data Management 🛰️
📚 Guide: How to run GraphQL requests - Part II Working with MMM

Hi everyone! I’m back with the second and last part of the GraphQL best practice series. First part was all about authentication types & which one you should use and how to authenticate GraphQL requests. This post will focus on how to work with MMM in GraphQL - so let’s get into it.If you’d like to check out the first part I’m sharing it here 👇 ONE Metadata Readers Or GraphQL? MMM is the name for the linked list that holds all metadata and the connections between them. Pretty much everything in MMM can be explored via GraphQL - as GraphQL is what happens behind the scenes in most steps/actions in ONE Desktop.As far as ONE Desktop is concerned, while ONE Metadata Readers are often all you need, highly nested queries and associated joins can become quite tricky to handle via ONE Desktop plans, and can sometimes be simpler to build by just running a specific GraphQL query. In addition to that, some things, such as raw profiling information can only be extracted via GraphQL. Exploring

510
OGordon100
Ataccamer
A
Star Blazer L1
aish_TFStar Blazer L1
asked in Master Data Management & Reference Data Management 🛰️
New Full Load for an already loaded source data

I  have a full load already configured for a source system. This load component has 3 different entities(party, contact, address).I have used this to load data into mdm-hub as well.However, now we want to use a different source table for party entity and want to load only the records for party entity. I am planning on using a new full load with mappings only for the party entity. Will thiscreate new instance party records and make the old records inactive? bring any change to the records for contact and address entities? 

415
A
Star Blazer L1
john.efechaobor
Ataccamer
john.efechaoborAtaccamer
published in Master Data Management & Reference Data Management 🛰️
Connecting Azure AD to Keycloak (SAML)Best practice

Security Assertion Markup Language (SAML) allows users to use one set of credentials to log into many different websites. It is an open standard that allows identity providers (IdP) to pass authorization credentials to service providers(SP). SAML transactions use Extensible Markup Language (XML) for standardized communications between the identity provider and service providers. SAML is the link between the authentication of a user’s identity and the authorization to use a service. Items to consider prior to connecting to SAML- Best PracticeIt is important to understand how your organization’s Active Directory is setup. Some pre-requisites needed can include things such as:Do you have a list of groups you need to import? If the answer is no, you may want to speak to your engagement manager from Ataccama to discuss in detail. In short, with AD Groups we can map Ataccama Roles to a single group. This benefit of doing this is, your internal dev-ops team won’t have to manually add/remove u

101343
David Mecca
Ataccamer
F
Universe Traveller
fshahinUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
Direct Load Operation failure

Our Incremental load operation is taking huge time (2 hrs to process 5-7K records). We have applied all performance tuning things which is there in document. Apart from this we thought of loading data from DW to PostgreSQL (MDM DB) stage table and then will use that stage table as a source in Incremental load. Idea is when the server will be same for both source and target the computation will be faster.But this direct load job is failing with below error. Kindly help on fixing this. Or please recommend on any other approach.com.ataccama.nme.core.NmeExecutionException: Plan "C:\Users\EYKU4F\Ataccama\workspace\OmniChannelMDM_Latest\Files\engine\load\EPRISM_stg_eprism.comp" execution failed: runtime.error.jdbc_reader_error - nullcom.ataccama.dqc.model.environment.AbortedExecutionException at com.ataccama.dqc.model.elements.data.flow.RecordQueue.putBatch(RecordQueue.java:173) at com.ataccama.dqc.model.elements.data.flow.RecordQueue.access$100(RecordQueue.java:35) at com.ataccama.dqc.model

243
Cansu
Community Manager
jduha
Ataccamer
jduhaAtaccamer
published in Master Data Management & Reference Data Management 🛰️
Spice Up Your MDM with Emojis! 🎉

Hi community 👋 Every now and then, we hear from our users wondering if it’s possible to spice up their Master Data Management (MDM) interface with something a little more visual.Recently, I worked with one of our members who wanted to mark one of the records in a group as having a special meaning, so that it would instantly stand out to data stewards. While the logic behind selecting this record was complex, the outcome boiled down to a simple boolean flag, like cmo_preferred_flag = {true | false}. However, displaying such an attribute on the screen isn’t exactly thrilling:In earlier versions, it was possible to load an image file to represent things like this, but it required customization that was tricky to maintain. Plus, it often got wiped out when regenerating the MDM project. In our current versions (14.5.x / 15.x), we’ve moved to SpringBoot, and for security reasons, loading external static content is no longer supported.So, can we solve this in a fun and practical way?The emoj

450
jduha
Ataccamer
M
Data Voyager
mauriceKData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Updates creates a record to split from its golden id

Hi  We are noticing behaviour in our model where a source system will split from its golden id group when updated on matching criteria fields ( in this example address). However it only does this when the group of records was manually merged onto the golden id. It wont “jump ship” and form a new golden id when the records previously auto merged based on the matched criteria we assigned in the model.Is there a way we can stop this splitting from happening when the source system is updated? For example we can see here the new golden id created with one SF record  the previous group the SF record belonged to, shows a lot of manual merging in the Match Rule Name column Our rematch if changed section shows these fields are used for rematching:  We want to keep rematching switched on, to bring other source systems into the group if they meet criteria, but we dont updates on the SF record itself to allow it to break out of the group. (We dont want “auto-splits”) thanks

314
Cansu
Community Manager
F
Universe Traveller
FionaFUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
Error during manual Merging

While trying to manually merge 2 records, facing an error stating permission issue. Followed above mentioned step to merge records. Error message 

516
Cansu
Community Manager
T
Data Voyager
TylerData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Set MDM records to inactive based on source flag and not delete

Hello, from one of our source systems we were previously excluding any inactive addresses, contact details, etc. Our users have requested we load these records into MDM for visibility. My issue is that while we can add these records as is, they will not show as inactive on MDM. We could add a source active flag but for consistency with other sources we would like them to show as inactive on MDM (Greyed out). We have considered doing a one time load of all the inactive instances and then excluding them from the daily load but because it is possible to create address and contact details as inactive from the source that would not work. I have explored using the delta load as it has a change type column that could be appropriate for our use case.Has anyone had to set records in MDM as inactive as part of the load not using the deletion strategy? What method did you use?I have also looked into creating new instance entities to store inactive records but that would be a large undertaking as

674
Cansu
Community Manager
R
Data Voyager
ritesh.ranjanData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Apply Last Changed Date Field Delta Change only on Instance Layer and not on Master Layer

Hi @Cansu and AllIn the event if there is no change in the delta records coming in MDM except one of the Sequence Generated column, is their a way that the date field(Last Changed) gets updated with the date of the new row only on INSTANCE layer and not on the MASTER layer. So, if MDM ingests the delta record in Instance Layer and sees that there are no changes detected on any columns except the sequence column and it has nothing to update the Golden Record already existing then it should update the date field on Instance Layer only and not on Master Layer.Please let me know if you have any additional questions.Thank YouRitesh Ranjan

693
Cansu
Community Manager
A
Star Blazer L1
aish_TFStar Blazer L1
asked in Master Data Management & Reference Data Management 🛰️
Unable to start keycloak locally on a Azure DevBox

Unable to start keycloak locally on a Azure DevBox, When I run the keycloak.bat file from OneDesktop, it is immediately terminated as per console logs. Can anyone help with the diagnosis?

192
Cansu
Community Manager
D
Data Pioneer
debashishghoshData Pioneer
asked in Master Data Management & Reference Data Management 🛰️
Update flow for Delta Export

We are getting errors in the delta update flow for party and policy master and this is the error message. “com.ataccama.nme.core.NmeExecutionException: Plan "/opt/ataccama/one/mdm-server-config-13.9.1.221107-11165-6e37fd24/Files/engine/export/Party_Master_Delta.comp" execution failed: runtime.error.sql.instance.processError - Transaction (Process ID 901) was deadlocked on lock | communication buffer resources with another process and has been chosen as the deadlock victim.” Please advice if any help can be provided.Thanks !!

142
Cansu
Community Manager
F
Universe Traveller
fshahinUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
MDM Performance Issue

Hi All,We are facing performance issue while loading and exporting data in MDM. We have around 30 million records. We are loading data in chunks and initial few execution were very quick. After processing 20M we are observing severe degrade in performance. Now even for 10K records the job is taking 8-10 hours for both load and export. We have applied parallelism wherever its possible. Is there any other thing which we need to consider/implement which will enhance the performance?TIA.

322
Cansu
Community Manager
J
Universe Traveller
jbrantUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
Updating Lookup Item via GraphQL Mutation

I have an ETL process that’s run on-demand and refreshes master data referenced by several Ataccama catalog items. There’s about 60 lookup items that are created from catalog item attributes that I need to update immediately following the master data refresh. I know there’s a lookup item “Update” button in the Ataccama web interface and a method to schedule refreshes; however, I haven’t been able to find a way to update lookup items on-demand, such as through a GraphQL mutation.Is there an available mutation for updating lookup items on-demand, or another method that could be utilized?

381
OGordon100
Ataccamer

Badge winners

  • DQG Certified Professional
    akshayl09has earned the badge DQG Certified Professional
  • First idea 💡
    abhiparamhas earned the badge First idea 💡
  • 10 ideas 💡
    ayounghas earned the badge 10 ideas 💡
  • First idea 💡
    JS21has earned the badge First idea 💡
  • First idea 💡
    akshayl09has earned the badge First idea 💡
Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings