Master Data Management & Reference Data Management 🛰️

Hi All,We are facing performance issue while loading and exporting data in MDM. We have around 30 million records. We are loading data in chunks and initial few execution were very quick. After processing 20M we are observing severe degrade in performance. Now even for 10K records the job is taking 8-10 hours for both load and export. We have applied parallelism wherever its possible. Is there any other thing which we need to consider/implement which will enhance the performance?TIA.

I have an ETL process that’s run on-demand and refreshes master data referenced by several Ataccama catalog items. There’s about 60 lookup items that are created from catalog item attributes that I need to update immediately following the master data refresh. I know there’s a lookup item “Update” button in the Ataccama web interface and a method to schedule refreshes; however, I haven’t been able to find a way to update lookup items on-demand, such as through a GraphQL mutation.Is there an available mutation for updating lookup items on-demand, or another method that could be utilized?

Taking reference of CDI Example, I have multiple contact values for the same person and I want all of these contacts to be a part of the contact master entity. I am not sure how the same instance record id will affect this. Will ataccama load both these records? Will both these records partivipate in match logic(same master_party_id, same_contact_type,same contact_value) or will it consider just the first one?Also, if someone can please confirm if the master_party_id is id for master record derived on processing of all party records?

Hi All,I have a few observations regarding the source_id column in matching step of an entity in a MDM project.For context, source_id is a column with unique values (Primary Key in most cases) that we define to uniquely identify each record in a source system, connected to mdm hub.I was recently trying to test the match logic on OneDesktop using plan files. I used a very small subset of records from each source.Load ComponentIn the project, source_id column(defined in load component) for one of these source system is “SOURCE_SYSTEM_NAME~^~pk_id”where SOURCE_SYSTEM_NAME is as string value and pk_id is the primary key. match componentWhen we defined a match component in mdm project, we do not define standalone bindings but assumably “Id Column” would be mapped to source_id column if we are testing on OneDesktop as a plan.So, when I created a plan to test the match logic, I mapped “Id Column” to source_id (with source_id having string values as mentioned above). But when I run the plan wi

How to load result data from Ataccama ONE MDM to ERP systems like SAP?

I have a scenario where I do not want to deactivate the source party records in Ataccama, even though it no longer exists in the source. Is there a way to achieve this?

Hello,I am trying to use MPP step to derive some values from some free text field.I am struggling to parse any regex pattern for string like “A/B”.It seems to work but whenever there is / sign it just doesn’t parse it.I tried to escape it using \/ and also some other different options but nothing seems to work. What am I doing wrong?EDIT:Tried to parse similar REGEX against Regex Matching step and here it seems to work: Could it be possible that MPP step is parsing incorrectly?EDIT 2:I might have found the issue. I took Tokenizer part from our another component and it started working correctly. However, I still don’t understand exactly how Tokenizer works and the docs aren’t providing with great examples on how to understand it. Szymek

Please help/guide me on how to create parameters to enter values for a workflow in admin centre. I have an already configured workflow with parameters in Admin centre but I want to remove it. I am not aware of this change as it was made previously by another person. If there is some documentation in ataccama docs that someone could point me towards, that would also be great.TIA 

Can we have duplicate source_id column values in mdm full load?

I created two Complex Delta Load file and this led to addition of related details in  .metadata/md/co‎nnected_systems‎But these two files don’t show up in the Admin Centre. Please tell me what can be done?

I have created a workflow to call a component which is selecting data based on a value provided by user in the admin center workflow input parameter. To make it error free so that the user doesn’t input any wrong value for the parameter, I was wondering if it is possible to create a dropdown or bullet with accepted parameter values in the admin center so we could just choose the value and run the workflow?Please let me know if anyone has tried this.Thank you,

Hi All,How can I use the file us_ca_firstname_synonym.lkp to create a match? Like Robert Smith should match with Bob Smith. I checked the file and for one name it has multiple synonyms. I can fetch the result in clean component but not sure how do I use that in Match component to generate match. Your help is much appreciated. Thanks in advance.ThanksFS

Reasons for deletionThere are several reasons why you might want to delete data from your MDM.Legal reasons e.g. GDPR Incorrect load operation happened The data is simply not relevant anymore Performance issues while keeping redundant data etc.Truncate tables?People usually ask if a TRUNCATE operation worked. The simple answer is NO. It might work only in isolated edge cases. You typically need to consider MANY other things and at least some of them need to be resolved.uncommitted transactions related tables/records x... tables historical table(s) direct deletion will not be properly removed from the history and must be removed separately master table(s) matching repository and matching proposals repository (if matching is enabled) think about copyColumns - are there any data copied from that specific entity to a related one export operations (truncated data will not be exported) event handlers (truncated data will not be published) auditing direct deletion will not be logged and will

If my MDM instance is up and running with the model same as the example project. But there were standardization changes that need to be implemented now. Example: ph no. (+91)22343 24532 is being standardised to +91234324532.Will this affect matching for contact.master records? If so, will it create new master ids in any scenario? 

Could you please help to share steps to setup connection from ataccama to Snowflake

Is there a way that I can use to make an API call to trigger a workflow?We want to start a workflow to Load Data into MDM after the data is refreshed in all source systems, each time it is refreshed.Please suggest if there is a way do define a service for this.Thanks in Advance :)

Hi All,I have recently made created new export delta operation along with made minor tweaks in the full load export operation too.After making changes,once i save and generate,trying to up the MDM server,getting the below erro.Please suggest,what is could be the missing dots here. Sharing the error log received in console for start_mdm_Server.bat file.2024-09-27 12:23:30,456 ←[1;31mERROR←[0;39m [][][main] ←[36mo.s.b.SpringApplication:835←[0;39m - Application run failedorg.springframework.beans.factory.BeanCreationException: Error creating bean with name 'workflowServerComponentService': Invocation of init method failed; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'nmeEngine' defined in class path resource [com/ataccama/nme/services/config/NmeBeansConfiguration.class]: Bean instantiation via factory method failed; nested exception is org.springframework.beans.BeanInstantiationException: Failed to instantiate [com.ataccama.nm

I would like to know what will be the effects in mdm web application if I make the following changes.Here goes the scenario:Let’s say I am using email attribute in my match logic of contact(silver) entity and have already loaded the email records into my mdm-hub.But now, I do not want to use email information from 1 of 3 source systems while determining the contact(silver) master. I think the option is to not load email information from the said system.Will the email information (from the records that were loaded previously from system 1 )still show up after I run a reprocess job( after loading the records from system 1 without any email information.)?

When i am creating a new flow for export operation,it is not reflecting in the admin console to trigger the respective flow’s execution.Please help how to enable that in the admin console.Please suggest.

When trying to run export operation from localhost admin center, error is thrown saying "Origin code 3389682780300157351 used on InstanceEntity(address) record 37150 not found!". Here address is one of the entity being used in my export operation.Attaching the error log file here and below is the export plan for the full load for policymaster export.Any help,highly appreciated. 

How can I edit existing lookup files to add new values? File location is “files → data → ext → lkp”or how can I create a new lkp file in same path?

Hi All,From source I am getting only one column as FullName and there is no other column which can identify whether the Fullname is person’s name or a company’s name. In Ataccam, is there any out of box functionality built which can parse the FullName column and identify the party type?If yes, then kindly do let me know the steps which I need to perform to achieve this.ThanksFS