Discuss, learn, ask, suggest, share all things MDM and RDM π
Recently active
Hi All,In my incremental table I am having 300K records which when I am trying to load in MDM, the server is getting crashed. Its running for 2-3 mins then throwing the error that βcant reach local host serverβ. We are in dev phase and using the local server.Β Some times it also throws the error βNot enough memory to load this pageβ. How do I fix this issue?I also saw the post for applying check points in full load but what about incremental load. How do we handle failures for incremental load and how can we optimize it more?Thanks. Your inputs will be much appreciated.
Does anybody need to ingest data into Ataccama by way of an excel file attached to an email?One of our business teams receive a βdata feedβ from an external supplier. It comes as an Excel attachment delivered by email.We have enquired, they do not have APIs. Excel via email is all weβve got.As it stands, my integration will depend on the person receiving the email dropping the file into something like an S3 / ADLS Gen2, and for us to build a .ewf to poll the location regularly to ingest the data (into RDM).Weβre on PaaS, v14.5.1 for now, soon to be v14.5.3.Donβt think the PaaS stack can automagically read emails and get attachments off. Weβre not keen on the dependency on the person to drop the file into ADLS Gen2, but it seems to be my only option at the moment.Do I have any alternatives?Β
Hi All,I have a scenario where I have loaded email table with 2 slightly different email data. Now next day source team sent the corrected data which is exactly equal to first data so the 2nd data gets updated but since it is exactly same it should get merged with first data but that is not happening. For email table we dont have any match rule. We just have defined a key rule on email address basically storing unique data for same load.First Loadid email 123 abc@gmail.com 124 abc1@gmail.com Β 2nd Loadid email 123 abc@gmail.com 124 abc@gmail.com Β Now I have duplicate email data with 2 diff id. How can I fix this? I do not have party id in this table. Party and Email are linked using Party_Email table which is having relationship for both the entities.Party_Emailid party_id email_id 1 100 123 2 100 124 Β
Our experts here canβt seem to get it to work even with support teamβs help.Β If you happen to have had success and are willing to share some of the details, it would be greatly appreciated.Β Β
HiΒ Β I want to search for a validation message on a field.For example if ABN is empty I can use Advance condition to write: ABN is nullΒ However in this case I want to search where the ABN contains a value which has a validation message attached to it, ie where an ABN field is detected to be incorrect as it contains either a dummy value, or it didnt pass a check.Β Usually these fields will be highlighted as they were scored higher in the cleanse layer in One DesktopΒ For example ABN is 0000000000 at the source layerΒ Is there a way I can search / filter records for their specific validation messages, as opposed to the content in the field. ( As the validation messages are not the actual input in the field, but score and explain what is wrong in the field)Β See photo attachedthanksΒ Β
Hi, I am getting this error while running the Load Operation for full load for one of the source system. Any help ,highly appreciated.Β
Hi all,For Postgre SQL,when we are loading its only to our local.eg,if one member is loading the data in load operation,the post gre table that are populated are only visible to the member who loaded.How to enable the postgre table or see the table and its data which will be common to all user? Please suggest.
Hi,I am getting this error while running the Load Operation for full load for one of the source system.Any help ,highly appreciated.Β
Hi All,I am very new to Ataccama and still exploring everything by myself. I have updated logical model (added new entities), load operation and then configured transformations. Saved and generated the project. But I cannot see the new entities in Postgresql. I was under assumptions that after generating the logical model, tables will be created automatically in postgre but that didnβt happen. Tried saving, generating, stopping and starting servers several time but no luck.Is there any steps to follow?ThanksFS
Hi,Β I have a requirement to ignore certain columns to notΒ detect as a change when that field comes with a different values in the message.I tried applying the field in ignores comparison columns as shown below, but looks like when the message came in again with a new value for this field, it still got processed. Are there more steps to be done to ignore a field? Also to highlight, we consume data from Kafka streaming consumer.Β Β Β
Hi All,I have created the logical model (Instance and master layer) and then configured the full load operation. I am now working on Transformations layer. Here for few new entities I can see only the clean and match component are generated automatically.Β Now I want to add merge component. How do I do that? I have the option to create new component under Files βΒ engine βΒ trans βΒ party_address but then that will be blank and there is no Integration input/ output added which gets generated using the model. Am I missing any step? Just like party_address I have also added party_rel and here I can see all the 3 components. (Please refer the attached picture).ThanksFS
Records marked as match_override after being fixed on OGC. When the matching rules changed and subject is reprocessed, these records are being unchanged while they are supposed to match with other records. How do weΒ [omnihealthdata].[dbo].[ids_override_match] andΒ [omnihealthdata].[dbo].[ids_override_property] tables contain these records, did try deleting from these table and rebuild and reprocess with the new match rules but they would not match.
In have a scenario, I need clarifications on:The project has been configured and deployed with the following golden entity and instance entity details:GOLDEN ENTITYemployee_name, stringINSTANCE ENTITYemployee_name, string.Β The golden entity is related to the instance entity.After deploying, I need to change the GOLDEN entity column - employee_name(String)Β to staff_name(string) in the ONE Desktop configuration as well as the GUI label. But I dont want to change the instance entity column name. This should be such that the updated staff_name attribute shows the value of employee_name from instance entity record when a golden record is matched. I am not using this attribute to determine a match.Can someone please confirm if this is possible?
Hi thereΒ Was wondering how I can use the length function in the Advanced Filtering to filter instance records where they either are under or over a certain length of characters.Β ie βinstance recordβ LENGTH >= 8 characters
I commit the changes of my MDM project into git regularly, however, I donβt see the changes reflect in ONE Desktop when I Switch branches I.e. if I had committed some changes into a branch and then created an new branch for new changes and commit them. Now if switch to the older branch, I donβt see the changes in Model Explorer-master layer, instance layer, etc. Can someone help me understand why this might be happening?
OAuth 2.0 is an authorization framework that allows third-party applications to access resources in a secure manner. Keycloak is an open-source identity and access management solution that provides OAuth 2.0 authorization services. This article will provide steps on how to use OAuth 2.0 via Keycloak for API requests.First, create a client in Keycloak. This client will contain the necessary information needed to make API requests. In the Keycloak admin console, navigate to the "Clients" section and click "Create". Fill in the necessary information, such as the client ID and save the Client.Creating a Client in KeycloakΒ Once saved, change the Access Type to "Confidential". Additionally, modify the Valid Redirect URL, to the base url of the application and an asterisk. For example, if the keycloak url is:Keycloak URL:Β https://one-3gk1k.worker-01-use1.prod.ataccama.link/auth/Base URL:https://one-3gk1k.worker-01-use1.prod.ataccama.link/The Valid Redirect URI will be:https://one-3gk1k.worker
Hi,Β Β Weβve lost access to the Keycloak admin user in one of our environments. How do we about resetting the password for the Keycloak admin user.Regards baz
Hi Team, we have defined date type fields and Ataccama store them in GMT timezone. We need data is EST considering our time zone for the client.@CansuΒ Β Could you please let me know how to change this from GMT to EST timezone ASAP.
Need clarification on below scenario.I have party entity (ID, FirstName, LastName, FullName, CompanyName, Birthdate, SSN),Β address entity (ID, Address_1, Address_2, City, State, Zip) and party_address (ID, party_id, address_id, address_type). Party and address are not directly linked but through this party_address.Β Now I know that we can create match rule using columns of related entity. But in this scenario how do I use Address attributes to create a match for Party?
Hi All,Β Can someone please let me know the steps forΒ configuring Survivorship logic for attributes once records are tagged for merge?I couldnt find much of survivorship details in One MDM document.Thanks,fshahin
Is anyone able to configure the Snowflake jdbc connection with OAUTH using AAD?Β Iβm not clear on how to accomplish the instructions in the documentation.Β Can anyone help with screen shots or a section of their runtimeConfig file (with obfuscated secrets, idβs, etc) ?TIA
Iβm new to Ataccama ONE MDM and have recently completed the training. Iβm currently doing a POC on it and am stuck at two places.So hereβs the situation:First, Iβm able to load the data but Iβm not sure how to update it. Like, lets say I have a person record and after loadingΒ it generated Person_ID X23233X. Now, I made changes to some of the data in the same request. For eg, Iβve updated the contact number or the address of the record. Now, when Iβll be loading this same data again I want the ID to remain the same and just update the contact/address data along with Last_Updated _Timestamp.Β Secondly, lets say I have a record with 2 differentΒ phone types,Β βHomeΒ PhoneβΒ and βWork Phoneβ, and Iβve loaded it. So, the Person_IDΒ X12322X will have two contact details associated with it. Now, lets say I removed the βHomeΒ PhoneβΒ details from the record and send it for update load. So, after updating the same request, βHomeΒ PhoneβΒ details should beΒ dissociated from the Person_IDΒ X12322X (the cont
Hi everyone!We are wrapping up our introduction to the MDM series with this postΒ delvingΒ into the core of MDMβthe Model. MDM isΒ a model-driven implementation, where the model takes center stage, driving the generation of structures and orchestrating crucial processes. Letβs dive in πΒ Unlocking the MDM Model MagicThe MDM Model is the maestro orchestrating the symphony of Ataccama MDM's capabilities. Here's a glimpse of how it weaves its magic: Automated Database Structures: Say goodbye to manual database creation. Ataccama MDM automatically generates database structures based on your model. MDM Workflow Wizardry: Cleansing, matching, and mergingβthe three crucial phasesβare seamlessly handled by the MDM Workflow, automating the orchestration of these intricate processes. Native MDM Services Creation: The model isn't just a blueprint; it's a generator. Native MDM services spring to life based on your model, simplifying service creation and eliminating unnecessary complexities. Con
Hello Team,can someone provide insightΒ around the solutionΒ to stop the event generations based on the condition, let's say- if MDMΒ system receives / source system sends less than 50K records for mastering then use events to propagate the changes to downstream system else send a batch extract file. knowing the fact that we can delete the events after generating but looking to stop the events conditionally.Β Β
Hi All,Β I am working on an enhancement project where I am adding more source system in existing model. As per the requirement I have added one match rule in Party Match Component at the bottom of existing matching rules and then I executed the component using Run button. Got message that Plans completed successfully. After that I executed load operation with some sample data in source which is passing that last added rule. Execution completed successfully but the records didnt merge. In master table they are present as 2 separate records. Am I missing any step?Β Β Thanks,FS
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.