Discuss, learn, ask, suggest, share all things MDM and RDM π
Recently active
Hi everyone!Β We are back with the second part of the introduction to RDM series. If you missed our first post you can find it here ππ»In this post, we'll delve into the fundamentals of RDMβcreating new reference data, editing existing records, publishing changes, and exploring advanced features like viewing modes and hierarchies. Let's get started ππ»ββοΈΒ How to Create New Reference DataLetβs go through a quickΒ example to demonstrate. Navigate to 102: Branch Table: Open the DATA section in the left menu. Choose Tables and open the 102: Branch table, showcasing a list of banking branches. Β Create New Record:Hit the Create button, unveiling an empty form. Fill in required fields, leaving Code blank. Validate your entries, correcting any issues. Hit Enrich to auto-populate certain fields based on predefined logic. Before saving, ensure your Address lacks the number 9. Save the record, acknowledging the warning prompt. Explore the option to create a new record from an existing one for ef
Hi everyone, and happy Monday!Β In this post, we will cover Ataccamaβs Reference Data Management solution with a short introduction, follow us for part 2 and check out our MDM Series below ππ»Β First things first.Β What is RDM?Reference dataΒ is data that defines the values that are used to classify and characterize other data. This is sometimes known - not always correctly - as Master Data, Golden Record, Golden Copy, or Single Source of Truth.RDM is an essential component ofΒ Master Data Management (MDM)Β that has evolved to become a mature data management discipline in its own right.Β Β Who's It For?At the heart of the RDM web application are three key player roles:Reference Data Stewards Analysts ManagersDesigned with precision, the RDM web application caters to these roles, ensuring a user-friendly and efficient experience.Β What Can You Do?The RDM web application empowers you with a rich set of features: View, Edit, and Manage: Seamlessly view, edit, and manage reference data, putting yo
Hi everyone,Β Welcome back to our best practice series onΒ MDM. In this post, we're diving deep into theΒ features that make MDM - so buckle up πΒ MDMβs primary featureΒ is its model-driven architecture. It's a domain-agnostic MDM that empowers developers to craft domain-specific MDM models. Let's break down its high-level features by type.Β Model-Driven ArchitectureMDM's domain-agnostic approach is complemented by vertical models (metadata templates) designed to be domain-specific. These models are not cast in stone; they are customizable and extendable to meet the unique needs of your project. To delve deeper into this model-driven marvel, check out the Model.Β Internal Workflow and Processing PerfectionMDM boasts a remarkable set of features:Out-of-the-box change detection on load: MDM is a keen observer. It can detect changes in source instance records by tracking their unique source IDs. If a record has changed, it triggers the MDM process for that specific record. The granularity of de
Hi everyone,Β In this post, we will continue our introduction to Master Data Management (MDM), if you have missed our first post you can find it here ππ»This article will focus onΒ the architectural details of MDM, breaking down the components, dependencies, and practical management tips β¨Β The Pillars of MDMAt the heart of MDM, we find four essential components:Keycloak: Our third-party identity management tool. MDM Server (formerly known as MDC): The robust Ataccama MDM processing engine. MDM Webapp (formerly known as MDA): The user-friendly Ataccama MDM web application. Relational Database: The sturdy backend database, supporting PostgreSQL, MS SQL, or Oracle.Each of these components is configured as a Linux service, allowing independent restarts and individual log access for issue identification.Β The Backbone of DatabasesMDM is compatible with PostgreSQL, MS SQL, and Oracle relational databases. However, it's important to note that Ataccama officially supports only PostgreSQL Standal
Hi everyone, happy Monday ππ»Β After publishing more than 20 articles onΒ ONE Desktop best practices, Iβm happy to share that we are ready to take the next step into Ataccama's Master Data Management (MDM), a robust, scalable, and highly available platform designed to simplify and enhance your master data management tasks. Letβs start with the basics β‘Β Β What is MDM and how is it different?Β Unlike the traditional "data flow driven" Data Quality Center (DQC), Ataccama MDM stands out as a fully metadata-driven data processing system. It incorporates an array of powerful tools, including the Advanced Metadata Editor (AME), a cutting-edge data processing engine (NME), and the DQC Plan Executor (complete with its steps and components).By doing so, MDM naturally extends the capabilities of the DQC, offering comprehensive data quality management functionality. In essence, MDM combines Master Data Management with a strong emphasis on Data Quality as a fundamental part of the process, providing a
I am following the tutorial toΒ install and run the latest MDM example projectΒ onΒ Windows.When I am starting the MDM Server using start-mdm-server.bat, I am facing the below error:Β Can anyone guide me on how to add a user role to Keycloak for this ? Keycloak demo version is being used in this case (Β Keycloak 21.0.1)
Iβve created a basic workflow that utilizes the API to execute an existing project/plan.Β The project had an post process component that writes the invalids to an Excel spreadsheet.The other steps in the workflow wait for the file to be created and load it into DQIT.Β We can write directly to DQIT due to an issue with Databricks/Spark.Β The workflow works great, but I need to manually execute it.Β Iβd like to us Admin Center to βSchedulerβ to execute the workflow.How do I do that?The environment is Azure / Linux.Β Β
Hi everyone, happy Wednesday!Β In this post, we will walk you through Model projects! Model projectsΒ play a crucial role in configuring various Ataccama products like DQ Issue Tracker, ONE RDM, and ONE MDM. These model projects are structured based on model templates, which define a specific set of nodes, folders, and files during project creation or import. It's important to note that you cannot modify or remove nodes created by a template.The configuration within model projects is developed using the Advanced Metadata Editor (AME). In this context, metadata refers to the configurations made within the model project nodes, which are used to generate plans, components, web service configurations, XML files, and other necessary components for a particular solution.Developing solutions based on metadata is carried out in the Model Explorer view, and detailed instructions for each product can be found in the respective Developer Guides.Every Ataccama build includes a default model project
πΒ Links to the legacy documentation portal are no longer available.Β Read about the changes and how to access our documentation here.Hi community!In this post, we will discover how to create server connections in ONE Desktop for various tasks and workflow steps. Read on to find out more πΒ How to register a new server?To set up a new server connection, follow these steps:Right-click Servers in the File Explorer and select New Server. Β Choose the desired Environment. Learn more about Environments. Β Provide a unique server Name and select the appropriate Implementation. Configure the server connection according to your implementation, and click Finish.Once registered, the new server connection will appear in the File Explorer tree.Please note that, during development, right-clicking the server connection and selecting Connect is not considered a valid connectivity test, and it's not necessary for enabling step communication.Β Implementation TypesGenericUse this implementation to conn
When IΒ use Monitoring Projects and try and apply a rule to a DATE or INTEGER it is not allowed.Β For Date Rule, IΒ want to check for NULL or a DATE range.Β For Integer, I want to check from a referenced lookup table.Β Β Β Β Why is this check only allowed for Strings ?Β Will DATE and INTEGER be added at a later time ?Β Rene Requenes
Hello,I have a requirement to append the records in parquet file in the event of RDM on-publish synchronization. Does anyone know, how can we append data into Parquet file in RDM on-publish event?I believeΒ parquetΒ file writer will write data in the file, but if the new record created in the RDM, will it append the data in the same file or will replace the file completely and create newΒ one.ThanksΒ for any help.-Ojaswini
Hello Ataccamer,I am dealing with Parquet file writing in on-publish mode. Could you please suggest how to write data to Parquet file when it is a record deletion event on RDM UIΒ (in on-publish) . As in case of Parquet file it is always first delete the file and then created the file again.How the CHANGE_TYPE is in {'DELETED'}Β will work in this case. Any suggestions, please share.Thanks and regards,Ojaswini
Hello Ataccama Community,I'm currently using Ataccama One Desktop version 13.9.1, and I'm encountering an error while trying to execute a plan that involves a Kafka Reader component. I have configured a Kafka server(kafka integration) with the following properties:ssl.truststore.location=LOCATION_TO_TRUSTSTOREssl.truststore.password=TRUSTSTORE_PASSWORDssl.protocol=TLSsecurity.protocol=SASL_SSLsasl.mechanism=GSSAPIsasl.kerberos.service.name=kafkasasl.jaas.config=com.sun.security.auth.module.Krb5LoginModule required \Β Β Β Β Β Β Β Β useKeyTab=trueΒ \Β Β Β Β Β Β Β Β storeKey=trueΒ \Β Β Β Β Β Β Β Β keyTab="LOCATION_OF_THE_KEYTAB"Β \Β Β Β Β Β Β Β Β principal="USERNAME_HERE@EUROPE.XYZXYZ.CORP";Β The error message I'm seeing is: "Property with name 'KafkaResources' doesn't exist in com.ataccama.dqc.streaming.KafkaProviderComponent!"I've reviewed my configuration, but I'm still unable to resolve this issue. Can someone please provide guidance on how to troubleshoot and resolve this error? Any insights or suggestions would be gre
Hi,Β I have below use case:A party can have multiple phones related to it, when any of them change, we need to update a flag on every related phones (same party_id)Β I am having problems to get those related phones during the merge process, what would be the better way to do it?Β Β I have tried it using Mdc Read Step, but I'm not able to start the server due below errorjava.lang.IllegalStateException: Cannot find INmeEngine: Failed to create step 'Mdc Read' (com.ataccama.nme.dqc.steps.MdcRead) (Cannot find INmeEngine) at com.ataccama.nme.internal.dqc.PlanExecutor.createRunner(PlanExecutor.java:137) at com.ataccama.nme.internal.dqc.PlanExecutor.<init>(PlanExecutor.java:83) at com.ataccama.nme.internal.dqc.PlanExecutor.<init>(PlanExecutor.java:69) at com.ataccama.nme.internal.dqc.pool.PlanExecutorCreator.createResource(PlanExecutorCreator.java:34) at com.ataccama.nme.internal.dqc.pool.PlanExecutorCreator.createResource(PlanExecutorCreator.java:17) at com.ataccama.dqc.commons.reso
At Stater we needed to iterate a table in a database and perform some action on it. This needed to be orchestrated from a workflow. In our case trigger a set of MP's and write the output to a DQ Data warehouse.So I created a βpatternβ which we use for our cookbook.Β With thanks to Brian and Matej!Β Β Now if somebody can tell me how to add a PDF and ZIP with the sample, I'd be happy ;)
Howdy Ataccama Community:If you are needing to know how to grey out fields for edit, please navigate here:Β Grey out fields for edit | Community (ataccama.com)Problem: After greying out fields, I noticed that fields an Enrichment acts on appeared to change in the User Interface, even if greyed out.Solution: Working with our Ataccama professional support person, it was found that although the fields change in the UI, when saved the greyed out fields are not updated in the record being edited. This is great news, as the purpose (at least for our team) of greying out a field, is so that it cannot be changed once created.So thatβs it, probably the shortest post I will put on here, but an important one for record reliability.Thank you,Jason R.S.
Hi Every one,Β Why the data acquisition in a multi-load operation could be so slow?Checking the database, the query to get the data is taking less than 10 minutes. Do you have any guidance about it?
Howdy Ataccama community:Today I am creating an LKP file with multiple columns for the first time, and came across a couple rookie mistakes I was making, and wanted to share the warnings and errors I am getting.The file I am making is a simple mapping file going from the key to a field βPH1βRookie mistake number 1: The file being used to make the lkp is a csv, and I made the assumption the Text File Reader in the lookup builder planΒ would recognize this from the file type. It did not, it had the separation of columns as \tΒ (tab) still. This created the warningΒ [EHS:SHORT_LINE][step:Text File Reader][line:1]Β with a row for ever row in my file. To fix this one was simply setting the βLine Separatorβ field in the Text File Reader to a comma instead of \t.Rookie mistake number 2:Β After correcting my first mistake, I was now getting the following errorΒ βThere were logged 1 runtime warnings and 1 runtime errors.βΒ With the details beingΒ βError sending responseβΒ with no info on why. I got frus
Howdy Ataccama Community!Have you ever wanted to have a user see a field while in edit mode, but want to have it greyed out for editing? This problem arose while we were working with a Primary Key that needed to be seen in edit mode but never edited. The only way for a field to be seen in edit mode, is to set it to Modify in the permissions, but we did not want the user to modify.Β Problem: Show all fields in Edit mode, but only have certain ones editable.Solution: Begin by deploying your project and populating any tables with initial loads as needed. Next go back to OneDesktop IDE, and open the table you are wanting to make some fields non-editable. For the fields you want to make non-editable select Generated. While this sounds like it will auto generate the field, I assure you it does not.Now generate and deploy your project again (remember to generate at the App Configuration level).Note:Β You might need to stop and restart services for the change to take effect. While I was testing
Hi All,I want to learn the implementation of ataccama MDM. Is there any learning module orΒ instructor who can provide training is available in India.If yes, please do let me know.Β Thanks,Mayank Verma
Howdy all:Earlier this week we started having an issue when end users were trying to log in to our DEV environment. When they would navigate to the URL, their browser would show Ataccama splash screen, then instantly (and continuously) refresh. When asked to try to ping the URL via the command line, the correct IP was being hit, and there was a low latency reply from the server.Note: This issue occurred using Azure AD.Problem:Β User navigates to a known good URL for Ataccama RDM Web Application. When the application is reached, Ataccama splash screen shows in browser, then browser starts refreshing every 2 to 3 seconds.Solution:Β It was found that someone accidentally change the setting in KeyCloak called βFirst Login Flow.β This should have been set to βFirst Broker Login,β but was switched to βBrowser.β Switching back to βFirst Broker Loginβ fixed the issue for our users.I am unsure if this is specific to Azure AD, but it is worth a try, if you are seeing a similar issue.Thank you,Jaso
Hi Team, I want to know if ataccama support the connection to Apache Druid and TigerGraph? If yes, is there any Docs for that?
Is there a doc/demo availableΒ on how to use DQI SK stage (Analyze category) in Thick client please?
I have to parse the below JSON GETΒ response to get βHeadersβ andΒ "NameβΒ as columns inΒ Json Call stepΒ with Data Streams, How can I perform this?Β [Β Β {Β Β Β Β "Headers": [Β Β Β Β Β Β βIdβ,Β Β Β Β Β Β βNameβ,Β Β Β Β Β Β βEmailβΒ Β Β Β ],Β Β Β Β "ID": βtest_111β,Β Β Β Β "Rows": [Β Β Β Β Β Β [Β Β Β Β Β Β Β Β "100β,Β Β Β Β Β Β Β Β βJohnβ,Β Β Β Β Β Β Β Β βJohn@gmail.comβΒ Β Β Β Β Β ]}]
My requirement is that I want to read a file in AtacamaΒ planΒ which is an output of a python script .I would like to integrate python script then plan to run sequentially.
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.