Discuss, learn, ask, suggest, share all things MDM and RDM π
Recently active
Hello everyone, Anna here! I work as a projects consultant in Ataccama and today I put together a guide for you on how to work with delta changes in Ataccama ONE. Enjoy!IntroductionAs part of every project, some kind of integration with other tools is usually required. In most cases, the integration requires synchronization of some data between the tools on regular bases. When it comes to Ataccama ONE, synchronization of assets like business terms or DQ rules may be required β for example with Collibra. It is desired to synchronize only delta changes (changes that happened since the last synchronization) to keep the integration efficient.This article explains how the delta changes can be detected in Ataccama ONE using graphQL queries. There is no simple out-of-the-box delta detection implemented, for that reason multiple graphQL queries are used in plans to achieve this goal.Ataccama doesnβt store a last modified date or similar property within assets. Ataccama creates a History Change
Hi,Β We are currently using 13.9.We have multiple kafka topics and they are differently named with a suffix representing the environment like topic.sit, topic.uat. When we do the deployment to prod we have to make sure that the comp files where the topics are specified like event handlers or streaming consumer are cherry picked manually.Since fetching the values from environment variable functionality is not available in MDM or ONE desktop, IΒ was wondering if there is a way we could create an alias for these topics and define them inΒ runtime configΒ as runtime config will anyway not be merged in any deployments.Β If someone has any workaround for this kind of situation, please suggest.Thanks,
Hi All,I am new to Ataccama and currently working on a POC. I have a requirement that if an update is coming for a master record then it should not again go through the match and merge process, instead it should directly update the master record. Is it possible to achieve the scenario? Do I need to create separate workflow or same workflow can be re-configured? Can someone please explain with detailed steps if at all this is a logical possible scenario?ThanksFS.
Hello everyone!I created a VCI (Virtual CatologΒ Item) and created a Monitoring Project with Rules in Atacama One, using a Post Processing Plan I wanted to upload the result of the monitoring project to databases, in Atacama One we have a csv file with the results in the Export tab, but I can't upload it to the database,Β the database is empty. Π‘reated a Global Runtime Configuration, but there is no result. Who has faced such a problem?
Hello everyone,In this post, we will cover upgrading your RDM project from version 12 to 14. This will also be applicable to any other version, but some specific details we will cover are specific when going from version 12 to 14. This is because of new features and options within the RDM model which were newly added in some version between 12 and 14. For the purpose of this article I will assume you are familiar with the desktop tool already and know how to open up the model explorer view.The first step is to ensure you have both the Ataccama Desktop tool downloaded and installed for both versions. To download latest version visit this link. Then setup the desktop as needed and ensure at a minimum you can start up the sample project.Once everything has been setup correctly our next step is to export our previous project mdc file from our version 12 desktop tool.To export your project, right click on the project and click on the βExport...β option. Then you will pick somewhere to save
Hello, how to run the plan below (created using ONE Desktop) on Ataccama Web ?Β Β
Hi,I have a .csv file containing country codes that looks like:countrycode.csvI want to use this file as a lookup. In ONE Web it is possible to use a .lkp file as a lookup (why not just import an excel file there is beyond me). In order to do this I understoond I had to create a lookup builder:Lookup builderββIn the Text File Reader I selected the documented with the encoding (I hope this is the right one?). As for the columns I created nm_lnd and kd_lnd (both string).Text File Reader - GeneralText File Reader - ColumnsAs for the Lookup Builder:Lookup BuilderWhen I run it a .lkp is created but also a rejected.txt with everything that is inside the .csv meaning I'm not able to create the desired .lkp file. What can I do to resolve this? Is there also documentation on how to create lookup using .csv somewhere? I can't find it.
I need to understand the difference between Full and Complex Delta Load in MDM.As per this document on Complex Delta Load,Β Β Delta Dependency ModeΒ Β needs to be setup for each entity. I see there are two options for it -Autonomous and Central. Can someone please explain the difference between these and in what scenario these should be used?I also see thatΒ The engine expects an additional column in the input interface denoting the type of record change (change_type:Β IΒ - insert,Β UΒ - update,Β DΒ - delete).Β Where shall we define these and what how can we identify which records needs which change_type?TIAΒ π
Hi all, is there any configurations we can edit in the page template and/or the metadata model,Β so that we can (best having a hyperlink or button to) exportΒ the content from e.g. the access,Β data structure or profile tabs of the catalog items? Thanks a lot.
Hello everyone, I am Abir π. I am a Principal Consultant at Ataccama. I have recently worked on a project where I had to explore how IDs in Ataccama MDM work, what to consider if any customization is required from the default behavior and how to utilize the dedicated ID sequence feature. I will share in this post what I have learned from MDM gurus and from the overall experience when implementing a custom solutionΒ for anyone else venturing into the same journey.Β Understanding IDs in MDMMDM generates IDs for columns such as id, master_id, xid, tid, etc.Β utilizing a database sequence created based on the model definition. When an MDM process creates new records, it fetches the NEXTVAL value from this sequence, multiplies it by 1000, and generates and assigns IDs to the new records. Once the MDM process is completed, using the maximum ID value assigned, the sequence is updated for the next MDM process. The sequence is cached in Java (for performance reasons) during this process, this is
Hi all,I am in process of learningΒ ONE Desktop and was curious if there any documentationΒ or best practices on integrating GIT. I have searched and found aΒ related topic that was helpful.Β Β Thanks for anyΒ help.Β
Checking to see if there is a way to create a βcurrent values onlyβ table in RDM, with no historical records to be kept?Β I donβt see any option for this in the documentation or One Desktop dialogs.Β Β Β Β
Hello community,Iβm working on an RDM project and have a question regarding the security configurations. I find that if I tick the Fixed Permission checkbox in the Security config. node, the roles permissions I have setupΒ in the IDE will get uploaded onto the web app., but it wonβt be editable later there. However, if I donβt tick this checkbox, none of the permissions will get loaded on to the web app., but I will be able to fully customize the roles permissions on the web app.Is there a way to have the initial roles permissions loaded from IDE, but also editable later on the web app.?Thank you in advance
Is anyone able to confirm if One Desktop version 13.3.2 is compatible withΒ with MS Windows Server 2022
Hello allA basic (and rookie) question, but I couldnβt find the answer in the manual or tutorials, or on this forum.After Iβve loaded source data into Ataccama ONE Desktop, Iβm looking to create a new column and fill it with the concatenated content of some other columns (two or more), maybe with a bit of text in between. In Excel Iβd use the Concatenate function...Example from ExcelAs you can see, I can then lookup information based on Column D and use that for bringing in various lookup values (the real use case is not name-based, this is just to create a simple example)Note - Iβm not looking to merge different tables (with join, union, or representative creator - unless those tools can do what Iβm looking for) - this is simply creating a new column/field which is a concatenation of two or more other fieldsContext: Iβm building a lookup based on multiple attributes - Iβll combine them into a single attributeΒ to give me a single lookup key and then I can use that for various other pur
HelloΒ I am trying to start the MDM Sever and I am facing the below issue. I have cleared the database and started the database and key-cloak. Database and key cloak started successfully. After that I am triggering the start-mdm-server.bat file and its causing the below issue.Β Β Did anyone face similar issue while starting the MDM server? Could you please let me know how to resolve this issueΒ
We recently had a glitch in our Test MDM load, and only 1,000 of the 4 Million+ records came into the MDM from our source system. MDM inactivated most of the 4 Million records (appropriately). However, now that we have fixed the glitch and are pulling all 4 MillionΒ into MDM from our source system, it is is not reactivating the ones it had previously inactivatedβ¦Β how can I force a re-activation of those records?
Say now we have an term with more than 10 properties to display at the same time. Is it possible to (configure the metadata model so once we click the term it will)Β show all the properties without having to click thisΒ Show all button? Thanks in advance.Β
Letβs say a data consumerΒ in my workplace is getting familiar with a data element (as term), and he/she want to know who the data owner is. Since we set the person reference for the roles in stewardship, the consumerΒ need to 1. click the display name of the data owner, see the username of the referred user, and then 2. click thatΒ username to see the detail of that user, namely his/herΒ user ID and email address.(1) Is it possible in any way the data consumersΒ only need to click once from the display name of the data owner to his/her user detail?(2) Is the above workaround applicable for other reference objects (e.g. the policy reference)?Thanks a lot.Β
Setting permissions for groups via the IDE.Ensure your groups exists in KeyCloak first In the IDE go to your RDM Project and complete the following under "Security" Right click on Roles Select New role Β Β Add the name and description of the role (be sure to use the same names that you setup in KeyCloak) then click Apply and OK Expand the new role, and right click on Entities then select Editβ¦Β Β Add the Tables and the Table level permissions in the next windowΒ Β NOTE: Table permissions do not give column level permissions. Double click the number next to the table that you wish to setup permissions for Notice that there are options for "View for All Columns" and "Modify for All Columns." However, if you want to select only certain columns, you can do that below with the following steps. Add the column names you want permissions to be given for, and select View and/or Modify for the given column Β Β When complete, click Apply then OKTo ensure these permissions are applied to the Web Admin do
Letβ say you have a graphQL query that works in a Postman or in Ataccama playground, and you want to use it inΒ a plan in ONE Desktop. How to do it?You cannot simply copy and paste the JSON body into JSON call step. You have to reformat it. You can use the COPY CURL button in Playground (in the upper right corner) or similar button Code in Postman. That will create a curl command that also contains the body:PlaygroundCurl commandThis body can be then pasted into JSON call. The query method needs to be set as POST.JSON call step configurationΒ Want to learn more about the graphQL API? Check out the documentation:Β https://support.ataccama.com/home/docs/aip/latest/development-guides/one-development-guide/one-api
We are on RDM v14.5.1, on PaaS, so underlying db is postgres.I need to query a table using the RDM Extended Reader step with a filter. The volume of this table will grow, so I much prefer to filter at the reader step, rather than bring the whole table into the plan and then filter, to manage performance.I have a column, from_date, that is datetime type. I have from_date in my data flow, and I want to query RDM for a day prior.Expecting that this is an SQL where clause, I tried to put in syntax compatible with PostgresΒ So I created a column called βrow_filterβ, with type string.Β Using postgres to_timestamp functionday_prior:=dateAdd(from_date,-1,'DAY');day_prior_string:=tostring(day_prior,'yyyy-MM-dd HH:mm:ss');"from_date=to_timestamp('"+day_prior+"','YYYY-MM-DD HH:MI:SS')"Β This one gave an error of:13.05.2024 13:10:00 [INFO] Ataccama DQC engine initialized.13.05.2024 13:10:00 [INFO] Creating runtime...13.05.2024 13:10:00 [INFO] Starting runtime...13.05.2024 13:10:00 [INFO]
I have a data set created and the query runs fine in a sql editor against my local database. I can deploy the configuration with no errors, but when I go to look at the data in Ataccama One I get Fatal error occurred and click on Details just gives me Internal error. The only thing I can think of is the query is rather long. Is there a max for data set sql? What is the best way to try to troubleshoot this? The error messages are not at all helpful.
Hey All!I am aware that only Stewardship owners have the ability to use the βDocumentβ button on a data source level, but is there a way that we can disable this button all together? If a user accidentally uses this feature, it eats up a lot of processing to import the metadata, and is a best practice that we are telling everyone not to use. Is there a way within the admin console to do this?Thanks!Β
Is there a way to put columns in a view with a static value? Like you can in a sql statement, such asSELECT col1, βthis is a static valueβ AS col2
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.