Skip to main content

Master Data Management & Reference Data Management 🛰️

Discuss, learn, ask, suggest, share all things MDM and RDM 🔍

  • 253 Topics
  • 574 Replies
253 Topics
M
Data Voyager
Mr.DQData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Is it possible to create a table in RDM that will not keep historical data, just current values?

Checking to see if there is a way to create a “current values only” table in RDM, with no historical records to be kept?  I don’t see any option for this in the documentation or One Desktop dialogs.     

244
Joeri
Data Pioneer
7 months ago
P
Data Pioneer L2
pdanpoonkijData Pioneer L2
asked in Master Data Management & Reference Data Management 🛰️
Make RDM tables permissions editable from the web app.

Hello community,I’m working on an RDM project and have a question regarding the security configurations. I find that if I tick the Fixed Permission checkbox in the Security config. node, the roles permissions I have setup in the IDE will get uploaded onto the web app., but it won’t be editable later there. However, if I don’t tick this checkbox, none of the permissions will get loaded on to the web app., but I will be able to fully customize the roles permissions on the web app.Is there a way to have the initial roles permissions loaded from IDE, but also editable later on the web app.?Thank you in advance

634
Joeri
Data Pioneer
7 months ago
R
Data Voyager
rpainte1Data Voyager
asked in Master Data Management & Reference Data Management 🛰️
One Desktop 13.3.2 Compatible with MS Windows Server 2022?

Is anyone able to confirm if One Desktop version 13.3.2 is compatible with with MS Windows Server 2022

192
Joeri
Data Pioneer
7 months ago
abir
Ataccamer
abirAtaccamer
published in Master Data Management & Reference Data Management 🛰️
IDs in MDM

Hello everyone, I am Abir 👋. I am a Principal Consultant at Ataccama. I have recently worked on a project where I had to explore how IDs in Ataccama MDM work, what to consider if any customization is required from the default behavior and how to utilize the dedicated ID sequence feature. I will share in this post what I have learned from MDM gurus and from the overall experience when implementing a custom solution for anyone else venturing into the same journey. Understanding IDs in MDMMDM generates IDs for columns such as id, master_id, xid, tid, etc. utilizing a database sequence created based on the model definition. When an MDM process creates new records, it fetches the NEXTVAL value from this sequence, multiplies it by 1000, and generates and assigns IDs to the new records. Once the MDM process is completed, using the maximum ID value assigned, the sequence is updated for the next MDM process. The sequence is cached in Java (for performance reasons) during this process, this is

1341
S
Ataccamer
7 months ago
N
Data Voyager
nigelData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Seeking to concatenate two columns into one (within the same record)

Hello allA basic (and rookie) question, but I couldn’t find the answer in the manual or tutorials, or on this forum.After I’ve loaded source data into Ataccama ONE Desktop, I’m looking to create a new column and fill it with the concatenated content of some other columns (two or more), maybe with a bit of text in between. In Excel I’d use the Concatenate function...Example from ExcelAs you can see, I can then lookup information based on Column D and use that for bringing in various lookup values (the real use case is not name-based, this is just to create a simple example)Note - I’m not looking to merge different tables (with join, union, or representative creator - unless those tools can do what I’m looking for) - this is simply creating a new column/field which is a concatenation of two or more other fieldsContext: I’m building a lookup based on multiple attributes - I’ll combine them into a single attribute to give me a single lookup key and then I can use that for various other pur

2346
anna.spakova
Ataccamer
7 months ago
D
Data Enthusiast
Devi PotturiData Enthusiast
asked in Master Data Management & Reference Data Management 🛰️
MDM server file start issue

Hello I am trying to start the MDM Sever and I am facing the below issue. I have cleared the database and started the database and key-cloak. Database and key cloak started successfully. After that I am triggering the start-mdm-server.bat file and its causing the below issue.  Did anyone face similar issue while starting the MDM server? Could you please let me know how to resolve this issue 

283
Cansu
Community Manager
7 months ago
J
Data Voyager
jebellData Voyager
asked in Master Data Management & Reference Data Management 🛰️
MDM records inactive in Ataccama but active in source system - How do I re-activate those in Ataccama?

We recently had a glitch in our Test MDM load, and only 1,000 of the 4 Million+ records came into the MDM from our source system. MDM inactivated most of the 4 Million records (appropriately). However, now that we have fixed the glitch and are pulling all 4 Million into MDM from our source system, it is is not reactivating the ones it had previously inactivated… how can I force a re-activation of those records?

475
Cansu
Community Manager
7 months ago
K
Data Voyager
Kelvin FongData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Possible to show all (> 10) properties without the show all button?

Say now we have an term with more than 10 properties to display at the same time. Is it possible to (configure the metadata model so once we click the term it will) show all the properties without having to click this Show all button? Thanks in advance. 

252
Cansu
Community Manager
7 months ago
K
Data Voyager
Kelvin FongData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Possible to access Reference Objects by only clicking the object once?

Let’s say a data consumer in my workplace is getting familiar with a data element (as term), and he/she want to know who the data owner is. Since we set the person reference for the roles in stewardship, the consumer need to 1. click the display name of the data owner, see the username of the referred user, and then 2. click that username to see the detail of that user, namely his/her user ID and email address.(1) Is it possible in any way the data consumers only need to click once from the display name of the data owner to his/her user detail?(2) Is the above workaround applicable for other reference objects (e.g. the policy reference)?Thanks a lot. 

402
Cansu
Community Manager
7 months ago
J
Universe Traveller
Jason.SupticUniverse Traveller
posted in Master Data Management & Reference Data Management 🛰️
Permission/Security setup via the OneDesktop IDE (RDM)

Setting permissions for groups via the IDE.Ensure your groups exists in KeyCloak first In the IDE go to your RDM Project and complete the following under "Security" Right click on Roles Select New role   Add the name and description of the role (be sure to use the same names that you setup in KeyCloak) then click Apply and OK Expand the new role, and right click on Entities then select Edit…  Add the Tables and the Table level permissions in the next window  NOTE: Table permissions do not give column level permissions. Double click the number next to the table that you wish to setup permissions for Notice that there are options for "View for All Columns" and "Modify for All Columns." However, if you want to select only certain columns, you can do that below with the following steps. Add the column names you want permissions to be given for, and select View and/or Modify for the given column   When complete, click Apply then OKTo ensure these permissions are applied to the Web Admin do

765
Cansu
Community Manager
7 months ago
Anna_Nebesova
Ataccamer
Anna_NebesovaAtaccamer
published in Master Data Management & Reference Data Management 🛰️
How to use graphQL queries in ONE DesktopTutorial

Let‘ say you have a graphQL query that works in a Postman or in Ataccama playground, and you want to use it in a plan in ONE Desktop. How to do it?You cannot simply copy and paste the JSON body into JSON call step. You have to reformat it. You can use the COPY CURL button in Playground (in the upper right corner) or similar button Code in Postman. That will create a curl command that also contains the body:PlaygroundCurl commandThis body can be then pasted into JSON call. The query method needs to be set as POST.JSON call step configuration Want to learn more about the graphQL API? Check out the documentation: https://support.ataccama.com/home/docs/aip/latest/development-guides/one-development-guide/one-api

5667
anna.spakova
Ataccamer
7 months ago
may_kwok
Star Blazer L3
may_kwokStar Blazer L3
asked in Master Data Management & Reference Data Management 🛰️
RDM Extended Reader row filter syntax

We are on RDM v14.5.1, on PaaS, so underlying db is postgres.I need to query a table using the RDM Extended Reader step with a filter. The volume of this table will grow, so I much prefer to filter at the reader step, rather than bring the whole table into the plan and then filter, to manage performance.I have a column, from_date, that is datetime type. I have from_date in my data flow, and I want to query RDM for a day prior.Expecting that this is an SQL where clause, I tried to put in syntax compatible with Postgres So I created a column called “row_filter”, with type string. Using postgres to_timestamp functionday_prior:=dateAdd(from_date,-1,'DAY');day_prior_string:=tostring(day_prior,'yyyy-MM-dd HH:mm:ss');"from_date=to_timestamp('"+day_prior+"','YYYY-MM-DD HH:MI:SS')" This one gave an error of:13.05.2024 13:10:00 [INFO] Ataccama DQC engine initialized.13.05.2024 13:10:00 [INFO] Creating runtime...13.05.2024 13:10:00 [INFO] Starting runtime...13.05.2024 13:10:00 [INFO]

293
may_kwok
Star Blazer L3
8 months ago
P
Data Enthusiast
Patty BData Enthusiast
asked in Master Data Management & Reference Data Management 🛰️
Troubleshooting data sets

I have a data set created and the query runs fine in a sql editor against my local database. I can deploy the configuration with no errors, but when I go to look at the data in Ataccama One I get Fatal error occurred and click on Details just gives me Internal error. The only thing I can think of is the query is rather long. Is there a max for data set sql? What is the best way to try to troubleshoot this? The error messages are not at all helpful.

503
ivan.kozlov
Ataccamer
8 months ago
T
Data Pioneer L2
ThomasProData Pioneer L2
asked in Master Data Management & Reference Data Management 🛰️
Data Source "Documentation"

Hey All!I am aware that only Stewardship owners have the ability to use the “Document” button on a data source level, but is there a way that we can disable this button all together? If a user accidentally uses this feature, it eats up a lot of processing to import the metadata, and is a best practice that we are telling everyone not to use. Is there a way within the admin console to do this?Thanks! 

352
T
Data Pioneer L2
8 months ago
P
Data Enthusiast
Patty BData Enthusiast
asked in Master Data Management & Reference Data Management 🛰️
Static values in RDM views

Is there a way to put columns in a view with a static value? Like you can in a sql statement, such asSELECT col1, ‘this is a static value’ AS col2

101
A
Ataccamer
8 months ago
P
Data Enthusiast
Patty BData Enthusiast
asked in Master Data Management & Reference Data Management 🛰️
UNIONS in RDM Views

Is there a way to create views in RDM that contain union statements combining queries to different tables?

121
A
Ataccamer
8 months ago
C
Universe Traveller
clyormzUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
ataccama dpe connection with databricks

Hello Ataccama team I would like to know if there is a reference about how to configure an external dpe using databricks on azure. Thank you

711
ivan.kozlov
Ataccamer
8 months ago
S
Data Voyager
sujmazumData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Encountering NoRouteToHostException Error on OnPublish

The response message was:null and response error was 'errorMsg:java.net.NoRouteToHostException: No route to host    at java.base/sun.nio.ch.Net.connect0(Native Method)    at java.base/sun.nio.ch.Net.connect(Net.java:579)    at java.base/sun.nio.ch.Net.connect(Net.java:568)    at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593)    at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327)    at java.base/java.net.Socket.connect(Socket.java:633)    at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:121)    at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)    at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:326)    at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:605)    at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:440)  

211
Cansu
Community Manager
8 months ago
M
Data Voyager
Mr.DQData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Accessing parent node attributes in XML with repeated tags

I have an xml file with a structure like this:<model xmlns="http://www.ataccama.com">    <entities>        <entity name="table1" />     <columns>             <column datatype="varchar(100)" name="abc" required="false" />             <column datatype="int" name="xyz" required="false" />             <column datatype="datetime" name="123" required="false" />     </columns>...I want to produce a data stream that combines the column name and data_type with the name from the parent entity node.  If I define the columns using xpath nm:model/nm:entitles/nm:entity/nm:columns/nm:column then I cannot access the entity name using ../../@name (or any xpath expression for that matter).  If I define the columns using entity level xpath epxression nm:model/nm:entitles/nm:entity and the columns with xpath nm:columns/nm:column/@name then I only get 1 record per entity with the first column only.   How can I get the entity name, column name, and column data

222
M
Data Voyager
8 months ago
S
Universe Traveller
sriniUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
Implement checkpoints in mdm data consolidation process

Hi Team, could someone please assist in getting idea of implementing checkpoints in master data consolidation process.?  as currently we observed MDM follows a one lengthy workflow of MDM data consolidation process from Data acquisition to publish data to the downstream systems [ data acquisition→ change detection → cleansing → match→ and then merge.]  during this entire flow execution if any one of the components failed after few hours due technical some issues, then it is required to restart this entire flow. just to avoid this we wanted to restart the jobs from the point where failure happens, is there any way to breakdown or separate the jobs or implement the check points to restart.? please suggest with the recommendations.Thanks, 

641
P
Ataccamer
9 months ago
C
Universe Traveller
C_RUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
Export lookup file

Hi all,Can I export lookup file and import to another environment?  Thanks in advance.

352
Cansu
Community Manager
9 months ago
Fergus
Data Voyager
FergusData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Getting logged out far too frequently from RDM

We have recently upgraded to RDM V14.5.0 and are finding that if you leave the screen idle for 5-10 mins the system will log you out and back in immediately. When it logs you back in it has closed all the tables that you had open previously.  Also, when you want to close RDM and press the “Log out” button it more often than not logs you out and then back in again. It takes a 2nd press of the “Log out” button to finally log out. Is there a setting somewhere that will increase the idle time so we don’t keep losing the open tables and is the need for a double log out a bug or some setting that we need to change. Any help would be appreciated.

573
Cansu
Community Manager
9 months ago
S
Universe Traveller
sriniUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
MDM Rest API Services + new columns to the existing model

Hello Team, require help, we are on MDM 13.9.3 → newly added columns to the Instance and Master entities are not visible in REST API calls, do we required to enable any configuration to visible those new attributes in get calls.?  thanks in advance for your inputs.

422
Cansu
Community Manager
9 months ago
O
Star Blazer L1
OjaswiniStar Blazer L1
asked in Master Data Management & Reference Data Management 🛰️
Not enough memory to run the plan file.

I want to load around 832,032 records from Excel file to DB table using Plan. Plan is not executing.It giving below error message :-1)Not enough memory to run the plan file. java.lang.OutOfMemoryError: Java heap space     at org.apache.commons.io.IOUtils.byteArray(IOUtils.java:338)     at org.apache.commons.io.output.AbstractByteArrayOutputStream.needNewBuffer(AbstractByteArrayOutputStream.java:104)     at org.apache.commons.io.output.UnsynchronizedByteArrayOutputStream.<init>(UnsynchronizedByteArrayOutputStream.java:51)     at org.apache.poi.util.IOUtils.toByteArray(IOUtils.java:181)     at org.apache.poi.util.IOUtils.toByteArray(IOUtils.java:153)     at org.apache.poi.openxml4j.util.ZipArchiveFakeEntry.<init>(ZipArchiveFakeEntry.java:67)     at org.apache.poi.openxml4j.util.ZipInputStreamZipEntrySource.<init>(ZipInputStreamZipEntrySource.java:98)     at org.apache.poi.openxml4j.opc.ZipPackage.<init>(ZipPackage.java:132)     at org.apache.poi.openxml4j.opc.OPCP

2529
greglvaughan
Data Enthusiast
10 months ago
may_kwok
Star Blazer L3
may_kwokStar Blazer L3
asked in Master Data Management & Reference Data Management 🛰️
RDM REST API (v14.3 or later)

Hello hive mind,Has anyone out there who have RDM v14.3 or later, and successfully used the new RDM REST API feature?We’ve upgraded our dev environment to v14.5.1 this week, I tried the REST API, and it keeps returning with “java.lang.Exception: org.springframework.security.access.AccessDeniedException: Cannot access entity: address_type” error. (Was trying to query my entity called address_type)I ensured my service account client has full access to the table. That service account client calls other API endpoints that I have built before on rdm-server and that authenticates fine.I wonder what I’m missing. Anybody successful before and we can compare notes?Thanks!

844
Cansu
Community Manager
11 months ago

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings