Discuss, learn, ask, suggest, share all things MDM and RDM 🔍
Recently active
Let’s say a data consumer in my workplace is getting familiar with a data element (as term), and he/she want to know who the data owner is. Since we set the person reference for the roles in stewardship, the consumer need to 1. click the display name of the data owner, see the username of the referred user, and then 2. click that username to see the detail of that user, namely his/her user ID and email address.(1) Is it possible in any way the data consumers only need to click once from the display name of the data owner to his/her user detail?(2) Is the above workaround applicable for other reference objects (e.g. the policy reference)?Thanks a lot.
Setting permissions for groups via the IDE.Ensure your groups exists in KeyCloak first In the IDE go to your RDM Project and complete the following under "Security" Right click on Roles Select New role Add the name and description of the role (be sure to use the same names that you setup in KeyCloak) then click Apply and OK Expand the new role, and right click on Entities then select Edit… Add the Tables and the Table level permissions in the next window NOTE: Table permissions do not give column level permissions. Double click the number next to the table that you wish to setup permissions for Notice that there are options for "View for All Columns" and "Modify for All Columns." However, if you want to select only certain columns, you can do that below with the following steps. Add the column names you want permissions to be given for, and select View and/or Modify for the given column When complete, click Apply then OKTo ensure these permissions are applied to the Web Admin do
Let‘ say you have a graphQL query that works in a Postman or in Ataccama playground, and you want to use it in a plan in ONE Desktop. How to do it?You cannot simply copy and paste the JSON body into JSON call step. You have to reformat it. You can use the COPY CURL button in Playground (in the upper right corner) or similar button Code in Postman. That will create a curl command that also contains the body:PlaygroundCurl commandThis body can be then pasted into JSON call. The query method needs to be set as POST.JSON call step configuration Want to learn more about the graphQL API? Check out the documentation: https://support.ataccama.com/home/docs/aip/latest/development-guides/one-development-guide/one-api
I have a data set created and the query runs fine in a sql editor against my local database. I can deploy the configuration with no errors, but when I go to look at the data in Ataccama One I get Fatal error occurred and click on Details just gives me Internal error. The only thing I can think of is the query is rather long. Is there a max for data set sql? What is the best way to try to troubleshoot this? The error messages are not at all helpful.
Hey All!I am aware that only Stewardship owners have the ability to use the “Document” button on a data source level, but is there a way that we can disable this button all together? If a user accidentally uses this feature, it eats up a lot of processing to import the metadata, and is a best practice that we are telling everyone not to use. Is there a way within the admin console to do this?Thanks!
Is there a way to put columns in a view with a static value? Like you can in a sql statement, such asSELECT col1, ‘this is a static value’ AS col2
Is there a way to create views in RDM that contain union statements combining queries to different tables?
Hello Ataccama team I would like to know if there is a reference about how to configure an external dpe using databricks on azure. Thank you
The response message was:null and response error was 'errorMsg:java.net.NoRouteToHostException: No route to host at java.base/sun.nio.ch.Net.connect0(Native Method) at java.base/sun.nio.ch.Net.connect(Net.java:579) at java.base/sun.nio.ch.Net.connect(Net.java:568) at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593) at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327) at java.base/java.net.Socket.connect(Socket.java:633) at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:121) at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180) at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:326) at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:605) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:440)
I have an xml file with a structure like this:<model xmlns="http://www.ataccama.com"> <entities> <entity name="table1" /> <columns> <column datatype="varchar(100)" name="abc" required="false" /> <column datatype="int" name="xyz" required="false" /> <column datatype="datetime" name="123" required="false" /> </columns>...I want to produce a data stream that combines the column name and data_type with the name from the parent entity node. If I define the columns using xpath nm:model/nm:entitles/nm:entity/nm:columns/nm:column then I cannot access the entity name using ../../@name (or any xpath expression for that matter). If I define the columns using entity level xpath epxression nm:model/nm:entitles/nm:entity and the columns with xpath nm:columns/nm:column/@name then I only get 1 record per entity with the first column only. How can I get the entity name, column name, and column data
Hi Team, could someone please assist in getting idea of implementing checkpoints in master data consolidation process.? as currently we observed MDM follows a one lengthy workflow of MDM data consolidation process from Data acquisition to publish data to the downstream systems [ data acquisition→ change detection → cleansing → match→ and then merge.] during this entire flow execution if any one of the components failed after few hours due technical some issues, then it is required to restart this entire flow. just to avoid this we wanted to restart the jobs from the point where failure happens, is there any way to breakdown or separate the jobs or implement the check points to restart.? please suggest with the recommendations.Thanks,
Hi all,Can I export lookup file and import to another environment? Thanks in advance.
We have recently upgraded to RDM V14.5.0 and are finding that if you leave the screen idle for 5-10 mins the system will log you out and back in immediately. When it logs you back in it has closed all the tables that you had open previously. Also, when you want to close RDM and press the “Log out” button it more often than not logs you out and then back in again. It takes a 2nd press of the “Log out” button to finally log out. Is there a setting somewhere that will increase the idle time so we don’t keep losing the open tables and is the need for a double log out a bug or some setting that we need to change. Any help would be appreciated.
Hello Team, require help, we are on MDM 13.9.3 → newly added columns to the Instance and Master entities are not visible in REST API calls, do we required to enable any configuration to visible those new attributes in get calls.? thanks in advance for your inputs.
I want to load around 832,032 records from Excel file to DB table using Plan. Plan is not executing.It giving below error message :-1)Not enough memory to run the plan file. java.lang.OutOfMemoryError: Java heap space at org.apache.commons.io.IOUtils.byteArray(IOUtils.java:338) at org.apache.commons.io.output.AbstractByteArrayOutputStream.needNewBuffer(AbstractByteArrayOutputStream.java:104) at org.apache.commons.io.output.UnsynchronizedByteArrayOutputStream.<init>(UnsynchronizedByteArrayOutputStream.java:51) at org.apache.poi.util.IOUtils.toByteArray(IOUtils.java:181) at org.apache.poi.util.IOUtils.toByteArray(IOUtils.java:153) at org.apache.poi.openxml4j.util.ZipArchiveFakeEntry.<init>(ZipArchiveFakeEntry.java:67) at org.apache.poi.openxml4j.util.ZipInputStreamZipEntrySource.<init>(ZipInputStreamZipEntrySource.java:98) at org.apache.poi.openxml4j.opc.ZipPackage.<init>(ZipPackage.java:132) at org.apache.poi.openxml4j.opc.OPCP
Hello hive mind,Has anyone out there who have RDM v14.3 or later, and successfully used the new RDM REST API feature?We’ve upgraded our dev environment to v14.5.1 this week, I tried the REST API, and it keeps returning with “java.lang.Exception: org.springframework.security.access.AccessDeniedException: Cannot access entity: address_type” error. (Was trying to query my entity called address_type)I ensured my service account client has full access to the table. That service account client calls other API endpoints that I have built before on rdm-server and that authenticates fine.I wonder what I’m missing. Anybody successful before and we can compare notes?Thanks!
Hi Team, require help- when clicking on any entity in web URL, popup error box and not able to edit for seach any records.error- "getRowsWithDraftsFailed to determine origin for record party, id = 37104” MDM log capture as per below:2024-02-09 19:24:33,338 ←[39mDEBUG←[0;39m [476bff][admin][http-nio-8050-exec-4] ←[36mc.a.m.s.MdaRemoteServlet:31←[0;39m - actionId=findRecords() status=START2024-02-09 19:24:33,355 ←[31mWARN ←[0;39m [476bff][admin][http-nio-8050-exec-4] ←[36mc.a.m.s.MdaRemoteServlet:51←[0;39m - actionId=findRecords() status=FAILURE message=findRecords() method failed. Error: Failed to determine origin for record party, id = 371042024-02-09 19:24:33,356 ←[31mWARN ←[0;39m [476bff][admin][http-nio-8050-exec-4] ←[36mc.a.m.s.MdaRemoteServlet:51←[0;39m - actionId=findRecords() status=FAILURE message=findRecords() method failed. Description: java.lang.NullPointerException: Failed to determine origin for record party, id = 37104 at com.ataccama.dqc.commons.util.AssertUtil.as
Hi All,require help on below error "This user does not have sufficient rights to access the application”.
Would you like to cover the case what will happen when a user enters her/his credentials incorrectly many times? The setting of Max Login Failure can be set in Keycloak Admin Console, follow these steps:Log into Keycloak Admin Console Go to Realm Settings (Ataccamaone) on the left-hand menu Go to Security Defenses tab Select Brute Force Detection and enable the feature Set the Max Login Failure to the desired amountBrute Force Detection before enablementWhen enabled, all setting can be changed accordingly to your needs Any question or comment? Let us know!
Download links: https://support.ataccama.com/home/downloads/14.5.0Steps overview:Download all components Install ONE Desktop Launch ONE Desktop and create the RDM Banking example project Place the files in the right structure Modify a bunch of files so they are working on MacOS Configure the Mac permissions to run things Launch ONE Desktop and create the RDM Banking example project Launch it all (keycloak, postrgres), one by oneDownload: Builds (Latest versions here, version picker at the top): RDM: https://ataccama.s3.amazonaws.com/products/releases/rdm-assembly-14.5.0.230901-50963-541c0569-linux.zip ONE Desktop: Ataccama-one-desktop-14.5.0-macos.dmg ONE Runtime: Server-assembly-14.5.0.tar Postgres keycloak: https://ataccama.s3.amazonaws.com/products/releases/keycloak/keycloak-21.1.2-3-demo.zip Plugins (Latest versions here, the official Postgres version for Linux missing for now) Your license (.plf file) Install ONE Desktop:Install One Desktop (Ataccama-one-desktop-14.5.0-m
How to delete orphan but active records on source and instance table in Omnihealthdata. The records were deleted at source but the load to onramp was missed for delete batch. Is there other way I could delete these records from _s(source) and instance tables? Is a manual SQL delete a right way to go with or would it cause any future issues?
I’m using RDM 14.2 (soon to be upgraded to 14.5) and I need to build an API endpoint to accept incoming data.I have an integration input and will use an RDM Importer step to import the data into my table.My table has a generated id as a primary key and I need to provide the generated id as a response back to the incoming API call.But the RDM Importer step stops there. It doesn’t tell me the id. How do I then get the id back? I could make an RDM Extended Reader step in the plan, but I cannot guarantee the Reader step is executed after the Importer step, because the Importer step doesn’t have an out endpoint, it only has an err endpoint. And if I query the data before the insert is committed then I will end up with nothing to provide. Any ideas? (I believe the new RDM REST API functionality is read only so that won’t be relevant here?)
My requirement is to get all the RDM tables in Ataccama to Snowflake or to amazon S3.Could anyone please let me know how to do that.
Hi Team, Can anyone please help me with below Information on MDM licensing?Is Ataccama MDM licensing model based on number of records that we load form various sources (unconsolidated) or based based on unique profiles in MDM (Consolidated) Apart from number of records, are there other aspects that affects licensing price like the domain that I want to master (Customer/Product/Location etc.), the number of API calls, the number of batch jobs that execute per day, total volume required to host source records + history + merge history etc. ? Any other factor that is required to calculate MDM licensing cost?
Hi Team ,Can anyone please help me setup my MDM environment locally .Please help me with the plugins and folder structure .Regards,Kundan
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.