Discuss, learn, ask, suggest, share all things MDM and RDM π
Recently active
Letβ say you have a graphQL query that works in a Postman or in Ataccama playground, and you want to use it inΒ a plan in ONE Desktop. How to do it?You cannot simply copy and paste the JSON body into JSON call step. You have to reformat it. You can use the COPY CURL button in Playground (in the upper right corner) or similar button Code in Postman. That will create a curl command that also contains the body:PlaygroundCurl commandThis body can be then pasted into JSON call. The query method needs to be set as POST.JSON call step configurationΒ Want to learn more about the graphQL API? Check out the documentation:Β https://support.ataccama.com/home/docs/aip/latest/development-guides/one-development-guide/one-api
We are on RDM v14.5.1, on PaaS, so underlying db is postgres.I need to query a table using the RDM Extended Reader step with a filter. The volume of this table will grow, so I much prefer to filter at the reader step, rather than bring the whole table into the plan and then filter, to manage performance.I have a column, from_date, that is datetime type. I have from_date in my data flow, and I want to query RDM for a day prior.Expecting that this is an SQL where clause, I tried to put in syntax compatible with PostgresΒ So I created a column called βrow_filterβ, with type string.Β Using postgres to_timestamp functionday_prior:=dateAdd(from_date,-1,'DAY');day_prior_string:=tostring(day_prior,'yyyy-MM-dd HH:mm:ss');"from_date=to_timestamp('"+day_prior+"','YYYY-MM-DD HH:MI:SS')"Β This one gave an error of:13.05.2024 13:10:00 [INFO] Ataccama DQC engine initialized.13.05.2024 13:10:00 [INFO] Creating runtime...13.05.2024 13:10:00 [INFO] Starting runtime...13.05.2024 13:10:00 [INFO]
I have a data set created and the query runs fine in a sql editor against my local database. I can deploy the configuration with no errors, but when I go to look at the data in Ataccama One I get Fatal error occurred and click on Details just gives me Internal error. The only thing I can think of is the query is rather long. Is there a max for data set sql? What is the best way to try to troubleshoot this? The error messages are not at all helpful.
Hey All!I am aware that only Stewardship owners have the ability to use the βDocumentβ button on a data source level, but is there a way that we can disable this button all together? If a user accidentally uses this feature, it eats up a lot of processing to import the metadata, and is a best practice that we are telling everyone not to use. Is there a way within the admin console to do this?Thanks!Β
Is there a way to put columns in a view with a static value? Like you can in a sql statement, such asSELECT col1, βthis is a static valueβ AS col2
Is there a way to create views in RDM that contain union statements combining queries to different tables?
Hello Ataccama teamΒ I would like to know if there is a reference about how to configure an external dpe using databricks on azure.Β Thank you
The response message was:null and response error was 'errorMsg:java.net.NoRouteToHostException: No route to hostΒ Β Β at java.base/sun.nio.ch.Net.connect0(Native Method)Β Β Β at java.base/sun.nio.ch.Net.connect(Net.java:579)Β Β Β at java.base/sun.nio.ch.Net.connect(Net.java:568)Β Β Β at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593)Β Β Β at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327)Β Β Β at java.base/java.net.Socket.connect(Socket.java:633)Β Β Β at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:121)Β Β Β at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)Β Β Β at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:326)Β Β Β at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:605)Β Β Β at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:440)Β Β
I have an xml file with a structure like this:<model xmlns="http://www.ataccama.com">Β Β Β <entities>Β Β Β Β Β Β <entity name="table1" />Β Β Β <columns>Β Β Β Β Β Β Β <column datatype="varchar(100)" name="abc" required="false" />Β Β Β Β Β Β Β <column datatype="int" name="xyz" required="false" />Β Β Β Β Β Β Β <column datatype="datetime" name="123" required="false" />Β Β Β </columns>...I want to produce a data stream that combines the column name and data_type with the name from the parent entity node.Β If I define the columns using xpath nm:model/nm:entitles/nm:entity/nm:columns/nm:column then I cannot access the entity name using ../../@nameΒ (or any xpath expression for that matter).Β If I define the columns using entity level xpath epxressionΒ nm:model/nm:entitles/nm:entity and the columns with xpath nm:columns/nm:column/@name then I only get 1 record per entity with the first column only.Β Β Β How can I get the entity name, column name, and column data
Hi Team, could someone please assist in getting idea of implementing checkpoints in master data consolidation process.? Β as currently we observed MDM follows a one lengthy workflow of MDM data consolidation process from Data acquisition to publish data to the downstream systems [Β data acquisitionβΒ change detection βΒ cleansing βΒ matchβΒ and then merge.]Β Β during this entire flow executionΒ if any one of the components failed after few hours due technical someΒ issues, then it is required to restart this entire flow. just to avoid this we wanted to restart the jobs from the point where failure happens, is there any way to breakdown or separate the jobs or implement the check points to restart.? please suggest with theΒ recommendations.Thanks,Β
Hi all,Can I export lookup fileΒ and import to another environment?Β Β Thanks in advance.
We have recently upgraded to RDM V14.5.0 and are finding that if you leave the screen idle for 5-10 mins the system will log you out and back in immediately. When it logs you back in it has closedΒ all the tables that you had open previously.Β Β Also, when you want to close RDM and press the βLog outβΒ button it more often than not logs you out and then back in again. It takes a 2nd press of the βLog outβ button to finally log out.Β Is there a setting somewhere that will increase the idle time so we donβt keep losing the open tables and is the need for a double log out a bug or some setting that we need to change. Any help would be appreciated.
Hello Team, require help, we are on MDM 13.9.3 β newly added columns to the Instance and Master entities are not visible in REST API calls, do we required to enable any configuration to visible those new attributes in get calls.? Β thanks in advance for your inputs.
I want to load around 832,032 records from Excel file to DB table using Plan. Plan is not executing.It giving below error message :-1)Not enough memory to run the plan file.Β java.lang.OutOfMemoryError: Java heap space Β Β Β at org.apache.commons.io.IOUtils.byteArray(IOUtils.java:338) Β Β Β at org.apache.commons.io.output.AbstractByteArrayOutputStream.needNewBuffer(AbstractByteArrayOutputStream.java:104) Β Β Β at org.apache.commons.io.output.UnsynchronizedByteArrayOutputStream.<init>(UnsynchronizedByteArrayOutputStream.java:51) Β Β Β at org.apache.poi.util.IOUtils.toByteArray(IOUtils.java:181) Β Β Β at org.apache.poi.util.IOUtils.toByteArray(IOUtils.java:153) Β Β Β at org.apache.poi.openxml4j.util.ZipArchiveFakeEntry.<init>(ZipArchiveFakeEntry.java:67) Β Β Β at org.apache.poi.openxml4j.util.ZipInputStreamZipEntrySource.<init>(ZipInputStreamZipEntrySource.java:98) Β Β Β at org.apache.poi.openxml4j.opc.ZipPackage.<init>(ZipPackage.java:132) Β Β Β at org.apache.poi.openxml4j.opc.OPCP
Hello hive mind,Has anyone out there who have RDM v14.3 or later, and successfully used the new RDM REST API feature?Weβve upgraded our dev environment to v14.5.1 this week, I tried the REST API, and it keeps returning with βjava.lang.Exception: org.springframework.security.access.AccessDeniedException: Cannot access entity: address_typeβ error. (Was trying to query my entity called address_type)I ensured my service account client has full access to the table. That service account client calls other API endpoints that I have built before on rdm-server and that authenticates fine.I wonder what Iβm missing. Anybody successful before and we can compare notes?Thanks!
Hi Team,Β require help- when clicking on any entity in web URL, popup error box and not able to edit for seach any records.error- "getRowsWithDraftsFailed to determine origin for record party, id = 37104βΒ MDM log capture as per below:2024-02-09 19:24:33,338 β[39mDEBUGβ[0;39m [476bff][admin][http-nio-8050-exec-4] β[36mc.a.m.s.MdaRemoteServlet:31β[0;39m - actionId=findRecords() status=START2024-02-09 19:24:33,355 β[31mWARN β[0;39m [476bff][admin][http-nio-8050-exec-4] β[36mc.a.m.s.MdaRemoteServlet:51β[0;39m - actionId=findRecords() status=FAILURE message=findRecords() method failed. Error: Failed to determine origin for record party, id = 371042024-02-09 19:24:33,356 β[31mWARN β[0;39m [476bff][admin][http-nio-8050-exec-4] β[36mc.a.m.s.MdaRemoteServlet:51β[0;39m - actionId=findRecords() status=FAILURE message=findRecords() method failed. Description: java.lang.NullPointerException: Failed to determine origin for record party, id = 37104Β Β Β Β at com.ataccama.dqc.commons.util.AssertUtil.as
Hi All,require help on below error "This user does not have sufficient rights to access the applicationβ.
Would you like to cover the case what will happenΒ when a user enters her/his credentials incorrectly many times? The setting of Max Login Failure can be set in Keycloak Admin Console, follow these steps:Log intoΒ Keycloak Admin Console Go toΒ Realm SettingsΒ (Ataccamaone) on the left-hand menu Go toΒ Security DefensesΒ tab SelectΒ Brute Force DetectionΒ and enable the feature Set theΒ Max Login FailureΒ to the desired amountBrute Force Detection before enablementWhen enabled, all setting can be changed accordingly to your needsΒ Any question or comment? Let us know!
Download links:Β https://support.ataccama.com/home/downloads/14.5.0Steps overview:Download all components Install ONE Desktop Launch ONE Desktop and create the RDM Banking example project Place the files in the right structure Modify a bunch of files so they are working on MacOS Configure the Mac permissions to run things Launch ONE Desktop and create the RDM Banking example project Launch it all (keycloak, postrgres), one by oneDownload: Builds (Latest versionsΒ here, version picker at the top): RDM:Β https://ataccama.s3.amazonaws.com/products/releases/rdm-assembly-14.5.0.230901-50963-541c0569-linux.zip ONE Desktop:Β Ataccama-one-desktop-14.5.0-macos.dmg ONE Runtime:Β Server-assembly-14.5.0.tar Postgres keycloak:Β https://ataccama.s3.amazonaws.com/products/releases/keycloak/keycloak-21.1.2-3-demo.zip Plugins (Latest versionsΒ here,Β the official Postgres version for Linux missing for now) Your license (.plf file) Install ONE Desktop:Install One Desktop (Ataccama-one-desktop-14.5.0-m
How to delete orphan but active records on source and instance table in Omnihealthdata. The records were deleted at source but the load to onramp was missed for delete batch. Is there other way I could delete these records from _s(source) and instance tables? Is a manual SQL deleteΒ a right way to go with or would it cause any future issues?
Iβm using RDM 14.2 (soon to be upgraded to 14.5) and I need to build an API endpoint to accept incoming data.I have an integration input and will use an RDM Importer step to import the data into my table.My table has a generated id as a primary key and I need to provide the generated id as a response back to the incoming API call.But the RDM Importer step stops there. It doesnβt tell me the id.Β How do I then get the id back? I could make an RDM Extended Reader step in the plan, but I cannot guarantee the Reader step is executed after the Importer step, because the Importer step doesnβt have an out endpoint, it only has an err endpoint. And if I query the data before the insert is committed then I will end up with nothing to provide.Β Any ideas?Β (I believe the new RDM REST API functionality is read only so that wonβt be relevant here?)
My requirement is to get all the RDM tables in Ataccama to Snowflake or to amazon S3.Could anyone please let me know how to do that.
Hi Team,Β Can anyone please help me with below InformationΒ on MDM licensing?Is Ataccama MDM licensing model based on number of records that we load form various sources (unconsolidated) or based based on unique profiles in MDM (Consolidated) Apart from number of records, are there other aspects that affectsΒ licensing price like the domain that I want to master (Customer/Product/Location etc.), the number of API calls, the number of batch jobs that execute per day, total volume required to host source records + history + merge history etc. ? Any other factor that is required to calculate MDM licensing cost?Β
Hi Team ,Can anyone please help me setup my MDM environment locally .Please help me with the plugins and folder structure .Regards,KundanΒ
Hi Team,I need to upgrade my ataccama 13.8 to new latest oneβ¦. request you to please provide upgrade version download path or URL's.Β As I am facing some issue on current repository-Β Β ";Cannot instantiate class: com.ataccama.dqc.jms.sqs.SQSInitialContextFactoryβ
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.