Learn & Share

I have data coming from a SQL database. For most queries, the structure of these queries remains the same, as shown in the picture, with only the attribute name changing. Now, I want to classify these queries as unique based on their structure rather than the attribute name. Demo Data Thank you. Regards,Dhaval

Hello, from one of our source systems we were previously excluding any inactive addresses, contact details, etc. Our users have requested we load these records into MDM for visibility. My issue is that while we can add these records as is, they will not show as inactive on MDM. We could add a source active flag but for consistency with other sources we would like them to show as inactive on MDM (Greyed out). We have considered doing a one time load of all the inactive instances and then excluding them from the daily load but because it is possible to create address and contact details as inactive from the source that would not work. I have explored using the delta load as it has a change type column that could be appropriate for our use case. Has anyone had to set records in MDM as inactive as part of the load not using the deletion strategy? What method did you use? I have also looked into creating new instance entities to store inactive records but that would be a large undertaking a

I’m hoping anyone has some good GraphQL examples to share. For us, it is necessary to integrate Ataccama into our standard reporting. To do so I’m trying to get a GraphQL working that returns the scores for each item in a monitoring project. Ideally, listing out all monitoring projects and items with their scores - for the latest processing (although I’ll take all at this point and filter the old ones later). This is all about the statistics (# records passed/failed etc. not the individual results - I am aware I can create post-processing plans to export data, but this is not applicable here). It’s basically the overview from the report tab in the monitoring project, at item level: I can get everything I need, including the total row count except the passed or failed figure. I have tried and looked at all GraphQL examples everywhere, including ONE API :: Ataccama ONE, and have pieced this together based on the structures visible in the desktop app. Things like DqAggregationResultOverTi

Hi @Cansu and All In the event if there is no change in the delta records coming in MDM except one of the Sequence Generated column, is their a way that the date field(Last Changed) gets updated with the date of the new row only on INSTANCE layer and not on the MASTER layer. So, if MDM ingests the delta record in Instance Layer and sees that there are no changes detected on any columns except the sequence column and it has nothing to update the Golden Record already existing then it should update the date field on Instance Layer only and not on Master Layer. Please let me know if you have any additional questions. Thank YouRitesh Ranjan

Hey all, I was wondering if you ever came accross the following requirement and has some tips maybe to implement it. The Text File Writer step can be used to create for instance log files. For tracking or governance reasons it may be necessary to keep all log files. But because the output file name is fixed, each time the file will be overwritten whenever a new one is created. Of course it is possible to manually add a datetimestamp to the file name after its creation, but that is a rather cumbersome approach. So I would like to be able to add a datetimestamp to the file name automatically. Does anyone have a suggestion? Kind regards, Albert

Hello, Has someone used $environment$ variable in the subject line in RDM notification or any other notification emails? We are experiencing an issue with the RDM when using the environment variable within our email notification template. When we configure the template to include $environment$ in the subject line, the received emails do not display the variable. Thanks, Ojaswini

Hi, I am looking for a plan to export column names for a catalog item in One Web. Can someone help me with it? Thanks

Hi Ataccama community, I’m hoping someone with better grip on the Ataccama GraphQL model can shine a light on this. For internal reporting, we are looking to retrieve data quality details via the Ataccama GraphQL API. One of the requests it to produce an overview of the DQ score across the (rule’s) DQ dimensions. This is basically the same as is shown in the web UI when navigating to the ‘Data Quality’ tab for a Term. It shows the score broken down by dimensions, based on how the rules are defined. What I’m trying to do is retrieve the passed/failed rows at this level, so for each term and each dimension. This would allow me to summarise this into a score per dimension. However, I am unable to get this out of the API. I’ve approached this from both the ‘terms’ and ‘rules’ pathway. In both approaches I always end up with the ‘Overall Quality’ score for each term - not the per dimension details. The ‘rules’ query looks promising, but ultimately only returns the passed/failed records for

Hi, I’m trying to add the data value to the file extension in the component but I’m not able to get the expected results. I have added a new string column using alter format step (tostring(today(), 'yyyy-MM-dd'). When I pass the column as $date or ${date} in the output filename, I’m not seeing the data on the output filename.

Can anyone guide me on how to generate an audit for every action, log it, and integrate the logs with the UI in Ataccama One Desktop? Any best practices or examples would be greatly appreciated!

Unable to start keycloak locally on a Azure DevBox, When I run the keycloak.bat file from OneDesktop, it is immediately terminated as per console logs. Can anyone help with the diagnosis?

We are getting errors in the delta update flow for party and policy master and this is the error message. “com.ataccama.nme.core.NmeExecutionException: Plan "/opt/ataccama/one/mdm-server-config-13.9.1.221107-11165-6e37fd24/Files/engine/export/Party_Master_Delta.comp" execution failed: runtime.error.sql.instance.processError - Transaction (Process ID 901) was deadlocked on lock | communication buffer resources with another process and has been chosen as the deadlock victim.” Please advice if any help can be provided.Thanks !!

Encountering with Runtime error in JDBC reader, while running the basic profiling for a table from SQL Server. Full Error details - Runtime error in JDBC reader: Error creating record: column type: 'STRING', read value: '<null value>', read object type: '<null value type>', cause: Connection reset Looking for ideas troubleshooting this error.

Hi All, We are facing performance issue while loading and exporting data in MDM. We have around 30 million records. We are loading data in chunks and initial few execution were very quick. After processing 20M we are observing severe degrade in performance. Now even for 10K records the job is taking 8-10 hours for both load and export. We have applied parallelism wherever its possible. Is there any other thing which we need to consider/implement which will enhance the performance? TIA.

Hi folks, I’ve been given details to an SFTP server, and I can successfully connect to it using Winscp on my laptop: I tried to setup connection in ONE desktop: I put workflow task: But I get an error: 14.11.2024 15:15:21 [INFO] Using following licenses:14.11.2024 15:15:21 [INFO] C:\Users\mkwok\license_hamilton_USER_v14_subscription_2025-01-29.plf14.11.2024 15:15:21 [INFO] ============================================================14.11.2024 15:15:21 [INFO] This is a subscription USER license for developers' laptops for "Hamilton". It expires on 2025-01-29.14.11.2024 15:15:21 [INFO] ============================================================2024-11-14 15:15:21 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'properties.encryption.keystore' property not specified2024-11-14 15:15:21 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'internal.

Hi, Can some help me with creating a post processing transformation plan that shows a different row for each DQ rule that has passed/failed on a particular field in the transformation plan in One Web UI. For Eg: I have 2 rules, a uniqueness check and a format check on the ID field. In the post processing output file, what’s the best way to see how I can split this for each rule and see the pass/fail metrics for each rule. Thanks

Hi Team need your expert opinion on how to tag Policies to Business Terms or any other assets(Applying policies to asset types) in 14.5 version? I cannot see any options for the same is it any version limitation or any customization needs to be turned on. Any help is appreciated.

Hello all, I want to create a DQ rule, In this rule I need to check a numeric field if the value is in the predefined interval or not. Let me give an example of logic. I have a column X contains ‘types of product’ and column Y contains ‘value of product’. And have a list of valid values. If the value of X is ‘abc’ then Y must be in the interval 1-30. If hte value of X is ‘xyz’ then Y must be in 1-200 and so on. I was going to create a lookup file for this one, but couldn’t be sure how to define intervals. Does someone know how to implement my DQ rule for this logic ? Thanks a lot !

I have an ETL process that’s run on-demand and refreshes master data referenced by several Ataccama catalog items. There’s about 60 lookup items that are created from catalog item attributes that I need to update immediately following the master data refresh. I know there’s a lookup item “Update” button in the Ataccama web interface and a method to schedule refreshes; however, I haven’t been able to find a way to update lookup items on-demand, such as through a GraphQL mutation. Is there an available mutation for updating lookup items on-demand, or another method that could be utilized?

I want to convert the instance export table values to a new table/view. The instance export contains 3 columns that I want to utilise Sharing an example- I have the following instance table structure : MASTER_ID SOURCE_SYSTEM SOURCE_ID 001 sys1 1234 001 sys2 12232 001 sys3 1292 001 sys4 13432 001 sys2 12334 5 records from 4 different source system make a master record, I want to group it in such a manner that there is a single row for each source_system id. If a source system participate twice(with two unique records) in formation of master record, I want two rows representing the different source_ids and a column with the source system that participates twice. Here is how I intend the output table to be: MASTER_ID SYS1_ID SYS2_ID SYS3_ID SYS4_ID MULTIPLE_REC 001 1234 12232 1292 13432 SYS2 001 1234 12234 1292 13432 SYS2 Can someone help me with the ONE Desktop step I can use for this?I have explored using Aggregating Column Assigner to group records but I but that wouldnt help.I think

Taking reference of CDI Example, I have multiple contact values for the same person and I want all of these contacts to be a part of the contact master entity. I am not sure how the same instance record id will affect this. Will ataccama load both these records? Will both these records partivipate in match logic(same master_party_id, same_contact_type,same contact_value) or will it consider just the first one?Also, if someone can please confirm if the master_party_id is id for master record derived on processing of all party records?

Hi Ataccama community. Could you please share examples of plans used for adding a new metadata entity and bulk loading values from excel file. We have an excel file with sensitivity level defined for each attribute. We need to add an entity called e.g. sensitivity level and to import this from excel file.