Solved

I’m new to Ataccama ONE MDM and have recently completed the training. I’m currently doing a POC on it and am stuck at two places. So here’s the situation: First, I’m able to load the data but I’m not sure how to update it. Like, lets say I have a person record and after loading it generated Person_ID X23233X. Now, I made changes to some of the data in the same request. For eg, I’ve updated the contact number or the address of the record. Now, when I’ll be loading this same data again I want the ID to remain the same and just update the contact/address data along with Last_Updated _Timestamp. Secondly, lets say I have a record with 2 different phone types, ‘Home Phone’ and ‘Work Phone’, and I’ve loaded it. So, the Person_ID X12322X will have two contact details associated with it. Now, lets say I removed the ‘Home Phone’ details from the record and send it for update load. So, after updating the same request, ‘Home Phone’ details should be dissociated from the Person_ID X12322X (the con

DQS matching component results are not reflected when bundle is deployed and the entity is re-processed. I did re-build the repo with the new Extended unifier but no effect. What could be a reason?

Hello Team, can someone provide insight around the solution to stop the event generations based on the condition, let's say- if MDM system receives / source system sends less than 50K records for mastering then use events to propagate the changes to downstream system else send a batch extract file. knowing the fact that we can delete the events after generating but looking to stop the events conditionally.

Hi All, I am working on an enhancement project where I am adding more source system in existing model. As per the requirement I have added one match rule in Party Match Component at the bottom of existing matching rules and then I executed the component using Run button. Got message that Plans completed successfully. After that I executed load operation with some sample data in source which is passing that last added rule. Execution completed successfully but the records didnt merge. In master table they are present as 2 separate records. Am I missing any step? Thanks, FS

Hi, We are currently using 13.9. We have multiple kafka topics and they are differently named with a suffix representing the environment like topic.sit, topic.uat. When we do the deployment to prod we have to make sure that the comp files where the topics are specified like event handlers or streaming consumer are cherry picked manually. Since fetching the values from environment variable functionality is not available in MDM or ONE desktop, I was wondering if there is a way we could create an alias for these topics and define them in runtime config as runtime config will anyway not be merged in any deployments. If someone has any workaround for this kind of situation, please suggest. Thanks,

Hi, 13.9.4 Currently we have a monitoring project with several DQ rules applied. We also build in ONE Desktop an export functionality through components in order for the users to click one button and get a .xlsx file to see all the invalid records. ONE Deskptop component​​​​​ When the .xlsx is downloaded and opened you will see the following: Export As you can see the same rules is shown multiple times with every time because a record can have multiple invalid rules applied on them hence the several options. This creates a list of invalid rules and for the user it's not a great experience to filter through the file. Is there a solution to this? I also want to take the moment to ask another question. As you can see you’ll notice “FLOAT is empty”. That is a generic rule we make available for every user. Input attribute is a float and it's checks whether the field is empty. If yes, it's invalid. This rule can be applied to any attribute that is a float data type. However in the invalid re

Is it possible to include attachments (containing invalid records) from the export tab of the monitoring project to the notifications sent out to the users?

Hi All, I am new to Ataccama and currently working on a POC. I have a requirement that if an update is coming for a master record then it should not again go through the match and merge process, instead it should directly update the master record. Is it possible to achieve the scenario? Do I need to create separate workflow or same workflow can be re-configured? Can someone please explain with detailed steps if at all this is a logical possible scenario? Thanks FS.

Hello everyone! I created a VCI (Virtual Catolog Item) and created a Monitoring Project with Rules in Atacama One, using a Post Processing Plan I wanted to upload the result of the monitoring project to databases, in Atacama One we have a csv file with the results in the Export tab, but I can't upload it to the database, the database is empty. Сreated a Global Runtime Configuration, but there is no result. Who has faced such a problem?

Hi, ONE Web > Monitoring Project I have a MP A which contains 7 CIs, I want to copy this MP to create MP B. For MP B I only want to use 6 out of the 7 CIs as the last CI is unnecessary. I use the import configuration (great qol btw) and for the 7th CI I use same CI. After the import configuration has been completed I delete the 7th CI from the MP. Inside the Report tab I still see that same CI appear which is not ideal. You'd think clicking the three dots besides it lets me Delete it from the page, but to my surprise that option is greyed out. How do I get rid of this CI from the Report page? ​​​

Hi everyone, I currently have a plan that is creating a main task and populating it with sub tasks that each link to individual tables. My issue at the moment is that sometimes this creates tasks with a huge amount of sub tasks that may seem daunting for people to try to work through. Currently the tables and their attribute ids are all stored in one excel sheet, so I was wondering if it would be possible to break it into separate excel files each containing 20 rows. If this is possible I would then be able to create additional tasks rather than just grouping everything in one. Thank you for any help!

Hi all! I am working on a monitoring project. I have a catalog item consisting 130 columns. I want to create a custom catalog item selecting only few attributes that I need to have them in my monitoring project. However, based on my previous experience: Once I have created a catalog item with selected attributes. Then I had to add new attributes according to my project needs. I have run the monitoring project again with new attributes of catalog item, then I lost my monitoring project. It showed errors for all DQ rules because as I understood from error message, DQ rules need to have attribute key ids, and with adding new attributes I have changed attribute key ids. Now, again I have a huge catalog item and I want to reduce the volume with selecting few attributes but I don’t want to face with the same problem again. If you have any suggestion it would be so great for me. Thanks !

Hello all, i have datalake gen2 parquet files in containers and folders. In the folder are delta.log file and parquets. Is there some way to merge these parquets to one table? This table should represent one current(up to date) table contains data from parquets. this is what i see now in ataccama. I want to merge these data to one table. Thanks for replies, Matus

I want to create another column using the filter step on the IDE. How do I concatenate foreign characters and fields with different data types into one field. Fields to concatenate is date field, special character (/), string and integer fields

Hi We are planning to use Atacamma DQ as a service and would like to use its DQ Engine to query and provide us counts. We would like to build a API call to Atacamma DQ with necessary SQL Query and connection parameters as part of API call, and would like to know if this SQL query can be executed on the Atacamma DQ and provide the results as an output back to API as a response. Please let us know the possibilities. Regards, Uma

Hello, is it possible to export a catalog item along with its associated terms? As you can see in the screenshot below, I set the attribute called “last_update_hostname” as confidential temporarily for an example, but when I export it to a file, I was only able to see the data values not the terms associated with it.

Hello, how to run the plan below (created using ONE Desktop) on Ataccama Web ?

Hi, I have a .csv file containing country codes that looks like: countrycode.csv I want to use this file as a lookup. In ONE Web it is possible to use a .lkp file as a lookup (why not just import an excel file there is beyond me). In order to do this I understoond I had to create a lookup builder: Lookup builder​​ In the Text File Reader I selected the documented with the encoding (I hope this is the right one?). As for the columns I created nm_lnd and kd_lnd (both string). Text File Reader - General Text File Reader - Columns As for the Lookup Builder: Lookup Builder When I run it a .lkp is created but also a rejected.txt with everything that is inside the .csv meaning I'm not able to create the desired .lkp file. What can I do to resolve this? Is there also documentation on how to create lookup using .csv somewhere? I can't find it.

Hi DQC online service experts, I have built an online service that writes data into RDM using Rdm importer. I put some validation logic into the component so that it would reject bad records from being written (e.g. value supplied does not exist in parent table). The rdm importer is going straight to confirm mode as we need the data to be automatically published and available. I've configured the integration output to provide the primary key and my explanation in the case that the component rejects the record. The app that is sending the data, are now saying that even if I provide an error explanation, the endpoint still provides a 200 response code. They have some in built error handling capability that they want to use, but they currently can't use it because the server responds 200. Is it possible for me to set a different response code e.g. 400, based on the data that is provided in the integration output?

I need to understand the difference between Full and Complex Delta Load in MDM.As per this document on Complex Delta Load, Delta Dependency Mode needs to be setup for each entity. I see there are two options for it -Autonomous and Central. Can someone please explain the difference between these and in what scenario these should be used?I also see that The engine expects an additional column in the input interface denoting the type of record change (change_type: I - insert, U - update, D - delete). Where shall we define these and what how can we identify which records needs which change_type? TIA 😊

Hello! I am interested in hiding the global settings from users, at least some of them. I know this question has been asked before for version 13, but it was mentioned the approach is quite different in 14.5. Would appreciate any insight you all have.

Hi Team, we are just trying to convert the string timestamp format values to dateTime format in the expression transformation, when we tried to use toDateTime(<column_name>,'YYYY-MM-DD HH:mm:ss','en') returning null- can someone help.

Hi Team, I am reading from collibra using collibra reader, some data has html tags like - <p> , <div> in it. Is there a way where we can filter out the html tags if its present in the data. like strip html tags like that. Let me know if more information is needed. Thanks.

Hi team,I am working on a story where a user needs to see the results of the monitoring project which is running.Like where the results are getting saved in the backend,in the tables.Need to create a pipeline for that like when we click the run monitoring button in Ataccama Web,a workflow in Ataccama desktop should run and the results should be saved in the database to look at to see how many records are passing and failing.So how can we create that pipeline?

Hello all, i have datalake gen2 parquet files in containers and folders. In the folder are delta.log file and parquets. Is there some way to merge these parquets to one table? This table should represent one current(up to date) table contains data from parquets. this is what i see now in ataccama. I want to merge these data to one table. Thanks for replies, Matus