Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Hi All, Can someone please let me know the steps for configuring Survivorship logic for attributes once records are tagged for merge?I couldnt find much of survivorship details in One MDM document.Thanks,fshahin
Is anyone able to configure the Snowflake jdbc connection with OAUTH using AAD? I’m not clear on how to accomplish the instructions in the documentation. Can anyone help with screen shots or a section of their runtimeConfig file (with obfuscated secrets, id’s, etc) ?TIA
I’m new to Ataccama ONE MDM and have recently completed the training. I’m currently doing a POC on it and am stuck at two places.So here’s the situation:First, I’m able to load the data but I’m not sure how to update it. Like, lets say I have a person record and after loading it generated Person_ID X23233X. Now, I made changes to some of the data in the same request. For eg, I’ve updated the contact number or the address of the record. Now, when I’ll be loading this same data again I want the ID to remain the same and just update the contact/address data along with Last_Updated _Timestamp. Secondly, lets say I have a record with 2 different phone types, ‘Home Phone’ and ‘Work Phone’, and I’ve loaded it. So, the Person_ID X12322X will have two contact details associated with it. Now, lets say I removed the ‘Home Phone’ details from the record and send it for update load. So, after updating the same request, ‘Home Phone’ details should be dissociated from the Person_ID X12322X (the cont
Hi everyone!We are wrapping up our introduction to the MDM series with this post delving into the core of MDM—the Model. MDM is a model-driven implementation, where the model takes center stage, driving the generation of structures and orchestrating crucial processes. Let’s dive in 😎 Unlocking the MDM Model MagicThe MDM Model is the maestro orchestrating the symphony of Ataccama MDM's capabilities. Here's a glimpse of how it weaves its magic: Automated Database Structures: Say goodbye to manual database creation. Ataccama MDM automatically generates database structures based on your model. MDM Workflow Wizardry: Cleansing, matching, and merging—the three crucial phases—are seamlessly handled by the MDM Workflow, automating the orchestration of these intricate processes. Native MDM Services Creation: The model isn't just a blueprint; it's a generator. Native MDM services spring to life based on your model, simplifying service creation and eliminating unnecessary complexities. Con
DQS matching component results are not reflected when bundle is deployed and the entity is re-processed. I did re-build the repo with the new Extended unifier but no effect. What could be a reason?
Hello Team,can someone provide insight around the solution to stop the event generations based on the condition, let's say- if MDM system receives / source system sends less than 50K records for mastering then use events to propagate the changes to downstream system else send a batch extract file. knowing the fact that we can delete the events after generating but looking to stop the events conditionally.
Hi All, I am working on an enhancement project where I am adding more source system in existing model. As per the requirement I have added one match rule in Party Match Component at the bottom of existing matching rules and then I executed the component using Run button. Got message that Plans completed successfully. After that I executed load operation with some sample data in source which is passing that last added rule. Execution completed successfully but the records didnt merge. In master table they are present as 2 separate records. Am I missing any step? Thanks,FS
Hello everyone, Anna here! I work as a projects consultant in Ataccama and today I put together a guide for you on how to work with delta changes in Ataccama ONE. Enjoy!IntroductionAs part of every project, some kind of integration with other tools is usually required. In most cases, the integration requires synchronization of some data between the tools on regular bases. When it comes to Ataccama ONE, synchronization of assets like business terms or DQ rules may be required – for example with Collibra. It is desired to synchronize only delta changes (changes that happened since the last synchronization) to keep the integration efficient.This article explains how the delta changes can be detected in Ataccama ONE using graphQL queries. There is no simple out-of-the-box delta detection implemented, for that reason multiple graphQL queries are used in plans to achieve this goal.Ataccama doesn’t store a last modified date or similar property within assets. Ataccama creates a History Change
Hi, We are currently using 13.9.We have multiple kafka topics and they are differently named with a suffix representing the environment like topic.sit, topic.uat. When we do the deployment to prod we have to make sure that the comp files where the topics are specified like event handlers or streaming consumer are cherry picked manually.Since fetching the values from environment variable functionality is not available in MDM or ONE desktop, I was wondering if there is a way we could create an alias for these topics and define them in runtime config as runtime config will anyway not be merged in any deployments. If someone has any workaround for this kind of situation, please suggest.Thanks,
Hi,13.9.4Currently we have a monitoring project with several DQ rules applied. We also build in ONE Desktop an export functionality through components in order for the users to click one button and get a .xlsx file to see all the invalid records.ONE Deskptop componentWhen the .xlsx is downloaded and opened you will see the following:ExportAs you can see the same rules is shown multiple times with every time because a record can have multiple invalid rules applied on them hence the several options. This creates a list of invalid rules and for the user it's not a great experience to filter through the file. Is there a solution to this?I also want to take the moment to ask another question. As you can see you’ll notice “FLOAT is empty”. That is a generic rule we make available for every user. Input attribute is a float and it's checks whether the field is empty. If yes, it's invalid. This rule can be applied to any attribute that is a float data type. However in the invalid records I
Is it possible to include attachments (containing invalid records) from the export tab of the monitoring project to the notifications sent out to the users?
Hello!I had a user pose the question of being able to view the plain values of lookup lists that came out of the box with Ataccama. When attempting to look at the lookup lists, it is unreadable from the Web UI, and the Desktop application. Is there any listed documentation of what these lookup lists contains, or a desktop plan to transform the lookup lists into a plain English format?Thanks!
Hi All,I am new to Ataccama and currently working on a POC. I have a requirement that if an update is coming for a master record then it should not again go through the match and merge process, instead it should directly update the master record. Is it possible to achieve the scenario? Do I need to create separate workflow or same workflow can be re-configured? Can someone please explain with detailed steps if at all this is a logical possible scenario?ThanksFS.
I have about 200+ rules in my rule library that i built over a period of last 2 years.Some of them I used Lookups. Later on I stopped using the rules in my moniotring projects, but the rules are still left in rule library. I want to disable the rebuildingo of lookups. How do i find out which of my rules are using the Lookups? How to find them?
Hello everyone!I created a VCI (Virtual Catolog Item) and created a Monitoring Project with Rules in Atacama One, using a Post Processing Plan I wanted to upload the result of the monitoring project to databases, in Atacama One we have a csv file with the results in the Export tab, but I can't upload it to the database, the database is empty. Сreated a Global Runtime Configuration, but there is no result. Who has faced such a problem?
Hello everyone,In this post, we will cover upgrading your RDM project from version 12 to 14. This will also be applicable to any other version, but some specific details we will cover are specific when going from version 12 to 14. This is because of new features and options within the RDM model which were newly added in some version between 12 and 14. For the purpose of this article I will assume you are familiar with the desktop tool already and know how to open up the model explorer view.The first step is to ensure you have both the Ataccama Desktop tool downloaded and installed for both versions. To download latest version visit this link. Then setup the desktop as needed and ensure at a minimum you can start up the sample project.Once everything has been setup correctly our next step is to export our previous project mdc file from our version 12 desktop tool.To export your project, right click on the project and click on the “Export...” option. Then you will pick somewhere to save
Hi Everyone ! I’m Srija ,Solutions Consultant here at ataccama. Today I’m sharing how to profile a catalog item using GraphQL by providing the Catalog item name and type of profiling. Profiling is usually performed to Catalog Items. There are two types of data profiling in AtaccamaOne. Sample Profiling Full ProfilingWe can do profiling using the Ataccama One Web GUI but there are limitations. Consider a scenario where profiling needs to be executed for multiple catalog items in one Go. In such cases, GraphQL can be leveraged within a plan to facilitate the profiling process. By specifyingthe catalog items and the type of profiling (Sample/Full), the profiling operation can be seamlessly performed.The below GraphQL Query helps to run the specified profiling for the specified Catalog Item. This can be executed in the playground/postman tool or can be done in a plan in ONE desktop. Here's the query structure:query ImportCatalog ($connection_id: GID!) {connection(gid: $connection_id) {i
Hi everyone,I currently have a plan that is creating a main task and populating it with sub tasks that each link to individual tables. My issue at the moment is that sometimes this creates tasks with a huge amount of sub tasks that may seem daunting for people to try to work through.Currently the tables and their attribute ids are all stored in one excel sheet, so I was wondering if it would be possible to break it into separate excel files each containing 20 rows. If this is possible I would then be able to create additional tasks rather than just grouping everything in one.Thank you for any help!
Hi all! I am working on a monitoring project. I have a catalog item consisting 130 columns. I want to create a custom catalog item selecting only few attributes that I need to have them in my monitoring project.However, based on my previous experience: Once I have created a catalog item with selected attributes. Then I had to add new attributes according to my project needs. I have run the monitoring project again with new attributes of catalog item, then I lost my monitoring project. It showed errors for all DQ rules because as I understood from error message, DQ rules need to have attribute key ids, and with adding new attributes I have changed attribute key ids. Now, again I have a huge catalog item and I want to reduce the volume with selecting few attributes but I don’t want to face with the same problem again. If you have any suggestion it would be so great for me. Thanks !
Hello all, i have datalake gen2 parquet files in containers and folders. In the folder are delta.log file and parquets. Is there some way to merge these parquets to one table? This table should represent one current(up to date) table contains data from parquets. this is what i see now in ataccama. I want to merge these data to one table. Thanks for replies, Matus
I want to create another column using the filter step on the IDE. How do I concatenate foreign characters and fields with different data types into one field.Fields to concatenate is date field, special character (/), string and integer fields
Hi We are planning to use Atacamma DQ as a service and would like to use its DQ Engine to query and provide us counts. We would like to build a API call to Atacamma DQ with necessary SQL Query and connection parameters as part of API call, and would like to know if this SQL query can be executed on the Atacamma DQ and provide the results as an output back to API as a response. Please let us know the possibilities. Regards,Uma
Hello, is it possible to export a catalog item along with its associated terms? As you can see in the screenshot below, I set the attribute called “last_update_hostname” as confidential temporarily for an example, but when I export it to a file, I was only able to see the data values not the terms associated with it.
Hello, how to run the plan below (created using ONE Desktop) on Ataccama Web ?
Hi,I have a .csv file containing country codes that looks like:countrycode.csvI want to use this file as a lookup. In ONE Web it is possible to use a .lkp file as a lookup (why not just import an excel file there is beyond me). In order to do this I understoond I had to create a lookup builder:Lookup builderIn the Text File Reader I selected the documented with the encoding (I hope this is the right one?). As for the columns I created nm_lnd and kd_lnd (both string).Text File Reader - GeneralText File Reader - ColumnsAs for the Lookup Builder:Lookup BuilderWhen I run it a .lkp is created but also a rejected.txt with everything that is inside the .csv meaning I'm not able to create the desired .lkp file. What can I do to resolve this? Is there also documentation on how to create lookup using .csv somewhere? I can't find it.
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.