Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Hi All,Β I am working on an enhancement project where I am adding more source system in existing model. As per the requirement I have added one match rule in Party Match Component at the bottom of existing matching rules and then I executed the component using Run button. Got message that Plans completed successfully. After that I executed load operation with some sample data in source which is passing that last added rule. Execution completed successfully but the records didnt merge. In master table they are present as 2 separate records. Am I missing any step?Β Β Thanks,FS
Hello everyone, Anna here! I work as a projects consultant in Ataccama and today I put together a guide for you on how to work with delta changes in Ataccama ONE. Enjoy!IntroductionAs part of every project, some kind of integration with other tools is usually required. In most cases, the integration requires synchronization of some data between the tools on regular bases. When it comes to Ataccama ONE, synchronization of assets like business terms or DQ rules may be required β for example with Collibra. It is desired to synchronize only delta changes (changes that happened since the last synchronization) to keep the integration efficient.This article explains how the delta changes can be detected in Ataccama ONE using graphQL queries. There is no simple out-of-the-box delta detection implemented, for that reason multiple graphQL queries are used in plans to achieve this goal.Ataccama doesnβt store a last modified date or similar property within assets. Ataccama creates a History Change
Hi,Β We are currently using 13.9.We have multiple kafka topics and they are differently named with a suffix representing the environment like topic.sit, topic.uat. When we do the deployment to prod we have to make sure that the comp files where the topics are specified like event handlers or streaming consumer are cherry picked manually.Since fetching the values from environment variable functionality is not available in MDM or ONE desktop, IΒ was wondering if there is a way we could create an alias for these topics and define them inΒ runtime configΒ as runtime config will anyway not be merged in any deployments.Β If someone has any workaround for this kind of situation, please suggest.Thanks,
Hi,13.9.4Currently we have a monitoring project with several DQ rules applied. We also build in ONE Desktop an export functionality through components in order for the users to click one button and get a .xlsx file to see all the invalid records.ONE Deskptop componentβββββWhen the .xlsx is downloaded and opened you will see the following:ExportAs you can see the same rules is shown multiple times with every time because a record can have multiple invalid rules applied on them hence the several options. This creates a list of invalid rules and for the user it's not a great experience to filter through the file. Is there a solution to this?I also want to take the moment to ask another question. As you can see youβll notice βFLOAT is emptyβ. That is a generic rule we make available for every user. Input attribute is a float and it's checks whether the field is empty. If yes, it's invalid. This rule can be applied to any attribute that is a float data type. However in the invalid records I
Is it possible to include attachments (containing invalid records) from the export tab of the monitoring project to the notifications sent out to the users?
Hello!I had a user pose the question of being able to view the plain values of lookup lists that came out of the box with Ataccama. When attempting to look at the lookup lists, it is unreadable from the Web UI, and the Desktop application.Β Is there any listed documentation of what these lookup lists contains, or a desktop planΒ to transform the lookup lists into a plain English format?Thanks!
Hi All,I am new to Ataccama and currently working on a POC. I have a requirement that if an update is coming for a master record then it should not again go through the match and merge process, instead it should directly update the master record. Is it possible to achieve the scenario? Do I need to create separate workflow or same workflow can be re-configured? Can someone please explain with detailed steps if at all this is a logical possible scenario?ThanksFS.
I have about 200+ rules in my rule library that i built over a period of last 2 years.Some of them I used Lookups. Later on I stopped using the rules in my moniotring projects, but the rules are still left in rule library. I want to disable the rebuildingo of lookups.Β Β How do i find out which of my rules are using the Lookups? How to find them?
Hello everyone!I created a VCI (Virtual CatologΒ Item) and created a Monitoring Project with Rules in Atacama One, using a Post Processing Plan I wanted to upload the result of the monitoring project to databases, in Atacama One we have a csv file with the results in the Export tab, but I can't upload it to the database,Β the database is empty. Π‘reated a Global Runtime Configuration, but there is no result. Who has faced such a problem?
Hello everyone,In this post, we will cover upgrading your RDM project from version 12 to 14. This will also be applicable to any other version, but some specific details we will cover are specific when going from version 12 to 14. This is because of new features and options within the RDM model which were newly added in some version between 12 and 14. For the purpose of this article I will assume you are familiar with the desktop tool already and know how to open up the model explorer view.The first step is to ensure you have both the Ataccama Desktop tool downloaded and installed for both versions. To download latest version visit this link. Then setup the desktop as needed and ensure at a minimum you can start up the sample project.Once everything has been setup correctly our next step is to export our previous project mdc file from our version 12 desktop tool.To export your project, right click on the project and click on the βExport...β option. Then you will pick somewhere to save
Hi Everyone ! Iβm Srija ,Solutions Consultant here at ataccama. Today Iβm sharing how to profile a catalog item using GraphQLΒ by providing the Catalog item name and type of profiling.Β Β Profiling is usually performed to Catalog Items. There are two types of data profiling in AtaccamaOne.ο· Sample Profilingο· Full ProfilingWe can do profiling using the Ataccama One Web GUI but there are limitations. Consider a scenario where profiling needs to be executed for multiple catalog items in one Go. In such cases, GraphQL can be leveraged within a plan to facilitate the profiling process. By specifyingthe catalog items and the type of profiling (Sample/Full), the profiling operation can be seamlessly performed.The below GraphQL Query helps to run the specified profiling for the specified Catalog Item. This can be executed in the playground/postman tool or can be done in a plan in ONE desktop.Β Here's the query structure:query ImportCatalog ($connection_id: GID!) {connection(gid: $connection_id) {i
HiΒ everyone,I currently have a plan that is creating a main task and populating it with sub tasks that each link to individual tables. My issue at the moment is that sometimes this creates tasks with a huge amount of sub tasks that may seem daunting for people to try to work through.Currently the tables and their attribute ids are all stored in one excel sheet, so I was wondering if it would be possible to break it into separate excel files each containing 20 rows. If this is possible I would then be able to create additional tasks rather than just grouping everything in one.Thank you for any help!
Hi all!Β I am working on a monitoring project. I have a catalog item consisting 130 columns. I want to create a custom catalog item selecting only few attributes that I need to have them in my monitoring project.However, based on my previous experience: Once I have created a catalog item with selected attributes. Then I had to add new attributes according to my project needs.Β I have run the monitoring project again with new attributes of catalog item, then I lost my monitoring project. It showed errors for all DQ rules because as I understood from error message, DQ rules need to have attribute key ids, and with adding new attributes I have changed attribute key ids.Β Now, again I have a huge catalog item and I want to reduce the volume with selecting few attributes but I donβt want to face with the same problem again. If you have any suggestion it would be so great for me.Β Thanks !
Hello all,Β i have datalake gen2 parquet files in containers and folders. In the folder are delta.log file and parquets. Is there some way to merge these parquets to one table? This table should represent one current(up to date) table contains data from parquets.Β this is what i see now in ataccama. I want to merge these data to one table.Β Thanks for replies, Matus
I want to create another column using the filter step on the IDE. How do I concatenate foreign characters and fields with different data types into one field.Fields to concatenate is date field, special character (/),Β string and integer fields
Hi We are planning to use Atacamma DQ as a service and would like to use its DQ Engine to query and provide us counts. We would like to build a API call to Atacamma DQ with necessary SQL Query and connection parameters as part of API call, and would like to know if this SQL query can be executed on the Atacamma DQ and provide the results as an output back to API as a response. Please let us know the possibilities.Β Regards,Uma
Hello, is it possible to export a catalog item along with its associated terms? Β As you can see in the screenshot below, I setΒ the attribute calledΒ βlast_update_hostnameβ Β as confidential temporarily for an example, but when I export it to a file, I was only able to see the data values not the terms associated with it.Β Β Β
Hello, how to run the plan below (created using ONE Desktop) on Ataccama Web ?Β Β
Hi,I have a .csv file containing country codes that looks like:countrycode.csvI want to use this file as a lookup. In ONE Web it is possible to use a .lkp file as a lookup (why not just import an excel file there is beyond me). In order to do this I understoond I had to create a lookup builder:Lookup builderββIn the Text File Reader I selected the documented with the encoding (I hope this is the right one?). As for the columns I created nm_lnd and kd_lnd (both string).Text File Reader - GeneralText File Reader - ColumnsAs for the Lookup Builder:Lookup BuilderWhen I run it a .lkp is created but also a rejected.txt with everything that is inside the .csv meaning I'm not able to create the desired .lkp file. What can I do to resolve this? Is there also documentation on how to create lookup using .csv somewhere? I can't find it.
The email notifications starts with βDear Collegueββ¦Β and i was wondering - is there a mail merge kind of thing - that can be done to replace the generic addressing with speicific name of the individual it is being emailed to? And - if it is a role - may be we need to get into role membership to expand into names.Β Has anyone done that?Β
Hi DQC online service experts,I have built an online service that writes data into RDM using Rdm importer.Β I put some validation logic into the component so that it would reject bad records from being written (e.g. value supplied does not exist in parent table).Β The rdm importer is going straight to confirm mode as we need the data to be automatically published and available.Β I've configured the integration output to provide the primary key and my explanation in the case that the component rejects the record.Β The app that is sending the data, are now saying that even if I provide an error explanation, the endpoint still provides a 200 response code. They have some in built error handling capability that they want to use, but they currently can't use it because the server responds 200.Β Is it possible for me to set a different response code e.g. 400, based on the data that is provided in the integration output?
I need to understand the difference between Full and Complex Delta Load in MDM.As per this document on Complex Delta Load,Β Β Delta Dependency ModeΒ Β needs to be setup for each entity. I see there are two options for it -Autonomous and Central. Can someone please explain the difference between these and in what scenario these should be used?I also see thatΒ The engine expects an additional column in the input interface denoting the type of record change (change_type:Β IΒ - insert,Β UΒ - update,Β DΒ - delete).Β Where shall we define these and what how can we identify which records needs which change_type?TIAΒ π
Hello Community!Β I am looking to make a bit of an adjustment to my MMM in DQG version 14.5. Specifically, I would like to add a field for AD groups, so that they are validated at an entity level. I know I can write in AD groups and add them to the entity description (see image below), but I am also looking to enforce that idea.Β The entity summary includes a field to list an AD group, but this does not have any sort of legitimate ties to the actual external group.Any insight on how others have approached this topic or otherwise accomplished my goal is greatly appreciated. Thank you for your time.Β Β Willoh
Hello! I am interested in hiding the global settings from users, at least some of them.Β I know this question has been asked before for version 13, but it was mentioned the approach is quite different in 14.5. Would appreciate any insight you all have.Β
Hi everyone!Im not sure if this is possible, but I have not been able to find a query to find who the stewards are of a particular catalogItem. Specifically I am interested in getting the data owner and then using this in another part of my project.I do have the Attribute Id of the catalog item and my atacamma playground is working I just cant seem to find specifically what query I need the make.Thank you for any help!
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.