Skip to main content

Learn & Share

Discuss data, share best practices, learn, and grow with Ataccama's Community.

811 Topics
H
Universe Traveller
hkulkarniUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
How does change detection work?

Hi, I have a requirement to ignore certain columns to not detect as a change when that field comes with a different values in the message.I tried applying the field in ignores comparison columns as shown below, but looks like when the message came in again with a new value for this field, it still got processed. Are there more steps to be done to ignore a field? Also to highlight, we consume data from Kafka streaming consumer.   

598
A
Ataccamer
3 months ago
F
Universe Traveller
fshahinUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
Add merge component for new entity

Hi All,I have created the logical model (Instance and master layer) and then configured the full load operation. I am now working on Transformations layer. Here for few new entities I can see only the clean and match component are generated automatically. Now I want to add merge component. How do I do that? I have the option to create new component under Files → engine → trans → party_address but then that will be blank and there is no Integration input/ output added which gets generated using the model. Am I missing any step? Just like party_address I have also added party_rel and here I can see all the 3 components. (Please refer the attached picture).ThanksFS

231
O
Ataccamer
3 months ago
T
Data Pioneer L2
ThomasProData Pioneer L2
asked in Data Quality & Catalog ⚙️
Microsoft Teams Notifications - incoming webhook is discontinued for new configurations

Hey all!Now that incoming webhooks within Microsoft Teams is discontinued (Existing configurations will work until end of 2025), is there a plan for how teams will continue to integrate with notifications from Monitoring Projects? This was a big sell to a lot of our users, and now that we are unable to use incoming webhooks for new monitoring projects, I want to see if there is a plan to have a work around, or if it will be not supported in the future.    

544
Cansu
Community Manager
3 months ago
Prasad Rani
Data Pioneer
Prasad RaniData Pioneer
posted in Data Quality & Catalog ⚙️
Day over day changes for certain data

Hello: I have a use case where when the data in a given column - for a key changes from previous day to next day - that should trigger an alert/notification For Ex: Security Ratings, and/or ESG ratings generally dont change for a given security. I have a table that has one record for each day for each security. And the ratings are in the columns of that table. Now - on a regular day - all ratings from previous day should be same for next day, and day after (until it changes). And on the day when it changes - i want to capture that security, ,what field changed - what was yesterday;s value vs todays value. The way - i would like to solve this - is create a SQLCatalog item - with previous day - and current day values combined into one dataset for each security and write scripts to compare them one by one, and report any changes. But I want to know if there is an out of box - date driven compare that can be done for this. 

361
A
Universe Traveller
3 months ago
S
Ataccamer
srija piratlaAtaccamer
published in Data Quality & Catalog ⚙️
How to create a Hyperlink in ONE Web App

Hi everyone, I’m Srija Piratla, Solutions Consultant here at Ataccama.In this post I’m going to talk about how to create a hyperlink for an attribute column in the ONE Web App. Curious? Follow these steps. This example demonstrates how to make a column, such as "Product URL," in the catalog item "Epic Dashboard" clickable, redirecting to the respective web page.Steps to Create a Hyperlink for an Attribute ColumnCreate Metadata Model: First, ensure you have a metadata model set up. You can find detailed instructions for creating a metadata model here. If you need to create a new entity, use the metadata writer step to load the data. Edit the Page Template: Navigate to the page where you want to create the URL hyperlink. In the top right corner of the page, click on the Edit Page Template option.   Add Renderers for Hyperlinks: In the page template editor, add the necessary renderers for hyperlinks. This involves specifying the renderer type for the attribute you want to make clic

230
S
Ataccamer
3 months ago
S
Data Pioneer
sgillaData Pioneer
asked in Master Data Management & Reference Data Management 🛰️
Overrides on records in OGC

Records marked as match_override after being fixed on OGC. When the matching rules changed and subject is reprocessed, these records are being unchanged while they are supposed to match with other records. How do we [omnihealthdata].[dbo].[ids_override_match] and [omnihealthdata].[dbo].[ids_override_property] tables contain these records, did try deleting from these table and rebuild and reprocess with the new match rules but they would not match.

376
S
Data Pioneer
3 months ago
K
Data Pioneer L2
KundanData Pioneer L2
asked in Master Data Management & Reference Data Management 🛰️
effect of changes in golden entity's structure and its impact in determining a golden record

In have a scenario, I need clarifications on:The project has been configured and deployed with the following golden entity and instance entity details:GOLDEN ENTITYemployee_name, stringINSTANCE ENTITYemployee_name, string. The golden entity is related to the instance entity.After deploying, I need to change the GOLDEN entity column - employee_name(String) to staff_name(string) in the ONE Desktop configuration as well as the GUI label. But I dont want to change the instance entity column name. This should be such that the updated staff_name attribute shows the value of employee_name from instance entity record when a golden record is matched. I am not using this attribute to determine a match.Can someone please confirm if this is possible?

796
K
Data Pioneer L2
3 months ago
M
Data Voyager
mauriceKData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Advance Filter functions - Length of characters

Hi there Was wondering how I can use the length function in the Advanced Filtering to filter instance records where they either are under or over a certain length of characters. ie ‘instance record’ LENGTH >= 8 characters

173
M
Data Voyager
3 months ago
K
Data Pioneer L2
KundanData Pioneer L2
asked in Master Data Management & Reference Data Management 🛰️
Git changes in OneDesktop for MDM project

I commit the changes of my MDM project into git regularly, however, I don’t see the changes reflect in ONE Desktop when I Switch branches I.e. if I had committed some changes into a branch and then created an new branch for new changes and commit them. Now if switch to the older branch, I don’t see the changes in Model Explorer-master layer, instance layer, etc. Can someone help me understand why this might be happening?

322
K
Data Pioneer L2
3 months ago
john.efechaobor
Ataccamer
john.efechaoborAtaccamer
published in Master Data Management & Reference Data Management 🛰️
OAuth 2.0 via Keycloak for API RequestsBest Practice

OAuth 2.0 is an authorization framework that allows third-party applications to access resources in a secure manner. Keycloak is an open-source identity and access management solution that provides OAuth 2.0 authorization services. This article will provide steps on how to use OAuth 2.0 via Keycloak for API requests.First, create a client in Keycloak. This client will contain the necessary information needed to make API requests. In the Keycloak admin console, navigate to the "Clients" section and click "Create". Fill in the necessary information, such as the client ID and save the Client.Creating a Client in Keycloak Once saved, change the Access Type to "Confidential". Additionally, modify the Valid Redirect URL, to the base url of the application and an asterisk. For example, if the keycloak url is:Keycloak URL: https://one-3gk1k.worker-01-use1.prod.ataccama.link/auth/Base URL:https://one-3gk1k.worker-01-use1.prod.ataccama.link/The Valid Redirect URI will be:https://one-3gk1k.worker

10711
M
Data Voyager
3 months ago
R
Space Explorer
rajeswarimylaSpace Explorer
asked in Data Quality & Catalog ⚙️
How to get yesterday date

hi Team, i need to get yesterday date in my workflow global variable, can you please help in getting.when i use toString(now(),"yyyy-MM-dd") -- printed me todays date when i use toString(now() - 1 ,"yyyy-MM-dd"), getting error as operator “-” can not be used

362
R
Space Explorer
3 months ago
B
Data Voyager
bazData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Resetting Keycloak admin credentials

Hi,   We’ve lost access to the Keycloak admin user in one of our environments. How do we about resetting the password for the Keycloak admin user.Regards baz

201
Cansu
Community Manager
3 months ago
A
Data Voyager
Akashsingh1991Data Voyager
asked in Master Data Management & Reference Data Management 🛰️
Convert the Ataccama generated fields with date datatype from GMT to EST.

Hi Team, we have defined date type fields and Ataccama store them in GMT timezone. We need data is EST considering our time zone for the client.@Cansu   Could you please let me know how to change this from GMT to EST timezone ASAP.

222
Cansu
Community Manager
3 months ago
D
Universe Traveller
Delbert71Universe Traveller
asked in Data Quality & Catalog ⚙️
How to define data types in Ataccama using regular expression syntax

Hi, I am trying to write some rules to check the data type of attributes within sql tables or flat file columns. I am aware that profiling checks this but I have a requirement to check the data type as well. There don’t appear to be any parse functions in the interface. Any help would be appreciated, I am a noob so please be gentle :)

392
D
Universe Traveller
4 months ago
F
Universe Traveller
fshahinUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
Configure Match for Unrelated entities

Need clarification on below scenario.I have party entity (ID, FirstName, LastName, FullName, CompanyName, Birthdate, SSN),  address entity (ID, Address_1, Address_2, City, State, Zip) and party_address (ID, party_id, address_id, address_type). Party and address are not directly linked but through this party_address. Now I know that we can create match rule using columns of related entity. But in this scenario how do I use Address attributes to create a match for Party?

181
A
Ataccamer
4 months ago
F
Universe Traveller
fshahinUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
Survivorship Configuration

Hi All, Can someone please let me know the steps for configuring Survivorship logic for attributes once records are tagged for merge?I couldnt find much of survivorship details in One MDM document.Thanks,fshahin

325
F
Universe Traveller
4 months ago
M
Data Voyager
Mr.DQData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Configure Snowflake connection to use OAuth via AAD

Is anyone able to configure the Snowflake jdbc connection with OAUTH using AAD?  I’m not clear on how to accomplish the instructions in the documentation.  Can anyone help with screen shots or a section of their runtimeConfig file (with obfuscated secrets, id’s, etc) ?TIA

570
M
Data Voyager
4 months ago
R
Data Voyager
RandomStranger37Data Voyager
asked in Master Data Management & Reference Data Management 🛰️
Survivorship Logic in Ataccama

I’m new to Ataccama ONE MDM and have recently completed the training. I’m currently doing a POC on it and am stuck at two places.So here’s the situation:First, I’m able to load the data but I’m not sure how to update it. Like, lets say I have a person record and after loading it generated Person_ID X23233X. Now, I made changes to some of the data in the same request. For eg, I’ve updated the contact number or the address of the record. Now, when I’ll be loading this same data again I want the ID to remain the same and just update the contact/address data along with Last_Updated _Timestamp. Secondly, lets say I have a record with 2 different phone types, ‘Home Phone’ and ‘Work Phone’, and I’ve loaded it. So, the Person_ID  X12322X will have two contact details associated with it. Now, lets say I removed the ‘Home Phone’ details from the record and send it for update load. So, after updating the same request, ‘Home Phone’ details should be dissociated from the Person_ID X12322X (the cont

814
Cansu
Community Manager
4 months ago
Cansu
Community Manager
CansuCommunity Manager
published in Master Data Management & Reference Data Management 🛰️
MDM Model ❇️

Hi everyone!We are wrapping up our introduction to the MDM series with this post delving into the core of MDM—the Model. MDM is a model-driven implementation, where the model takes center stage, driving the generation of structures and orchestrating crucial processes. Let’s dive in 😎 Unlocking the MDM Model MagicThe MDM Model is the maestro orchestrating the symphony of Ataccama MDM's capabilities. Here's a glimpse of how it weaves its magic: Automated Database Structures: Say goodbye to manual database creation. Ataccama MDM automatically generates database structures based on your model. MDM Workflow Wizardry: Cleansing, matching, and merging—the three crucial phases—are seamlessly handled by the MDM Workflow, automating the orchestration of these intricate processes. Native MDM Services Creation: The model isn't just a blueprint; it's a generator. Native MDM services spring to life based on your model, simplifying service creation and eliminating unnecessary complexities. Con

3002
Cansu
Community Manager
4 months ago
S
Data Pioneer
sgillaData Pioneer
asked in Data Quality & Catalog ⚙️
DQS matching component results

DQS matching component results are not reflected when bundle is deployed and the entity is re-processed. I did re-build the repo with the new Extended unifier but no effect. What could be a reason?

12818
S
Data Pioneer
4 months ago
S
Universe Traveller
sriniUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
Auto Stop on MDM Events

Hello Team,can someone provide insight around the solution to stop the event generations based on the condition, let's say- if MDM system receives / source system sends less than 50K records for mastering then use events to propagate the changes to downstream system else send a batch extract file. knowing the fact that we can delete the events after generating but looking to stop the events conditionally.  

352
S
Universe Traveller
4 months ago
F
Universe Traveller
fshahinUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
Configure Match Rule

Hi All, I am working on an enhancement project where I am adding more source system in existing model. As per the requirement I have added one match rule in Party Match Component at the bottom of existing matching rules and then I executed the component using Run button. Got message that Plans completed successfully. After that I executed load operation with some sample data in source which is passing that last added rule. Execution completed successfully but the records didnt merge. In master table they are present as 2 separate records. Am I missing any step?  Thanks,FS

291
A
Ataccamer
4 months ago
K
Data Pioneer
KarthikeyanData Pioneer
asked in Data Quality & Catalog ⚙️
Reading array of response using Json call

Hi Team, I am trying to json call to read the response of api and process it for further results. This is my example response { "Data": [ { "Name": "Amount", "Id": "12345", "ValueListAttribute_5d": [ { "term": "Attribute", "term_Id": "67" } ], "StringAttribute_00": [ { "definition": "Dollar amount", "definition_id": "5" } ], "BooleanAttribute_18e": [ { "indicator": "true", "indicatorid": "6" } ], }, { "Name": "Amount", "Id": "12345", "ValueListAttribute_5d": [ { "term": "Attribute", "term_Id": "67" } ], "StringAttribute_00": [ {

895
K
Data Pioneer
4 months ago
K
Data Pioneer L2
KundanData Pioneer L2
asked in Master Data Management & Reference Data Management 🛰️
Schedule load in MDM

I have MDM setup and records are loaded using a Full Laod configuration. I need to create a load such that all the records that were added into the source are moved into to MDM hub on a daily basis. The approach being used is to identify all the records updated today and load them into MDM. Can you please suggest if I need to create a Delta Load for this or Full Load works. Also, I need to schedule a run of the load file on daily basis.How can I do it?

221
A
Ataccamer
4 months ago
anna.spakova
Ataccamer
anna.spakovaAtaccamer
published in Master Data Management & Reference Data Management 🛰️
Working with delta changes in Ataccama ONE

Hello everyone, Anna here! I work as a projects consultant in Ataccama and today I put together a guide for you on how to work with delta changes in Ataccama ONE. Enjoy!IntroductionAs part of every project, some kind of integration with other tools is usually required. In most cases, the integration requires synchronization of some data between the tools on regular bases. When it comes to Ataccama ONE, synchronization of assets like business terms or DQ rules may be required – for example with Collibra. It is desired to synchronize only delta changes (changes that happened since the last synchronization) to keep the integration efficient.This article explains how the delta changes can be detected in Ataccama ONE using graphQL queries. There is no simple out-of-the-box delta detection implemented, for that reason multiple graphQL queries are used in plans to achieve this goal.Ataccama doesn’t store a last modified date or similar property within assets. Ataccama creates a History Change

2433
greglvaughan
Data Enthusiast
4 months ago

Badge winners

  • First idea 💡
    Roman Tobisekhas earned the badge First idea 💡
  • First idea 💡
    keithjankehas earned the badge First idea 💡
  • First idea 💡
    Elliehas earned the badge First idea 💡
  • First idea 💡
    David Suenhas earned the badge First idea 💡
  • First idea 💡
    clyormzhas earned the badge First idea 💡
Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings