Ataccama Community | Community

Skip to main content

Product Updates
Events
Training Resources
Groups

Getting Started

10 topics
35 Replies

Learn & Share

787 topics
1831 Replies

From Ataccama

101 topics
42 Replies

Featured 🟣

Recent Posts
Answer Questions

ritguptaData Voyager

Data Quality & Governance ⚙️

Create DQ Rule that checks multiple tables

Hi,I want to create a DQ aggregation rule that checks fields from two different tables for the group by clause. Is there a way to do this directly in Ataccama One Web UI.Thanks!

CansuCommunity Manager

Ataccama Community News 🗞️

Meet our Community Champions✨

Hi everyone! Today, I’m really excited to introduce our Community Champions 🎉 A couple months ago we started building and launched our Community Champions program with the first members of the program @Albert de Ruiter, @Catherine, @may_kwok, and @thomas.prociuk who are all long time Ataccama Community contributors going above and beyond✨ You might have seen them sharing articles on Ataccama best practices, helping other members with ideas and solutions on their questions, participating in events, and more! Community Champions earn access to a private group, exclusive events, rewards, and a champion badge in their profile for their dedication to the Ataccama community 💜 We are very excited to have our first champions, we recognize all community members who have become increasingly active and celebrate of all the questions you’ve answered and the solutions you've offered that have helped others with our Recognition Program. All along the way, you’ve been interacting with our Community

fshahinUniverse Traveller

Master Data Management & Reference Data Management 🛰️

MDM Performance Issue

Hi All,We are facing performance issue while loading and exporting data in MDM. We have around 30 million records. We are loading data in chunks and initial few execution were very quick. After processing 20M we are observing severe degrade in performance. Now even for 10K records the job is taking 8-10 hours for both load and export. We have applied parallelism wherever its possible. Is there any other thing which we need to consider/implement which will enhance the performance?TIA.

ritguptaData Voyager

Data Quality & Governance ⚙️

Access to Transformation Plan

Hi,I am not able to access the transformation plan feature in v15.3 from both the Transformation Plan tab and from the monitoring projects tab. Can someone explain why is there a restriction on creating transformation plans and how can I get access to it?Thanks

Lindsay OwensData Voyager

Data Quality & Governance ⚙️

Slice Time Ranges

Hi - I wanted more information on how to use the slices vs a SQL Catalog Item.The use case being often when I’m leveraging a slice I want to be able to do a start date of >2023 , if it is part of a quality program I want the data to keep updating i.e as new records come in. However, it seems like the slice is only really designed for the ‘previous’ so ignores current records i.e previous year = 2023, and I can’t set the custom date without an end date so it would be limited to a fixed time range.It seems like for the quality program is better served with the SQL CAT ITEM but I was curious if there was value with the slice I was missing or if I could accomplish the same objective with the slice ? Thank you, Lindsay

aish_TFData Pioneer

Master Data Management & Reference Data Management 🛰️

Unable to start keycloak locally on a Azure DevBox

Unable to start keycloak locally on a Azure DevBox, When I run the keycloak.bat file from OneDesktop, it is immediately terminated as per console logs. Can anyone help with the diagnosis?

MelUniverse Traveller

Data Quality & Governance ⚙️

Join a ONE Data table with a Catalog Item in OneWeb

I have a One Data table created by importing data from a .csv file. I need to use some of the data in this table by joining it with an existing Catalog Item by creating a SQL Catalog Item so that I can implement some rules on it. Where you select the source when starting to create the SQL Catalog Item I do not get an option to select oneData. Is it even possible to do this in OneWeb?

Szymon OlejniczakUniverse Traveller

Data Quality & Governance ⚙️

Debugging - setting breakpoints

Debugging - is this possible to i.e. setup some breakpoint and let the application run all the previous steps before selected one?I like using debug function on steps (CTRL+Shift+D). To debug below Step i need to first debug all the previous steps and then i am able to debug the current one.However, if I happen to update logic on some step from the top i then would need to run & debug all the previous steps before i could debug i.e. Multiplicative Regex Matching.Is this possible to automate the manual work here? I would like to create a breakpoint on Multiplicative Regex Matching and each time i could just click a button and it would self-debug from the start to my breakpoint. I looked in your documentation but didn’t found any solution for this. I found some debugging view in ONE Desktop but it doesn’t allow me to add breakpoints.Do i need to configure my debugger somehow to achieve the above? Szymek

CansuCommunity Manager

Getting Started with the Community 👋

Community Recognition Program: Ranks, Leaderboard, Badges, and Rewards🎁

Hi everyone, We have introduced our brand new Community Recognition Program and Badges early this year ✨In this post, you can find out all about the ranks, leaderboard, badges, and rewards that makes our Recognition Program. 🧑‍💻 LeaderboardOur leaderboard features the top contributors of the week and all time community experts who have shared their best practices, tips & tricks, replies & solutions, and supported the community members’ Ataccama journey.The leaderboard is backed by our transparent points system where all members earn points for creating best practice, use case, and any other educational or thought leadership content for the community, providing an answer to another members question, sharing their thoughts as a reply, by receiving a like for their post or a vote on their product idea. 🪜 RanksMember ranks are earned through engagement and participation in the community🤝 Every member of the community is assigned a rank based on their contributions. Our revamp

aish_TFData Pioneer

Master Data Management & Reference Data Management 🛰️

Duplicate instance record IDs with different contact values

Taking reference of CDI Example, I have multiple contact values for the same person and I want all of these contacts to be a part of the contact master entity. I am not sure how the same instance record id will affect this. Will ataccama load both these records? Will both these records partivipate in match logic(same master_party_id, same_contact_type,same contact_value) or will it consider just the first one?Also, if someone can please confirm if the master_party_id is id for master record derived on processing of all party records?

ritguptaData Voyager

Data Quality & Governance ⚙️

Create DQ Rule that checks multiple tables

Hi,I want to create a DQ aggregation rule that checks fields from two different tables for the group by clause. Is there a way to do this directly in Ataccama One Web UI.Thanks!

fshahinUniverse Traveller

Master Data Management & Reference Data Management 🛰️

MDM Performance Issue

Hi All,We are facing performance issue while loading and exporting data in MDM. We have around 30 million records. We are loading data in chunks and initial few execution were very quick. After processing 20M we are observing severe degrade in performance. Now even for 10K records the job is taking 8-10 hours for both load and export. We have applied parallelism wherever its possible. Is there any other thing which we need to consider/implement which will enhance the performance?TIA.

Lindsay OwensData Voyager

Data Quality & Governance ⚙️

Slice Time Ranges

Hi - I wanted more information on how to use the slices vs a SQL Catalog Item.The use case being often when I’m leveraging a slice I want to be able to do a start date of >2023 , if it is part of a quality program I want the data to keep updating i.e as new records come in. However, it seems like the slice is only really designed for the ‘previous’ so ignores current records i.e previous year = 2023, and I can’t set the custom date without an end date so it would be limited to a fixed time range.It seems like for the quality program is better served with the SQL CAT ITEM but I was curious if there was value with the slice I was missing or if I could accomplish the same objective with the slice ? Thank you, Lindsay

aish_TFData Pioneer

Master Data Management & Reference Data Management 🛰️

Unable to start keycloak locally on a Azure DevBox

Unable to start keycloak locally on a Azure DevBox, When I run the keycloak.bat file from OneDesktop, it is immediately terminated as per console logs. Can anyone help with the diagnosis?

Szymon OlejniczakUniverse Traveller

Data Quality & Governance ⚙️

Debugging - setting breakpoints

Debugging - is this possible to i.e. setup some breakpoint and let the application run all the previous steps before selected one?I like using debug function on steps (CTRL+Shift+D). To debug below Step i need to first debug all the previous steps and then i am able to debug the current one.However, if I happen to update logic on some step from the top i then would need to run & debug all the previous steps before i could debug i.e. Multiplicative Regex Matching.Is this possible to automate the manual work here? I would like to create a breakpoint on Multiplicative Regex Matching and each time i could just click a button and it would self-debug from the start to my breakpoint. I looked in your documentation but didn’t found any solution for this. I found some debugging view in ONE Desktop but it doesn’t allow me to add breakpoints.Do i need to configure my debugger somehow to achieve the above? Szymek

greglvaughanData Enthusiast

Data Quality & Governance ⚙️

monitoring project processing custom label

Issue: We receive files to be tested against our DQ rules (Monitoring Projects) every 2 weeks. Each set of files is referenced by its date created (aka 2024-10-01,2024-10-14...). When running Monitoring Projects against these items we only get the Execution Date which can be different from the file date. When extracting data for reporting from ONE we only have the Extraction Date and don’t necessarily know which file date the plan results are for (sometimes have to rerun old files for new rules etc..). Question: Is there a way to add a custom attribute / parameter for when we run the Monitoring Project (at the processing id level) so we can report our DQ results by File date? The 2 options we could think of: In extraction component connect to the catalog items and get the file date which is in the table itself (tried this but we need to extract history so would need file date, catalog item, and Monitoring Project processing id to join with DQ Aggregation Results tasks in the com

Data Quality & Governance ⚙️

Runtime error in JDBC reader: Error creating record

Encountering with Runtime error in JDBC reader, while running the basic profiling for a table from SQL Server. Full Error details -Runtime error in JDBC reader: Error creating record: column type: 'STRING', read value: '<null value>', read object type: '<null value type>', cause: Connection reset Looking for ideas troubleshooting this error.

debashishghoshData Pioneer

Master Data Management & Reference Data Management 🛰️

Update flow for Delta Export

We are getting errors in the delta update flow for party and policy master and this is the error message. “com.ataccama.nme.core.NmeExecutionException: Plan "/opt/ataccama/one/mdm-server-config-13.9.1.221107-11165-6e37fd24/Files/engine/export/Party_Master_Delta.comp" execution failed: runtime.error.sql.instance.processError - Transaction (Process ID 901) was deadlocked on lock | communication buffer resources with another process and has been chosen as the deadlock victim.” Please advice if any help can be provided.Thanks !!

ritesh.ranjanData Voyager

Master Data Management & Reference Data Management 🛰️

Apply Last Changed Date Field Delta Change only on Instance Layer and not on Master Layer

Hi @Cansu and AllIn the event if there is no change in the delta records coming in MDM except one of the Sequence Generated column, is their a way that the date field(Last Changed) gets updated with the date of the new row only on INSTANCE layer and not on the MASTER layer. So, if MDM ingests the delta record in Instance Layer and sees that there are no changes detected on any columns except the sequence column and it has nothing to update the Golden Record already existing then it should update the date field on Instance Layer only and not on Master Layer.Please let me know if you have any additional questions.Thank YouRitesh Ranjan

RoelantVosData Voyager

Data Quality & Governance ⚙️

Reproducing the Term level Data Quality overview from GraphQL

Hi Ataccama community,I’m hoping someone with better grip on the Ataccama GraphQL model can shine a light on this. For internal reporting, we are looking to retrieve data quality details via the Ataccama GraphQL API. One of the requests it to produce an overview of the DQ score across the (rule’s) DQ dimensions. This is basically the same as is shown in the web UI when navigating to the ‘Data Quality’ tab for a Term. It shows the score broken down by dimensions, based on how the rules are defined.What I’m trying to do is retrieve the passed/failed rows at this level, so for each term and each dimension. This would allow me to summarise this into a score per dimension.However, I am unable to get this out of the API.I’ve approached this from both the ‘terms’ and ‘rules’ pathway. In both approaches I always end up with the ‘Overall Quality’ score for each term - not the per dimension details.The ‘rules’ query looks promising, but ultimately only returns the passed/failed records for the

Keep me informed 🔔

- Master Data Management & Reference Data Management 🛰️
- Data Quality & Data Governance ⚙️
- News & Announcements 📣
- Ataccama User Lab 🧪

Upcoming Events 📆

Community Recognition Program ✨

Climb the ranks, earn badges and receive recognition rewards!
Join our recognition program by sharing your best practices, providing solutions, participating in our user interviews, and overall engaging with our community to unlock invites to exclusive events and rewards🎁

Learn more

Community experts

Show full leaderboard

Show full leaderboard

Badges 🏅

Catherinehas earned the badge Community Champion
Albert de Ruiterhas earned the badge Community Champion
ThomasProhas earned the badge Community Champion
may_kwokhas earned the badge Community Champion
Poojithahas earned the badge First idea 💡

Show all badges

Powered by Gainsight

Community Terms of Use & Conditions Cookie settings

Sign up

Already have an account? Login

For Ataccama Customers and Partners

or

Username *

E-mail address *

Company *

Job Title *

A bit about yourself

How did you hear about the Data People Community? *

Ataccama version

Password *

I accept the terms & conditions

loginBox.register.email_repeat

Login to the Ataccama Community

No account yet? Create an account

For Ataccama Customers and Partners

or

Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK