Skip to main content

Learn & Share

Discuss data, share best practices, learn, and grow with Ataccama's Community.

834 Topics
may_kwok
Star Blazer L3
may_kwokStar Blazer L3
asked in Data Quality & Catalog ⚙️
Microsoft OneDrive connection on ONE Desktop?

We are on version 14.2 and trying to create a connection to Microsoft OneDrive, so we can export some data from RDM to it. We are planning to write the data using onPublish plan.We see that Ataccama ONE supports Onedrive in the ONE webapp (https://support.ataccama.com/home/docs/aip/14.2.0/user-guides/one-web-application-user-guide/knowledge-catalog/data-catalog/working-with-data-sources/microsoft-onedrive-storage-connection)But I cannot find a corresponding connection type in ONE Desktop. In here One drive is not an option: How can we set this up please?

771
Cansu
Community Manager
F
Data Pioneer
FCB developerData Pioneer
asked in Data Quality & Catalog ⚙️
Regular scanning of data schemas to detect the appearance of new tables: metadata import

 Hello everyone!In the new version of Ataccama 14.5, how is the configuration done for regular scanning of data schemas to detect the appearance of new tables: metadata import? I need to regularly automatically import tables based on a specific schema that are not in the Catalog Item.I will be very grateful for your help🤗Thank you!

1134
Cansu
Community Manager
H
Data Voyager
hiansenData Voyager
asked in Data Quality & Catalog ⚙️
DQ Rules replication

I got 2 questionsFirst: how can I replicate my DQ rules from one environment to another ? (example: from dev to QA)Second: how can I make the rules automatically replicate to new records on a table ? Like if I have a table with 500 rows and I add 50 more rows, I need to re apply the rules to all the table, instead I wanna make it in an incremental way so only my new records would need to have the rules applied.

592
Cansu
Community Manager
N
Data Voyager
NatarajanData Voyager
asked in Data Quality & Catalog ⚙️
Ataccama in azure cloud

how to be ataccama data integration(migration) to azure cloud?

511
Cansu
Community Manager
A
Universe Traveller
AkashUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
How can we ingest data from RDM tables in ataccama to either to Snowflake or Amazon S3.

My requirement is to get all the RDM tables in Ataccama to Snowflake or to amazon S3.Could anyone please let me know how to do that.

1365
A
Ataccamer
A
Data Voyager
Ajay ShuklaData Voyager
asked in Master Data Management & Reference Data Management 🛰️
MDM Licensing model

Hi Team, Can anyone please help me with below Information on MDM licensing?Is Ataccama MDM licensing model based on number of records that we load form various sources (unconsolidated) or based based on unique profiles in MDM (Consolidated) Apart from number of records, are there other aspects that affects licensing price like the domain that I want to master (Customer/Product/Location etc.), the number of API calls, the number of batch jobs that execute per day, total volume required to host source records + history + merge history etc. ? Any other factor that is required to calculate MDM licensing cost? 

781
Cansu
Community Manager
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
Introduction to ONE Desktop 🖥️Best Practice

📌  Links to the legacy documentation portal are no longer available. Read about the changes and how to access our documentation here.Hi everyone! This week, we are starting a new best practice series on ONE Desktop 🎈🎈In the upcoming weeks, we will cover different features, functionalities, and use cases of ONE Desktop and we’d love to hear your tips & tricks, questions, and feedback in the comments as always!Now, let’s dive into a crucial tool that drives your data quality (DQ) and master data management (MDM) solutions – the ONE Desktop.Have you met the ONE Desktop (formerly known as DQC)? It's an Eclipse-based Integrated Development Environment (IDE) specifically designed for crafting top-notch DQ and MDM solutions powered by Ataccama products.Why ONE Desktop? All the core Ataccama products rely on ONE Desktop for seamless development. It's the command center for bringing your data solutions to life. A Glimpse of the InterfaceThis post is your compass to navigate through the O

4852
Cansu
Community Manager
M
Star Blazer L2
Marnix WisselaarStar Blazer L2
asked in Data Quality & Catalog ⚙️
Where are DQE rules applied when executing (DPE or data source)

We had a internal discussion, but ended up not being 100% sure. So here's the question.When we run DQE on a CI, where are the rules evaluated? Does the DPE get the full data (possibly with filters on the MP?) and the run the rules evaluation IN the DPE. Or does the DPE create a SQL-like statement and does the source DB return the results?As we also run on Hadoop with DPE on Hadoop. Is this the same.

672
Cansu
Community Manager
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
Four Trends that Defined 2023 - Issue #13📰Digest

Hi everyone,  As the holidays are just around the corner, we wanted to share a piece of news that got us thinking! Our latest digest issue covers the trends in 2023 and we are keen to hear your thoughts on it! If you are seeing this for the first time, let me briefly explain our biweekly news digests. Every other week we bring you a piece of select news from the industry and we are keen to hear your thoughts about it 😎 This week on the news:Move to the Cloud, AI and Machine Learning, DevOps, and Data Governance: Four Trends that Defined 2023 by Kevin Kline published in dbta.We are also curious to learn more about what have you been reading recently, or planning to read over the holidays. Enjoy the holidays and let us know in the comments what’s on your reading list 👇🏻📚🗞️

180
Cansu
Community Manager
Albert de Ruiter
Star Blazer L2
Albert de RuiterStar Blazer L2
asked in Data Quality & Catalog ⚙️
Term Suggestions Synchronization

Hi community,I am looking for a bit more clarity about Term Suggestions Synchronization. In the Documentation Portal I read that the synchronization is only relevant after a database restore or ‘by importing any initial content (default, demo, etc.)’.For me it is not clear what is meant with this initial content. Importing a catalog item for the first time, or? Does anyone know?Kind regards,Albert

402
Albert de Ruiter
Star Blazer L2
S
Data Pioneer
sgillaData Pioneer
asked in Data Quality & Catalog ⚙️
DQC - matching component - huge groups

The performance of one of the subject is bad. This what is happening.A new or existing records loaded and it runs matching against 1000 records (one master and 999 slaves) because they are similar and have same master_id 123. So if we think of overall if 500 records are loaded during an incremental load and each have similar conditions, its ending up touching 500000 records and taking several hours. IS there a way to make the record only try to match against the Master record? or other ways to improve the performance? Please suggest. Thank you.

876
S
Data Pioneer
K
Data Pioneer L2
KundanData Pioneer L2
asked in Master Data Management & Reference Data Management 🛰️
Ataccama MDM setup

Hi Team ,Can anyone please help me setup my MDM environment locally .Please help me with the plugins and folder structure .Regards,Kundan 

1184
Cansu
Community Manager
M
Data Pioneer L2
MayKwokData Pioneer L2
posted in Data Quality & Catalog ⚙️
What Ataccama DQC reader/writer step should you choose for Big Data sources?

One of the most common data sources that our users connect to are relational databases, e.g. Oracle, MSSQL, PostgreSQL, etc. For those sources, we usually recommend using JDBC drivers to connect, and use JDBC Reader and JDBC Writer steps to work with the data.But for big data sources, e.g. Databricks, within the Ataccama ONE Desktop environment there are a few different steps available. Ever wondered which one you should choose? Hive Reader and Writer:Hive Reader and Writers are the simplest to configure, but also offer the least options. You will need to specify the exact database, table and column names you want to read from / write to. For the Reader step you can provide some simple where clause in the Filter. Spark SQL Reader:For more complex SQL queries, you can use the Spark SQL Reader. This is not limited to where clauses, but also joins, aggregates etc. Spark Reader and Writer:For even more complex operations, you can use the Spark Reader and Writer steps. They are more complex

1892
M
Ataccamer
M
Data Voyager
MayankData Voyager
asked in Data Quality & Catalog ⚙️
Snowflake features

Ataccama detail document on what all can be done related to snowflake like can we pull tags from snowflake connect to snowflake console from Ataccama?is there any blog or document available on the same. Any limitation related to that

341
S
Ataccamer
S
Data Voyager
SabariData Voyager
asked in Data Quality & Catalog ⚙️
difference between ataccama ONE and ONE desktop

What is the difference between ataccama one desktop and ataccama ONE? 

1001
S
Ataccamer
V
Data Voyager
VikramData Voyager
asked in Data Quality & Catalog ⚙️
Trying to connect to AS400

Hi we are trying to connect to a AS400 source using JT400 jdbc driver for a customer and keep getting "Unable to initialize pool" is there any specific configuration we are missing in DPE? If anyone has done a similar connection in the past then please do share some inputs. Will be highly appreciated.

544
DannyRyan
Ataccamer
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
Your Guide to Monitoring Projects 🧭

Hi everyone! In this post, you will find a curated journey to become a Monitoring Projects expert. Be sure to read all the way to find the community best practices & short videos 🎥 First things first 🪄  Watch & learn under 2 minutes ⬅️ If you have the basics, let’s move on 🏗️   Watch & Learn under 2 minutes: Scheduling Monitoring Projects More best practices from the community What are your best practices or use cases creating Monitoring Projects? Let us know in the comments 👇

1150
Cansu
Community Manager
may_kwok
Star Blazer L3
may_kwokStar Blazer L3
asked in Data Quality & Catalog ⚙️
Does the "Before Script" and "After Script" in JDBC writer step support parameterisation?

I have a use case to use the JDBC writer step to write some data into a MS SQL db.I will need to use the Before and After script feature. (Truncate the table in the before script, then I need to call a stored proc in the after script).And in the after script, I need to construct that based on some value that I calculate in the plan. So it is different every time I run the plan, but I need to keep it consistent.Does this after script support some parameterisation? I have a feeling it won’t but wanted to double check.

672
A
Ataccamer
S
Data Voyager
sandipilagData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Upgrade Ataccama from 13.8 version to higer one (Latest one)

Hi Team,I need to upgrade my ataccama 13.8 to new latest one…. request you to please provide upgrade version download path or URL's. As I am facing some issue on current repository-  ";Cannot instantiate class: com.ataccama.dqc.jms.sqs.SQSInitialContextFactory”

402
S
Data Voyager
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
New to Data Quality? Start here 📍

Hi everyone,  Ever thought about where to start with DQ in Ataccama? Worry no more. Follow the journey we have created for you to take your first steps into becoming a DQ wizard  🪄 First things first - Start with reviewing our Beginner’s Guides 🧠  Let’s try a few rules ✖️➕➖   Explore some use cases and best practices from the community 💜 Don’t forget to check out our Training Resources page to access video resources under 2 minutes on how to create a Detection Rule to Creating DQ Validation Rules 🎥 Next up is… Monitoring Projects - so stay tuned. Subscribe to our forum to not miss out on the latest articles🔔  

1510
Cansu
Community Manager
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
Taking on the Data Quality Challenge in the Age of AI - Issue #12 📰

Happy Friday everyone! We are here with the newest issue of the Data News Digest 🗞️ This week on the news is a new research by Joseph McKendrick “Taking on the Data Quality Challenge in the Age of AI” produced by Unisphere Research. New analytics and AI technology have been one of the highlights in 2023, if not the main discussion topic. There is a rising interest and high levels of investment from companies and while this research touches upon an important conversation it feels like it’s just the beginning. What are your thoughts? Any news you’d like to share? Your take on the latest news? What would you like to see more of? Post it in the comments below 👇

430
Cansu
Community Manager
M
Data Voyager
MayureshData Voyager
asked in Master Data Management & Reference Data Management 🛰️
pgsql not working in MDM template project.

I am working on template project for MDM and i am not able to run the pgsql script in it and i did followed the steps mentioned in this  MDM Example Project - Ataccama ONE Gen2 Platform Latest Kindly let me know if you have any solution for this.   

723
DannyRyan
Ataccamer
DannyRyan
Ataccamer
DannyRyanHead of Technical Training
published in Master Data Management & Reference Data Management 🛰️
RDM Record ValidityBlog

When working with Reference Data table there may be a business requirement to control what kind of values can be input into a given attribute which are checked whenever a user creates or edits records within the RDM application. There are two kinds of validations:  The first kind are called Instantaneous validations. These conditions, e.g., regular expressions or string size are checked automatically when you enter an attribute value. When the input value fails to meet these condition, an INVALID message appears next to the attribute field. The second kind are called Online validations. These are more complex conditions, which are triggered by clicking Validate in the Create detail/Edit detail dialogue or upon closing them. Such validations are performed by DQC plans (using, e.g., phone number or address lookups) or SQL queries in RDM. When the input value fails to meet these condition, a Warning message appears next to the attribute field.Records which do not satisfy online conditions

1303
Joeri
Data Pioneer
Cansu
Community Manager
CansuCommunity Manager
published in Data Quality & Catalog ⚙️
Follow this Journey to Data Governance 👣

Hi everyone,  Are you just starting out with Data Governance or would like to brush off some of your skills? Check out our learning journey below and follow along to improve your Data Governance skills one article at a time⚡ First things first: Let’s start with the basics 📚 Continue with the essentials 🔑 Advance your skills 🔗 Need some brainstorming? Check out our digest issue 🧠 

670
Cansu
Community Manager
K
Data Pioneer L2
KundanData Pioneer L2
asked in Data Quality & Catalog ⚙️
 standardization of volume data

I need to standardize volume data in ml .  I have data in galons,liters and mililiters . Can anyone please help me in this . Sample Volume Data 450ml2L5galon2.8L  Thanks in advance   

472
Ales
Ataccamer

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings