Skip to main content

Data Quality & Data Governance ⚙️

Discuss, learn, ask, suggest, share all things DQ and DG 🔍

  • 533 Topics
  • 1,276 Replies
533 Topics
DannyRyan
Ataccamer
DannyRyanHead of Technical Training
published in Data Quality & Data Governance ⚙️
How to reserve more memory for the DQA IDE?Best Practice

If you experience out of memory errors when processing a large dataset. You can increase the amount of system memory that is available to the Ataccama DQA application.Open dqa.ini located in the root folder of the DQA installation. This file contains the JAVA_OPTS that will be used by the virtual machine on start.Edit Xmx and substitute the number (256 by default) by a higher number for reserving more memory, e.g. -Xmx1024 

400
DannyRyan
Ataccamer
2 years ago
DannyRyan
Ataccamer
DannyRyanHead of Technical Training
published in Data Quality & Data Governance ⚙️
How to reserve more memory for executing plans?Best Practice

DQA plans store data while processing it. This means the more input data there and the more the plan logic multiplies this data to produce desired outputs, the more memory needs to be reserved it.Some of the most memory-intensive steps are Profiling and JDBC Reader.There steps to change the default settings are:Open Window > Preferences > Ataccama DQ Analyzer > Launching. Change the value of the Default memory for launch configuration (MB) to 1024, which is recommended for modern for modern machines. 

510
DannyRyan
Ataccamer
2 years ago
DannyRyan
Ataccamer
DannyRyanHead of Technical Training
published in Data Quality & Data Governance ⚙️
DQ Analyzer for Windows can help you gain valuable insights into your data.Tutorial

Did you know our DQ Analyser for Windows (32 or 64bit) can help you to gain valuable insights into your data, and the application is free to use.Visit https://www.ataccama.com/download/dq-analyzer Some of the features include;Duplicate count Pattern & mask analysis Business rule analysis Numeric statistics Ability to drill down into the data on a per record basis Foreign key analysis Dependency analysis Primary key analysis Concerned about duplicate values in your datasets?Frequency Analysis can tell us that we have a value ‘SYSTEM MIGRATION’ in the customer name column 4551 times. It is clear that these customer names were not transferred into the current system correct - supposedly during previous migration activity.One of my personal favorites for the identification of duplicate records is Group Frequency analysis.Here we can see the same value of 4551 as a group size, with a group count of 1. We can interpret the group analysis as there is 1 value that appears 4551 times.Or usi

660
DannyRyan
Ataccamer
2 years ago
DannyRyan
Ataccamer
DannyRyanHead of Technical Training
published in Data Quality & Data Governance ⚙️
Data Quality Analyzer Tutorial - 4. Email AnalysisTutorial

Learn how to standardize and extract email addresses from a customer data set. Used functions are regex matching, conditions to separate data flows, and merging data flows. 

460
DannyRyan
Ataccamer
2 years ago
DannyRyan
Ataccamer
DannyRyanHead of Technical Training
published in Data Quality & Data Governance ⚙️
Data Quality Analyzer Tutorial - 3. Advanced ProfilingTutorial

Learn how to configure custom mask analysis, enable and configure drill-through, check your data against business rules, and configure primary key analysis. 

350
DannyRyan
Ataccamer
2 years ago
DannyRyan
Ataccamer
DannyRyanHead of Technical Training
published in Data Quality & Data Governance ⚙️
Data Quality Analyzer Tutorial - 2. Understanding Profiling ResultsTutorial

Understand and interpret the information generated in profiling results with the free Ataccama DQ Analyzer (DQA). 

280
DannyRyan
Ataccamer
2 years ago
DannyRyan
Ataccamer
DannyRyanHead of Technical Training
published in Data Quality & Data Governance ⚙️
Data Quality Analyzer Tutorial - 1. Creating a profileTutorial

Get started with Ataccama DQ Analyzer (DQA) and learn how to create a data profile. 

400
DannyRyan
Ataccamer
2 years ago
DannyRyan
Ataccamer
DannyRyanHead of Technical Training
published in Data Quality & Data Governance ⚙️
How to setup email notifications for DQ monitoring projects?Tutorial

Did you know that you can setup email notifications when certain events occur in your DQ Monitoring Projects? There are 4 types of notifications that can be assigned to events; Notification + Email sends both an in-app notification and an email to the recipients in case of the event occurrence. Email sends an email to the recipients in case of the event occurrence. Notification sends an in-app notification to the recipients in case of the event occurrence. Leave the events notification options blank if you do not want to be notified of a particular event occurrence. Process Steps Configure the MMM Module for generating links in emails.Ensure the MMM Module has been configured for SMTP (There is a link to the documentation at the end of this post)Underneath your existing configuration for plugin.email.ataccama.one.addressAdd a new configuration line for plugin.email.ataccama.one.base.url which is the base URL for generating links in emails. The default value is http://localhost:80

4870
DannyRyan
Ataccamer
2 years ago

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings
ataccama
arrows
Lead your team  forward  OCT 24 / 9AM ET
Register now
×