Skip to main content

Product Updates
Events
Training Resources
Groups

Home
Learn & Share

Learn & Share

Discuss data, share best practices, learn, and grow with Ataccama's Community.

811 Topics

CansuCommunity Manager

published in Data Quality & Catalog ⚙️

Import Monitoring Project Configurations Part 3️⃣Best Practice

Hi everyone! In the last part of Monitoring Projects Configurations, we will talk about how to easily import configurations from one monitoring project to another, making your data quality monitoring more efficient. If you’ve missed Part 1&2 you can find them below:Import the Configuration Instead of creating a new project from scratch, you can copy the configuration of one monitoring project and apply it to another. This is particularly useful when you want to replicate settings from a testing environment to a production environment. The copied configuration includes all checks, invalid samples, reports structure, and DQ filters.To import the configuration:Navigate to the project where you want to apply the configuration. Expand the more options menu and select Import configuration. Choose the monitoring project from which you want to copy the configuration, from the list provided. Check if the preselected catalog items are correct. You can modify the list by deleting items or

mahesh ArData Pioneer

asked in Data Quality & Catalog ⚙️

Pivot every 13 rows into one row in target.

The source csv file has splitted into 13 rows for each actual row in target.By using Ataccama one desktop we would like to pivot the data by sending source 13 rows into one row in target. I am trying to implement the logic below in the Text file reader step but it's not working . v_RowNum = iif(v_RowNum IS NULL,0,v_RowNum+1) -------- Initialize v_RowNum to 0 if NULL; otherwise, increment it by 1 for each row.v_CurrentNumber = iif(v_CurrentNumber%13= 0, v_CurrentNumber+1, v_CurrentNumber ). -- Increment v_CurrentNumber by 1 for every 10 rows.GENERATED_NUMBER= v_CurrentNumber GENERATED_NUMBER INTEGER Please help us to make it work in Ataccama one desktop .

CansuCommunity Manager

published in Data Quality & Catalog ⚙️

Monitoring Project Configuration Part 2️⃣Best Practice

Hi everyone! In this continuation of our best practices post on Monitoring Project Configuration, we will explore additional settings and actions to ensure seamless data quality monitoring.Check out the part one of the series if you’ve missed it:Disable Rule SuggestionsPower users can disable rule suggestions in monitoring projects. For more details, refer to the link provided in the text. Set Partition DefaultsFor partitioned tables in monitoring projects, identify them with the provided icon. Define default analysis for partitioned tables using the more options icon and selecting either Last partition analysis as default or Full analysis as default. These settings will be applied when running the monitoring project. See the link provided for more information. Anomaly DetectionWhen running anomaly detection during monitoring projects, choose between the time-dependent model or time-independent model. Configure the sensitivity of the detection as well. For further details, check out th

pdanpoonkijData Pioneer L2

asked in Data Quality & Catalog ⚙️

Questions for Ataccama One Power BI connector

Hello community,I’m creating a Power BI source on Ataccama One and have a few queries:Is the built-in Power BI connection allow One to retrieve a Power BI datasets? Or this is strictly for only bringing the Power BI reports to One? The imported catalog items from this connection shows “0” number of attributes and “-” number of records (screenshots below). This is also presents in the the screenshot from the Ataccama support page (link). Is this behave as intended or am I missing anything here?Thank you in advance.Ben

mahesh ArData Pioneer

asked in Data Quality & Catalog ⚙️

Pivoting all rows into columns in target.

My input file is in the below structure and looking to pivot all rows into columns. No name 1 value1 2 value2 3 value3 4 value4 5 value5 Expecting output should be like Col1 Col2 Col3 Col4 Col5 value1 value2 value3 value4 value5 What will be the best approach in Ataccama One desktop? Looking for support and help..

mahesh ArData Pioneer

asked in Data Quality & Catalog ⚙️

I have to write below Multi array list in to a file through JSON call.How can I perform this?

Json : [ { "Headers":[ "Empid", "Name", "dept", "EMAIL" ], "ID":"Table_112", "Rows":[ [ "100", "John", "Finance", "John@gmail.com" ], [ "101", "Smith", "HR", "Smith@gmail.com" ], [ "102", "Derek", "Marketing", "Derek@gmail.com" ] ] }] Expecting the output in below format:Empid Name dept EMAIL ID 100 John Finance John@gmail.com Table_112 101 Smith HR Smith@gmail.com 102 Derek Marketing Derek@gmail.com I have created a plan with below details:After running a plan with JSON CALL step below response file got created. Based on response file i have given below columns in Data Streams I am not getting the out put what i expected. Appreciate your help and support .

Jason.SupticUniverse Traveller

posted in Master Data Management & Reference Data Management 🛰️

EXTRA_DATA error or warning

The EXTRA_DATA error/warning was a thorn in my side for the last couple of days. I added a column to a dataset I was loading to a model from a Text File Reader, and I could not figure out for the life of me what I was doing different from before the column add. It turned out, where I was trying to unselect data was too early.Problem: Suppose you are bringing in a delimited file to use in a Text File Reader that has an extra field at the beginning, which you don't want to have in your output. Finding the correct place to disable this data can difficult. If you disable it before your Text File Reader, or simply don't bring it into your Text File Reader, then you run the risk of getting an error or warning that states EXTRA_DATA for every row you try to bring in, as seen below.I have seen the EXTRA_DATA error in 3 scenariosDeselecting the “Use” box in the Metadata definition on columns you don’t want. Selecting all columns in the Metadata definition, but not bringing the column into your

CansuCommunity Manager

published in Data Quality & Catalog ⚙️

Getting Started with Monitoring Projects 🎢Best Practice

Hi Community!In the next few days, we will discuss Monitoring Projects, a powerful tool to evaluate and monitor data quality over time for selected catalog items. Monitoring projects use DQ checks, automatic anomaly detection, and structure checks to maintain data quality. We also have a short video introduction to Monitoring Projects, go check it out here 👇 If you are ready, let's dive in 🤿 Accessing Monitoring ProjectsTo access Monitoring Projects:Go to the left-hand menu and select Data Quality. Choose Monitoring Projects. In this section, you'll find all configured projects. If you want to start a new project, click Create.Each project listed will show the following information:Name: The project's name. Terms: The glossary terms associated with the project. Items: The number of items monitored within the project. Latest run: The date of the project's last evaluation. The current state of a project is indicated through row highlighting, showing if it's published, recently ad

GregersData Voyager

asked in Data Quality & Catalog ⚙️

License issue with free desktop version of DQ analyzer

HiI have with great success been using your free desktop version of DQ Analyzer.But the license has run out. Last time I had this issue a new download and a re-installation solved it.I have tried to do the same, but it did not work. See issue “DQ analyzer windows version update” for further details.Any advice what to do?

PiotrPietData Voyager

asked in Data Quality & Catalog ⚙️

Is there any option to set up diffirent 'Teams' channels for each DQ Monitoring project ?

I would like as an example to have one ‘MS Teams’ channel for one DQ Monitoring to reach out different groups of people tus set up diffirent Teams connections Is there any option to set it up in the current version? cheersPiotr

CansuCommunity Manager

published in Data Quality & Catalog ⚙️

Scheduling Lookup Item Rebuilds and Managing Lookup Files 🗃️Best Practice

Hello Community! In this second part of the lookup best practices series, we'll cover how to schedule automatic rebuilds of Lookup Items and provide some useful tips for managing your Lookup Files effectively. If you’ve missed the first post you can check it out here: Scheduling Lookup Item RebuildsAutomating the rebuild process of your Lookup Items can save time and effort. To schedule automatic rebuilds, follow these steps:In the Lookup Item, select the more options icon, and then click Schedule. In the sidebar, choose Add scheduled event. Set up the scheduled events for the rebuilding of lookups. For more details, refer to the Scheduler documentation.Managing Lookup FilesEditing Lookup FilesOnce Lookup Items have been uploaded, you can edit them manually or reupload the files if necessary. To edit the lookup manually: Select the required item. Click the more options icon, then choose Edit. To reupload the lookup item: Select the required item. Click Upload new version

MarcelData Voyager

asked in Data Quality & Catalog ⚙️

AVG and avg not working

Hi guys, I'm doing the dq foundation course and I'm stuck.I have tried to look it up, but no result.This is on an environment in the portal.When I'm doing, with AVG or avg, this:It says:How do I make this work? Kind regards,Marcel

mdaflucasData Voyager

asked in Data Quality & Catalog ⚙️

How do I evaluate multiple columns for possible composite primary key?

I have a legacy database without primary keys. I know how to evaluate a single column for uniqueness, and thus a primary key. How do I evaluate multiple columns which together would be unique and thus be a composite primary key?

bazData Voyager

asked in Master Data Management & Reference Data Management 🛰️

Displaying a list in a drop-down

Hi, How do I present a selection of values in a drop-down in the RDM create/edit screens.E.g. I have an entity called Door with a column called state that can have a value of either Open or Closed. Can this be presented as a drop down to a user?baz

GregersData Voyager

asked in Data Quality & Catalog ⚙️

DQ analyzer windows version update

HiI’m running your free version of DQ Analyzer, but when I want to run my profiles this can’t be done. As I understand it, it is due to a needed version update.Can you advice how I get my license key updated and not losing my existing profiles and still running the free version?I do not want to install Ataccama One.

CansuCommunity Manager

published in Data Quality & Catalog ⚙️

Lookup Items and Rules ✍️Best Practice

Hi Community!We are starting the week by exploring best practices for effectively working with Lookup Items and integrating them into your Data Quality (DQ) rules. Lookups are essential in ONE Web Application as they provide a list of predefined values for attributes, enhancing data validation and detection capabilities.If you remember we have previously covered how to create Lookup files in rules in our Working with DQ Rules series, today we will expand on the lookup items feature. Overview of Lookup ItemsLookup Files in ONE Web Application enable you to use reference data, offering a catalog of predefined values for an attribute. You can utilize Lookup Files in both DQ Evaluation rules and Detection rules. To find Lookup Files, go to Data Quality → Lookup Items. Uploading and Creating Lookup FilesCreating Lookup FilesTo create a Lookup File, follow these steps:In Knowledge Catalog, navigate to Data Quality. Select Lookup Items and click Create. Provide the required details, such as

OjaswiniStar Blazer L1

asked in Master Data Management & Reference Data Management 🛰️

RDM: The capability to create a new record with a unique Primary Key column through the UI, accompanied by the restriction of disallowing any subsequent edits to the Primary Key ID.

Dear Community,I require your assistance with a specific scenario in RDM (Record Data Management).We have a table in RDM that allows users to create, edit, and delete records, which are synchronized back to the database. This table contains a primary key ID column. During the creation of a new record, the user provides the Primary key value. However, the challenge we face is that this primary key column should not be editable afterward to maintain its uniqueness as a key.We attempted to restrict column-level permissions, but this resulted in the Primary key column not being visible even during the creation of a new record.I would appreciate your guidance on this matter.Thanks very much.Ojaswini

anna.spakovaAtaccamer

published in Data Quality & Catalog ⚙️

Migration of permissions from version 13 to version 14Tutorial

Hello everyone, Anna here! I work as a projects consultant in Ataccama and today I put together a guide for you on how to migrate permissions after upgrade of v13 to v14. In v14, we introduced a fresh new permissions model introducing Groups and Stewardship. The downside is, though, that after the upgrade the old permissions model cannot be automatically migrated into the new setup.Attached to this guide is a migration package – a set of plans that you can use that will help you through the process of migrating the old permissions into the new setup in more automated way. It is not meant for fresh v14 installations.The article is split to two parts:Preparation phase – steps you need to do BEFORE you upgrade your environment to v14. Post-upgrade phase – steps you need to do AFTER the upgrade, meaning in your new v14 environment.Preparation phaseFollowing steps should be run on version 13 prior running the migration scripts and upgrade of the environment.1. Create server connection in ON

sandipilagData Voyager

asked in Master Data Management & Reference Data Management 🛰️

MDM Server start issue

Receiving error when trying to start ataccama server: Description:Parameter 1 of constructor in com.ataccama.mdm.core.SpringServerConfig required a bean of type 'com.ataccama.dqc.server.config.ServerConfigImpl$IServerConfigConfigBeanProvider' that could not be found.Action:Consider defining a bean of type 'com.ataccama.dqc.server.config.ServerConfigImpl$IServerConfigConfigBeanProvider' in your configuration. Need help on this please?

Jason.SupticUniverse Traveller

published in Master Data Management & Reference Data Management 🛰️

RDM Table Enrichment with Null Value

Let me start with the fact that I am new to developing Ataccama RDM (as in a couple months into development/learning).Problem statement: I am working on a project for creating new RD in the RDM module, and came across an instance where I needed an Enrichment that could not only fill in a field in the request, but could also delete the data in that field. I attempted many different methods, and could not get it to work, as having the field blank it would be considered a null value. After looking through the XML for the enrichment, I found that the column I was trying to set to null was set up in such a manner as to not allow null values (which appears to be the default in Ataccama RDM).Solution: When creating an Enrichment there is an .online file that is created for deployment in the online application services. In this file, there is a setting for Strategy. The default for Strategy → Output Format → Root Section for each column is set to Optional Element, which does not allow null/bla

CansuCommunity Manager

published in Data Quality & Catalog ⚙️

Introduction to Working with Components - Desktop Edition⛏️Best Practice

Happy Wednesday Community!Today’s post will cover how to work with component rules on ONE Desktop Application. If you missed yesterday’s article we had an introduction to working with components on ONE Web. Check it out here: Component rules play a crucial role in tackling complex data validation tasks that may go beyond what standard DQ rules in the web application can handle. By leveraging component rules, you can define custom validation logic tailored to your specific data quality requirements.To ensure accurate and effective results, follow these best practices when working with component rules:1. Creating a Component Rule on ONE DesktopTo create a component rule, follow these steps: Open ONE Desktop and add Ataccama ONE Platform Server by creating a new server connection. Navigate to the ONE Metadata Explorer tab. Select the component you've created in ONE Web Application (e.g., "Email Check" in this example). For more information on creating a component in ONE Web Applicatio

CansuCommunity Manager

published in Data Quality & Catalog ⚙️

Introduction to Working with Components ⛏️Best Practice

Hello everyone! Welcome back to our Data Quality (DQ) series. Today, we're diving into component rules!We're also excited to announce that we'll be hosting a live training session on component rules on July 27th. Don't miss the opportunity to learn from our certified trainer and engage in live Q&A. Register now here! Component Rules, also known as components, are a powerful feature in the ONE Desktop application. They serve three key data processing purposes: Post-processing components: These components allow you to perform various actions on your data after processing it based on predefined rules. You can easily apply transformations, validations, or any other required post-processing steps. Transformation components: With transformation components, you can automate the process of transforming data records according to specific rules. For instance, you can standardize gender markers to "M" and "F" while transforming any other variations to these standard values. Validation co

ritguptaData Voyager

asked in Data Quality & Catalog ⚙️

Row Count Comparison Between Source and Target

Hi,I want to compare the number of not null records in source (custom sql using JDBC writer) and target (salesforce object) using a VCI. Is there any way to do that in Ataccama version 14.1.0. The aim is to get the records which are in source and not in target and records which are in target but not in source.Thanks.

AkashUniverse Traveller

asked in Master Data Management & Reference Data Management 🛰️

RDM Web App deleting the data

In RDM web app, I see State column as waiting for confirmation as its not getting published due to data error.I am manually deleting record one by one by going to Problems section in web app.Can it be deleted in bulk and please tell me the procedure.

AkashUniverse Traveller

asked in Master Data Management & Reference Data Management 🛰️

Add table in RDM web application.

How to add a new table by uploading a excel file data in RDM web application which is already having a list of existing tables.Also, could you please help how to add a new business user in RDM web app via keycloak who will have access to RDM tables to edit records.@Cansu please help

1
...
19
20
21
22
23
24
25
...
33

Page 22 / 33

Badge winners

Roman Tobisekhas earned the badge First idea 💡
keithjankehas earned the badge First idea 💡
Elliehas earned the badge First idea 💡
David Suenhas earned the badge First idea 💡
clyormzhas earned the badge First idea 💡

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more

Powered by Gainsight

Community Terms of Use & Conditions Cookie settings

Sign up

Already have an account? Login

For Ataccama Customers and Partners

or

Username *

E-mail address *

Company *

Job Title *

A bit about yourself

How did you hear about the Data People Community? *

Ataccama version

Password *

I accept the terms & conditions

loginBox.register.email_repeat

Login to the Ataccama Community

No account yet? Create an account

For Ataccama Customers and Partners

or

Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK