Skip to main content

Learn & Share

Discuss data, share best practices, learn, and grow with Ataccama's Community.

879 Topics
A
Anonymous
published in Master Data Management & Reference Data Management 🛰️
Run Shell ScriptTips & Tricks

When using Run Shell Script task in a Workflow, be careful that this task uses a different expression markup: %expression()% Link to documentation: Run Shell Script

530
A
J
Universe Traveller
jfbaroUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
Differentiate between verified (KYCed) and unverified data? Is that possible?

Hello there,Please, when sending data about a person to MDM, can we differentiate this data between VERIFIED and UNVERIFIED?I mean, unverified DATA should be stored, but it should never overwrite the existing verified data in MDM.Example:User ELON MUSK, 60 years old, elon@tesla.com, California, etc is created as verified data in MDM and master-ID ABC is assigned to his record. Months later someone tries to create a profile and the data is not yet verified, that data would be ELON MUSKK, 58 years old, elon@tesla.com, Texas.   The end result coming from from a “GET” should be ELON MUSK, 60 years old, elon@tesla.com, California, master-ID ID ABCIt would be OK to MDM store that UNVERIFIED Data somewhere, but it should NEVER overwrite VERIFIED data nor consider UNVERIFIED information as correct data to be returned to MDM callers/consumers.I know that other MDMs keep unverified data separated of VERIFIED data, I would like to know what is the recommended way to do this in Ataccama.Any help w

1082
J
Universe Traveller
A
Anonymous
published in Data Quality & Catalog ⚙️
Showing Column Names when Profiling Excel FilesF.A.Q.

Do you profile an Excel file and are you unable to see the column names? DQ Analyzer is not processing the column header and in the profiling results, you see the names of the columns as Field_0, Field_1, etc.You can achieve the desired result by editing the metadata of the file you want to profile.Find the necessary file under the File Explorer window. Right-click on it and choose the Edit Metadata option. Specify the column you want it to start with. You should be able to see that the Name of the columns will change automatically. You can verify the column type, as well. Then you can profile the file.

320
A
A
Data Voyager
ahmingData Voyager
asked in Data Quality & Catalog ⚙️
Default template

Any one can help to create this template using version 13.6?  It show the items clearly.  Our users can know the data presentation without explanation.  However, I can find this template in our current version.

972
A
Data Voyager
A
Anonymous
published in Data Quality & Catalog ⚙️
Data Type Conversions in DQCF.A.Q.

Data type conversions occurrences when working with databases are the natural behaviour of DQC. When reading data from a database (e.g. using JDBC Reader step), the data type is read from the database and transformed into DQC data type.DQC internally works with its own data types. When writing the data back to the database (in such case, JDBS Writer step is commonly used), data type alternation takes place. The rules for data types conversions are defined in SQL Transformation Rules. There is a possibility to change from what exact database types there will be a conversion to DQC types. To redefine the database types from which DQC will transform data into its own data types:Go to Window > Preferences Select Ataccama DQC > Database > SQL Transformation Rules Modify SQL transformation rules of the specific database product you use

570
A
A
Anonymous
published in Data Quality & Catalog ⚙️
How can I find and replace all values without opening the plans?F.A.Q.

You can find and replace using the Search option in the upper panel of DQC.Click on Search and enter the text you would like to replace. Click on Replace, and enter the new text you wish to use as a replacement. Clicking on Preview will display a dialog showing where text was found, and a preview of the XML representation of the plans, before and after the change. You may want to uncheck some of the locations. Click OK.

420
A
J
Data Voyager
jdc122Data Voyager
asked in Data Quality & Catalog ⚙️
How best to use the Purpose function in Ataccama?

Any best practices for using the Purpose function in Ataccama One (webapp)? I see that it is recommended for monitoring projects but when I create a monitoring project I want to be able to search for that tag. Any tips for searching just based on the purpose tag? I’m very new to Ataccama so any and all tips would be appreciated!

1072
J
Data Voyager
jhoppesch
Data Voyager
jhoppeschData Voyager
asked in Data Quality & Catalog ⚙️
Operate on File: INFO Operation

I’m trying to read the file name of a file so I can write it in an email within a Workflow. I’m using the “Operate On File” task. The Operation I selected is “INFO”. I then point to the Source File. Next I’m trying to determine which variable I use to supply to the Send Email task. The Operate On File Documentation says you can use task variables and the example they give is “name”, “localName”, “size”, and “timestamp”. When I try using these variables in the Send Email task they just come across as blank in the email (variables appear to be null). Here is the body of the email I’m using: Name = ${name}localName = ${localName} Two questions:Does any one happen to know what I’m doing wrong in above?Additionally is there a way to pull out a file name within a Plan. I’m using the “Excel File Reader” step. I want to pass along the file name in the flow so I can use it later on. Thanks!

1431
F
Ataccamer
S
Data Voyager
semoData Voyager
asked in Data Quality & Catalog ⚙️
Data profiling - set attribute type

Hi, I’ve just started data profiling with Ataccama One so please bear with me.I have data with technical IDs (e.g. “000123456”, “009876543”,...) in a csv that I imported. The IDs are however interpreted as a number.How exactly can I change the attribute type to text? I have done so when importing the file: but it seems to go to numbers nonetheless.The original file has comma-separated values that are all between double quotes. Thanks for any help! edit: typo

1062
S
Data Voyager
M
Data Voyager
mehalrathodData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Error on Edit Transformation

I am getting the error “Column Name cannot be empty” under StringValue. When I click on the drop down, there’s no options available. 

351
M
Ataccamer
Daniel M
Ataccamer
Daniel MAtaccamer
posted in Master Data Management & Reference Data Management 🛰️
LDAP Integration with Keycloak

What is LDAP?LDAP is directory that stores companies usernames, passwords, email addresses, connection information and much more. It is usually used due to it's ability to allow hundreds of active connections at any given point.In terms of configuration and connectivity, in Ataccama we authenticate/authorize through a 3rd party tool called Keycloak. Items to consider prior to connecting to LDAP - Best PracticeYou first need to understand how your organizations Active Directory is setup. Some pre-requirements needed can include things such as:Do you have a list of groups you need to import? If the answer is no, you may want to speak to your engagement manager from Ataccama to discuss in detail. In short, LDAP groups is a way where we can map Ataccama Roles to a single group. This will heavily assist in ease of maintenance going forward and not leave your devops team stuck doing manual work such as adding/removing new users each time someone is added/removed from LDAP. Once you have dec

11670
Daniel M
Ataccamer
O
Data Voyager
onipledData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Wait step 2

Hi, is there a method to make a “wait n seconds” between 2 steps?Thanks a lot

481
F
Ataccamer
D
Data Voyager
ddw_MH22Data Voyager
asked in Data Quality & Catalog ⚙️
catalog item not found error

I opened the on-prem AtaccamaONE environment this morning and was looking at recent (auto) profiled catalog items. A majority of them are not found - the error is “Catalog item not found” and the provided explanation is “This catalog item doesn’t exist anymore or someone has revoked your access”. Neither of these cases should be true as I am the only one who currently works in the environment and I’m the one who launched the data discovery on 3/09. This is a recent error - I have not seen this before. Any help you could provide would be appreciated.Thanks.

562
M
Ataccamer
L
Ataccamer
lumir.studnicka
published in Master Data Management & Reference Data Management 🛰️
ONE Desktop Git recommendationsBest Practice

GeneralIt is strongly recommended not to place an Eclipse Project directly inside the git repository.That means, avoid having .git directory and .project file at the same level - instead, place the project into a sub directory.On the other hand, there are particular config files which you typically keep at the same level as .git directory:  .gitattributes and .gitignore. We use them to control some processes when working with Git. Note: settings in these files will override any git global settings on your computer.Example of recommended setup is as follows: .gitattributesThe file provides a possibility to control certain operations in the git repository. Especially it is important to keep the line endings (prevents Git from normalizing them) as provided in the Ataccama default Eclipse Project content because:Prevents the "The project signature is invalid" issue resulting into a state when you are not able to see/work with the Project at all (entire project tree is not visible). Prevent

5160
L
Ataccamer
K
Data Voyager
kumaritarData Voyager
asked in Data Quality & Catalog ⚙️
For or while loop in detection rule

How can we use functionality like ‘for’ and ‘while’ loop in detection rule field while writing/creating rules for capturing data/records.

933
A
Ataccamer
O
Data Voyager
onipledData Voyager
asked in Data Quality & Catalog ⚙️
JSON Call. Get Method dynamic parameter

Hello, I’m new with Ataccama and I have a simple problem. I want call a Rest service:https://api.bulkemailverifier.com/api/a/v1?key=xxxxxxxxxx&email=myemail.comI’m using the JSON Call step and If I put the full URL with my email it’s working, but now I want read the emails forma txt file and I don’t know how to make the url dynamic.In the step I have 3 parameters: URL: Resource  I set it as https://api.bulkemailverifier.com/api/a/v1?key=xxxxxxxxxx&email=Method: GETURL: HERE IS WHERE i DONT KNOW WHAT TYPE. I have tried a lot of combinations without successThe input file has one column with the mail: src_mailThanks 

2543
O
Data Voyager
M
Data Voyager
mcvinothData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Multi Language support

Hi,Am exploring Ataccama MDM and would like to know if Ataccama MDM supports Multiple language in matching and data maintenance. Appreciate your help. Thanks.Vinoth

582
M
Data Voyager
A
Data Voyager
ashpoghoshData Voyager
asked in Data Quality & Catalog ⚙️
Copy File from remote location

How can we download files from remote path ( connected through vpn) on to local?I tried with Operate on File component but it is not working.Is there any work around for it?

431
Anna_Nebesova
Ataccamer
K
Data Voyager
KranthiVardhan.MagatiData Voyager
posted in Master Data Management & Reference Data Management 🛰️
RDM Import functionality is loading '?' characters in various instances

Hi,When importing a flat file, if the data has double quotes or single quotes or some special characters then they are automatically being replaced with ‘?’s. This is not as expected. This is the same issue for all encoding formats. Could you please suggest how to fix this? Thanks,Kranthi 

671
K
Data Voyager
Luca
Ataccamer
LucaAtaccamer
posted in Data Quality & Catalog ⚙️
Data Governance & why we need it

Enterprise Data Governance as the management of data across its pipeline - from production to consumption (and retirement). How to enable our “data fellows” to leverage on data to save money, save time and reduce risk?What are the key elements to success? What are your thoughts? 

1643
D
Data Voyager
A
Data Voyager
anu1237Data Voyager
asked in Data Quality & Catalog ⚙️
Rows to Columns

I was wondering if there is a way in Ataccama that I can move my rows data into columns?I’ve data as such:Element:          Dimension:                 Values:         Code: XYZ            Validity                        200               678XYZ            Completeness              250               678 YUP            Completeness            300                555 HIO             Accuracy                     400                100 I’d like it to look like:Element:          Validity:                 Completeness:        Accuracy;         Code: XYZ                 200                               250                         250               678 YUP                500                                300                        300                555 HIO                 200                                450                        400                100 Thank you!  

1051
T
Ataccamer
DannyRyan
Ataccamer
DannyRyanHead of Technical Training
published in Master Data Management & Reference Data Management 🛰️
What is Reference Data?Blog

Simply explained, reference data is data that serves as the model for all other data throughout an organization. It is contained within tables and databases, which help bridge one source system to another, and provides the foundation for the entire data architecture. Together with the initiative set forth by the overall data governance program, reference data maintains consistent data across all departments and allows for source system inter-communication. Reference Data tables are entities that compose the framework of the reference data architecture, providing lists of values for each department and the company as a whole. They contain either the backbone data in its base form (central authority) or data that is a derivative of the base-form data (tables used in the various branch systems throughout the enterprise).Each department within a company works with table data fields in a particular format that suits their processes. Although department A might deal with the same product as

981
Luca
Ataccamer
hoo
Ataccamer
hooAtaccamer
posted in Data Quality & Catalog ⚙️
Why Pie charts are evil?

Data Stories provides a wide range of charts, it includes also Pie and Donut ones, even though I do not recommend using them, and the same applies to a Gauge chart. Let's look at the reasoning why and why I'd recommend using a (stacked) bar chart instead.Space usageIn data visualization (reporting, data storytelling) you have limited space you can use. Your task is to fill the limited space with the most value for the end viewer/user. Note, most value does not necessarily mean most charts, sometimes one curated chart is far better than five. The problem with Pie, Donut and Gauge charts is that they use more space in comparison to an alternative that provides the same value - a bar chart. Sales distribution on a Pie ChartMore space is used due to 2 reasons:Pie and Donut charts use Area to give value to a single category. Bar chars use just distance. An Area just takes more space All these charts are circular, which creates unnecessary space around the chart objectBellow find a better al

1534
hoo
Ataccamer
N
Data Voyager
Neeraj SinghData Voyager
posted in Data Quality & Catalog ⚙️
Use of Joiner in component rule

I am trying to build a component rule where I can compare primary_id from catalog table A to another table B using join and send primary_id existing in both tables, existing only in catalog table A and existing only in B table in the one report. Also checking if that is possible through Lookup

410
N
Data Voyager
M
Data Voyager
mehalrathodData Voyager
asked in Master Data Management & Reference Data Management 🛰️
How to create user groups

We would like to have a user group in AtaccamaOne so that when new people join, we do not have to manually add them for access of rules, catalogs or projects. Simply adding them to a user group should give them all the necessary access. How to create such a user group?

1281
A
Data Voyager

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings