Skip to main content

Product Updates
Events
Training Resources
Groups

Home
Learn & Share

Learn & Share

Discuss data, share best practices, learn, and grow with Ataccama's Community.

770 Topics

Recently active

Most replies Most views Newest first

Jason.SupticUniverse Traveller

posted in Master Data Management & Reference Data Management 🛰️

Errors in LKP file with multiple columns

Howdy Ataccama community:Today I am creating an LKP file with multiple columns for the first time, and came across a couple rookie mistakes I was making, and wanted to share the warnings and errors I am getting.The file I am making is a simple mapping file going from the key to a field “PH1”Rookie mistake number 1: The file being used to make the lkp is a csv, and I made the assumption the Text File Reader in the lookup builder plan would recognize this from the file type. It did not, it had the separation of columns as \t (tab) still. This created the warning [EHS:SHORT_LINE][step:Text File Reader][line:1] with a row for ever row in my file. To fix this one was simply setting the “Line Separator” field in the Text File Reader to a comma instead of \t.Rookie mistake number 2: After correcting my first mistake, I was now getting the following error “There were logged 1 runtime warnings and 1 runtime errors.” With the details being “Error sending response” with no info on why. I got frus

babamarData Voyager

asked in Data Quality & Data Governance ⚙️

Snowflake key pair authentication

Hello,I’m setting a new connection for Snowflake datasource, and I need to use key pair authentication for this.In the credentials drop-down menu it doesn’t look like this option to be present: What do you advise?

mahesh ArData Pioneer

asked in Data Quality & Data Governance ⚙️

Ataccama and workday integration

By using one url we imported multiple tables structure from workday into Ataccama. if we need to query any specific imported table in ataccama is ataccam will dynamically updates the API endpoints ?

Marcel-JanStar Blazer L2

posted in Data Quality & Data Governance ⚙️

Ataccama source monitoring

At our site we have Ataccama on premise and several sources from different data systems. It happened a couple of times that profiling on one of the sources was no longer possible and that we found that out more than a week later. After which it was difficult to track back why this happened.We do have monitoring of all kinds of Ataccama components with Prometheus. But that didn't seem to detect these issues. I was looking for a way to monitor profiling functionality.So what I came up with was a monitoring project that profiles a small table from each source, every hour.Since you can schedule a monitoring project every hour at least, and since you can add notification in case of failure, this gives us warning at most near 1 hours after something breaks.Just adding a catalog item of a table to the MP turned out not to be sufficient though. Because when the monitoring project ran, it did only a structure check, not a profile. To get it profiling, it needed an anomaly check.When you do an a

Marnix WisselaarStar Blazer L2

asked in Data Quality & Data Governance ⚙️

Hiding the Global Settings or at least users for all viewers

We have a question. The basic viewer can view the global settings and with that also a list of users. We'd rather not share this info with the basic viewer. How can we change this?

Jason.SupticUniverse Traveller

posted in Master Data Management & Reference Data Management 🛰️

Grey out fields for edit

Howdy Ataccama Community!Have you ever wanted to have a user see a field while in edit mode, but want to have it greyed out for editing? This problem arose while we were working with a Primary Key that needed to be seen in edit mode but never edited. The only way for a field to be seen in edit mode, is to set it to Modify in the permissions, but we did not want the user to modify. Problem: Show all fields in Edit mode, but only have certain ones editable.Solution: Begin by deploying your project and populating any tables with initial loads as needed. Next go back to OneDesktop IDE, and open the table you are wanting to make some fields non-editable. For the fields you want to make non-editable select Generated. While this sounds like it will auto generate the field, I assure you it does not.Now generate and deploy your project again (remember to generate at the App Configuration level).Note: You might need to stop and restart services for the change to take effect. While I was testing

mahesh ArData Pioneer

asked in Data Quality & Data Governance ⚙️

How can we handle csv output from API response

How can we handle csv output from API response?I tried to use json call ,SOAP call but it didn't work.Anyway, can we handle in One desktop csv output from API.

CansuCommunity Manager

published in Data Quality & Data Governance ⚙️

Mastering Anomaly Detection in Your Data Catalog📔Best Practice

Hi Community! Yesterday we took a step into Anomaly Detection, what is it, and how to use it. If you’ve missed that post, go check it out here:Today, we will have a short summary of what we covered yesterday with a focus on the Data Catalog.Spotting the Unseen: Anomaly Detection DemystifiedAnomaly Detection is like having a data detective, tirelessly examining your catalog items for any unusual activities. It operates on two levels:Catalog Item Level: Analyzing key metrics like the number of records and summary statistics. Attribute Level: Delving into value distribution, standard deviation, numeric sum, and more.Whenever a metric's value behaves abnormally, it raises a flag. But wait, there's more! Our AI-driven Anomaly Detection system, fondly known as "ONE," is a quick learner. With every confirmed or dismissed alert, it refines its understanding of your data's unique quirks. This means more precise anomaly detection with each profiling session.Customizing Anomaly Detection to Fit

lsmall028Data Enthusiast

asked in Data Quality & Data Governance ⚙️

AQL for Purpose Tags

Easy question: I used to be able to use this AQL search to look up tables with specific purpose tags, but it’s no longer working with the upgrade to 14.3. Does anyone have a suggestion? Here is the AQL search I used: dataInstances.any(displayName = '[Purpose Tag]')

CansuCommunity Manager

published in Data Quality & Data Governance ⚙️

Mastering Anomaly Detection: Unveiling Data Inconsistencies 🔎

Hi everyone!A new week means new best practices! This week we will focus on Anomaly Detection to our new Data Dictionary so if you haven’t started to follow our forums - click on Subscribe now to not miss out on any news 🔔 Easiest way to follow us is by selecting all forums you are interested to follow from our homepage and hit subscribe. Now let’s dive in! Anomaly detection is a pivotal tool for ensuring data accuracy and quality by identifying irregularities and inconsistencies within datasets.Why Anomaly Detection MattersAnomaly detection is your safeguard against data discrepancies and plays a crucial role in maintaining data quality and relevance. With this service, you gain the following advantages:Swift Issue Resolution: Users are promptly notified of potential data discrepancies or pipeline variations, enabling timely problem resolution. Enhanced Data Quality Monitoring: Monitor your dataset's quality to ensure its alignment with actual data conditions. This, in turn, improves

Mayank VermaData Voyager

asked in Master Data Management & Reference Data Management 🛰️

Looking for a training on Ataccama MDM tool

Hi All,I want to learn the implementation of ataccama MDM. Is there any learning module or instructor who can provide training is available in India.If yes, please do let me know. Thanks,Mayank Verma

Lisa KovalskaiaAtaccamer

published in Data Quality & Data Governance ⚙️

How to organize assets in ONE web app: adding columns and filters in Business Glossary

Adding more details to a list view and providing additional filtering options can help business users in their daily tasks as you scale Data Governance across multiple teams, geographies, or business functions.In this article we’ll customize the Business Glossary to show additional term attributes as columns in the list view and to enable filtering by those attributes. This approach generally works across the Ataccama ONE Web app, so you can use this article as a guide to customize other pages, for example Rules, Catalog Items, or Monitoring Projects.You don’t have to be a developer to follow this guide. If you come across any concepts you’re not familiar with, have a look at our documentation. Adding columns First, navigate to the Business Glossary’s Terms list. In the top right, find the 3-dot menu which features the option to Edit page. In the side bar that opens up, go to the Layout tab. You’ll see the JSON that describes how the objects are shown on this page when the web app load

KundanData Pioneer L2

asked in Data Quality & Data Governance ⚙️

How to extract the root of JSON result which I got from GET api call from JSON CALL step .?I am able to fetch the attributes of root but I am unable to fetch the root itself .

Jason.SupticUniverse Traveller

posted in Master Data Management & Reference Data Management 🛰️

Screen flashing when user tries to log in

Howdy all:Earlier this week we started having an issue when end users were trying to log in to our DEV environment. When they would navigate to the URL, their browser would show Ataccama splash screen, then instantly (and continuously) refresh. When asked to try to ping the URL via the command line, the correct IP was being hit, and there was a low latency reply from the server.Note: This issue occurred using Azure AD.Problem: User navigates to a known good URL for Ataccama RDM Web Application. When the application is reached, Ataccama splash screen shows in browser, then browser starts refreshing every 2 to 3 seconds.Solution: It was found that someone accidentally change the setting in KeyCloak called “First Login Flow.” This should have been set to “First Broker Login,” but was switched to “Browser.” Switching back to “First Broker Login” fixed the issue for our users.I am unsure if this is specific to Azure AD, but it is worth a try, if you are seeing a similar issue.Thank you,Jaso

LianeData Voyager

asked in Data Quality & Data Governance ⚙️

Which steps do you take to add a DQ rule?

I’d like to check if I am listing the correct steps to add a DQ rule in an existing Monitoring Project, and the order in which to take them. I am quite new to Ataccama so please excuse my ignorance. Can anyone please confirm or adjust them? Many thanks in advance! How to add a DQ ruleCheck if the rule you want to apply, already exists out of the box. For example, if you want to say a certain field cannot be empty, you can apply the predefined rule: String completeness. Other standard checks include validation of email addresses, and URLs. Go to Monitoring Project, tab Configuration & Results Choose the file you want to check (either a VCI or a Parquet File – the latter starts with PF). Choose which attribute you want to check In the 5th column, add: applied DQ checks Doublecheck whether the scoring of the rule is correct (some of the standard rules have a scoring of 0 – you might want to change that) In the upper right hand corner, choose “Publish” Run monitoring. This will take so

qingyuData Voyager

asked in Master Data Management & Reference Data Management 🛰️

Supported Data Sources

Hi Team, I want to know if ataccama support the connection to Apache Druid and TigerGraph? If yes, is there any Docs for that?

anagha.kData Voyager

posted in Data Quality & Data Governance ⚙️

DQ Timeliness rule

How to implement Timeliness rule in web application

Jason.SupticUniverse Traveller

published in Master Data Management & Reference Data Management 🛰️

Programming Languages

Howdy community!Today’s post is a very quick thought on some language knowledge that seems to help me when searching for answers about a project I might be working on in Ataccama. When I search online for an answer about an expression, or maybe an error I am seeing, I typically search in the following order. In this example we will assume I want to change a date to a string in a Column Assigner.I always start with SQL. So my search might be “PGSQL to turn a date into a string” Next I usually go to JAVA. Same search but with JAVA instead of PGSQL. Finally (and I usually reserve this one more for troubleshooting), I go to XML. While it might not be super useful for this example, there have been a couple times where searching for certain XML. One example is from another of my post on making a field nillable (able to accept a null value). The way I was helped by looking up XML functions, was that I was actually able to view the XML for the Enrichment I was creating and search it piece by p

CansuCommunity Manager

published in Data Quality & Data Governance ⚙️

Monitoring Project - Results Retention 🦾Best Practice

Hi everyone! This week’s last best practice post is on Monitoring Project Results Retention! Managing data retention is crucial for maintenance and security purposes. Whether you want to keep results for a specific duration or limit data storage based on the number of runs, Ataccama's Monitoring Project Results Retention feature has got you covered. Flexible Retention SettingsWith Monitoring Project Results Retention, you have the flexibility to choose how long you want to store the results of your monitoring projects. This can be defined in two ways: Per project configuration: Keep the last X runs. Remove runs after X days. Global configuration (available to power-users only) that takes precedence over project configuration: Keep the last X runs. Remove runs after X days. When global settings are configured, you'll receive notifications in the web application.For more details on configuring global settings, check out Monitoring Projects Global Retention.When Data Will Be DeletedMo

anagha.kData Voyager

asked in Data Quality & Data Governance ⚙️

DQ Accuracy Rule for Date datatype

Hi Team,I have tried to create Accuracy rule for Date datatype to check whether Date is in the standard format. Accurate rule should be as follows:Standard date format is ‘MM-DD-YYYY’. If date is entered in any format other than the above mentioned (‘DD-MM-YYYY’ or ‘YYYY-MM-DD’ or ‘YYYY-DD-MM’) then it should be considered as inaccurate.When I tried using regex expression, I am getting error. Any ideas?

BhumiData Voyager

asked in Master Data Management & Reference Data Management 🛰️

DQI SK stage sample demo

Is there a doc/demo available on how to use DQI SK stage (Analyze category) in Thick client please?

mahesh ArData Pioneer

asked in Master Data Management & Reference Data Management 🛰️

parse multi arrays response value from JSON call

I have to parse the below JSON GET response to get “Headers” and "Name” as columns in Json Call step with Data Streams, How can I perform this? [ { "Headers": [ “Id”, “Name”, “Email” ], "ID": “test_111”, "Rows": [ [ "100”, “John”, “John@gmail.com” ]}]

mahesh ArData Pioneer

asked in Master Data Management & Reference Data Management 🛰️

How can we integrate python script with Ataccama plan?

My requirement is that I want to read a file in Atacama plan which is an output of a python script .I would like to integrate python script then plan to run sequentially.

ThangarajData Voyager

asked in Data Quality & Data Governance ⚙️

Thin Client - Catalogue item based access Request

Is there any way that we restrict accessing the data that are imported to Ataccama Thin client ?, as we do role based access , we are able to see all others catalogue items imported into Thin Client.Such catalogue item view breach the data classification compliance which is managed in main data factory where we store the data.Anyone suggest here your thoughts to how restrict the data by giving right access / restriction while we importing the catalogue item or any measure we can take to restrict in viewing the catalogue items within Thin client w.r.t catalogue item import owner?

sandipilagData Voyager

asked in Master Data Management & Reference Data Management 🛰️

Login issue in ataccama web URL (http://localhost:8050/)

Hi Team,When trying to login in ataccama web URL, receiving below error:Could you please help me here?As all compeonts like DB, leyloack, MDM server, MDM are up and running successfuly.-----------------------------------------------------------Error in MDM server ------------------------------------------------------------------WARNING: An illegal reflective access operation has occurredWARNING: Illegal reflective access by retrofit2.Platform (file:/D:/Ataccama/mdm/lib/retrofit-2.9.0.jar) to constructor java.lang.invoke.MethodHandles$Lookup(java.lang.Class,int)WARNING: Please consider reporting this to the maintainers of retrofit2.PlatformWARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operationsWARNING: All illegal access operations will be denied in a future release2023-08-07 15:26:23,797 ←[34mINFO ←[0;39m [][][restartedMain] ←[36mn.r.s.b.l.a.LogbackAccessContext:149←[0;39m - Configured the Logback-access: context=[default], config=[classpat

1
...
16
17
18
19
20
21
22
...
31

Page 19 / 31

Badge winners

GastonQhas earned the badge First idea 💡
may_kwokhas earned the badge 10 ideas 💡
DiBetzhas earned the badge First idea 💡
Lindsay Owenshas earned the badge First idea 💡
AndrewH_LBGhas earned the badge First idea 💡

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more

Powered by Gainsight

Community Terms of Use & Conditions Cookie settings

Sign up

Already have an account? Login

For Ataccama Customers and Partners

or

Username *

E-mail address *

Company

(Private)

Only you and moderators can see this information

*

Job Title *

A bit about yourself

How did you hear about the Data People Community? *

Ataccama version

Password *

I accept the terms & conditions

loginBox.register.email_repeat

Login to the Ataccama Community

No account yet? Create an account

For Ataccama Customers and Partners

or

Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

Lead your team forward OCT 24 / 9AM ET

×