Skip to main content

Product Updates
Events
Training Resources
Groups

Home
Learn & Share

Learn & Share

Discuss data, share best practices, learn, and grow with Ataccama's Community.

811 Topics

C_RUniverse Traveller

asked in Data Quality & Catalog ⚙️

What is the best mechanism or approach to share the desktop html profile results?

Hello everyone,I created a profile of my catalog item using ONE desktop and I would like the output(.html) to be accessible to business analyst with read access. The html is only accessible on my local computer. Where’s the best / secure location to store output reports of profiling? Please chime in with any thoughts. Thank you! 😀

zayarData Voyager

asked in Master Data Management & Reference Data Management 🛰️

Attribute Name Duplication Error for SQL Catalog Item Query

Hi, I’ve been trying to create a SQL catalog item in the UI using the query below. It’s basically joining the same table twice. The query ran successfully in IDE but it’s giving me an error: Attribute '3' is duplicated. Please make sure that attributes have unique names. Can anyone help?select x.1, x.2, ax.3 as SSN, aze.3 as EIDfrom table1 xinner join table 2 ax on (x.a = ax.b) and trim(ax.c) in ('1','S','Social Security Number US')left join table 2 aze on (x.a = aze.b) and trim(aze.c) in ('E','EMPL_PROVIDED_ID','Employee ID')where x.last_update_date > '2023-02-08 00:00:00.000'

Lisa KovalskaiaAtaccamer

published in Data Quality & Catalog ⚙️

How to organize assets in ONE web app: adding columns and filters in Business Glossary

Adding more details to a list view and providing additional filtering options can help business users in their daily tasks as you scale Data Governance across multiple teams, geographies, or business functions.In this article we’ll customize the Business Glossary to show additional term attributes as columns in the list view and to enable filtering by those attributes. This approach generally works across the Ataccama ONE Web app, so you can use this article as a guide to customize other pages, for example Rules, Catalog Items, or Monitoring Projects.You don’t have to be a developer to follow this guide. If you come across any concepts you’re not familiar with, have a look at our documentation. Adding columns First, navigate to the Business Glossary’s Terms list. In the top right, find the 3-dot menu which features the option to Edit page. In the side bar that opens up, go to the Layout tab. You’ll see the JSON that describes how the objects are shown on this page when the web app load

FCB developerData Pioneer

asked in Data Quality & Catalog ⚙️

Comparison of two columns for matches in One Desktop

Hello everyone!I have an interesting task related to the desktop, we have a table combined with certain attributes and with full names, full names are divided into columns (firstname, lastname, midname) and they need to be compared with other columns (firstname1, lastname1, midname1) it is necessary to output non-matching full names. I can't compare one table between columns, I need your help. Do you know how to implement this?I will be very grateful for your help

Samuel MuvdiAtaccamer

published in Master Data Management & Reference Data Management 🛰️

Kafka Streaming Use Case ExamplesBest Practice

Use Case: Send records from Kafka to Ataccama IDE for parsing and other transformations and send this data to database tables Beginning set up for Kafka with MDM: ⦁ The first thing you would need to do is add the Kafka configuration to the runtime configuration file, for usage in the server The configuration should be in this format as in the picture above, where you provide the connection string, key, trustore, and keystore passwords You will also need to add this information into the serverConfig file as well, naming the server as you would like between the string tags Once the file configurations are ready for you to connect to Kafka, you can then start adding your streaming information into the model explorer The first step would be to right-click on the STREAMING button in the model explorer From there you would need to click New Consumer You would then click Kafka Stream Source, to create a new kafka streaming source and configuration Above is the screen you should see

vsoppa1Data Voyager

asked in Master Data Management & Reference Data Management 🛰️

API/Python code for onboarding (connections) the Databases into Ataccama

API/Python code for onboarding (connections) the Databases into Ataccama:-We are trying to create Database connections into Ataccama by using Python. Is there any way to do the same. It would be really great if you can share us with any reference links or docs.Thanks in advance!

TamilData Voyager

asked in Data Quality & Catalog ⚙️

Identification of new Dataset using Detection Rule

Is it possible to Set up the detection rule, which would allow to detection of new table(s) within the Snowflake schema and trigger the required potential alerts

MayKwokData Pioneer L2

published in Data Quality & Catalog ⚙️

Integrating Ataccama with JiraBest Practice

Imagine the scenario where you have Ataccama ONE Data Quality Monitoring Projects running regularly. Any Data Quality (DQ) issues are already exported to our DQ Issue Tracker (DQIT) module. You can also see trends of DQ over time within the Ataccama ONE Web application.You start noticing that the score for some DQ rules has had a sharp drop in quality, and you want someone to investigate this.One of our customers decided that they want to integrate Ataccama with Jira at this point. Have Ataccama raise a ticket into Jira when this happens automatically.In this article, we will explore:Preparing to integrate with Jira The Json Call stepPreparationsBusinessUnderstand your end users. What do they expect to see in their Jira ticket? Know which fields in the Jira ticket are mandatory Have an idea of what extra information you should supply in the detailed description of the ticket. Think about formatting and presentation. Good to understand Jira markdown notation (link)JiraKnow which version

TamilData Voyager

posted in Data Quality & Catalog ⚙️

Is it possible to do Duplication check (Uniqueness) on Table level using Data Quality

Hi Team,Our Aim is to Avoid duplication of the same data coming from different requirements (project trains) - in case of identified duplication DQ Brach alert should be reported. 1.How to identify if Somone ingested the same table in a different Snowflake schema ?Is it possible to detect duplicate table through ONE web application or ONE Desktop by creating a rule?Thanks in Advance!

samyData Voyager

asked in Data Quality & Catalog ⚙️

How to parameterize data source name or how make value in data source name as dynamic in components?

I have a sql select where in I wanted to pass multiple data source names. how to make it dynamic or parameterized so that It can read all the names one by one.

Marnix WisselaarStar Blazer L2

posted in Data Quality & Catalog ⚙️

Re-usable published components

Hi,For our monitoring projects post processing we use fairly standardized (sub-) components. Now for every MP / CI combination these sub-components are all the same. If an MP Postprocessing is published these components get published also, right?Is there a way to have a single version of a component stored?This would make maintenance and life-cycle-management on these components a lot easier. In stead of having to go in the PostProcessing main component, we'd just have to change one.A plausible solution would be to split things and do things asynchronously, maybe. But that is a more of a workaround.Any ideas?

cbre_jonathanData Voyager

asked in Data Quality & Catalog ⚙️

Customize Business Glossary Term View

Hi,I’m trying to modify our view of our business terms - currently we have a lot of information showing in the default view that our end users may not care about. What I really want to do is modify the view, so that it only shows Name, Abbreviation, Description and Synonym. I have figured out how to add the columns, but I can’t figure out how to remove unwanted columns. For reference here is the default screen layout in Ataccama One via the Debugging Tools. {"_type": "entity.page.listing","children": {"_type": "relationships.hierarchyListing","enableSelection": true,"columns": {"type": {"dataPath": [],"name": "Type","after": "name","renderer": {"_type": "glossary.termType.tableCell"}}}}}

CatherineData Pioneer

asked in Data Quality & Catalog ⚙️

Ataccama Web - User Activity Logging Reporting

Use Case: As part of the Data Governance Program KPIs reporting, we need to report on unique user usage count and details of who within the Ataccama Web on a monthly, month-to-date, and year-to-date. Can this be easily captured using OpenSearch Dashboards historically or elsewhere?

MayKwokData Pioneer L2

published in Master Data Management & Reference Data Management 🛰️

How to generate a Basic Auth headerTutorial

Basic Auth headers are frequently used as part of communication between applications, e.g. as part of API calls.Common use cases in the Ataccama context include (and not limited to):Graphql call to ONE application API call to an online service set up on a DQC / runtime / orchestration serverOption 1: Do it in a ONE Desktop plan Create a new plan Create a step that evaluates expressions, e.g. Alter Format Go into the expression window and put this expression in. The username and password are separated with a colon: coding.toBase64('username:password') Click Evaluate Copy the result string Your header is going to be Basic dXNlcm5hbWU6cGFzc3dvcmQ=Option 2: Use an online base64 encode websiteIf you are building something to integrate with Ataccama but you don’t actually have Ataccama ONE Desktop installed…. Go to a website that offers this conversion (e.g. link. Warning: this site is not affiliated with Ataccama) Put in your username and password in this format: username:password, se

MayKwokData Pioneer L2

published in Data Quality & Catalog ⚙️

Parse JSON value in (Databricks) SQLBest Practice

I’ve been working on a use case recently which I think may be of interest to the community here.Some reference data is stored in a single table DATA_KEY_ID column tells us what reference data set it is DATA_VAL column stores the actual reference data in the format of a json array Goal is to extract the values from the json array, and use it as a lookup item in Ataccama ONE, which in turn is used in Data Quality Validation rulesTo start with, you need to have some preview access to the data and understand the schema of the json. For the example in this post, I have very simple “id” and “name” properties for my json. You will need to analyse that data before starting this, so you know what to put into the Json parser, or which values you want to get out from the json object. Solution 1: Virtual Catalog Item (VCI)Bring the reference data table into Ataccama ONE Build a VCI, with a Catalog Item Reader of the reference data table Use a filter step to filter the exact set I need (it will al

kriangsaksumthongData Voyager

posted in Data Quality & Catalog ⚙️

importing DQ rules fail.

I’m having this import error note, how to fix this? thank you.

bazData Voyager

asked in Master Data Management & Reference Data Management 🛰️

RDM - Permissions to stop a role editing published rows

Hi - I need to set the permissions for a role in RDM that allows users within this role to create new rows, edit newly created rows and move them to publish. Once a row has been either Published or ‘Awaiting Confirmation’ the user should not be able to edit or delete the row.Is there a way of doing this in RDM? baz

KarthikaSPillaiData Pioneer

asked in Data Quality & Catalog ⚙️

How to stop monitoring project?

I tried to run monitoring project at morning, but it is forever running. Please let me a know a way to stop it. Thanks!@anna.spakova @Catherine

sxk020501Data Voyager

posted in Master Data Management & Reference Data Management 🛰️

Dynamically provisioning Ataccama environment for supporting automated unit testing capability

I’d like to implement a dynamically provisioning Ataccama environment for supporting automated unit testing capability. I.eBuilding a Container image of Ataccama software stored in a private cloud and. Developers can rapidly iterate code, commit in a repo, CI triggers application build, container image build and Automated unit testing of new features via Azure pipelines.And It seems Ataccama is working on a Containerized deployments soon according to their web site,Does anybody know the timeline of when this feature can be available to do the above goals? Also can we use it as a preview for unit testing environment?

matthewtaylorukAtaccamer

posted in Data Quality & Catalog ⚙️

Data Quality and Integration Scenarios

IntroductionThis post was created to answer the following questions:When moving data through data pipelines, how can the Ataccama ONE DQ platform support Data Integration platforms other than its own. How do other Integration Platforms access the DQ rules? How do other Integration Platforms flag records for Data Stewards to review?DQ platform in context of integration processesThere are three key patterns that are typically used for integration of the ETL process with Data Quality:Option 1The integration platform calls Ataccama DQ rules exposed as real-time API, sending in batches or micro-batches of data for evaluation.Option 2The Integration platform loads data into a staging/landing layer and triggers (via API call) a batch process in Ataccama, Ataccama evaluates/improves the data and populates the cleansed layer in the data lake, including DQ scores and flags. Option 3Ataccama can be connected to a data stream, such as Kafka, and on the fly evaluating data in the stream - every mes

pdanpoonkijData Pioneer L2

asked in Data Quality & Catalog ⚙️

Trigger a workflow after monitoring project finished

Hello, communityI’m currently working on a project which requires a workflow on the runtime server to be triggered after the monitoring project on Ataccama ONE is finished. Can anyone recommend a solution to achieve this? Thank you in advance

Maxim KimAtaccamer

posted in Master Data Management & Reference Data Management 🛰️

What to do if Approval Requests page throws error with NodePath()

One of the customers had experienced the error upon entering Approval Requests page:And it happened after metadata changes that looked reasonably safe.So what happened?It turns out that if you have an entity that is a part of workflow (draft, approve, …, publish) and you already have published some of them -- deleting attribute which is an embedded array of other entities would lead to this kind of error.Luckily, there is a way to fix it if you have access to MMM database: delete from "mdArbitraryReference_r" where id in ( select id_i from "mdArbitraryReference_q" where "referencedNodePath_s" not in (select id from "_MmdDictionary" where type = 'PATH')); delete from "mdArbitraryReference_q" where "referencedNodePath_s" not in (select id from "_MmdDictionary" where type = 'PATH');These SQL queries fix DB inconsistency removing invalid records from arbitrary references tables.I would still suggest to consult with support if you encounter such an error first, though. :)

KarthikaSPillaiData Pioneer

asked in Data Quality & Catalog ⚙️

do we have row level quality score?

I see column level quality score in monitoring project. Do we have row level quality score?

OjaswiniStar Blazer L1

asked in Data Quality & Catalog ⚙️

DQ Monitoring project UAT/Test deployment

Hello,I am new to DQ and Ataccama. Our code is in development environment and soon to be deployed in Test/UAT for UAT testing and later to Prod once we get UAT signoff.My question is what is the way to export DQ monitoring project and its related components (like rules, etc) from Dev environment to UAT/Test environment? Is there any export capability? I have also heard that we may need to recreate it again in UAT environment. Really appreciate any direction in this.Thanks in advance.

pdanpoonkijData Pioneer L2

asked in Data Quality & Catalog ⚙️

Configuring export plan for exporting evaluation rules

I want to export DQ Evaluation Rules from Ataccama ONE and import them onto another Ataccama environment. To my knowledge, this will require an export plan. However, I’m unsure how to configure the JSON file for the plan.Could anyone guide me on this, please? Thank you in advance

1
...
23
24
25
26
27
28
29
...
33

Page 26 / 33

Badge winners

Roman Tobisekhas earned the badge First idea 💡
keithjankehas earned the badge First idea 💡
Elliehas earned the badge First idea 💡
David Suenhas earned the badge First idea 💡
clyormzhas earned the badge First idea 💡

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more

Powered by Gainsight

Community Terms of Use & Conditions Cookie settings

Sign up

Already have an account? Login

For Ataccama Customers and Partners

or

Username *

E-mail address *

Company *

Job Title *

A bit about yourself

How did you hear about the Data People Community? *

Ataccama version

Password *

I accept the terms & conditions

loginBox.register.email_repeat

Login to the Ataccama Community

No account yet? Create an account

For Ataccama Customers and Partners

or

Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK