Skip to main content

Learn & Share

Discuss data, share best practices, learn, and grow with Ataccama's Community.

878 Topics
M
Star Blazer L2
Marnix WisselaarStar Blazer L2
published in Data Quality & Catalog ⚙️
Catch OneWeb GraphQL in Chrome/Edge test and useBest Practice

We are using some GraphQL to ‘do stuff’. Turns out the easiest way to find the GraphQL is using the Developer-tools in Chrome or Edge. See enclosed. 

1363
M
Star Blazer L2
anna.spakova
Ataccamer
anna.spakovaAtaccamer
published in Data Quality & Catalog ⚙️
Export metadata model into ExcelBest Practice

Hello everyone, Anna here! I work as a projects consultant in Ataccama and today I put together a guide for you on how to export a metadata model definition from Ataccama ONE.Ataccama ONE allows to export metadata model definition from the platform into a JSON file. However, the JSON file is not an ideal format for business users. For that reason, parsing of the JSON into more user-friendly format, for instance Excel, is desired. The current JSON parser step in Ataccama DQC, however, is not able to parse this JSON structure.This article introduces a Python script that was developed to parse the JSON structure of the metadata export and provide the metadata model in Excel and CSV formats. It is supported for v13 of Ataccama ONE.As a first step, the metadata model has to be exported from Ataccama. Next step is to run the Python script on top of the exported metadata model to obtain the CSV and Excel format. Chapter JSON parser in Python describes in detail the Python script as well as th

3070
anna.spakova
Ataccamer
S
Data Voyager
smunotData Voyager
asked in Data Quality & Catalog ⚙️
MCQs in Certification

What kind of MCQs are asked in Certification exam?

1021
DannyRyan
Ataccamer
S
Data Pioneer
sgillaData Pioneer
asked in Data Quality & Catalog ⚙️
NULL Valued fields on DQS

How are NULL’s considered? I have a case statement which gives the right value matching measure -used debug to test. But when it comes to matching rules, it skips the rule. Example:Name      NPIRamona  12345678NULL       12345678the 2nd row should match the 1st on NPI value and considering on of them is null.Even the scenarioName      NPINULL       12345678NULL       12345678these two should match together based on NPI. I do not see a special character. If I replace NULL with a value ‘A’ , they match with rule Matching on NPI. but does not work for NULL.  Any thoughts or suggestions appreciated. 

1096
S
Data Pioneer
P
Data Pioneer L2
pdanpoonkijData Pioneer L2
asked in Master Data Management & Reference Data Management 🛰️
Inquiry about RDM Merge Importer Step

Hello community,I am trying to implement the RDM database synchronization. However, the data from a database does not seem to be loaded back to RDM; thus, I checked the system_input plan, which is the plan that is supposed to load data back to the RDM. The key step is the RDM Merge Importer that loads data back, but after I ran the plan, there does not seem to be any data loaded to the RDM in any viewing perspective.I also notice that the column rdm_primary_key is null for every record not in RDM prior to entering the Importer step. I’m not sure if this is an issue either.Does anyone familiar with the RDM Merge Importer step? Could you please guide me on how to use this step properly?Thank you in advance 😀

382
P
Data Pioneer L2
P
Data Pioneer L2
pdanpoonkijData Pioneer L2
asked in Master Data Management & Reference Data Management 🛰️
RDM reverse synchronization not working

Hello community,I’m implementing the RDM synchronization to sync data with a database. However, the data seems to sync only one way, which is from the RDM to the database. Whenever I add an additional record to the database manually, it gets removed after performing synchronization, and they don’t appear in the RDM inputs view.I have “Use Reverse Synchronization” enabled and followed the steps from Configuring RDM Synchronization with External Databases - Ataccama ONE Gen2 Platform Latest.If anyone knows how to get this working, could you please guide me on this?

925
P
Data Pioneer L2
J
Data Voyager
JerinData Voyager
asked in Data Quality & Catalog ⚙️
Results message not showing as message.

Hello, I’ve got a question while using DQ evaluation rules.I have been creating rules with valid and invalid messages but just the invalid message at the end does not display as intended. But when I view this in the results tab it just says OTHER as the explanation.    Is there a workaround to this problem? Should I edit my rule logic to include some specific condition and leave the rest to fall under the ‘IF none of the conditions above apply THEN’ TIA for the replies.  

672
J
Data Voyager
A
Ataccamer
alinAtaccamer
published in Data Quality & Catalog ⚙️
Data Quality and Pipeline ExecutionBest Practice

Hello, here is a short video to illustrate how an organization might use Ataccama Data Quality to run checks as part of an existing data pipeline, and verify data integrity before further processing. With Ataccama, you can use various data warehouses or ETL tools, and GraphQL API integration allows conditional scheduling and more complex orchestration.In this demonstration, we use DataBricks Notebook to trigger DQ execution and retrieve the results. These determine whether to halt or commence the pipeline, and in-app dashboards display the metrics. All results and metadata can also be exported to a data mart table for further analysis and visualization.The platform is designed to provide visible and usable data quality insights, and we offer flexible integration capabilities to suit any data stack. Thanks for watching. 

2610
A
Ataccamer
M
Data Voyager
MacarenaData Voyager
asked in Master Data Management & Reference Data Management 🛰️
ONE Web connection to amazon Redshift

Is there a way to connect ataccama One Web to a private Redshift? 

551
Cansu
Community Manager
O
Star Blazer L1
OjaswiniStar Blazer L1
asked in Master Data Management & Reference Data Management 🛰️
RDM Images by value presenters not working

Hello, I’m trying to demo the RDM Banking Example. However, the flag images in the Country table are not showing properly (as shown in Picture1.png).I have fixed the source CSV file to point to an online website with corresponding flag images (shown below) and run its loading plan to update the data on RDM, but those images are still not showing on RDM. (as shown in Picture2.png)

795
O
Star Blazer L1
E
Data Voyager
EllieData Voyager
asked in Data Quality & Catalog ⚙️
Export profiling result

Hi Team, Is there anyway that we can export the result of profiling in ataccama? Thanks, Ellie

1271
O
Star Blazer L1
K
Universe Traveller
KP_DQUniverse Traveller
asked in Data Quality & Catalog ⚙️
Extracting data quality results- deatiled failed records

Hi,We are using Ataccama one 12.6 version. We have a project containing 40+ models with 90 + rules. I am looking for an options to get the detailed invalid/failed records for each model. Like all the attributes from the model along with invalid rule instance names.The idea is to get the whole failed dataset to automate the remediation process. We already have automated process to remediate the data using other technologies.I don’t want to use the download results in csv option, because we are transitioning to latest version of Ataccama.I am looking for couple of optionsExtract the detailed failed records from backend tables using sqls (where Ataccama stores the results) or would like to understand how those csv files are generated in backend and use the same way to get the data and store in  db. Reading data through Ataccama inbuilt API’s and loading into a db. I am  going through the GraphQL options. Could you please let me know, If there is way to get the similar data through GraphQL

2835
Cansu
Community Manager
M
Data Voyager
maneelloydsData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Getting one browser error while connecting to oracle database

Hi All, We are getting the below error while adding an oracle database from add datasources in One web app. we give jdbc connection string, username and password(doesnt matter/validate if it is right password/username). Please check and let me know how can i troubleshoot/debug the issue. Some browser component is throwing the error. jdbc - format - jdbc:oracle:thin:@<jdbcHost>:1521:<jdbcDatabaseName> error when we try to connect the first time after a restart of one-tomcat servicejava.lang.RuntimeException: java.lang.ExceptionInInitializerError        at com.ataccama.one.browser.database.AbstractDatabaseDatasourceClient.retrieveConnectionWithTimeout(AbstractDatabaseDatasourceClient.java:119)        at com.ataccama.one.browser.database.AbstractDatabaseDatasourceClient.handleRequest(AbstractDatabaseDatasourceClient.java:353)        at com.ataccama.one.browser.database.AbstractDatabaseDatasourceClient.<init>(AbstractDatabaseDatasourceClient.java:92)        at com.ataccam

1213
Cansu
Community Manager
S
Ataccamer
SathyaAtaccamer
published in Data Quality & Catalog ⚙️
Adding a New Entity in MMM ModelBest Practice

METADATA MODELThe metadata model is used to configure the application entities and their properties. The Metadata Model describes the entities and their properties in the application.  Web Application) use the Metadata Model to create the frontend user interface. The metadata model is also responsible for the configuration of the left navigation menu of the application.ONE METADATA PROPERTY REFERENCESEntities consist of properties of Simple types, such as strings and integers, and Object types, which link the entity to other entities.ADDING NEW ENTITY TO MMM MODELIf you are creating an entity using the user interface, you must then add it as a property of the root entity metadata and then publishFor example, if we need to add a new entity under Business Glossary named (TestEntity) to the MMM modelClick on the Global settings on the left panelChoose Metadata Model under Maintenance CenterWe must create a new entity under Term so click on create entityFill in the name of the Entity, and

791
S
Data Enthusiast
S
Data Pioneer
sgillaData Pioneer
asked in Data Quality & Catalog ⚙️
subject_matching.online: Error message: Online configuration is not valid!

During bundle deployment I see this error. I have tried different combination ofUpdate to old bundle. Manually update the component again on the existing old bundle and upload Copying extended unification Updating OmnigenServer folders (bundle,cmd,dbms) with the backup. restarting services as needed.Any thoughts or suggestions? Thank you.

413
S
Data Pioneer
S
Data Pioneer
sgillaData Pioneer
asked in Data Quality & Catalog ⚙️
DQC match - slow incremental load

The matching component is slow at the extended unifications step for a incremental load. When a record like ‘WALGREEN%’ is loaded and there are 20K records with similar name on the instance, the records are all considered through the process of matching. Hence the process is slow when processing the increment and even if the incremental load has 11 records to process 30K records have the transaction Id and omni_modified date updated with the work order related on the instance table.  When I check history, nothing changes on these records except the omni_modified_date and transaction_id to that of the work order. Tweaking the union keys to create combination of name and key factors or adding separate groups for the high count records is not helping. Any thoughts or suggestions?

936
S
Data Pioneer
M
Data Voyager
maneelloydsData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Ataccama connection to https endpoint

Hi All, we have Ataccama version 12.8.0 version in our one web. Is there a connector available or how can we connect to a https url which points to a csv file? how do we configure https get method using security like oauth in Ataccama?

1021
A
Ataccamer
C
Data Pioneer
C_RData Pioneer
asked in Data Quality & Catalog ⚙️
What is the best mechanism or approach to share the desktop html profile results?

Hello everyone,I created a profile of my catalog item using ONE desktop and I would like the output(.html) to be accessible to business analyst with read access. The html is only accessible on my local computer. Where’s the best / secure location to store output reports of profiling? Please chime in with any thoughts. Thank you! 😀     

491
Maxim Kim
Ataccamer
Z
Data Voyager
zayarData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Attribute Name Duplication Error for SQL Catalog Item Query

Hi, I’ve been trying to create a SQL catalog item in the UI using the query below. It’s basically joining the same table twice. The query ran successfully in IDE but it’s giving me an error: Attribute '3' is duplicated. Please make sure that attributes have unique names. Can anyone help?select x.1, x.2, ax.3 as SSN, aze.3 as EIDfrom table1 xinner join table 2 ax on (x.a = ax.b) and trim(ax.c) in ('1','S','Social Security Number US')left join table 2 aze on (x.a = aze.b) and trim(aze.c) in ('E','EMPL_PROVIDED_ID','Employee ID')where x.last_update_date > '2023-02-08 00:00:00.000'

661
Cansu
Community Manager
Lisa Kovalskaia
Ataccamer
Lisa KovalskaiaAtaccamer
published in Data Quality & Catalog ⚙️
How to organize assets in ONE web app: adding columns and filters in Business Glossary

Adding more details to a list view and providing additional filtering options can help business users in their daily tasks as you scale Data Governance across multiple teams, geographies, or business functions.In this article we’ll customize the Business Glossary to show additional term attributes as columns in the list view and to enable filtering by those attributes. This approach generally works across the Ataccama ONE Web app, so you can use this article as a guide to customize other pages, for example Rules, Catalog Items, or Monitoring Projects.You don’t have to be a developer to follow this guide. If you come across any concepts you’re not familiar with, have a look at our documentation. Adding columns First, navigate to the Business Glossary’s Terms list. In the top right, find the 3-dot menu which features the option to Edit page. In the side bar that opens up, go to the Layout tab. You’ll see the JSON that describes how the objects are shown on this page when the web app load

4695
Lisa Kovalskaia
Ataccamer
F
Data Pioneer
FCB developerData Pioneer
asked in Data Quality & Catalog ⚙️
Comparison of two columns for matches in One Desktop

Hello everyone!I have an interesting task related to the desktop, we have a table combined with certain attributes and with full names, full names are divided into columns (firstname, lastname, midname) and they need to be compared with other columns (firstname1, lastname1, midname1) it is necessary to output non-matching full names. I can't compare one table between columns, I need your help. Do you know how to implement this?I will be very grateful for your help

1111
A
Ataccamer
S
Ataccamer
Samuel MuvdiAtaccamer
published in Master Data Management & Reference Data Management 🛰️
Kafka Streaming Use Case ExamplesBest Practice

Use Case: Send records from Kafka to Ataccama IDE for parsing and other transformations and send this data to database tables Beginning set up for Kafka with MDM: ⦁ The first thing you would need to do is add the Kafka configuration to the runtime configuration file, for usage in the server  The configuration should be in this format as in the picture above, where you provide the connection string, key, trustore, and keystore passwords You will also need to add this information into the serverConfig file as well, naming the server as you would like between the string tags   Once the file configurations are ready for you to connect to Kafka, you can then start adding your streaming information into the model explorer The first step would be to right-click on the STREAMING button in the model explorer From there you would need to click New Consumer You would then click Kafka Stream Source, to create a new kafka streaming source and configuration  Above is the screen you should see

2400
S
Ataccamer
V
Data Voyager
vsoppa1Data Voyager
asked in Master Data Management & Reference Data Management 🛰️
API/Python code for onboarding (connections) the Databases into Ataccama

API/Python code for onboarding (connections) the Databases into Ataccama:-We are trying to create Database connections into Ataccama by using Python. Is there any way to do the same. It would be really great if you can share us with any reference links or docs.Thanks in advance!

2113
Maxim Kim
Ataccamer
T
Data Voyager
TamilData Voyager
asked in Data Quality & Catalog ⚙️
Identification of new Dataset using Detection Rule

Is it possible to Set up the detection rule, which would allow to detection of new table(s) within the Snowflake schema and trigger the required potential alerts

641
Maxim Kim
Ataccamer
M
Data Pioneer L2
MayKwokData Pioneer L2
published in Data Quality & Catalog ⚙️
Integrating Ataccama with JiraBest Practice

Imagine the scenario where you have Ataccama ONE Data Quality Monitoring Projects running regularly. Any Data Quality (DQ) issues are already exported to our DQ Issue Tracker (DQIT) module. You can also see trends of DQ over time within the Ataccama ONE Web application.You start noticing that the score for some DQ rules has had a sharp drop in quality, and you want someone to investigate this.One of our customers decided that they want to integrate Ataccama with Jira at this point. Have Ataccama raise a ticket into Jira when this happens automatically.In this article, we will explore:Preparing to integrate with Jira The Json Call stepPreparationsBusinessUnderstand your end users. What do they expect to see in their Jira ticket? Know which fields in the Jira ticket are mandatory Have an idea of what extra information you should supply in the detailed description of the ticket. Think about formatting and presentation. Good to understand Jira markdown notation (link)JiraKnow which version

4920
M
Data Pioneer L2

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings