Skip to main content

Product Updates
Events
Training Resources
Groups

Home
Learn & Share

Learn & Share

Discuss data, share best practices, learn, and grow with Ataccama's Community.

770 Topics

Recently active

Most replies Most views Newest first

KarthikaSPillaiData Pioneer

asked in Data Quality & Data Governance ⚙️

Need Sample Look up file

@anna.spakova @Catherine I need some sample look up file so I can understand the format of the look up file. Could you please provide. Thanks!

vcostaData Voyager

posted in Master Data Management & Reference Data Management 🛰️

Vault or ENV to manage secrets

Hello guys, I'm using Master Data Center 12.7 and I have the below scenario:I have a Kafka Server for development and another one for production, they are set with different username and password, so I need to connect to them:Without putting these username and password values directly in my code. In a way that MDC recognizes if it need to use development or production values. So, is there a way to setup it to use secrets (like database and server passwords) managed in Vault by HashiCorp? If it's not, how can we use ENV variables to achieve the requirements above? Thank you,Victor Costa.

alexAguilarMxData Pioneer

asked in Master Data Management & Reference Data Management 🛰️

how to apply new changes into clean operation for records already in the db?

We made changes into the clean operation of an entity. it will take effects for new transactions.How can we apply this to the current records that we already have into the database? We are exploring use a full reprocess of this entity:but we have some doubts about the setup. For example:What is the difference between a reprocess vs rematch checkbox? We tried to read the documentation but there is not detail explanation about it. Thanks in advance!

shifatData Voyager

asked in Master Data Management & Reference Data Management 🛰️

Adding SQS generates empty NME config file

Hi Everyone,We have setup SQS on the IDE and noticed that the NME config(nme-stream-gen.xml) under file is empty and is not generating any JMS config tags. We are using One desktop release 13.8. As per the Ataccama documents, the NME config file should generate JMS details on its own. Does anyone know a fix for this?

shifatData Voyager

asked in Master Data Management & Reference Data Management 🛰️

Cannot Instantiate class: com.ataccama.dqc.jms.sqs.SQSIntitalContextFactory

On release 13.8 IDE, we have configured JMS and each time we run the mdm server, we get the error: Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'jmsProviderComponentInstance': Invocation of init method failed; nested exception is com.ataccama.dqc.server.config.ConfigException: Cannot initialize JmsProviderComponent: Cannot instantiate class: com.ataccama.dqc.jms.sqs.SQSInitialContextFactory Did anyone encounter this with JMS?

asif shaikhData Voyager

posted in Master Data Management & Reference Data Management 🛰️

simple example for authentication and authorisation

Hi,I am using DQC and setting it up as a DQ Window service. This provides the server’s Admin centre. I would like to secure this using the users.xml and role-mapping.xml to get started. I have been able to configure it so that it prompts for login credentials but i am unable to actually login. Does any have an example of the users.xml and role-mapping.xml that works together? or any docs that i could refer to? We are using DQC v12.3.the following is what i have configured in the server.config.xml:i have only included the sections that are relevant: <component class="com.ataccama.dqc.server.services.AuthenticationService"> <methods> <method class="com.ataccama.dqc.communication.auth.server.PasswordServerMethod"> <provider class="com.ataccama.dqc.communication.auth.server.FileBasedIdentityProvider"> <configFile>users.xml</configFile> </provider>

Siva_MadhavanData Pioneer

asked in Master Data Management & Reference Data Management 🛰️

API Usage with Ataccama

Hi community members, How are you using Ataccama API’s in your project. I am explaining the most common scenario which we have in our project. I have a need to use Ataccama API part of data pipelines, i.e right after reading the source. execute the ataccama jobs. Per my understanding the Ataccama API is capable of doing below items thru API calls:Running DQ EvaluationProfilingRun Catalog itemRun Monitoring etc This will not be truly data pipeline usage, For eg) I wanted to run a DQ Evaluation and based on the result of the DQ Evaluation, I would like to capture the results Success/Failure + failed records(if there are any failures). Is it possible with Ataccama API’s? Have any one tried similar approach or if not want to understand the API usage in your projects

FCB developerData Pioneer

asked in Data Quality & Data Governance ⚙️

Catalog Item Reader : "cannot retrieve metadata node"

Hi all!Please tell me where to look to cope with the error "Cannot submit job: Cannot execute task 'preprocess job' for job xxx. Caused by: Cannot retrieve metadata node" when starting remote plan execution. When the plan is run, it goes through the SUBMITTED and PREPROCESSING stages and then ends up in the FAILURE stage with the above error.For clarification: my account has full admin rights in ONE Web, so I have access to the catalog item.

mukeshData Voyager

asked in Data Quality & Data Governance ⚙️

sorting issues if we use record descriptor builder

simply I use here two columns date and kpi and sorting of date its fine but if we use record descriptor builder, its missing the date wise sorting.out: Steps:Sort → have date column sorting.Alter→ have rd1 <String> and record_counter<Interger> Column additionRecord descriptor builder → have rd1 binding with date and kpi column

CatherineData Pioneer

asked in Data Quality & Data Governance ⚙️

Mongo DB Data Source Connectivity

Is Mongo DB data source supported to connect and profile?

vickylau32Data Voyager

asked in Data Quality & Data Governance ⚙️

How to add now column on term level page?

I would like to add new column e.g. Description to the column bar, next to Abbreviation, but not familiar how to achieve it? current layout syntax

vickylau32Data Voyager

asked in Data Quality & Data Governance ⚙️

How to indicate data quality score on sub category and category terms?

Hi there, From the official website, I found the business terms could show data quality score on from category to element term level. I wonder how the sub-category item do an aggregation data quality score based on the element(column items). I understand that data quality rule could apply on column level or table level to show the quality result. For our current environment, I’ve set the hierarchy relationship, Data Domain is parent relationship to Data set, Data Set is the Parent relationship to Tables, which looks like Data Domain > Data Set > Data Table. How can it show data quality score on Data Set(Sub-category) and Data Domain level(Category). Thank you! Best regards,Vicky

Marnix WisselaarStar Blazer L2

asked in Data Quality & Data Governance ⚙️

How to get the metadata for a post-processing integration input?

Hi Experts,Maybe I’m missing something here. I’d like to get the name and id of the monitoring project, catalog item in a post process, but the integration input doesn’t provide those, right? (Why nut? Or am I missing some system pars I could use here?) So how can I get these quickly?Thank you!

FCB developerData Pioneer

asked in Data Quality & Data Governance ⚙️

Directory with large values

Hello. everyone! Has anyone encountered a problem with large directory(example: 150 values). How did you solve this issue and make clear to this directory easy in the Ataccama ONE itself, without using other external softwares, services?

bartlomiej.konopkaData Voyager

asked in Data Quality & Data Governance ⚙️

Two data sources for one Catalog Item

Hi, is it possible to use data from two data sources in one catalog item? Is there an instruction regarding such task? Let’s say we have data in ERP and separate data in MDM tool, which are not the part of the ERP itself, and we want to check if data in both are consistent for same records. We’ve heard, that it should be done by converting catalog items in IDE (at least for Gen1), but I’m not sure how should it be working.

anna.spakovaAtaccamer

published in Data Quality & Data Governance ⚙️

valueList:property: Trait with a great power

Did you ever use valueList:property trait? No? Maybe this article will change your mind.What are traitsFirst things first. What are traits? Traits are used to enable additional configuration on our entities in the metadata model. They are either property traits (applied to properties) or entity traits (added to entities). Example can be a trait called fe:term that allows to give a term subtype a different color. Link to the full list of traits as well as how to apply them can be found at the end of this article.Why to use valueList:property traitNow, what is valueList:property trait? It is a trait that will (simply put) make properties look like terms. It will change the design from the underlined text or list of underlined entities to small boxes. While it adds more to the design of the layout, it can also be very beneficial for arrays of embedded objects. If you have many values for this type of property, Ataccama will show only first 10 values and additional will be on other pages.

Alexander KislyakovData Voyager

published in Master Data Management & Reference Data Management 🛰️

Running RDM v13.x Locally on MacOSTutorial

Tested on v13.8.1Steps overview:Download all components Install ONE Desktop Launch ONE Desktop and create the RDM Banking example project Place the files in the right structure Modify a bunch of files so they work on MacOS Configure the Mac permissions to run things Launch ONE Desktop and create the RDM Banking example project Launch them all (keycloak, postrgres), one by oneDownload: Builds (Latest versions here): RDM: Rdm-assembly-13.8.1-linux.zip (Linux) ONE Desktop: Ataccama-one-desktop-13.8.1-macos.dmg (MacOS) Plugins (Latest versions here, the official Postgres version for Linux missing for now): Postgres: https://drive.google.com/file/d/1Lho_9BQh78xRWR2QHAAGoQuERof-Rn-e/view?usp=sharing Keycloak: https://ataccama.s3.amazonaws.com/Frances/Ataccama-one-desktop-13.0.0-GA_keycloak_12_0_4_plugin.zip Your license (.plf file) Install ONE Desktop: Install One Desktop (Ataccama-one-desktop-13.8.1-macos.dmg (MacOS) Rename the application so that there are no spaces

mahesh ArData Pioneer

asked in Data Quality & Data Governance ⚙️

Is there an expression to verify that a list of EMPNAME contains only characters in Ataccama one web 13.6 version ? like REG_MATCH(column,[a-zA-Z])

i found below string fucntion. in help document but it will check [A-Za-z] pattern.string matches(string srcRegex, string srcStr [, string caseInsensitive=false])

KP_DQUniverse Traveller

asked in Data Quality & Data Governance ⚙️

Ataccama one functions and expressions

Could someone pls share the link to learn about Ataccama one functions and expressions to refer

A

Anonymous

published in Data Quality & Data Governance ⚙️

#4 Detection rulesGet certified with Ataccama

We continue with our series - today’s topic is Detection rules.👉 Get Certified with Ataccama article series#1 Adding Data Sources#2 Add a Data Source to the Catalog#3 Business Terms🔎 LET’S TEST YOUR SKILLSUsing the ONE Web App, in the ONE Data Quality module, create a Detection Rule for 'Blood Type', if the value in the input column is one of the following 4 values, then Detect Term A B AB O 💡 How to do it? Navigate to Data Quality - Detection Rules and click on CreateFill in Name and other information if needed and Save itGo to tab Implementation and fill in Input Attributes - always make sure you follow best practices for naming conventions In the section Rule Logic, select DetectionSwitch to Advanced Expression, write a condition and Test RulePublish the rule Do you have any question or tips&tricks? Let us know in comments section!

A

mukeshData Voyager

asked in Data Quality & Data Governance ⚙️

How to extract the any columns data based on date value of the Nth occurence

I am doing POC to adopt ataccama, please help me out on this requirementRequirement:Previous and current run data validation.For example:what is the threshold of yesterday sales or one week back sales and todays sales

Marnix WisselaarStar Blazer L2

asked in Data Quality & Data Governance ⚙️

Ataccama One Desktop - Select only distinct rows

Is there a way to quickly select only distinct rows in Ataccama One Desktop? (I now used a record descriptor and filter with Regex find(“.:.:1”, rd_column)

asif shaikhData Voyager

asked in Data Quality & Data Governance ⚙️

updating LKP via a web service for other web services to consume

Is there a best approach to have LKPs updated via a webservice so that other web services can consume the updated lkp without restarting DQS? I have Web Service ‘A’ which builds a dictionary file. I also have Web Service ‘B’ which uses the dictionary built by Web Service ‘A’.I would like to run Web Service ‘A’ so that Web Service ‘B’ is able to immediately use the updated dictionary without restarting the DQS service. Currently when i run Web Service ‘ A’ I get a locked file issue:26.07.2022 12:43:56 [FATAL] [OnlineServicesComponent][buidTestDictionary.online][buidTestDictionary][buidTestDictionary.comp] [40] Internal error occurred during run of the plan: java.nio.channels.OverlappingFileLockException[STEP Lookup Builder[Lookup Builder]]java.nio.channels.OverlappingFileLockException at sun.nio.ch.SharedFileLockTable.checkList(Unknown Source) at sun.nio.ch.SharedFileLockTable.add(Unknown Source) at sun.nio.ch.FileChannelImpl.tryLock(Unknown Source) at com.ataccama.dqc.i

matthewtaylorukAtaccamer

posted in Data Quality & Data Governance ⚙️

Expressions 101 for non-technical users...

Hi all-- Please find below an introductory primer for the Ataccama Expressions language, for those familiar with Excel formulae (which are deliberately very similar in structure and use to the way we’ve designed the expression language)… IntroductionOverviewOne of Ataccama’s core values when developing Ataccama ONE is to create a user experience which simplifies as far as possible the technical complexities of data manipulation and data quality, and to put as many capabilities into the hands of business and non-technical users as possible.With this philosophy in mind we have created a powerful expression language, which moves away from the complexity of development languages such as scripting/python/SQL. Despite containing powerful and extensible functionality for complex data challenges, the design of the expressions have been made as simple as possible, and can be easily learned by anyone with a familiarity in MS-Excel formulas and features.This expression language is used throughout

FCB developerData Pioneer

asked in Master Data Management & Reference Data Management 🛰️

java.net.SecketTimeoutException: Read timed out

When you start the workflow, in the last step, emails are sent using SMTP. When executing a task, the process throws the error java.net.SocketTimeoutException: Read timed outI suspect this is due to the fact that too little time is allotted for the connection, which is why the SMTP server does not have time to return a response. Is there a configuration file somewhere in ONE desktop where you can manually set the time on timeout ?

1
...
24
25
26
27
28
29
30
31

Page 27 / 31

Badge winners

GastonQhas earned the badge First idea 💡
may_kwokhas earned the badge 10 ideas 💡
DiBetzhas earned the badge First idea 💡
Lindsay Owenshas earned the badge First idea 💡
AndrewH_LBGhas earned the badge First idea 💡

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more

Powered by Gainsight

Community Terms of Use & Conditions Cookie settings

Sign up

Already have an account? Login

For Ataccama Customers and Partners

or

Username *

E-mail address *

Company

(Private)

Only you and moderators can see this information

*

Job Title *

A bit about yourself

How did you hear about the Data People Community? *

Ataccama version

Password *

I accept the terms & conditions

loginBox.register.email_repeat

Login to the Ataccama Community

No account yet? Create an account

For Ataccama Customers and Partners

or

Username or Email

Password

Remember me

Forgot password?

Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.

Enter your e-mail address

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

Lead your team forward OCT 24 / 9AM ET

×