Learn & Share

How can we write case statements in Ataccama one web DQ rules? As of now we are writing multiple conditions with distinct invalid statements. I am looking for a better approach rather than going the traditional way. Thanks, Mahesh

@anna.spakova @Catherine I need some sample look up file so I can understand the format of the look up file. Could you please provide. Thanks!

Hello guys, I'm using Master Data Center 12.7 and I have the below scenario: I have a Kafka Server for development and another one for production, they are set with different username and password, so I need to connect to them: Without putting these username and password values directly in my code. In a way that MDC recognizes if it need to use development or production values. So, is there a way to setup it to use secrets (like database and server passwords) managed in Vault by HashiCorp? If it's not, how can we use ENV variables to achieve the requirements above? Thank you, Victor Costa.

Hi Everyone, We have setup SQS on the IDE and noticed that the NME config(nme-stream-gen.xml) under file is empty and is not generating any JMS config tags. We are using One desktop release 13.8. As per the Ataccama documents, the NME config file should generate JMS details on its own. Does anyone know a fix for this?

On release 13.8 IDE, we have configured JMS and each time we run the mdm server, we get the error: Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'jmsProviderComponentInstance': Invocation of init method failed; nested exception is com.ataccama.dqc.server.config.ConfigException: Cannot initialize JmsProviderComponent: Cannot instantiate class: com.ataccama.dqc.jms.sqs.SQSInitialContextFactory Did anyone encounter this with JMS?

Hi, I am using DQC and setting it up as a DQ Window service. This provides the server’s Admin centre. I would like to secure this using the users.xml and role-mapping.xml to get started. I have been able to configure it so that it prompts for login credentials but i am unable to actually login. Does any have an example of the users.xml and role-mapping.xml that works together? or any docs that i could refer to? We are using DQC v12.3. the following is what i have configured in the server.config.xml: i have only included the sections that are relevant: <component class="com.ataccama.dqc.server.services.AuthenticationService"> <methods> <method class="com.ataccama.dqc.communication.auth.server.PasswordServerMethod"> <provider class="com.ataccama.dqc.communication.auth.server.FileBasedIdentityProvider"> <configFile>users.xml</configFile> </provider> </method> </methods> <roleMappingProvider class="com.ataccama.dqc.communication.auth.server.FileRoleMapping"> <configFile>role-mapping.xml</c

Hi community members, How are you using Ataccama API’s in your project. I am explaining the most common scenario which we have in our project. I have a need to use Ataccama API part of data pipelines, i.e right after reading the source. execute the ataccama jobs. Per my understanding the Ataccama API is capable of doing below items thru API calls: Running DQ Evaluation Profiling Run Catalog item Run Monitoring etc This will not be truly data pipeline usage, For eg) I wanted to run a DQ Evaluation and based on the result of the DQ Evaluation, I would like to capture the results Success/Failure + failed records(if there are any failures). Is it possible with Ataccama API’s? Have any one tried similar approach or if not want to understand the API usage in your projects

Hi all!Please tell me where to look to cope with the error "Cannot submit job: Cannot execute task 'preprocess job' for job xxx. Caused by: Cannot retrieve metadata node" when starting remote plan execution. When the plan is run, it goes through the SUBMITTED and PREPROCESSING stages and then ends up in the FAILURE stage with the above error. For clarification: my account has full admin rights in ONE Web, so I have access to the catalog item.

simply I use here two columns date and kpi and sorting of date its fine but if we use record descriptor builder, its missing the date wise sorting. out: Steps: Sort → have date column sorting. Alter→ have rd1 <String> and record_counter<Interger> Column addition Record descriptor builder → have rd1 binding with date and kpi column

Is Mongo DB data source supported to connect and profile?

I would like to add new column e.g. Description to the column bar, next to Abbreviation, but not familiar how to achieve it? current layout syntax

Hi there, From the official website, I found the business terms could show data quality score on from category to element term level. I wonder how the sub-category item do an aggregation data quality score based on the element(column items). I understand that data quality rule could apply on column level or table level to show the quality result. For our current environment, I’ve set the hierarchy relationship, Data Domain is parent relationship to Data set, Data Set is the Parent relationship to Tables, which looks like Data Domain > Data Set > Data Table. How can it show data quality score on Data Set(Sub-category) and Data Domain level(Category). Thank you! Best regards, Vicky

Hi Experts, Maybe I’m missing something here. I’d like to get the name and id of the monitoring project, catalog item in a post process, but the integration input doesn’t provide those, right? (Why nut? Or am I missing some system pars I could use here?) So how can I get these quickly? Thank you!

Hello. everyone! Has anyone encountered a problem with large directory(example: 150 values). How did you solve this issue and make clear to this directory easy in the Ataccama ONE itself, without using other external softwares, services?

Hi, is it possible to use data from two data sources in one catalog item? Is there an instruction regarding such task? Let’s say we have data in ERP and separate data in MDM tool, which are not the part of the ERP itself, and we want to check if data in both are consistent for same records. We’ve heard, that it should be done by converting catalog items in IDE (at least for Gen1), but I’m not sure how should it be working.

Did you ever use valueList:property trait? No? Maybe this article will change your mind. What are traits First things first. What are traits? Traits are used to enable additional configuration on our entities in the metadata model. They are either property traits (applied to properties) or entity traits (added to entities). Example can be a trait called fe:term that allows to give a term subtype a different color. Link to the full list of traits as well as how to apply them can be found at the end of this article. Why to use valueList:property trait Now, what is valueList:property trait? It is a trait that will (simply put) make properties look like terms. It will change the design from the underlined text or list of underlined entities to small boxes. While it adds more to the design of the layout, it can also be very beneficial for arrays of embedded objects. If you have many values for this type of property, Ataccama will show only first 10 values and additional will be on other pag

Tested on v13.8.1 Steps overview: Download all components Install ONE Desktop Launch ONE Desktop and create the RDM Banking example project Place the files in the right structure Modify a bunch of files so they work on MacOS Configure the Mac permissions to run things Launch ONE Desktop and create the RDM Banking example project Launch them all (keycloak, postrgres), one by one Download: Builds (Latest versions here ): RDM: Rdm-assembly-13.8.1-linux.zip (Linux) ONE Desktop: Ataccama-one-desktop-13.8.1-macos.dmg (MacOS) Plugins (Latest versions here , the official Postgres version for Linux missing for now): Postgres: https://drive.google.com/file/d/1Lho_9BQh78xRWR2QHAAGoQuERof-Rn-e/view?usp=sharing Keycloak: https://ataccama.s3.amazonaws.com/Frances/Ataccama-one-desktop-13.0.0-GA_keycloak_12_0_4_plugin.zip Your license (.plf file) Install ONE Desktop: Install One Desktop ( Ataccama-one-desktop-13.8.1-macos.dmg (MacOS) Rename the application so that there are no spaces . For example ONE

i found below string fucntion. in help document but it will check [A-Za-z] pattern. string matches(string srcRegex, string srcStr [, string caseInsensitive=false])

Could someone pls share the link to learn about Ataccama one functions and expressions to refer

According to the documentation multiple listeners are allowed to be configured - Trying to configure mdm to listen at more than 1 port results in the following error on the first defined listener with only 1 other working : HTTP ERROR 500 org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'keycloakSecurityConfigurer': Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No qualifying bean of type 'com.ataccama.server.http.security.keycloak.KeycloakSecurity' available: expected at least 1 bean which qualifies as autowire candidate. Dependency annotations: {} Am I doing something wrong?

According to MDC 12.7 Documentation , we are allowed to define multiple listeners in the HttpDispatcher on different ports. When I try to do that, I get the following error trying to access one of the ports (the first one defined in order top to bottom in the serverConfig) , leaving me with only 1 working listener HTTP ERROR 500 org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'keycloakSecurityConfigurer': Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No qualifying bean of type 'com.ataccama.server.http.security.keycloak.KeycloakSecurity' available: expected at least 1 bean which qualifies as autowire candidate. Dependency annotations: {} Is there are workaround for this?

We continue with our series - today’s topic is Detection rules. 👉 Get Certified with Ataccama article series #1 Adding Data Sources #2 Add a Data Source to the Catalog #3 Business Terms 🔎 LET’S TEST YOUR SKILLS Using the ONE Web App, in the ONE Data Quality module, create a Detection Rule for 'Blood Type', if the value in the input column is one of the following 4 values, then Detect Term A B AB O 💡 How to do it? Navigate to Data Quality - Detection Rules and click on Create Fill in Name and other information if needed and Save it Go to tab Implementation and fill in Input Attributes - always make sure you follow best practices for naming conventions In the section Rule Logic, select Detection Switch to Advanced Expression, write a condition and Test Rule Publish the rule Do you have any question or tips&tricks? Let us know in comments section!

I am doing POC to adopt ataccama, please help me out on this requirement Requirement: Previous and current run data validation. For example: what is the threshold of yesterday sales or one week back sales and todays sales

Is there a best approach to have LKPs updated via a webservice so that other web services can consume the updated lkp without restarting DQS? I have Web Service ‘A’ which builds a dictionary file. I also have Web Service ‘B’ which uses the dictionary built by Web Service ‘A’. I would like to run Web Service ‘A’ so that Web Service ‘B’ is able to immediately use the updated dictionary without restarting the DQS service. Currently when i run Web Service ‘ A’ I get a locked file issue: 26.07.2022 12:43:56 [FATAL] [OnlineServicesComponent][buidTestDictionary.online][buidTestDictionary][buidTestDictionary.comp] [40] Internal error occurred during run of the plan: java.nio.channels.OverlappingFileLockException[STEP Lookup Builder[Lookup Builder]]java.nio.channels.OverlappingFileLockException at sun.nio.ch.SharedFileLockTable.checkList(Unknown Source) at sun.nio.ch.SharedFileLockTable.add(Unknown Source) at sun.nio.ch.FileChannelImpl.tryLock(Unknown Source) at com.ataccama.dqc.io.storage.RafR

Hi all-- Please find below an introductory primer for the Ataccama Expressions language, for those familiar with Excel formulae (which are deliberately very similar in structure and use to the way we’ve designed the expression language)… Introduction Overview One of Ataccama’s core values when developing Ataccama ONE is to create a user experience which simplifies as far as possible the technical complexities of data manipulation and data quality, and to put as many capabilities into the hands of business and non-technical users as possible. With this philosophy in mind we have created a powerful expression language, which moves away from the complexity of development languages such as scripting/python/SQL. Despite containing powerful and extensible functionality for complex data challenges, the design of the expressions have been made as simple as possible, and can be easily learned by anyone with a familiarity in MS-Excel formulas and features. This expression language is used throug