Learn & Share

Hi Maksim,Can anyone help me view the broken new_database_connection image at MS SQL Connection error - DQ Analyzer - Ataccama Community? The png image’s status is 'Page not found.'I couldn't connect DQ Analyzer to an Azure SQL database using jTDS- MS SQL. I am using Active Directory - Universal with MFA support authentication.Thank you very much for your time and assistance!JP

Hi!Just started to learn how to work with Scheduler and Workflows and ran into an error when starting workflow through scheduler:ERROR: Data source 'GP' specified by property dataSourceName must exist. [Jdbc Reader (Jdbc Reader, offending property path=/dataSourceName)]The error occurs in the "run build file" task. This is a normal plan containing a database connection. Because of this, all other tasks remain with the "WAITING" status. I will attach the configuration of my .sch file:<?xml version='1.0' encoding='UTF-8'?><scheduleDefinition><description>test</description><enabled>true</enabled><job class="com.ataccama.adt.scheduler.job.WorkflowJob"><workflow>WF00:missed_products_flow_test.ewf</workflow></job><scheduling>40 16 * * *</scheduling></scheduleDefinition>Can you please tell me what I could be missing? Where to write database connection settings in .sch configuration? I just created a workflow, .sch w

While doing unit testing i can’t exclude special characters in Alphanumeric check.Please let me know the best way to do it.

How can we do decimal validation in Ataccama one web DQ rules. input attribute data type should be float for this rule.  

imagine we have 100 views for which we need to find the count difference in 2 different db’s .we need to create a dynamic query in a while loop which looks up view names one by one and runs until the requirement is met.  I have a few questions to ask :Can we have a “JDBC Reader” which can read dynamic queries? For example, using a “Global Variable” in the JDBC Reader query to pick up view_names for every iteration. As per the solution above, we need to create a while loop to cater multiple iteration. Is there any method/function in Ataccama to achieve this? 

We were trying to get the first name and middle name parsed out of an embedded array object using the json parser, but for some reason, anytime we called name_info.name It would only return the middle name, we saw this patter on all records, if name has middle name, then middle name only would show, if no middle name, then first name would show. With the json parser, it should have returned one line for first name and one line for middle but it didnt Solution: create a data stream that goes from root into name, then for the attributes in that data stream, you will use an @ as the path for the attribute. This will then give you a separate line for first and middle name. The documentation for 13 has this, but since we were working with 12.6 we went through trail and error  "name_info": [ { "name": [ "John", "A" ] }]Data structure example

Is there a stdout writer, or anything that can echo output?This would be the perfect compliment to the Random Record Generator. The ability to specify an input (Random Record Generator) and output (StdOut Writer) without having to use Text File Reader / Writer would allow the help to be much better without having to provide the tutorials (which are complicated). I want just the simplest hello world example for the Pattern Parser to simply split two words separated by white space (please supply!). But the help is inadequate with too much text and no simple example, and the tutorial example “06.04 Pattern Parser” is far too complicated to decode.If there was a StdOut Writer then it would be much easier to supply examples in the help. Simply paste the entire xml plan into the help. Each plan would only need a Random Record Generator to create one record, the step being displayed (Pattern Parser) and a StdOut Write to write the output to the console of the eclipse desktop.

HiI need an example of using JSON Call.I try a simple REST API call, but it does not work.Thanks 

Humanise MDM and Automate Testing With APIs

What does the exclamation mark mean in pattern groups as in the Multiplicative Pattern Parser?ie this (found in the tutorial){FIRST_NAME!}{LAST_NAME!}{FIRST_NAME!}{INITIAL}{LAST_NAME!} As usual it’s not explained in the help, and the help says see examples. The help is very thin and too much text to explain nothing. One tutorial example isn’t enough. There should be several examples building from the simplest hello world example to more complex. Can’t edit my community profile name so it looks like I’m accidentally stuck with Pattern Groups    

I want to concatenate the values of one attribute in a group of records. Inputcustomer  purchased0000001   shoes0000001   belt0022222   pants0022222   jacket The output I want iscustomer  accumulated0000001    shoes belt0022222    pants jacket The representative creater offers best and second to access records in a group, or aggregations like avg, sum. This question asks how to build an expression in a group to concatenate the the values.I looked at the Record Descriptor steps as maybe offering a solution but the help is very thin.    

 I have created Business term employee id and detection and DQ rules and linked the rule to business term wherever possible but when I tried to evaluate the following error displayed always: Please help! Couldn't run DQ evaluationNo matching rules found for term attributes.

How can we write case statements in Ataccama one web DQ rules?As of now we are writing multiple conditions with distinct invalid statements. I am looking for a better approach rather than going the traditional way. Thanks,Mahesh

@anna.spakova @Catherine I need some sample look up file so I can understand the format of the look up file. Could you please provide. Thanks!

Hello guys, I'm using Master Data Center 12.7 and I have the below scenario:I have a Kafka Server for development and another one for production, they are set with different username and password, so I need to connect to them:Without putting these username and password values directly in my code. In a way that MDC recognizes if it need to use development or production values. So, is there a way to setup it to use secrets (like database and server passwords) managed in Vault by HashiCorp? If it's not, how can we use ENV variables to achieve the requirements above? Thank you,Victor Costa.

Hi Everyone,We have setup SQS on the IDE and noticed that the NME config(nme-stream-gen.xml) under file is empty and is not generating any JMS config tags.  We are using One desktop release 13.8. As per the Ataccama documents, the NME config file should generate JMS details on its own. Does anyone know a fix for this?

On release 13.8 IDE, we have configured JMS and each time we run the mdm server, we get the error:  Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'jmsProviderComponentInstance': Invocation of init method failed; nested exception is com.ataccama.dqc.server.config.ConfigException: Cannot initialize JmsProviderComponent: Cannot instantiate class: com.ataccama.dqc.jms.sqs.SQSInitialContextFactory Did anyone encounter this with JMS?

Hi,I am using DQC and setting it up as a DQ Window service. This provides the server’s Admin centre. I would like to secure this using the users.xml and role-mapping.xml to get started. I have been able to configure it so that it prompts for login credentials but i am unable to actually login. Does any have an example of the users.xml and role-mapping.xml that works together? or any docs that i could refer to? We are using DQC v12.3.the following is what i have configured in the server.config.xml:i have only included the sections that are relevant:         <component class="com.ataccama.dqc.server.services.AuthenticationService">            <methods>                <method class="com.ataccama.dqc.communication.auth.server.PasswordServerMethod">                    <provider class="com.ataccama.dqc.communication.auth.server.FileBasedIdentityProvider">                        <configFile>users.xml</configFile>                    </provider>        

Hi community members, How are you using Ataccama API’s in your project. I am explaining the most common scenario which we have in our project. I have a need to use Ataccama API part of data pipelines, i.e right after reading the source. execute the ataccama jobs. Per my understanding the Ataccama API is capable of doing below items thru API calls:Running DQ EvaluationProfilingRun Catalog itemRun Monitoring etc This will not be truly data pipeline usage, For eg) I wanted to run a DQ Evaluation and based on the result of the DQ Evaluation, I would like to capture the results Success/Failure + failed records(if there are any failures). Is it possible with Ataccama API’s? Have any one tried similar approach or if not want to understand the API usage in your projects

Hi all!Please tell me where to look to cope with the error "Cannot submit job: Cannot execute task 'preprocess job' for job xxx. Caused by: Cannot retrieve metadata node" when starting remote plan execution. When the plan is run, it goes through the SUBMITTED and PREPROCESSING stages and then ends up in the FAILURE stage with the above error.For clarification: my account has full admin rights in ONE Web, so I have access to the catalog item.

simply I use here two columns date and kpi and sorting of date its fine but if we use record descriptor builder, its missing the date wise sorting.out: Steps:Sort → have date column sorting.Alter→ have rd1 <String> and record_counter<Interger> Column additionRecord descriptor builder → have rd1 binding with date and kpi column  

I would like to add new column e.g. Description to the column bar, next to Abbreviation, but not familiar how to achieve it?  current layout syntax 

Hi there, From the official website, I  found the business terms could show data quality score on from category to element term level.  I wonder how the sub-category item do an aggregation data quality score based on the element(column items). I understand that data quality rule could apply on column level or table level to show the quality result.  For our current environment, I’ve set the hierarchy relationship, Data Domain is parent relationship to Data set, Data Set is the Parent relationship to Tables, which looks like Data Domain > Data Set > Data Table. How can it show data quality score on Data Set(Sub-category) and Data Domain level(Category).   Thank you! Best regards,Vicky  

Hi Experts,Maybe I’m missing something here. I’d like to get the name and id of the monitoring project, catalog item in a post process, but the integration input doesn’t provide those, right? (Why nut? Or am I missing some system pars I could use here?) So how can I get these quickly?Thank you!