Master Data Management & Reference Data Management 🛰️

We were trying to get the first name and middle name parsed out of an embedded array object using the json parser, but for some reason, anytime we called name_info.name It would only return the middle name, we saw this patter on all records, if name has middle name, then middle name only would show, if no middle name, then first name would show. With the json parser, it should have returned one line for first name and one line for middle but it didnt Solution: create a data stream that goes from root into name, then for the attributes in that data stream, you will use an @ as the path for the attribute. This will then give you a separate line for first and middle name. The documentation for 13 has this, but since we were working with 12.6 we went through trail and error  "name_info": [ { "name": [ "John", "A" ] }]Data structure example

Is there a stdout writer, or anything that can echo output?This would be the perfect compliment to the Random Record Generator. The ability to specify an input (Random Record Generator) and output (StdOut Writer) without having to use Text File Reader / Writer would allow the help to be much better without having to provide the tutorials (which are complicated). I want just the simplest hello world example for the Pattern Parser to simply split two words separated by white space (please supply!). But the help is inadequate with too much text and no simple example, and the tutorial example “06.04 Pattern Parser” is far too complicated to decode.If there was a StdOut Writer then it would be much easier to supply examples in the help. Simply paste the entire xml plan into the help. Each plan would only need a Random Record Generator to create one record, the step being displayed (Pattern Parser) and a StdOut Write to write the output to the console of the eclipse desktop.

Humanise MDM and Automate Testing With APIs

What does the exclamation mark mean in pattern groups as in the Multiplicative Pattern Parser?ie this (found in the tutorial){FIRST_NAME!}{LAST_NAME!}{FIRST_NAME!}{INITIAL}{LAST_NAME!} As usual it’s not explained in the help, and the help says see examples. The help is very thin and too much text to explain nothing. One tutorial example isn’t enough. There should be several examples building from the simplest hello world example to more complex. Can’t edit my community profile name so it looks like I’m accidentally stuck with Pattern Groups    

I want to concatenate the values of one attribute in a group of records. Inputcustomer  purchased0000001   shoes0000001   belt0022222   pants0022222   jacket The output I want iscustomer  accumulated0000001    shoes belt0022222    pants jacket The representative creater offers best and second to access records in a group, or aggregations like avg, sum. This question asks how to build an expression in a group to concatenate the the values.I looked at the Record Descriptor steps as maybe offering a solution but the help is very thin.    

Hello guys, I'm using Master Data Center 12.7 and I have the below scenario:I have a Kafka Server for development and another one for production, they are set with different username and password, so I need to connect to them:Without putting these username and password values directly in my code. In a way that MDC recognizes if it need to use development or production values. So, is there a way to setup it to use secrets (like database and server passwords) managed in Vault by HashiCorp? If it's not, how can we use ENV variables to achieve the requirements above? Thank you,Victor Costa.

Hi Everyone,We have setup SQS on the IDE and noticed that the NME config(nme-stream-gen.xml) under file is empty and is not generating any JMS config tags.  We are using One desktop release 13.8. As per the Ataccama documents, the NME config file should generate JMS details on its own. Does anyone know a fix for this?

On release 13.8 IDE, we have configured JMS and each time we run the mdm server, we get the error:  Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'jmsProviderComponentInstance': Invocation of init method failed; nested exception is com.ataccama.dqc.server.config.ConfigException: Cannot initialize JmsProviderComponent: Cannot instantiate class: com.ataccama.dqc.jms.sqs.SQSInitialContextFactory Did anyone encounter this with JMS?

Hi,I am using DQC and setting it up as a DQ Window service. This provides the server’s Admin centre. I would like to secure this using the users.xml and role-mapping.xml to get started. I have been able to configure it so that it prompts for login credentials but i am unable to actually login. Does any have an example of the users.xml and role-mapping.xml that works together? or any docs that i could refer to? We are using DQC v12.3.the following is what i have configured in the server.config.xml:i have only included the sections that are relevant:         <component class="com.ataccama.dqc.server.services.AuthenticationService">            <methods>                <method class="com.ataccama.dqc.communication.auth.server.PasswordServerMethod">                    <provider class="com.ataccama.dqc.communication.auth.server.FileBasedIdentityProvider">                        <configFile>users.xml</configFile>                    </provider>        

Hi community members, How are you using Ataccama API’s in your project. I am explaining the most common scenario which we have in our project. I have a need to use Ataccama API part of data pipelines, i.e right after reading the source. execute the ataccama jobs. Per my understanding the Ataccama API is capable of doing below items thru API calls:Running DQ EvaluationProfilingRun Catalog itemRun Monitoring etc This will not be truly data pipeline usage, For eg) I wanted to run a DQ Evaluation and based on the result of the DQ Evaluation, I would like to capture the results Success/Failure + failed records(if there are any failures). Is it possible with Ataccama API’s? Have any one tried similar approach or if not want to understand the API usage in your projects

According to the documentation multiple listeners are allowed to be configured - Trying to configure mdm to listen at more than 1 port results in the following error on the first defined listener with only 1 other working :HTTP ERROR 500 org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'keycloakSecurityConfigurer': Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No qualifying bean of type 'com.ataccama.server.http.security.keycloak.KeycloakSecurity' available: expected at least 1 bean which qualifies as autowire candidate. Dependency annotations: {} Am I doing something wrong? 

According to MDC 12.7 Documentation , we are allowed to define multiple listeners in the HttpDispatcher on different ports.When I try to do that, I get the following error trying to access one of the ports (the first one defined in order top to bottom in the serverConfig) , leaving me with only 1 working listener HTTP ERROR 500 org.springframework.beans.factory.UnsatisfiedDependencyException: Error creating bean with name 'keycloakSecurityConfigurer': Unsatisfied dependency expressed through constructor parameter 0; nested exception is org.springframework.beans.factory.NoSuchBeanDefinitionException: No qualifying bean of type 'com.ataccama.server.http.security.keycloak.KeycloakSecurity' available: expected at least 1 bean which qualifies as autowire candidate. Dependency annotations: {}Is there are workaround for this?  

When you start the workflow, in the last step, emails are sent using SMTP. When executing a task, the process throws the error java.net.SocketTimeoutException: Read timed outI suspect this is due to the fact that too little time is allotted for the connection, which is why the SMTP server does not have time to return a response. Is there a configuration file somewhere in ONE desktop where you can manually set the time on timeout ?  

Is there a way to ingest data from a kafka topic as a connected system in ataccama?

Hi,I am creating an export operation, I have an entity 01, with a list of users and an entity 02 with email addresses:Entity structure I need to convert this to an export file with the next structure: Export file layoutI would to know if there a step to help me grouping the data for this purpose. Thanks in advance,Alejandro

It is worth immediately clarifying that I have admin rights. I create a policy and after creation there is no block for creating conditions. Are there any guesses? Policy Managment Block 

Will ataccama support vault model? For example on Day 1 - My name is entered as “Karthika” day 2 - “Kar” Day 3 corrected as “Karthika”. 

We are having a difficult time connecting a MS SQL database to Ataccama

This is needed when a user would like to go directly to the platform and skip the “login with Azure AD SSO or OKTA” page. This can be turned on (or off) by following the below directions: Login to the Keycloak Administration Console Ensure the Ataccamaone Realm is selected In the left-hand-menu, Click on Authentication Under Flows select Browser  On the Identity Provider Redirector line, click on Actions and select Config a. If you would like to disable (turn off) the auto login - we can select the ‘disabled’ radio button on the Identity provider redirector line Enter the name of the Identity provider, e.g. saml, in both the Alias and Default Identity Provider boxes Select Save

Hi,I am wondering to know if is good idea:use MDC Reader step for delta export operations where we need to complement data from entities of other layer   oradd another Data Sources with full mode of this other entity, then use a Join step to get the information required.  Both are feasible, not sure what is better talking about batch processing, performance, etc.

Hello Ataccama gurus--- Has anyone here integrated with OneTrust before? It’s something that’s come up at 2-3 potential projects at different customers recently, and I’m curious of any previous experience people may have nad, or not with this? (What type of data would be kept at each side, methods of synchronisation (assuming API & metadata readers/writers. Any re-usable components available?)Cheers! 

I need the party entity (MDC -ataccama one) to send a notification to kafka when insert or update

When I am publish message in kafka, it throw exception error I am using ataccama 12.7 com.ataccama.nme.core.NmeException: java.lang.NullPointerException at com.ataccama.nme.engine.event.handler.SimpleEventProcessor$NmeSimpleEventProcRuntime.publish(SimpleEventProcessor.java:66) at com.ataccama.nme.engine.event.handler.NmeEventPublisherBase$Runner.mainLoop(NmeEventPublisherBase.java:210) at com.ataccama.nme.engine.event.handler.NmeEventPublisherBase$Runner.run(NmeEventPublisherBase.java:172) at java.base/java.lang.Thread.run(Unknown Source)Caused by: java.lang.NullPointerException at com.ataccama.dqc.streaming.io.writer.KafkaWriter.validate(KafkaWriter.java:130) at com.ataccama.dqc.model.validation.ValidationUtils.validateRecursiveInternal(ValidationUtils.java:158) at com.ataccama.dqc.model.validation.ValidationUtils.validateRecursive(ValidationUtils.java:127) at com.ataccama.dqc.tasks.common.config.ValidatingStepConfigBase.validateElement(ValidatingStepConfigBase.java:39) at com.atacca

 This article will explain how you can build a relationship between different entities in Gen 2. Out-of-the-box you can have relationship between the same entities - e.g. Catalog Items. But what if you would like to define a relation between different entities? E.g. Source and Report (custom entity)? Following are steps that will explain how to do it. AssumptionsYou have your two entities between which you would like to have a relationship. For this article we will use source (default entitiy) and report (custom). Create the relationship entityFirst, go to the Global Settings (or Organization) → Metadata Model and create a new entity that will store the relationships. Name it e.g. sourceReportRelationship. It will have following properties:order (Integer) source (Referenced Object: source) target (Referenced Object: report) type (Referenced Object: relationshipType). Put the new relationship entity in metadata entityUnder Metadata model, navigate to the entity metadata. Add a new prope

Hi Team, I have few data loads that read data using API’s and writing to Snowflake tables. Often the data is incomplete & inconsistent. Im checking if I can use Attacama to compare the data between different snowflake schema’s : eg) Raw vs Curated? I understand we can write SQL Execute (select col1 from Tab A minus select col1 from Tab b and create a plan. But i have 500+ jobs and needs a lot of plans to be created. Looking for correct way of doing this?