Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
We were trying to get the first name and middle name parsed out of an embedded array objectΒ using the json parser, but for some reason, anytime we called name_info.nameΒ It would only return the middle name, we saw this patter on all records, if name has middle name, then middle name only would show, if no middle name, then first name would show. With the json parser, it should have returned one line for first name and one line for middle but it didntΒ Solution:Β create a data stream that goes from root into name, then for the attributes in that data stream, you will use an @ as the path for the attribute. This will then give you a separate line for first and middle name. The documentation for 13 has this, but since we were working with 12.6 we went through trail and errorΒ Β "name_info": [ { "name": [ "John", "A" ] }]Data structure example
Is there a stdout writer, or anything that can echo output?This would be the perfect compliment to the Random Record Generator. The ability to specify an input (Random Record Generator) and output (StdOut Writer) without having to use Text File Reader / Writer would allow the help to be much better without having to provide the tutorials (which are complicated).Β I want just the simplest hello world example for the Pattern Parser to simply split two words separated by white space (please supply!). But the help is inadequate with too much text and no simple example, and the tutorial example β06.04 Pattern Parserβ is far too complicated to decode.If there was a StdOut Writer then it would be much easier to supply examples in the help. Simply paste the entire xml plan into the help. Each plan would only need a Random Record Generator to create one record, the step being displayed (Pattern Parser) and a StdOut Write to write the output to the console of the eclipse desktop.
HiI need an example of using JSON Call.I try a simpleΒ REST API call, but it does not work.ThanksΒ
Humanise MDM and Automate Testing With APIs
What does the exclamation mark mean in pattern groups as in the Multiplicative Pattern Parser?ie this (found in the tutorial){FIRST_NAME!}{LAST_NAME!}{FIRST_NAME!}{INITIAL}{LAST_NAME!}Β As usual itβs not explained in the help, and the help says see examples. The help is very thin and too much text to explain nothing. One tutorial example isnβt enough. There should be several examples building from the simplest hello world example to more complex.Β Canβt edit my community profile name so it looks like Iβm accidentally stuck with Pattern GroupsΒ Β Β Β
I want to concatenate the values of one attribute in a group of records.Β InputcustomerΒ purchased0000001Β Β shoes0000001Β Β belt0022222Β Β pants0022222Β Β jacketΒ The output I want iscustomerΒ accumulated0000001Β Β shoes belt0022222Β Β pants jacketΒ The representative creater offers best and second to access records in a group, or aggregations like avg, sum. This question asks how to build an expression in a group to concatenate the the values.I looked at the Record Descriptor steps as maybe offering a solution but the help is very thin.Β Β Β Β
Β
Β I have created Business term employee id and detection and DQ rules and linked the rule to business term wherever possible but when I tried to evaluate the following error displayed always: Please help!Β Couldn't run DQ evaluationNo matching rules found for term attributes.
How can we write case statements in Ataccama one web DQ rules?As of now we are writingΒ multiple conditions with distinct invalid statements. I am looking for a better approach rather than going the traditional way.Β Thanks,Mahesh
@anna.spakovaΒ @CatherineΒ I need some sample look up file so I can understand the format of the look up file. Could you please provide. Thanks!
Hello guys,Β I'm using Master Data Center 12.7 and I have the belowΒ scenario:I have a Kafka ServerΒ for development and another one for production,Β theyΒ are set with different username and password, soΒ I need to connect to them:Without putting these username and password values directly in my code. In a way that MDC recognizes if it need to use development or production values.Β So, is there a way to setup it to use secrets (like database and server passwords) managed inΒ Vault by HashiCorp?Β If it's not, how can we use ENV variables to achieve the requirements above?Β Thank you,Victor Costa.
Hi Everyone,We have setup SQS on the IDE and noticed that the NME config(nme-stream-gen.xml) underΒ file is empty and is not generating any JMS config tags.Β We are using One desktop release 13.8. As per the Ataccama documents, the NME config file should generate JMS details on its own. Does anyone know a fix for this?
On release 13.8 IDE, we have configured JMS and each time we run the mdm server, we get the error:Β Β Exception encountered during context initialization - cancelling refresh attempt: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'jmsProviderComponentInstance': Invocation of init method failed; nested exception is com.ataccama.dqc.server.config.ConfigException: Cannot initialize JmsProviderComponent: Cannot instantiate class: com.ataccama.dqc.jms.sqs.SQSInitialContextFactoryΒ Did anyone encounter this with JMS?
Hi,I am using DQC and setting it up as a DQ Window service. This provides the serverβs Admin centre.Β I would like to secure this using the users.xml and role-mapping.xml to get started. I have been able to configure it so that it prompts for login credentials but i am unable to actually login.Β Does any have an example of the users.xml and role-mapping.xml that works together? or any docs that i could refer to?Β We are using DQC v12.3.the following is what i have configured in the server.config.xml:i have only included the sections that are relevant:Β Β Β Β Β Β Β <component class="com.ataccama.dqc.server.services.AuthenticationService">Β Β Β Β Β Β Β Β Β <methods>Β Β Β Β Β Β Β Β Β Β Β Β <method class="com.ataccama.dqc.communication.auth.server.PasswordServerMethod">Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β <provider class="com.ataccama.dqc.communication.auth.server.FileBasedIdentityProvider">Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β <configFile>users.xml</configFile>Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β </provider>Β Β Β Β Β Β
Hi community members,Β How are you using Ataccama APIβs in your project. I am explaining the most common scenario which we have in our project. I have a need to use Ataccama API part of data pipelines, i.e right after reading the source. execute the ataccama jobs. Per myΒ understanding the Ataccama API is capable of doing below items thru API calls:Running DQ EvaluationProfilingRun Catalog itemRun Monitoring etcΒ This will not be truly data pipeline usage, For eg) I wanted to run a DQ Evaluation and based on the result of the DQ Evaluation, I would like to capture the results Success/Failure + failed records(if there are any failures). Is it possible with Ataccama APIβs? Have any one tried similar approach or if not want to understand the API usage in your projects
Hi all!Please tell me where to look to cope with the error "Cannot submit job: Cannot execute task 'preprocess job' for job xxx. Caused by: Cannot retrieve metadata node" when starting remote plan execution. When the plan is run, it goes through the SUBMITTED and PREPROCESSING stages and then ends up in the FAILURE stage with the above error.For clarification: my account has full admin rights in ONE Web, so I have access to the catalog item.
simply IΒ use here twoΒ columns date and kpi and sorting of date its fineΒ but if we useΒ record descriptor builder,Β its missing the date wise sorting.out:Β Steps:Sort βΒ have date column sorting.AlterβΒ have rd1 <String> and record_counter<Interger> Column additionRecord descriptor builder βΒ have rd1 binding with date and kpi columnΒ Β
I would like to add new column e.g. Description to the column bar, next to Abbreviation,Β but not familiar how to achieve it?Β Β current layout syntaxΒ
Hi there,Β From the official website, IΒ Β found the business terms could show data quality score on from category to element term level.Β Β I wonder how the sub-category itemΒ do an aggregation data quality score based on the element(column items). I understand that data quality rule could apply on column level or table level to show the quality result.Β Β For our current environment, Iβve set the hierarchyΒ relationship, Data DomainΒ is parent relationship toΒ Data set, Data Set is the Parent relationship to Tables, which looks like Data Domain > Data Set > Data Table. How can it show data quality score on Data Set(Sub-category)Β and Data Domain level(Category).Β Β Β Thank you!Β Best regards,VickyΒ Β
Hi Experts,Maybe Iβm missing something here. Iβd like to get the name and id of the monitoring project, catalog item in a post process, but the integration input doesnβt provide those, right? (Why nut? Or am I missing some system pars I could use here?) So how can I get these quickly?Thank you!Β
Hello. everyone! Has anyone encountered a problem withΒ large directory(example: 150 values).Β How did you solve this issueΒ andΒ make clearΒ to this directoryΒ easy in the Ataccama ONE itself, without using other external softwares, services?Β
Hi, is it possible to use data from two data sources in one catalog item? Is there an instruction regarding such task? Letβs say we have data in ERP and separate data in MDM tool, which areΒ not the part of the ERP itself, and we want to check if data in both are consistent for same records. Weβve heard, that it should be done by converting catalog items in IDE (at least for Gen1), but Iβm not sure how should it be working.Β
Did you ever useΒ valueList:property trait? No? Maybe this article will change your mind.What are traitsFirst things first. What are traits?Β Traits are used to enable additional configuration on our entities in the metadata model. They are either property traits (applied to properties) or entity traits (added to entities). Example can be a trait calledΒ fe:term that allows to give a term subtype a different color. Link to the full list of traits as well as how to apply them can be found at the end of this article.Why to useΒ valueList:property traitNow, what isΒ valueList:property trait? It is a trait that will (simply put) make properties look like terms. It will change the designΒ from the underlined text or list of underlined entities to small boxes. While it adds more to the design of the layout, it can also be very beneficial for arrays of embedded objects.Β If you have many values for this type of property, Ataccama will show only first 10 values and additional will be on other pages.
i found below string fucntion. in help document but it will check [A-Za-z]Β pattern.stringΒ matches(stringΒ srcRegex,Β stringΒ srcStrΒ [,Β stringΒ caseInsensitive=false])Β
Could someone pls share the link to learn about Ataccama one functions and expressions to refer
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.