Skip to main content

Data Quality & Catalog ⚙️

Discuss, learn, ask, suggest, share all things DQ&C 🔍

  • 788 Topics
  • 2,012 Replies
788 Topics
F
Data Pioneer
FCB developerData Pioneer
asked in Data Quality & Catalog ⚙️
Catalog Item Reader : "cannot retrieve metadata node"

Hi all!Please tell me where to look to cope with the error "Cannot submit job: Cannot execute task 'preprocess job' for job xxx. Caused by: Cannot retrieve metadata node" when starting remote plan execution. When the plan is run, it goes through the SUBMITTED and PREPROCESSING stages and then ends up in the FAILURE stage with the above error.For clarification: my account has full admin rights in ONE Web, so I have access to the catalog item.

1487
S
Ataccamer
M
Data Voyager
mukeshData Voyager
asked in Data Quality & Catalog ⚙️
sorting issues if we use record descriptor builder

simply I use here two columns date and kpi and sorting of date its fine but if we use record descriptor builder, its missing the date wise sorting.out: Steps:Sort → have date column sorting.Alter→ have rd1 <String> and record_counter<Interger> Column additionRecord descriptor builder → have rd1 binding with date and kpi column  

501
M
Data Voyager
V
Data Voyager
vickylau32Data Voyager
asked in Data Quality & Catalog ⚙️
How to add now column on term level page?

I would like to add new column e.g. Description to the column bar, next to Abbreviation, but not familiar how to achieve it?  current layout syntax 

2093
F
Data Pioneer
V
Data Voyager
vickylau32Data Voyager
asked in Data Quality & Catalog ⚙️
How to indicate data quality score on sub category and category terms?

Hi there, From the official website, I  found the business terms could show data quality score on from category to element term level.  I wonder how the sub-category item do an aggregation data quality score based on the element(column items). I understand that data quality rule could apply on column level or table level to show the quality result.  For our current environment, I’ve set the hierarchy relationship, Data Domain is parent relationship to Data set, Data Set is the Parent relationship to Tables, which looks like Data Domain > Data Set > Data Table. How can it show data quality score on Data Set(Sub-category) and Data Domain level(Category).   Thank you! Best regards,Vicky  

994
F
Data Pioneer
M
Star Blazer L2
Marnix WisselaarStar Blazer L2
asked in Data Quality & Catalog ⚙️
How to get the metadata for a post-processing integration input?

Hi Experts,Maybe I’m missing something here. I’d like to get the name and id of the monitoring project, catalog item in a post process, but the integration input doesn’t provide those, right? (Why nut? Or am I missing some system pars I could use here?) So how can I get these quickly?Thank you! 

1665
M
Star Blazer L2
F
Data Pioneer
FCB developerData Pioneer
asked in Data Quality & Catalog ⚙️
Directory with large values

Hello. everyone! Has anyone encountered a problem with large directory(example: 150 values). How did you solve this issue and make clear to this directory easy in the Ataccama ONE itself, without using other external softwares, services? 

472
F
Data Pioneer
B
Data Voyager
bartlomiej.konopkaData Voyager
asked in Data Quality & Catalog ⚙️
Two data sources for one Catalog Item

Hi, is it possible to use data from two data sources in one catalog item? Is there an instruction regarding such task? Let’s say we have data in ERP and separate data in MDM tool, which are not the part of the ERP itself, and we want to check if data in both are consistent for same records. We’ve heard, that it should be done by converting catalog items in IDE (at least for Gen1), but I’m not sure how should it be working. 

1365
S
Data Pioneer L2
anna.spakova
Ataccamer
anna.spakovaAtaccamer
published in Data Quality & Catalog ⚙️
valueList:property: Trait with a great power

Did you ever use valueList:property trait? No? Maybe this article will change your mind.What are traitsFirst things first. What are traits? Traits are used to enable additional configuration on our entities in the metadata model. They are either property traits (applied to properties) or entity traits (added to entities). Example can be a trait called fe:term that allows to give a term subtype a different color. Link to the full list of traits as well as how to apply them can be found at the end of this article.Why to use valueList:property traitNow, what is valueList:property trait? It is a trait that will (simply put) make properties look like terms. It will change the design from the underlined text or list of underlined entities to small boxes. While it adds more to the design of the layout, it can also be very beneficial for arrays of embedded objects. If you have many values for this type of property, Ataccama will show only first 10 values and additional will be on other pages.

1845
Catherine
Data Pioneer
M
Data Pioneer
mahesh ArData Pioneer
asked in Data Quality & Catalog ⚙️
Is there an expression to verify that a list of EMPNAME contains only characters in Ataccama one web 13.6 version ? like REG_MATCH(column,[a-zA-Z])

i found below string fucntion. in help document but it will check [A-Za-z]  pattern.string matches(string srcRegex, string srcStr [, string caseInsensitive=false]) 

932
M
Data Pioneer
K
Universe Traveller
KP_DQUniverse Traveller
asked in Data Quality & Catalog ⚙️
Ataccama one functions and expressions

Could someone pls share the link to learn about Ataccama one functions and expressions to refer

1223
K
Universe Traveller
A
Anonymous
published in Data Quality & Catalog ⚙️
#4 Detection rulesGet certified with Ataccama

We continue with our series - today’s topic is Detection rules.👉 Get Certified with Ataccama article series#1 Adding Data Sources#2 Add a Data Source to the Catalog#3 Business Terms🔎 LET’S TEST YOUR SKILLSUsing the ONE Web App, in the ONE Data Quality module, create a Detection Rule for 'Blood Type', if the value in the input column is one of the following 4 values, then Detect Term A B AB O  💡 How to do it? Navigate to Data Quality - Detection Rules and click on CreateFill in Name and other information if needed and Save itGo to tab Implementation and fill in Input Attributes - always make sure you follow best practices for naming conventions In the section Rule Logic, select DetectionSwitch to Advanced Expression, write a condition and Test RulePublish the rule Do you have any question or tips&tricks? Let us know in comments section! 

1490
A
M
Data Voyager
mukeshData Voyager
asked in Data Quality & Catalog ⚙️
How to extract the any columns data based on date value of the Nth occurence

I am doing POC to adopt ataccama, please help me out on this requirementRequirement:Previous and current run data validation.For example:what is the threshold of yesterday sales or one week back sales and todays sales 

1184
S
Data Pioneer L2
A
Data Voyager
asif shaikhData Voyager
asked in Data Quality & Catalog ⚙️
updating LKP via a web service for other web services to consume

Is there a best approach to have LKPs updated via a webservice so that other web services can consume the updated lkp without restarting DQS? I have Web Service ‘A’ which builds a dictionary file. I also have Web Service ‘B’ which uses the dictionary built by Web Service ‘A’.I would like to run Web Service ‘A’ so that Web Service ‘B’ is able to immediately use the updated dictionary without restarting the DQS service.   Currently when i run Web Service ‘ A’ I get a locked file issue:26.07.2022 12:43:56 [FATAL]   [OnlineServicesComponent][buidTestDictionary.online][buidTestDictionary][buidTestDictionary.comp] [40] Internal error occurred during run of the plan: java.nio.channels.OverlappingFileLockException[STEP Lookup Builder[Lookup Builder]]java.nio.channels.OverlappingFileLockException    at sun.nio.ch.SharedFileLockTable.checkList(Unknown Source)    at sun.nio.ch.SharedFileLockTable.add(Unknown Source)    at sun.nio.ch.FileChannelImpl.tryLock(Unknown Source)    at com.ataccama.dqc.i

1072
A
Data Voyager
M
Ataccamer
matthewtaylorukAtaccamer
posted in Data Quality & Catalog ⚙️
Expressions 101 for non-technical users...

Hi all-- Please find below an introductory primer for the Ataccama Expressions language, for those familiar with Excel formulae (which are deliberately very similar in structure and use to the way we’ve designed the expression language)… IntroductionOverviewOne of Ataccama’s core values when developing Ataccama ONE is to create a user experience which simplifies as far as possible the technical complexities of data manipulation and data quality, and to put as many capabilities into the hands of business and non-technical users as possible.With this philosophy in mind we have created a powerful expression language, which moves away from the complexity of development languages such as scripting/python/SQL. Despite containing powerful and extensible functionality for complex data challenges, the design of the expressions have been made as simple as possible, and can be easily learned by anyone with a familiarity in MS-Excel formulas and features.This expression language is used throughout

220310
M
Data Voyager
M
Data Voyager
mukeshData Voyager
asked in Data Quality & Catalog ⚙️
Does Ataccama support data class ?

I am working on 12.9 at my company, where I can see the data classification ?I do not see that, please help me out if this version support. Thanks & regards,Mukesh

321
M
Data Voyager
K
Data Pioneer
KarthikaSPillaiData Pioneer
asked in Data Quality & Catalog ⚙️
Trend Analysis in ataccama

How to Show a trend of data quality score ? Example : Trend of data quality scores is going up or low. 9/10 - Quality Score is 50%9/11 - Quality Score is 60%9/12 - Quality Score is 70 %9/13 - Quality Score is 80 %

683
S
Data Pioneer L2
K
Data Pioneer
KarthikaSPillaiData Pioneer
asked in Data Quality & Catalog ⚙️
how to change environment in ataccama web interface?

How to change  environment in ataccama web interface?

20316
S
Data Pioneer L2
F
Data Pioneer
FCB developerData Pioneer
asked in Data Quality & Catalog ⚙️
"No default credentials found" after full profiling

I did full profiling for data catalog and it finished successfully, but “Error” occured after when we want to see data. Where there may not be access for source/table?

772
F
Data Pioneer
K
Data Pioneer
KarthikaSPillaiData Pioneer
asked in Data Quality & Catalog ⚙️
Need DQ Rule

How to Check whether the target column has only DATE values or not.?

2024
S
Data Pioneer L2
A
Anonymous
published in Data Quality & Catalog ⚙️
#2 Add a Data Source to the CatalogGet certified with Ataccama

In the second article of Get certified with Ataccama series, we will focus on Adding a Data Source to the Catalog. 👉 First article of the series - #1 Adding Data Sources 🔎 LET’S TEST YOUR SKILLSUsing the ONE Web App, in the ONE Knowledge Catalog module, add your database as a data source. Using the ONE Web App, in the ONE Knowledge Catalog module, add the table you created in ONE Desktop application to the Catalog Items. 💡 How to do it? Go to ONE Web App - Data Catalog - Sources and click on CreateFill in Name and Description (if needed)Fill in Connection details - Select connection type, Name and JDBCAdd Credentials, select Credential type, fill in required information and Test ConnectionSave and publishNavigate to Connections in and click on BrowseSelect your tableFrom Profile menu select ProfileAfter the profiling is done, check that your table is in the Catalog items list Do you have any question or tips&tricks? Let us know in comments section! 

1270
A
S
Data Voyager
Sunil AroraData Voyager
asked in Data Quality & Catalog ⚙️
Salesforce Connection

Has anyone successfully connected to Salesforce environments (prod/test/dev etc.) thru One Desktop (13.7.1).  Thanks

952
Catherine
Data Pioneer
A
Anonymous
published in Data Quality & Catalog ⚙️
Automate the Delivery of High Quality DataWhitepaper

What makes manual data quality so hard to scale in large organization? Is there a step by step approach to automating data quality? Why is an automated DQM system the future of enterprise data quality?You can find an answer to all these questions (and many more!) in our latest whitepaper.👉 Download it here

430
A
A
Universe Traveller
Ajeesh_GUniverse Traveller
asked in Data Quality & Catalog ⚙️
Connect with Share point

Can we connect Ataccama to Sharepoint xl file? if yes, how can I achieve this? I am new this forum and new to ataccama.

1671
A
Universe Traveller
J
Data Voyager
justinpData Voyager
asked in Data Quality & Catalog ⚙️
Has anyone else experienced antivirus interference with DQ Analyzer 11?

My organization runs McAfee antivirus.  I’ve just tried out the DQ Analyzer 11 tool and really like it, but it takes forever to start up or perform any actions.  Just starting up, the antivirus pegs 1 CPU for about 30 minutes before the application starts.  And then various actions like starting a new profile or clicking a menu item will also be delayed by several minutes at least.We’ve tried excluding the install directory, but it hasn’t helped.  Any ideas?  Has anyone else run into this issue before, and how did you solve it? 

452
J
Data Voyager
S
Data Voyager
sd_2000Data Voyager
asked in Data Quality & Catalog ⚙️
Custom Data quality check

Can we create custom check on data as per our need and get stats out of it ??for example.. I want to check whether colA has values between list [‘A’,’AB’,’O’,’B’] and stats about the values that are present in data.

831
S
Data Voyager

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings