Data Quality & Catalog ⚙️

DPM and DPE - Ataccama ONE Gen2 Platform Latest Once DPE connects to a data source, it creates metadata and optional sampling of records that do not satisfy DQ rules. Could you please answer the following questions or direct me to a link that can answer the below questions?1. Does DPE create other temporary files as a result of processing as well?2. What happens to the metadata, sample records that do not satisfy DQ rules and any temporary files generated during processing after the connection to the data source get closed?3. How does purging of data works in Ataccama?

What does the id mention in invalid_rules column in Monitoring Project Export refer to?the alphanumeric term within() after rule name as in the image below Is this the ruleId of the rule? If not, what does this refer to?Is there a way I can configure Metadata Export step to give rule id?

The idea is to divide the invalid_rules column as obtained in export for Monitoring Project into two columns- one containing the rule name and the other containing the explanation; and implement this for all the rules mentioned in a cell.For example, The below cell would be divided into invalid_rule_name column containing two records-validation [USA] State and calidation[Noth America] Phone Numbers, and invalid_rule_explanation column containing explanation for the respective rules. The challenge I am facing here is that the rule ID mentioned in Monitoring Project report export is not the same as the rule ID mentioned in the list of rules I export; which I am trying to use to identify the rule in invalid_rules column from Monitoring Project report. Please help me find a solution for this

​Hello everyone! Foreword and problem statement There are several subcategories of terms. I need to set up access for manager and steward of each subcategory so that: The steward of certain subcategory is able to create new terms, edit old ones in his subcategory only. However, he can not publish any changes The manager, in addition to above, can publish changes, but also in his own subcategory only. I have the list of questions concerning access management in v.14.2: Is it possible to grant ownership to node? And if it’s yes, how can I implement it? Do you know any way to solve my manager-steward task? (there are my understanding of the solution below) In States of approval workflow what are the “User roles” : governance or identity provider ones? (looks like the second ones, but doesn’t work) what is the “OWNER” for this version of workflow? _______________________ There is a long prelude to where the questions came from. Version: 13.9 There is the ability to create a special capabil

METADATA MODEL The metadata model is used to configure the application entities and their properties. The Metadata Model describes the entities and their properties in the application. Web Application) use the Metadata Model to create the frontend user interface. The metadata model is also responsible for the configuration of the left navigation menu of the application. ONE METADATA PROPERTY REFERENCES Entities consist of properties of Simple types, such as strings and integers, and Object t ypes, which link the entity to other entities. ADDING NEW PROPERTY TO THE MMM MODEL Go to left panel of the Webapp and choose Global settings Choose metadata model under Maintenance Center Choose the Custom filed where you need to add the new property to CatalogItem, Glossary and sources. In our case we adding to CatalogItem Click on the Custom field CatalogItem. We can see General Information and Property. Click add property and type in the property to be added. Fill in the name and choose the typ

Hello, I have a speed of profiling data for using Oracle DB of about 4000-7000 rows per minute. I use Ataccama DQ Analyzer (Version: 11.1.1.ga-2017-06-14). Please, can you take me to advise me on how to increase the speed of profiling data for using Oracle DB? I hope to take the profiling speed to about 100 000 rows per minute... Connation config: Log: 17.03.2023 12:56:04 [INFO] Switching to logging setup from C:\Users\ECHERN~1\AppData\Local\Temp\loggingConfig3307204922660014311.tmp17.03.2023 12:56:04 [INFO] Using following licenses:17.03.2023 12:56:04 [INFO] C:\Ataccama DQ Analyzer 11\runtime\license_keys\license.plf17.03.2023 12:56:04 [INFO] Using DQ Analyzer configuration file C:\Ataccama DQ Analyzer 11\workspace\sqb_prof_pilot\data\out\sqb_all_table.plan17.03.2023 12:56:04 [INFO] Using runtime configuration file C:\Users\echernoskutov\AppData\Local\Temp\runtimeCfg1065525328424309714.tmp17.03.2023 12:56:04 [INFO] Changing CPU affinity to 4 CPU(s).17.03.2023 12:56:04 [INFO] DQ Analyz

We are using some GraphQL to ‘do stuff’. Turns out the easiest way to find the GraphQL is using the Developer-tools in Chrome or Edge. See enclosed.

What kind of MCQs are asked in Certification exam?

How are NULL’s considered? I have a case statement which gives the right value matching measure -used debug to test. But when it comes to matching rules, it skips the rule. Example: Name NPI Ramona 12345678 NULL 12345678 the 2nd row should match the 1st on NPI value and considering on of them is null. Even the scenario Name NPI NULL 12345678 NULL 12345678 these two should match together based on NPI. I do not see a special character. If I replace NULL with a value ‘A’ , they match with rule Matching on NPI. but does not work for NULL. Any thoughts or suggestions appreciated.

Hello, I’ve got a question while using DQ evaluation rules. I have been creating rules with valid and invalid messages but just the invalid message at the end does not display as intended. But when I view this in the results tab it just says OTHER as the explanation. Is there a workaround to this problem? Should I edit my rule logic to include some specific condition and leave the rest to fall under the ‘IF none of the conditions above apply THEN’ TIA for the replies.

Hi Team, Is there anyway that we can export the result of profiling in ataccama? Thanks, Ellie

Hi, We are using Ataccama one 12.6 version. We have a project containing 40+ models with 90 + rules. I am looking for an options to get the detailed invalid/failed records for each model. Like all the attributes from the model along with invalid rule instance names. The idea is to get the whole failed dataset to automate the remediation process. We already have automated process to remediate the data using other technologies. I don’t want to use the download results in csv option, because we are transitioning to latest version of Ataccama. I am looking for couple of options Extract the detailed failed records from backend tables using sqls (where Ataccama stores the results) or would like to understand how those csv files are generated in backend and use the same way to get the data and store in db. Reading data through Ataccama inbuilt API’s and loading into a db. I am going through the GraphQL options. Could you please let me know, If there is way to get the similar data through Grap

METADATA MODEL The metadata model is used to configure the application entities and their properties. The Metadata Model describes the entities and their properties in the application. Web Application) use the Metadata Model to create the frontend user interface. The metadata model is also responsible for the configuration of the left navigation menu of the application. ONE METADATA PROPERTY REFERENCES Entities consist of properties of Simple types, such as strings and integers, and Object types, which link the entity to other entities. ADDING NEW ENTITY TO MMM MODEL If you are creating an entity using the user interface, you must then add it as a property of the root entity metadata and then publish For example, if we need to add a new entity under Business Glossary named (TestEntity) to the MMM model Click on the Global settings on the left panel Choose Metadata Model under Maintenance Center We must create a new entity under Term so click on create entity Fill in the name of the Ent

During bundle deployment I see this error. I have tried different combination of Update to old bundle. Manually update the component again on the existing old bundle and upload Copying extended unification Updating OmnigenServer folders (bundle,cmd,dbms) with the backup. restarting services as needed. Any thoughts or suggestions? Thank you.

The matching component is slow at the extended unifications step for a incremental load. When a record like ‘WALGREEN%’ is loaded and there are 20K records with similar name on the instance, the records are all considered through the process of matching. Hence the process is slow when processing the increment and even if the incremental load has 11 records to process 30K records have the transaction Id and omni_modified date updated with the work order related on the instance table. When I check history, nothing changes on these records except the omni_modified_date and transaction_id to that of the work order. Tweaking the union keys to create combination of name and key factors or adding separate groups for the high count records is not helping. Any thoughts or suggestions?

Hello everyone, I created a profile of my catalog item using ONE desktop and I would like the output(.html) to be accessible to business analyst with read access. The html is only accessible on my local computer. Where’s the best / secure location to store output reports of profiling? Please chime in with any thoughts. Thank you! 😀

Hello everyone! I have an interesting task related to the desktop, we have a table combined with certain attributes and with full names, full names are divided into columns (firstname, lastname, midname) and they need to be compared with other columns (firstname1, lastname1, midname1) it is necessary to output non-matching full names. I can't compare one table between columns, I need your help. Do you know how to implement this? I will be very grateful for your help

Is it possible to Set up the detection rule, which would allow to detection of new table(s) within the Snowflake schema and trigger the required potential alerts

Imagine the scenario where you have Ataccama ONE Data Quality Monitoring Projects running regularly. Any Data Quality (DQ) issues are already exported to our DQ Issue Tracker (DQIT) module. You can also see trends of DQ over time within the Ataccama ONE Web application. You start noticing that the score for some DQ rules has had a sharp drop in quality, and you want someone to investigate this. One of our customers decided that they want to integrate Ataccama with Jira at this point. Have Ataccama raise a ticket into Jira when this happens automatically. In this article, we will explore: Preparing to integrate with Jira The Json Call step Preparations Business Understand your end users. What do they expect to see in their Jira ticket? Know which fields in the Jira ticket are mandatory Have an idea of what extra information you should supply in the detailed description of the ticket. Think about formatting and presentation. Good to understand Jira markdown notation (link) Jira Know whic

Hi Team, Our Aim is to Avoid duplication of the same data coming from different requirements (project trains) - in case of identified duplication DQ Brach alert should be reported. 1.How to identify if Somone ingested the same table in a different Snowflake schema ? Is it possible to detect duplicate table through ONE web application or ONE Desktop by creating a rule? Thanks in Advance!

I have a sql select where in I wanted to pass multiple data source names. how to make it dynamic or parameterized so that It can read all the names one by one.

Hi, For our monitoring projects post processing we use fairly standardized (sub-) components. Now for every MP / CI combination these sub-components are all the same. If an MP Postprocessing is published these components get published also, right? Is there a way to have a single version of a component stored? This would make maintenance and life-cycle-management on these components a lot easier. In stead of having to go in the PostProcessing main component, we'd just have to change one. A plausible solution would be to split things and do things asynchronously, maybe. But that is a more of a workaround. Any ideas?