Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
What does the id mention in invalid_rules column in Monitoring Project Export refer to?the alphanumeric term within() after rule name as in the image belowIs this the ruleId of the rule? If not, what does this refer to?Is there a way I can configure Metadata Export step to give rule id?
The idea is to divide the invalid_rules column as obtained in export for Monitoring Project into two columns- one containing the rule name and the other containing the explanation; and implement this for all the rules mentioned in a cell.For example,Β The below cell would be divided into invalid_rule_name column containing two records-validation [USA] State and calidation[Noth America] Phone Numbers, and invalid_rule_explanation column containing explanation for the respective rules.The challenge I am facing here is that the rule ID mentioned in Monitoring Project report export is not the same as the rule ID mentioned in the list of rules I export; which I am trying to use to identify the rule in invalid_rules column from Monitoring Project report.Please help me find a solution for this
βHello everyone!Β Foreword and problem statementThere are several subcategories of terms. I need to set up access for managerΒ and stewardΒ ofΒ each subcategory so that:The steward of certain subcategory is able to create new terms, edit old onesΒ in his subcategory only. However, he can not publish any changes The manager, in addition to above, can publish changes, but also in his own subcategory only.I have theΒ list ofΒ questions concerning access management in v.14.2:Is it possible to grant ownership to node? And if itβs yes, how can I implement it? Do you know any way to solve my manager-steward task? (there are my understanding of the solution below) In States of approval workflowwhat are theΒ βUser rolesβ : governance or identity provider ones? (looks like the second ones, but doesnβt work) what isΒ the βOWNERβ for this version of workflow?_______________________There is a long prelude to where the questions came from.Β Version: 13.9There is the ability to create a special capabilityΒ to b
METADATA MODELΒ The metadata model is used toΒ configure the application entities and their properties. TheΒ Metadata ModelΒ describes the entities and their properties in the application.Β Β Web Application) use theΒ Metadata ModelΒ to create the frontend user interface.Β The metadata model is also responsible for the configuration of the left navigation menu of the application.Β ONE METADATA PROPERTY REFERENCESEntities consist of properties of SimpleΒ types, such as strings and integers, andΒ ObjectΒ types, which link the entity to other entities.Β ADDING NEW PROPERTY TO THE MMM MODELGo to left panel of the Webapp and choose Global settings Β Choose metadata model under Maintenance CenterChoose the Custom filed where you need to add the new property to CatalogItem, Glossary and sources. In our case we adding to CatalogItem Β Click on the Custom field CatalogItem. We can see General Information and Property. Click add property and type in the property to be added. Β Fill in the name and choose the
Hello,Β I have a speedΒ of profiling data for using Oracle DB of about 4000-7000 rows per minute.I useΒ Ataccama DQ Analyzer (Version:Β 11.1.1.ga-2017-06-14).Β Β Please, can you take me to advise me on howΒ to increase the speed of profiling data for using Oracle DB?I hope to take the profiling speed to about 100 000Β rows per minute...Β Β Connation config:Β Β Β Log:17.03.2023 12:56:04 [INFO] Switching to logging setup from C:\Users\ECHERN~1\AppData\Local\Temp\loggingConfig3307204922660014311.tmp17.03.2023 12:56:04 [INFO] Using following licenses:17.03.2023 12:56:04 [INFO] C:\Ataccama DQ Analyzer 11\runtime\license_keys\license.plf17.03.2023 12:56:04 [INFO] Using DQ Analyzer configuration file C:\Ataccama DQ Analyzer 11\workspace\sqb_prof_pilot\data\out\sqb_all_table.plan17.03.2023 12:56:04 [INFO] Using runtime configuration file C:\Users\echernoskutov\AppData\Local\Temp\runtimeCfg1065525328424309714.tmp17.03.2023 12:56:04 [INFO] Changing CPU affinity to 4 CPU(s).17.03.202
MAJOR CONCEPTS IN PERMISSIONSKeycloakΒ is primarily used to manage Users and Roles as well as their assignment.Β ONE Web Application - where you canΒ assign preconfigured permissions to Users and Roles. It is also possible to change the default configurationΒ and create custom permissions on the ONE Web Application. Users (Persons)Β - identifyΒ people or services who have access toΒ Ataccama ONE.Β RoleΒ - theΒ container for permissionsΒ that users can perform in ONE on entitiesΒ in alignment with the company organization chart. βRoleβ refers to the roles defined inΒ Keycloak, for example,Β MMM_ admin. UsersΒ need to be mapped toΒ Roles. ThisΒ will determine their node permissions based on the operations allowed for that role on individual nodes. A user can have more than one role assigned to them.Β Users and roles are managed primarily in the Keycloak service, thenΒ synced with ONE. UsersΒ andΒ Roles access can be regulated byΒ permissionsΒ thatΒ are configured via different blocks:Β Capabilities,Β Operation
We are using some GraphQL to βdo stuffβ. Turns out the easiest way to find the GraphQL is using the Developer-tools in Chrome or Edge.Β See enclosed.Β
Hello everyone, Anna here! I work as a projects consultant in Ataccama and today I put together a guide for you on how to export a metadata model definition from Ataccama ONE.Ataccama ONE allows to export metadata model definition from the platform into a JSON file. However, the JSON file is not an ideal format for business users. For that reason, parsing of the JSON into more user-friendly format, for instance Excel, is desired. The current JSON parser step in Ataccama DQC, however, is not able to parse this JSON structure.This article introduces a Python script that was developed to parse the JSON structure of the metadata export and provide the metadata model in Excel and CSV formats. It is supported for v13 of Ataccama ONE.As a first step, the metadata model has to be exported from Ataccama. Next step is to run the Python script on top of the exported metadata model to obtain the CSV and Excel format. Chapter JSON parser in Python describes in detail the Python script as well as th
What kind of MCQs are asked in Certification exam?
How are NULLβs considered? I have a case statement which gives the right value matching measure -used debug to test. But when it comes to matching rules, it skips the rule.Β Example:NameΒ Β Β NPIRamonaΒ 12345678NULLΒ Β Β Β 12345678the 2nd row should match the 1st on NPI value and considering on of them is null.Even the scenarioNameΒ Β Β NPINULLΒ Β Β Β 12345678NULLΒ Β Β Β 12345678these two should match together based on NPI. I do not see a special character. If I replace NULL with a value βAβ , they match with rule Matching on NPI. but does not work for NULL.Β Β Any thoughts or suggestions appreciated.Β
Hello community,I am trying to implementΒ the RDM database synchronization. However, the data from a database does not seem to be loaded back to RDM; thus, I checkedΒ the system_input plan, which is the plan that is supposed to load dataΒ back to the RDM. The key step is the RDM Merge Importer that loadsΒ data back, but after I ran the plan, there does not seem to be any data loaded to the RDM in any viewing perspective.I also notice that the columnΒ rdm_primary_key is null for every record not in RDM prior to entering the Importer step. Iβm not sure if this is an issue either.Does anyone familiar with the RDM Merge Importer step? Could you please guide me on how to use this step properly?Thank you in advance π
Hello community,Iβm implementing the RDM synchronization to sync data with a database. However, the data seems to sync only one way, which is from the RDM to the database. Whenever I add an additional record to the database manually, it gets removed after performing synchronization, and they donβt appear in the RDM inputs view.I have βUse Reverse Synchronizationβ enabled and followed the steps fromΒ Configuring RDM Synchronization with External Databases - Ataccama ONE Gen2 Platform Latest.If anyone knows how to get this working, could you please guide me on this?
Hello,Β Iβve got a question while using DQ evaluation rules.I have been creating rules with valid and invalid messages but just the invalid message at the end does not display as intended.Β But when I view this in the results tab it just says OTHER as the explanation.Β Β Β Β Is there a workaround to this problem?Β Should I edit my rule logic to include some specific condition and leave the rest to fall under the βIF none of the conditions above apply THENβΒ TIA for the replies.Β Β
Hello, here is a short video to illustrate how an organization might use Ataccama Data Quality to run checks as part of an existing data pipeline, and verify data integrity before further processing. With Ataccama, you can use various data warehouses or ETL tools, and GraphQL API integration allows conditional scheduling and more complex orchestration.In this demonstration, we use DataBricks Notebook to trigger DQ execution and retrieve the results. These determine whether to halt or commence the pipeline, and in-app dashboards display the metrics. All results and metadata can also be exported to a data mart table for further analysis and visualization.The platform is designed to provide visible and usable data quality insights, and we offer flexible integration capabilities to suit any data stack. Thanks for watching.Β
METADATA MODELThe metadata model is used toΒ configure the application entities and their properties. TheΒ Metadata ModelΒ describes the entities and their properties in the application.Β Β Web Application) use theΒ Metadata ModelΒ to create the frontend user interface.Β The metadata model is also responsible for the configuration of the left navigation menu of the application.ONE METADATA PROPERTY REFERENCESEntities consist of properties of SimpleΒ types, such as strings and integers, andΒ ObjectΒ types, which link the entity to other entities.ADDING NEW ENTITY TO MMM MODELIf you are creating an entity using the user interface, you must then add it as a property of the root entityΒ metadataΒ and then publishFor example, if we need to add a new entity under Business Glossary named (TestEntity) to the MMM modelClick on the Global settings on the left panelChoose Metadata Model under Maintenance CenterWe must create a new entity under Term so click on create entityFill in the name of the Entity, and
Is there a way to connect ataccama One Web to a private Redshift?Β
Hello, Iβm trying to demo the RDM Banking Example. However, the flag images in the Country table are not showing properly (as shown in Picture1.png).I have fixed the source CSV file to point to an online website with corresponding flag images (shown below) and run its loading plan to update the data on RDM, but those images are still not showing on RDM.Β (as shown in Picture2.png)
Hi Team,Β Is there anyway that we can export the result of profiling in ataccama?Β Thanks,Β Ellie
Hi All,Β We are getting the below error while adding an oracle database from add datasources in One web app. we give jdbc connection string, username and password(doesnt matter/validate if it is right password/username). Please check and let me know how can i troubleshoot/debug the issue. Some browser component is throwing the error.Β jdbc - format -Β jdbc:oracle:thin:@<jdbcHost>:1521:<jdbcDatabaseName>Β error when we try to connect the firstΒ time after a restart of one-tomcat servicejava.lang.RuntimeException: java.lang.ExceptionInInitializerErrorΒ Β Β Β at com.ataccama.one.browser.database.AbstractDatabaseDatasourceClient.retrieveConnectionWithTimeout(AbstractDatabaseDatasourceClient.java:119)Β Β Β Β at com.ataccama.one.browser.database.AbstractDatabaseDatasourceClient.handleRequest(AbstractDatabaseDatasourceClient.java:353)Β Β Β Β at com.ataccama.one.browser.database.AbstractDatabaseDatasourceClient.<init>(AbstractDatabaseDatasourceClient.java:92)Β Β Β Β at com.ataccam
During bundle deployment I see this error. I have tried different combination ofUpdate to old bundle. Manually update the component again on the existing old bundle and upload Copying extended unification Updating OmnigenServer folders (bundle,cmd,dbms) with the backup. restarting services as needed.Any thoughts or suggestions? Thank you.
The matching component is slow at the extended unifications step for a incremental load. When a record like βWALGREEN%β is loaded and there are 20K records with similar name on the instance, the records are all considered through the process of matching. Hence the process is slow when processing the increment and even if the incremental load has 11 records to process 30K records have the transaction Id and omni_modified date updated with the work order related on the instance table. Β When I check history, nothing changes on these records except the omni_modified_date and transaction_id to that of the work order. Tweaking the union keys to create combination of name and key factors or adding separate groups for the high count records is not helping. Any thoughts or suggestions?
Hi All,Β we have Ataccama version 12.8.0 version in our one web. Is there a connector available or how can we connect to a https url which points to a csv file?Β how do we configure https get method using security like oauth in Ataccama?
Hello everyone,IΒ created aΒ profile of my catalog item using ONE desktop andΒ I would like theΒ output(.html)Β to be accessibleΒ to business analystΒ with read access. The html isΒ only accessible on my local computer. Whereβs the best / secure location to store output reports of profiling?Β Please chime in with any thoughts. Thank you! πΒ Β Β Β Β
Hi, Iβve been trying to create a SQL catalog item in the UI using the query below. Itβs basically joining the same table twice. The query ran successfully in IDE but itβs giving me an error:Β Attribute '3' is duplicated. Please make sure that attributes have unique names. Can anyone help?select x.1, x.2, ax.3 as SSN, aze.3Β as EIDfrom table1 xinner join table 2 ax on (x.a = ax.b) and trim(ax.c) in ('1','S','Social Security Number US')left join table 2 aze on (x.a = aze.b) and trim(aze.c) in ('E','EMPL_PROVIDED_ID','Employee ID')where x.last_update_date > '2023-02-08 00:00:00.000'
Hello everyone!I have an interesting task related to the desktop, we have a table combined with certain attributes and with full names, full names are divided into columns (firstname, lastname, midname) and they need to be compared with other columns (firstname1, lastname1, midname1) it is necessary to output non-matching full names. I can't compare one table between columns, I need your help. Do you know how to implement this?I will be very grateful for your help
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.