Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Hello,Is this possible now in latest version? I am using 15.4.0. Requirement is to schedule profiling of specific schema in the database. Or subset of that schema if schema is too big (set of tables).Thanks in advance.
We are on RDM v14.5.1, on PaaS, so underlying db is postgres.I need to query a table using the RDM Extended Reader step with a filter. The volume of this table will grow, so I much prefer to filter at the reader step, rather than bring the whole table into the plan and then filter, to manage performance.I have a column, from_date, that is datetime type. I have from_date in my data flow, and I want to query RDM for a day prior.Expecting that this is an SQL where clause, I tried to put in syntax compatible with Postgres So I created a column called “row_filter”, with type string. Using postgres to_timestamp functionday_prior:=dateAdd(from_date,-1,'DAY');day_prior_string:=tostring(day_prior,'yyyy-MM-dd HH:mm:ss');"from_date=to_timestamp('"+day_prior+"','YYYY-MM-DD HH:MI:SS')" This one gave an error of:13.05.2024 13:10:00 [INFO] Ataccama DQC engine initialized.13.05.2024 13:10:00 [INFO] Creating runtime...13.05.2024 13:10:00 [INFO] Starting runtime...13.05.2024 13:10:00 [INFO]
Step-by-step setup guide for a local Windows environmentAtaccama MDM 17.1 introduces an experimental Model Context Protocol (MCP) Server that enables AI assistants to access MDM metadata, records, relationships, and tasks.This guide explains how to configure the MDM MCP Server, enable OAuth 2.0 authentication through Keycloak, and connect Claude Desktop using mcp-remote.The integration allows users to retrieve MDM records and explore available metadata using natural-language queries. 1. Prerequisites Ensure the following components are available:Component Requirement Ataccama MDM Version 17.1 with MCP Server support Keycloak Administrator access to the MDM realm MDM Server configuration Access to application.properties Claude Desktop Installed and authenticated Node.js Installed with npm and npx npm registry Accessible for downloading mcp-remote The local environment used in this guide has the following configuration:Component Address MDM Server http://localh
Hello fellow data enthusiasts,We’re starting to look into the lineage feature of Ataccama and we want to get it right. Calling other customers who already use lineage, and also if a representative from the Product team could chime in, that’d be amazing!I’m reviewing how our data catalog sources / connections are set up, and how that needs to / doesn’t need to relate to how the scan plans are configured.For the catalog, for example:Sources: A source system. I’m in the insurance business, we’d have Policy Admin systems, Claims systems, Accounting systems, Datawarehouse etc. I’d put each one of them separately Connections: Possibility of multiple connections for a given system, as each system might have separate databases. We use MS SQL and we do have a database server that has multiple databases sitting in it, and data moves between them. SQL CIs / VCIs: These go under the source into the workspace / foldersDoes this have any bearing as to how the lineage scan plans are set up?One scan p
We connect our Ataccama dev environment to multiple environments for our source systems.E.g. We have 3 non-prod environments for System A, 2 non-prod environments for System B.How do you organise them in your Sources / Connections? Do you do one of the below or go completely different?Source Connection System A Dev db 1 Dev db 2 Tst db 1 Tst db 2 Pre db 1 Pre db 2 System B Dev db 3 Dev db 4 Pre db 3 Pre db 4 OrSource Connection System A Dev Dev db 1 Dev db 2 System A Tst Tst db 1 Tst db 2 System A Pre Pre db 1 Pre db 2 System B Dev Dev db 3 Dev db 4 System B Pre Pre db 3 Pre db 4
Version 16.3.0, on PaaS.Normally, our Ataccama team gets access to all workflows in the admin centre.I’ve got a use case where we want to allow users with 1 RDM role to run 1 workflow. They should not be able to run any other workflows.I’m trying to play with the intercepturls in the git project.I tried giving access to the welcome page, but it comes up weird. Normal welcome page: Welcome page for my test user: How do I neatly provide the access to just that 1 workflow but also allow them to navigate to it? Or am I stuck having to give them the exact URL? I can’t give /console/wfConfigs/** to allow them to browse to the workflow, because that would automatically allow them access to all workflows.Any ideas?
Hello, How can I schedule DQ Eval for multiple Glossary terms at same time instead of repeating the process for each separately? Thanks
I am promoting a SQL Catalog Item from Environment A to Environment B in Ataccama ONE.The SQL Catalog Item does not exist in Environment B, so it is expected to be created as part of the import. The required Location/Source GUID mappings are already configured.The challenge is that the SQL Catalog Item contains an SQL query with an environment-specific schema name.For example, in Environment A, the query contains:FROM ENV_A_SCHEMA.brz_pa_oracle_view.table1WHERE Report_Snapshot_Date = ( SELECT MAX(Report_Snapshot_Date) FROM ENV_A_SCHEMA.brz_pa_oracle_view.table1)LEFT JOIN ENV_A_SCHEMA.brz_pa_oracle_view.table2 pmIn Environment B, the schema should be: FROM ENV_B_SCHEMA.brz_pa_oracle_view.table1 and similarly for the other tables.What I triedBased on the Environment Mapping documentation, I configured a scalar mapping for the Location: { "location.name": [ { "pattern": "^<ENV_A_SCHEMA>$", "replacement": "<ENV_B_SCHEMA>" } ]}The Location mapping works a
Hi community!Today, I have a quick tip to share on how to pass a dynamic query into a JDBC reader. If you are using ONE Desktop as part of your day-to-day this would be a good practice to implement when it comes to using the JDBC reader step.OverviewThe following is a working example of passing a dynamic query into a JDBC reader. Its overall structure consists of two plans that are run sequentially in a workflow. The idea is that the first plan will produce the query that the second plan (that includes our main logic) will use.In the above example, an audit table is read in the second DQC plan, but with a query that depends on information on the current state of the table (for example, the maximum of a particular record, record count, and latest refresh date). First Plan - Retrieving QueriesIn the first plan, functions and variables are applied to produce a .sql file that contains the JDBC reader query to be used.As an example, functions can include getting the current date to apply a
Hi everyone, Today’s post is specifically on Collibra! So if you work with Collibra and are curious about how to integrate it with Ataccama ONE Desktop read on. This post will cover how you can harness the power of the Collibra Reader and Collibra Writer steps to effortlessly manage Data Quality (DQ) Rules. PrerequisitesBefore we dive in, ensure you have the following essentials:Ataccama ONE Desktop: Make sure it's installed on your machine with a valid license. Collibra: You need an active Collibra instance, complete with valid credentials for accessing and managing assets.Setting Up a Collibra Server ConnectionLet's establish a connection to Collibra from ONE Desktop:In ONE Desktop, right-click on Servers, and choose New > Server. Fill in the details: Implementation: Choose Generic. Name: Give your connection a meaningful name. URL: Provide the URL of your Collibra instance. Authentication: Select Basic. Username: Enter your Collibra username. Password: Input your Collibra
In large RDM implementations containing dozens of datasets and hundreds of business rules, choosing the appropriate Ataccama RDM capability improves consistency, reduces implementation effort, and makes solutions easier to maintain. Selecting the Right Validation Mechanism The first design decision is not how to write a validation, but which Ataccama RDM capability is best suited to implement the business requirement. Using Dataset Configuration RequiredUse the Required property for mandatory attributes instead of validation expressions such as: column is not null GeneratedUse the Generated property for business key attributes that should remain unchanged after record creation. Using Custom Data Types (Domains) Reusable attribute constraints should be implemented as Project Data Types (Domains) rather than duplicating the same validation logic across multiple datasets. Typical examples include:Requirement Domain Example Configuration Data type Integer, Long, Float, B
Yes, it is clearly stated in the documentation (Scheduler - Ataccama ONE Gen2 Platform Latest), but it is also easy to overlook: scheduling plans for workflows look a bit like crontab schedules. But they aren't.Example workflow scheduling plan:<?xml version='1.0' encoding='UTF-8'?><scheduleDefinition> <description>ATAC_DWH - Load Dimensions and Facts</description> <enabled>true</enabled> <job workflow="myorg:ATAC_DWH_dims_and_facts.ewf" class="com.ataccama.adt.scheduler.job.WorkflowJob"/> <scheduling>0 20 1-5 *</scheduling></scheduleDefinition> For example, when you want to schedule workflow Monday to Friday at 20:00 you might think “easy, I just go to crontab.guru, Fill in what I want and voila”: the schedule plan will be 0 20 * * 1-5.Except you will notice that your workflow will also run in weekends. Because the format of the workflow scheduler is:minutes hours day_of_week day_of_monthIt has only
An Ataccama RDM implementation starts with business requirements and results in an RDM configuration. Throughout the implementation, consultants produce numerous artefacts, including validation rules, migration plans, test cases and technical documentation. Although these artefacts serve different purposes, they all describe the same solution. Traditionally, creating and maintaining these artefacts requires navigating business requirements, XML configuration files and project documentation. Large Language Models (LLMs) can accelerate this process by generating implementation artefacts and analysing the completed configuration.The following sections demonstrate practical examples of how AI can support different stages of an Ataccama RDM implementation. AI Support Across the RDM Implementation Lifecycle№ Project stage Project task Input Coverage AI support 1⃣ Design Validation Rule and Lookup Design Business requirements, data model, sample data, DQ rule templates Ful
CSV and TXT imports through the Ataccama RDM Web UI can complete with non-intuitive status messages, making it difficult to understand what happened or how to fix the input file.This article explains the most common import messages, what they mean, and where to find additional information to diagnose and resolve import issues. Import Completed Successfully Two common scenarios produce the same completion message. Scenario Message Meaning Records were created or updated ‘Import’ operation finished successfully. The import completed and changes were applied. Imported data is identical to existing records ‘Import’ operation finished successfully. The import completed successfully, but no changes were required because the imported data already matches the current data. Import Completed with Warnings A warning indicates that the import completed, but some records could not be processed. Scenario Message
During data migration or bulk imports, validation issues are often spread across multiple RDM datasets. Although each dataset provides its own validation results, reviewing them individually requires switching between datasets and records, making it difficult to assess the overall quality of the imported data.A consolidated validation report provides a single view of validation issues across the implementation, allowing data stewards and developers to quickly identify affected datasets, records, attributes, and validation messages. Retrieving Validation Results The report follows the same retrieval pattern for every dataset. The only dataset-specific elements are the dataset name and the business key displayed in the report.The query performs the following steps:Reads validation results from the validation table (<dataset>v). Shows validation results for both the published (<dataset>) and draft (<dataset>e) versions of the dataset. Returns only validation entries
Expression validations allow business-specific data quality rules to be implemented directly in Ataccama RDM without custom development.Each validation consists of two parts:Validation Expression – defines the business rule. Validation Message – explains why the value is invalid and how it can be corrected.Both components are equally important. A well-designed validation not only prevents invalid data from being entered but also helps business users understand and resolve data quality issues efficiently. Before Implementing a ValidationBefore implementing a validation, define the following:Item Description Business requirement The business rule to be enforced Target attribute The attribute being validated Validation expression The logical expression used to evaluate the rule Validation message The message displayed when the validation fails Step 1. Define the Validation RuleThe validation expression defines the condition that an attribute value must satisfy to be consi
Hello Ataccama Community,We are using Ataccama ONE 17.0 and have configured Business Term hierarchies along with Data Quality Evaluation Rules.Our requirement is to display an aggregated Data Quality score on a parent Business Term based on the quality results of its child terms.Could anyone please suggest the possible ways to do so within the Web App itself as :Whether Business Term hierarchy quality rollup is supported in our Ataccama ONE 17.0 deployment.Whether any server-side configuration, feature flag, or platform setting is required to enable parent-term quality aggregation.If supported, please provide the configuration steps or documentation reference.We have reviewed the Business Glossary and Data Quality configuration screens but do not see any hierarchy rollup setting available in the Web App.Thank you for your assistance.Regards,Advait Kulkarni
Hi Team,Do you have any code snippet to Integrate Ataccama with Collibra ?I would like to map ataccama catalog item and its metadata with Collibra and vice versa.Similar way for Business Terms, & Data Quality RulesAny documentation or code snippet related to requirement will help
I’m trying to implement a monitoring project on two tables: one a database table, and another a virtual catalogue item. I would like to tag selected mandatory attributes on both tables.While I can see the “+ make mandatory” feature on the database table (1st screenshot), I cannot see it for the virtual catalogue item (2nd screenshot). It would be good to be alerted of unplanned changes in table structures in both cases.
Good Day, I would like to firstly, thank God almighty for this Ataccama platform that he granted me chance to be its member. I managed to start level 1 and complete various exercises.
Hello Ataccama,I would like to share an observation regarding the behavior of the review workflow and approver access rights.We have an entity with the review workflow enabled, where the approver is defined as a specific group (not based on stewardship assignments).From my testing, I observed that when a user publishes the entity for the first time and the review workflow is triggered, the approver group automatically receives full access to the entity. This happens regardless of whether stewardship is assigned or not.However, the behavior seems different when entities are uploaded in bulk from ONE Desktop. If multiple entities are imported without stewardship assigned, the review workflow is skipped during the initial publication. As a result, only the creator can access the entities, which is the expected behavior.Later, if one of these entities is modified manually, the review workflow is triggered as expected. The approver group can review, approve, and publish the changes. Neverth
Hi everyone,I have a business term called Customer Status. This term is sourced from the Status column in the following table:Customer | Status | UpdateTime---------|--------|---------------------1 | Gold | 08.07.2026 00:00:002 | Silver | 08.07.2026 00:00:003 | Bronze | 08.07.2026 00:00:00I would like to define a timeliness rule for the term based on the UpdateTime column, e.g. Customer Status term is timely if: dateDiff(UpdateTime, today(), “DAYS”) < 2Is this possible?
I would like to implement a DQ accuracy rule where Attribute A is accurate if and only if its value is greater than Attribute B. Attribute B cannot be derived from Attribute A. For example: Attribute A: Date of DeathAttribute B: Date of BirthRule: Date of death needs to be greater than date of birth for a particular person.
Hello, I'm working on a MDM project and need help with workflow-governed record creation via the REST API.I have an integration where record creation requests come in from a third party application with the required record details.I pick up those details and use them to create a new master record in MDM via POST /api/rest/master/{viewName}/{typeName}Currently the record gets created and published immediately, completely bypassing the workflow.What I actually need is for this record creation to go through the workflow, meaning it should create a task in draft state with the actual record details, and then go through the configured approval workflow steps before being published.Is there a way to achieve this via the REST API? Any workarounds or approaches others have used for this would be really helpful.
HelloI am getting new line character while extracting metadata (column name) from catalog in DQC. I need to replace that with space. Data is extracted as a csv and this new line character is breaking my csv. How can I do that?
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.