Discuss, learn, ask, suggest, share all things DQ&C 🔍
Recently active
Hello,Is this possible now in latest version? I am using 15.4.0. Requirement is to schedule profiling of specific schema in the database. Or subset of that schema if schema is too big (set of tables).Thanks in advance.
Hello fellow data enthusiasts,We’re starting to look into the lineage feature of Ataccama and we want to get it right. Calling other customers who already use lineage, and also if a representative from the Product team could chime in, that’d be amazing!I’m reviewing how our data catalog sources / connections are set up, and how that needs to / doesn’t need to relate to how the scan plans are configured.For the catalog, for example:Sources: A source system. I’m in the insurance business, we’d have Policy Admin systems, Claims systems, Accounting systems, Datawarehouse etc. I’d put each one of them separately Connections: Possibility of multiple connections for a given system, as each system might have separate databases. We use MS SQL and we do have a database server that has multiple databases sitting in it, and data moves between them. SQL CIs / VCIs: These go under the source into the workspace / foldersDoes this have any bearing as to how the lineage scan plans are set up?One scan p
We connect our Ataccama dev environment to multiple environments for our source systems.E.g. We have 3 non-prod environments for System A, 2 non-prod environments for System B.How do you organise them in your Sources / Connections? Do you do one of the below or go completely different?Source Connection System A Dev db 1 Dev db 2 Tst db 1 Tst db 2 Pre db 1 Pre db 2 System B Dev db 3 Dev db 4 Pre db 3 Pre db 4 OrSource Connection System A Dev Dev db 1 Dev db 2 System A Tst Tst db 1 Tst db 2 System A Pre Pre db 1 Pre db 2 System B Dev Dev db 3 Dev db 4 System B Pre Pre db 3 Pre db 4
Version 16.3.0, on PaaS.Normally, our Ataccama team gets access to all workflows in the admin centre.I’ve got a use case where we want to allow users with 1 RDM role to run 1 workflow. They should not be able to run any other workflows.I’m trying to play with the intercepturls in the git project.I tried giving access to the welcome page, but it comes up weird. Normal welcome page: Welcome page for my test user: How do I neatly provide the access to just that 1 workflow but also allow them to navigate to it? Or am I stuck having to give them the exact URL? I can’t give /console/wfConfigs/** to allow them to browse to the workflow, because that would automatically allow them access to all workflows.Any ideas?
Hello, How can I schedule DQ Eval for multiple Glossary terms at same time instead of repeating the process for each separately? Thanks
I am promoting a SQL Catalog Item from Environment A to Environment B in Ataccama ONE.The SQL Catalog Item does not exist in Environment B, so it is expected to be created as part of the import. The required Location/Source GUID mappings are already configured.The challenge is that the SQL Catalog Item contains an SQL query with an environment-specific schema name.For example, in Environment A, the query contains:FROM ENV_A_SCHEMA.brz_pa_oracle_view.table1WHERE Report_Snapshot_Date = ( SELECT MAX(Report_Snapshot_Date) FROM ENV_A_SCHEMA.brz_pa_oracle_view.table1)LEFT JOIN ENV_A_SCHEMA.brz_pa_oracle_view.table2 pmIn Environment B, the schema should be: FROM ENV_B_SCHEMA.brz_pa_oracle_view.table1 and similarly for the other tables.What I triedBased on the Environment Mapping documentation, I configured a scalar mapping for the Location: { "location.name": [ { "pattern": "^<ENV_A_SCHEMA>$", "replacement": "<ENV_B_SCHEMA>" } ]}The Location mapping works a
Hi community!Today, I have a quick tip to share on how to pass a dynamic query into a JDBC reader. If you are using ONE Desktop as part of your day-to-day this would be a good practice to implement when it comes to using the JDBC reader step.OverviewThe following is a working example of passing a dynamic query into a JDBC reader. Its overall structure consists of two plans that are run sequentially in a workflow. The idea is that the first plan will produce the query that the second plan (that includes our main logic) will use.In the above example, an audit table is read in the second DQC plan, but with a query that depends on information on the current state of the table (for example, the maximum of a particular record, record count, and latest refresh date). First Plan - Retrieving QueriesIn the first plan, functions and variables are applied to produce a .sql file that contains the JDBC reader query to be used.As an example, functions can include getting the current date to apply a
Hi everyone, Today’s post is specifically on Collibra! So if you work with Collibra and are curious about how to integrate it with Ataccama ONE Desktop read on. This post will cover how you can harness the power of the Collibra Reader and Collibra Writer steps to effortlessly manage Data Quality (DQ) Rules. PrerequisitesBefore we dive in, ensure you have the following essentials:Ataccama ONE Desktop: Make sure it's installed on your machine with a valid license. Collibra: You need an active Collibra instance, complete with valid credentials for accessing and managing assets.Setting Up a Collibra Server ConnectionLet's establish a connection to Collibra from ONE Desktop:In ONE Desktop, right-click on Servers, and choose New > Server. Fill in the details: Implementation: Choose Generic. Name: Give your connection a meaningful name. URL: Provide the URL of your Collibra instance. Authentication: Select Basic. Username: Enter your Collibra username. Password: Input your Collibra
Yes, it is clearly stated in the documentation (Scheduler - Ataccama ONE Gen2 Platform Latest), but it is also easy to overlook: scheduling plans for workflows look a bit like crontab schedules. But they aren't.Example workflow scheduling plan:<?xml version='1.0' encoding='UTF-8'?><scheduleDefinition> <description>ATAC_DWH - Load Dimensions and Facts</description> <enabled>true</enabled> <job workflow="myorg:ATAC_DWH_dims_and_facts.ewf" class="com.ataccama.adt.scheduler.job.WorkflowJob"/> <scheduling>0 20 1-5 *</scheduling></scheduleDefinition> For example, when you want to schedule workflow Monday to Friday at 20:00 you might think “easy, I just go to crontab.guru, Fill in what I want and voila”: the schedule plan will be 0 20 * * 1-5.Except you will notice that your workflow will also run in weekends. Because the format of the workflow scheduler is:minutes hours day_of_week day_of_monthIt has only
Hello Ataccama Community,We are using Ataccama ONE 17.0 and have configured Business Term hierarchies along with Data Quality Evaluation Rules.Our requirement is to display an aggregated Data Quality score on a parent Business Term based on the quality results of its child terms.Could anyone please suggest the possible ways to do so within the Web App itself as :Whether Business Term hierarchy quality rollup is supported in our Ataccama ONE 17.0 deployment.Whether any server-side configuration, feature flag, or platform setting is required to enable parent-term quality aggregation.If supported, please provide the configuration steps or documentation reference.We have reviewed the Business Glossary and Data Quality configuration screens but do not see any hierarchy rollup setting available in the Web App.Thank you for your assistance.Regards,Advait Kulkarni
Hi Team,Do you have any code snippet to Integrate Ataccama with Collibra ?I would like to map ataccama catalog item and its metadata with Collibra and vice versa.Similar way for Business Terms, & Data Quality RulesAny documentation or code snippet related to requirement will help
I’m trying to implement a monitoring project on two tables: one a database table, and another a virtual catalogue item. I would like to tag selected mandatory attributes on both tables.While I can see the “+ make mandatory” feature on the database table (1st screenshot), I cannot see it for the virtual catalogue item (2nd screenshot). It would be good to be alerted of unplanned changes in table structures in both cases.
Good Day, I would like to firstly, thank God almighty for this Ataccama platform that he granted me chance to be its member. I managed to start level 1 and complete various exercises.
Hello Ataccama,I would like to share an observation regarding the behavior of the review workflow and approver access rights.We have an entity with the review workflow enabled, where the approver is defined as a specific group (not based on stewardship assignments).From my testing, I observed that when a user publishes the entity for the first time and the review workflow is triggered, the approver group automatically receives full access to the entity. This happens regardless of whether stewardship is assigned or not.However, the behavior seems different when entities are uploaded in bulk from ONE Desktop. If multiple entities are imported without stewardship assigned, the review workflow is skipped during the initial publication. As a result, only the creator can access the entities, which is the expected behavior.Later, if one of these entities is modified manually, the review workflow is triggered as expected. The approver group can review, approve, and publish the changes. Neverth
Hi everyone,I have a business term called Customer Status. This term is sourced from the Status column in the following table:Customer | Status | UpdateTime---------|--------|---------------------1 | Gold | 08.07.2026 00:00:002 | Silver | 08.07.2026 00:00:003 | Bronze | 08.07.2026 00:00:00I would like to define a timeliness rule for the term based on the UpdateTime column, e.g. Customer Status term is timely if: dateDiff(UpdateTime, today(), “DAYS”) < 2Is this possible?
I would like to implement a DQ accuracy rule where Attribute A is accurate if and only if its value is greater than Attribute B. Attribute B cannot be derived from Attribute A. For example: Attribute A: Date of DeathAttribute B: Date of BirthRule: Date of death needs to be greater than date of birth for a particular person.
HelloI am getting new line character while extracting metadata (column name) from catalog in DQC. I need to replace that with space. Data is extracted as a csv and this new line character is breaking my csv. How can I do that?
There seems to be no way to hide the global settings from users? I can only make them read only at best?
It seems that One Data access permissions are derived from Catalog Item permissions.I have a situation where a user group should only have read rights on Catalog Items within their domain but ful rights on One Data objects within that domain. This seems impossible?This is for version 16.3.1
Hello, Ataccama Community. I am hoping you can help me figure this out. I am trying to create a timeliness check. The objective would be to have a general DQ rule that accepts an update date and then allows the user to configure a minimum delay and a maximum delay. The rule would find the number of days from today and the update date, then take the maximum of that value. If the max of that delay is mroe than the maximum parameter set, then it should return a “MAJOR DELAY” indication.Here is my challenge. It does not seem to work when I use the parameter. It only works when I use a hard coded value for the “maximum delay” in the test.I am hoping someone can help me figure it out.
I am trying use pushdown jdbc databricks (Azure databricks) connection in ataccama. Authentication using service principal in Hybrid Infrastructure.Authentication type : JDBC string for EntraID authenticationor OAuth M2M service principal Both methods are not working. Please help me if there is any additional setting needs to be done apart from given in documentation.
We have been working on the FIBO ontology and have started setting up the custom relationships as they appear in FIBO. Some examples are below: FIBO Parent Term FIBO Relationship FIBO Child Term Account hasOpenDate Open Date Account isHeldBy Account Holder Account isIdentifiedBy Account Identifier Account hasCloseDate Close Date Account hasRecord Transaction Record Account hasBalance Balance Account isProvidedBy Account Provider Account As An Asset isAssetOf Account Holder Account As An Asset isPlayedBy Account Account Holder holds Account The relationships are in the middle column, titled “FIBO Relationship.”When we create the relationships, they are duplicating because there is not an inverse relationship. For example, Parent has an i
Rule description is field must contain 0 or 1 representing false or True respectively. Is this convertion possible? I am not able to create rule with this rule description because the source table data has only true or false or null values only. But rule description says different.
Hi @anna.spakova I was able to create data slice in CI. But in the monitoring project the option is not visible
I have worked in Informatica Data Quality and I am new to Ataccama , can anyone explain me with steps In IDQ we create Rule→ Profiling → Mapping → Workflow → Scorecard Validation → Drill down the records
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.