Discuss, learn, ask, suggest, share all things DQ&C π
Recently active
Hi Team,Do you have any code snippet to Integrate Ataccama with Collibra ?I would like to map ataccamaΒ catalog item and its metadata with Collibra and vice versa.Similar way for Business Terms, & Data Quality RulesAny documentationΒ or code snippetΒ related to requirement will help
Hello Ataccama,I would like to share an observation regarding the behavior of the review workflow and approver access rights.We have an entity with the review workflow enabled, where the approver is defined as a specificΒ group (not based on stewardship assignments).From my testing, I observed that when a user publishes the entity for the first time and the review workflow is triggered, the approver group automatically receives full access to the entity. This happens regardless of whether stewardship is assigned or not.However, the behavior seems different when entities are uploaded in bulk from ONE Desktop. If multiple entities are imported without stewardship assigned, the review workflow is skipped during the initial publication. As a result, only the creator can access the entities, which is the expected behavior.Later, if one of these entities is modified manually, the review workflow is triggered as expected. The approver group can review, approve, and publish the changes. Neverth
Hi everyone,I have a business term called Customer Status. This term is sourced from the Status column in the following table:Customer | Status | UpdateTime---------|--------|---------------------1 | Gold | 08.07.2026 00:00:002 | Silver | 08.07.2026 00:00:003 | Bronze | 08.07.2026 00:00:00I would like to define a timeliness rule for the termΒ based on the UpdateTime column, e.g. Customer Status term is timely if:Β dateDiff(UpdateTime, today(), βDAYSβ) < 2Is this possible?Β Β Β Β
I would like to implement a DQ accuracy rule where Attribute A is accurate if and only if its value is greater than Attribute B. Attribute B cannot be derived from Attribute A.Β Β For example:Β Attribute A: Date of DeathAttribute B: Date of BirthRule: Date of death needs to be greater than date of birth for a particular person.Β Β Β
HelloI am getting new line character while extracting metadata (column name) from catalog in DQC. I need to replace that with space. Data is extracted as a csv and this new line character is breaking my csv. How can I do that?Β
There seems to be no way to hide the global settings from users? I can only make them read only at best?
It seems that One Data access permissions are derived from Catalog Item permissions.I have a situation where a userΒ group should only have read rights on Catalog Items within their domain but ful rights on One Data objects within that domain. This seems impossible?This is for version 16.3.1
Hello, Ataccama Community.Β I am hoping you can help me figure this out.Β I am trying to create a timeliness check.Β The objective would be to have a general DQ rule that accepts an update date and then allows the user to configure a minimum delay and a maximum delay.Β Β The rule would find the number of days from today and the update date, then take the maximum of that value.Β If the max of that delay is mroe than the maximum parameter set, then it should return a βMAJOR DELAYβ indication.Here is my challenge.Β It does not seem to work when I use the parameter.Β It only works when I use a hard coded value for the βmaximum delayβ in the test.I am hoping someone can help me figure it out.Β
I am trying use pushdown jdbc databricks (Azure databricks)Β connectionΒ in ataccama. Authentication using service principal in Hybrid Infrastructure.Authentication type :Β JDBC string for EntraID authenticationorΒ OAuth M2M service principalΒ Both methods are not working.Β Please help me if there is any additional setting needs to be done apart from given in documentation.Β
We have been working on the FIBO ontologyΒ and have started setting up the custom relationships as they appear in FIBO. Some examples are below:Β FIBO Parent Term FIBO Relationship FIBO Child Term Account hasOpenDate Open Date Account isHeldBy Account Holder Account isIdentifiedBy Account Identifier Account hasCloseDate Close Date Account hasRecord Transaction Record Account hasBalance Balance Account isProvidedBy Account Provider Account As An Asset isAssetOf Account Holder Account As An Asset isPlayedBy Account Account Holder holds Account Β The relationships are in the middle column, titled βFIBO Relationship.βWhen we create the relationships, they are duplicating because there is not an inverse relationship. For example, Parent has an i
Rule description is field must contain 0 or 1 representing false or True respectively. Is this convertion possible? I am not able to create rule with this rule description because the source table data has only true or false or null values only. But rule description says different.
Hi β@anna.spakovaΒ I was able to create data slice in CI. But in the monitoring project the option is not visibleΒ
I have worked in Informatica Data Quality and I am new to Ataccama , can anyone explain me with stepsΒ In IDQ we create RuleβΒ Profiling β Mapping βΒ Workflow βΒ Scorecard Validation βΒ Drill down the recordsΒ
Hello,I am trying to export the information displayed in the βHistoryβ tab of Glossary / Business Terms in Ataccama ONE using the ONE Metadata Reader component.On the Business Term page in the UI, the History tab displays details such as:Version number Published on date/time Published by userIt also shows when a term was newly created or updated, including the timestamp and the name of the user who made the change, similar to an audit/history log.I would like to export this information together with my glossary/business term metadata.However, in the ONE Metadata Reader, I can only see the standard business term attributes, and I cannot find any entities or columns related to:history version history revisions published by published on audit informationI am therefore trying to understand where this information is stored and how it can be exported.Could you please clarify:Which entity/table/object stores the data displayed in the History tab? Is this history/version information accessible
Hi,Can some help me with creating a post processing transformation plan that shows a different row for each DQ rule that has passed/failed on a particular field in the transformation plan in One Web UI.Β For Eg: I have 2 rules, a uniqueness check and a format check on the ID field. In the post processing output file, whatβs the best way to see how I can split this for each rule and see the pass/fail metrics for each rule.Thanks
Hi,We are using Ataccama one 12.6 version. We have a project containing 40+ models with 90 + rules. I am looking for an options to get the detailed invalid/failed records for each model. Like all the attributes from the model along withΒ invalid rule instance names.The idea isΒ to get the whole failed dataset to automate the remediation process. We already have automated process to remediate the data using other technologies.I donβtΒ want to use the downloadΒ results in csv option,Β because we are transitioning to latest version of Ataccama.I am looking for couple of optionsExtract the detailed failed records from backend tables using sqls (where Ataccama stores the results) or would like to understand how those csv files are generated in backend and use the same way to get the data and store in Β db. Reading data through Ataccama inbuilt APIβs and loading into a db. I am Β goingΒ through the GraphQL options. Could you please let me know, If there is way to get the similar dataΒ through GraphQL
Hello,Iβm trying to build some ONE Desktop plans and workflows to integrate RDM with an application which only accepts SOAP calls.I managed to do a 2 step approach - a SOAP call to get a token using username/pwd, then another SOAP call to do the actual thing using the token (insert some data into that system).I was hoping to have instead, the pwd encrypted in the runtime config file, so I tried setting up a connection like so:I tried to set up the connection in server connection:Where the SecurityProvider endpoint is where I get the token, andΒ ComponentExecutor endpoint is where I connect to do the thing I actually want to do.Β But when I try to use this connection in the SOAP call step, it tells me:Β Β So it only accepts Basic auth.Β Β Β Do I have any other options?
Weβre on v16.3. Is it possible to have an MMM role which has: read metadata access run profiling jobs run lkp builder jobs run monitoring project jobs But without the ability for example to edit the contents? e.g. just run a lkp builder job but not be able to amend the configurations of the lkp, or run the monitoring project without ability to change anything.I tried looking at documentation, seems like for Monitoring Project, the levels of view metadata access and view data access doesnβt allow running the project, while full access can. However full access also gives editing rights to monitoring projects which we donβt want to allow.Has anyone else run into the same scenario? How have you solved it?
Hi everyone,Iβve seen several posts about extracting dataβquality metadata from Ataccama ONE for Monitoring projects, using approaches like GraphQL or Metadata Reader steps.Β I wanted to ask if anyone has been successfully able to extract this metadata using either method.Weβre running into significant challenges with both approaches:GraphQL: When drilling down to the table or dataβelement level, the underlying query structure becomes extremely complex and difficult to interpret. Itβs very time-consuming, and we havenβt been able to construct workable queries. Metadata Reader steps: This option requires joining multiple metadata streams, and the resulting plan becomes overly complicated.Iβm trying to understand whether anyone has successfully built Data Quality dashboards by extracting metadata from Ataccama ONE, loading it into a database(Databricks), and connecting it to Power BI.If youβve done this or have guidance, I would really appreciate connecting with you to discuss your approa
I am trying another way to deal with my strange timeliness issue.Β Does anyone know how to reference a parameter in an advanced expression setting a variable?Β As you can see it does not like me just using the name of the parameter, although it lets me use the name of an attribute just fine.Any ideas?Β
Hello,We have a use case to integrate Ataccama ONE DQ&C with STONEBRANCH scheduler tool. The STONEBRANCH scheduler job should be able to trigger aΒ monitoring project in DQ&C to perform DQ Evaluation on a Catalog item and generate a success/failure flag upon completion. Looking for documentation/details on how this can be achieved.Thanks in advance,Arjundev
Hi!We need to see the same filters from Main Rule page to subpages such as βDetectionβ and βDQ Evaluationβ. How to do that?
We are working to migrate a long running set of data quality rules into Ataccama.Β Most have been easily implemented and are running smoothly.However, the last set of about 10 deals with overlapping date ranges related to effective dates.Β We want to validate that one Processor (for instance) only has one βactiveβ record for a date (as defined by the start effective date and end effective dates on those records).For instance, letβs say Processor ABC has the following records, there is a problem with records 2 and 3.ABC, Start: 1/1/2024, End: 12/31/2024 ABC, Start: 1/1/2025, End: 12/31/2025 ABC, Start: 10/1/2025, End: 12/31/2026Ideally, we would like to pass an identifier (in this case ABC), and then the start effective date, and then the end effective date, as we have to do this on about ten + tables.Β So, weβd like a universal rule that we can use across the board.Iβm reaching out to see if anyone else has implemented a similar rule and can share with us their logic and process.
Hi,I need to dynamically union all sheets in an Excel file used as input for a plan. Since the number and names of sheets may change, Iβm exploring whether this can be handled within Ataccamaβpotentially by using a Python script in a Run Shell Script step within a separate workflow, and then using the output as the plan input.I would appreciate your help.
Hi everyone,Iβm working with Ataccama ONE version 15.4.1 and would like to track user activity for reporting purposes (e.g., number of users logging in or using the platform on a weekly ,monthly and quarterlyΒ Β basis).Is it possible to capture this kind of user activity and export it into a SQL database for reporting?If yes, could you please outline:What needs to be configured to enable user activity tracking How to capture login/usage data How to export or make this data available in a SQL database Any recommended approach for building weekly/monthly user metricsΒ Secondly :Β I want to create an export plan using a post-processing plan in the IDE. Is it possible to make the export rule-based, instead of exporting the entire set of invalid samples?For example: If a rule checks for missing values, can the export return only the invalid samples for that specific rule? OrΒ Is it possible to export invalid samplesΒ by attribute, so that if the attribute is Last Name, the export includes only
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.