Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Hi,Can some help me with creating a post processing transformation plan that shows a different row for each DQ rule that has passed/failed on a particular field in the transformation plan in One Web UI.Β For Eg: I have 2 rules, a uniqueness check and a format check on the ID field. In the post processing output file, whatβs the best way to see how I can split this for each rule and see the pass/fail metrics for each rule.Thanks
Hi,We are using Ataccama one 12.6 version. We have a project containing 40+ models with 90 + rules. I am looking for an options to get the detailed invalid/failed records for each model. Like all the attributes from the model along withΒ invalid rule instance names.The idea isΒ to get the whole failed dataset to automate the remediation process. We already have automated process to remediate the data using other technologies.I donβtΒ want to use the downloadΒ results in csv option,Β because we are transitioning to latest version of Ataccama.I am looking for couple of optionsExtract the detailed failed records from backend tables using sqls (where Ataccama stores the results) or would like to understand how those csv files are generated in backend and use the same way to get the data and store in Β db. Reading data through Ataccama inbuilt APIβs and loading into a db. I am Β goingΒ through the GraphQL options. Could you please let me know, If there is way to get the similar dataΒ through GraphQL
Hello,I wanted some help in MDMΒ around publishing of master data records while creation in mdm if they have data quality issues. So if I create a record in the master layer of mdm and if any of the records have data quality issue that record should not be allowed to be published.So in this record there are 2 data quality issues. But I am still able to publish the record. So how can I prevent that. If there are data quality issues that record should not be allowed to publish. How can I achieve that please help me.Thank you.
We upgraded to 16.3.1 and are now looking at the new Admin Centre.It is great that it is now accessible via the MDM webapp and has a great look. It also has great new features like the Server Dashboard and the Runtime Parameters.However, the Orchestration holds all the functionalities the business users regularly use. Basically everything under βWorkflowsβ.This section is now further removed and looks very awkward. Especially in comparison to the slick new look of the rest. It is therefore harder to use which is not a great comfort. Given there are quite important commands that shouldnβt be done wrongly.Will you be looking to improve the look and usability and move it back to a more prominent location?
Hello,I have a question regardingΒ MDMΒ services. So there are different services that are already predefined in the services tab of the MDMΒ project and we can use them easilyΒ Β Some of the services are predefined and some are configurable. Now what I wanted to know is that is there a service which I can use to detect duplicates fromΒ the MDMΒ system. So basically if I send some record information in the soap call it should tell me based on the matching logic defined in the matching stepΒ that the sent record is matched with any record or not in the MDM. Is thatΒ possible? I did try the βProcess Matchβ part but that works differently and does not address the above use case.Thank you.
Hello,Iβm trying to build some ONE Desktop plans and workflows to integrate RDM with an application which only accepts SOAP calls.I managed to do a 2 step approach - a SOAP call to get a token using username/pwd, then another SOAP call to do the actual thing using the token (insert some data into that system).I was hoping to have instead, the pwd encrypted in the runtime config file, so I tried setting up a connection like so:I tried to set up the connection in server connection:Where the SecurityProvider endpoint is where I get the token, andΒ ComponentExecutor endpoint is where I connect to do the thing I actually want to do.Β But when I try to use this connection in the SOAP call step, it tells me:Β Β So it only accepts Basic auth.Β Β Β Do I have any other options?
Weβre on v16.3. Is it possible to have an MMM role which has: read metadata access run profiling jobs run lkp builder jobs run monitoring project jobs But without the ability for example to edit the contents? e.g. just run a lkp builder job but not be able to amend the configurations of the lkp, or run the monitoring project without ability to change anything.I tried looking at documentation, seems like for Monitoring Project, the levels of view metadata access and view data access doesnβt allow running the project, while full access can. However full access also gives editing rights to monitoring projects which we donβt want to allow.Has anyone else run into the same scenario? How have you solved it?
Hi everyone,Iβve seen several posts about extracting dataβquality metadata from Ataccama ONE for Monitoring projects, using approaches like GraphQL or Metadata Reader steps.Β I wanted to ask if anyone has been successfully able to extract this metadata using either method.Weβre running into significant challenges with both approaches:GraphQL: When drilling down to the table or dataβelement level, the underlying query structure becomes extremely complex and difficult to interpret. Itβs very time-consuming, and we havenβt been able to construct workable queries. Metadata Reader steps: This option requires joining multiple metadata streams, and the resulting plan becomes overly complicated.Iβm trying to understand whether anyone has successfully built Data Quality dashboards by extracting metadata from Ataccama ONE, loading it into a database(Databricks), and connecting it to Power BI.If youβve done this or have guidance, I would really appreciate connecting with you to discuss your approa
I am trying another way to deal with my strange timeliness issue.Β Does anyone know how to reference a parameter in an advanced expression setting a variable?Β As you can see it does not like me just using the name of the parameter, although it lets me use the name of an attribute just fine.Any ideas?Β
Hello,We have a use case to integrate Ataccama ONE DQ&C with STONEBRANCH scheduler tool. The STONEBRANCH scheduler job should be able to trigger aΒ monitoring project in DQ&C to perform DQ Evaluation on a Catalog item and generate a success/failure flag upon completion. Looking for documentation/details on how this can be achieved.Thanks in advance,Arjundev
Hi!We need to see the same filters from Main Rule page to subpages such as βDetectionβ and βDQ Evaluationβ. How to do that?
We are working to migrate a long running set of data quality rules into Ataccama.Β Most have been easily implemented and are running smoothly.However, the last set of about 10 deals with overlapping date ranges related to effective dates.Β We want to validate that one Processor (for instance) only has one βactiveβ record for a date (as defined by the start effective date and end effective dates on those records).For instance, letβs say Processor ABC has the following records, there is a problem with records 2 and 3.ABC, Start: 1/1/2024, End: 12/31/2024 ABC, Start: 1/1/2025, End: 12/31/2025 ABC, Start: 10/1/2025, End: 12/31/2026Ideally, we would like to pass an identifier (in this case ABC), and then the start effective date, and then the end effective date, as we have to do this on about ten + tables.Β So, weβd like a universal rule that we can use across the board.Iβm reaching out to see if anyone else has implemented a similar rule and can share with us their logic and process.
Hi,I need to dynamically union all sheets in an Excel file used as input for a plan. Since the number and names of sheets may change, Iβm exploring whether this can be handled within Ataccamaβpotentially by using a Python script in a Run Shell Script step within a separate workflow, and then using the output as the plan input.I would appreciate your help.
Hi everyone,Iβm working with Ataccama ONE version 15.4.1 and would like to track user activity for reporting purposes (e.g., number of users logging in or using the platform on a weekly ,monthly and quarterlyΒ Β basis).Is it possible to capture this kind of user activity and export it into a SQL database for reporting?If yes, could you please outline:What needs to be configured to enable user activity tracking How to capture login/usage data How to export or make this data available in a SQL database Any recommended approach for building weekly/monthly user metricsΒ Secondly :Β I want to create an export plan using a post-processing plan in the IDE. Is it possible to make the export rule-based, instead of exporting the entire set of invalid samples?For example: If a rule checks for missing values, can the export return only the invalid samples for that specific rule? OrΒ Is it possible to export invalid samplesΒ by attribute, so that if the attribute is Last Name, the export includes only
Hi Team,Good day! Iβm trying to bulk purge some instance records, the high level approach is deactivate the records (i.e. set eng_active to false) and run purge process to delete the deactivated record. To implement this approach i Have following queries:Can I directly set eng_active status for those identified instance records using βExecute SQLβ tool? To call purgeProcess from the plan, I use βSoap Callβ? how do i get the wsdl of all the native services. As Ataccama documents suggested I could locate them in Admin Center (InterfacesΒ >Β Services) , but when i click on show service info/show wsdl, it asks for credentials, but I login using Azure AD. Please let me know if there is any other simple approach I should consider.Thank you!
Hi Team,Could someone provide guidance on how to customize API responses in Ataccama MDM (version 15.4.1)?Our requirement is to conditionally exclude certain child records from the API response based on a relationship-type attribute. For example, a single party may have multiple identifiers such as SSN, TIN, ABC, etc. When a consumer application makes a GET API call, we need logic that checks whether an ABC-type identifier exists. If it does, the API should stop further processing and return the response accordingly (e.g., prioritizing or limiting the payload based on this condition).How can this kind of conditional filtering or response control be implementedβpreferably within Ataccama (configuration, query layer, or business rules), rather than handling it downstream?Β Regards,
Hello everyone!!!Β I have a classic use case to create data slicing on Catalog Item available in One web through One desktop plan. Can anybody help me with step-by-step process to do so and publish the slicing in One web.
Hi Team,I am using one desktop and trying to fetch the catalogitems along with the associated attributes from one metadata reader. However i am getting an null pointer error, would really appreciate if there are any fix or solutions around the sameβInternal error occurred during run of the plan: Cannot invoke "com.ataccama.one.client.impl.MdAncestor.getProperty()" because "this.ancestors[i]" is nullβ
Hi β@anna.spakovaΒ We have MongoDb as source. For a particular column most of the data are present but some data are not present. Please help to fix.Thanks!
Hello β@Lisa KovalskaiaΒ Β I need to bulk update the description of the rules which include a hyperlink. When I used ONE Desktop Plan it displays as string rather than link. Can you please help?
Hi,I want to create data quality rules that calculateΒ the Population Stability Index (PSI) on a categorical attributeΒ to detect distribution shifts over time.My goal is to build a flowΒ that:Uses a date column from the rule inputΒ to split the dataset into:Β a reference window (previous N days) a current window (most recent N days)Calculates category distributions (percentages) for both periods Computes the PSI between these two distributions.I would appreciate guidanceΒ on the best way to implement this and other kinds of drift metricsΒ in Ataccama on both categorical and numerical columns.
Use Case: When clicking "Create" in MDM master record creation, I want certain fields to be pre-filled with default/placeholder values the moment the record detail view opens β before the user manually enters anything.Scenario (CDI Example): In our setup, some fields are common across both Customer Types. The goal is to have these shared fields auto-populated with sensible defaults as soon as the creation screen loads β improving data consistency and reducing manual effort.Β What I've tried / What I'm looking for:β Is there a Workflow Step triggered at record creation (not save) where default values can be injected? β Can a Plan File be used to define these default values at screen load? β Any supported configuration or workaround to achieve pre-population on the Create event?Β Screenshots attached for reference:Field layout on the record detail view Highlighted common fields across Customer TypesΒ Β
Hi Is there any way to fetch the entities like catalog item or business terms which are not published(Draft and new assets) from one desktop?I tried the workflow state as draft, but its giving me the complete list of both published and unpublished assets. Is there any way to isolate them?
Hi Is it possible to fetch the last update timestamp from the history tab of an entity for example Business Term from one desktop?
Using v16.3.Hereβs what Iβm trying to achieve.I have some data:"id";"name"1;"apple"2;"orange"Β I need to generate some xml, eventually to have the data looking like:Β The ultimate purpose is to send a SOAP call and that xml will be used as the payload for the call.I tried using the Complex XML Assigner, and it tells me off for not referencing my data, but I canβt figure out the syntax.Iβve defined the top level to use the data stream βinβ.And Iβve defined the βinβ object with the id and name column.Β How am I supposed to use this?
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.