Discuss, learn, ask, suggest, share all things DQ&C π
Recently active
Hello,We have a use case to integrate Ataccama ONE DQ&C with STONEBRANCH scheduler tool. The STONEBRANCH scheduler job should be able to trigger aΒ monitoring project in DQ&C to perform DQ Evaluation on a Catalog item and generate a success/failure flag upon completion. Looking for documentation/details on how this can be achieved.Thanks in advance,Arjundev
Hi!We need to see the same filters from Main Rule page to subpages such as βDetectionβ and βDQ Evaluationβ. How to do that?
We are working to migrate a long running set of data quality rules into Ataccama.Β Most have been easily implemented and are running smoothly.However, the last set of about 10 deals with overlapping date ranges related to effective dates.Β We want to validate that one Processor (for instance) only has one βactiveβ record for a date (as defined by the start effective date and end effective dates on those records).For instance, letβs say Processor ABC has the following records, there is a problem with records 2 and 3.ABC, Start: 1/1/2024, End: 12/31/2024 ABC, Start: 1/1/2025, End: 12/31/2025 ABC, Start: 10/1/2025, End: 12/31/2026Ideally, we would like to pass an identifier (in this case ABC), and then the start effective date, and then the end effective date, as we have to do this on about ten + tables.Β So, weβd like a universal rule that we can use across the board.Iβm reaching out to see if anyone else has implemented a similar rule and can share with us their logic and process.
Hi,I need to dynamically union all sheets in an Excel file used as input for a plan. Since the number and names of sheets may change, Iβm exploring whether this can be handled within Ataccamaβpotentially by using a Python script in a Run Shell Script step within a separate workflow, and then using the output as the plan input.I would appreciate your help.
Hi everyone,Iβm working with Ataccama ONE version 15.4.1 and would like to track user activity for reporting purposes (e.g., number of users logging in or using the platform on a weekly ,monthly and quarterlyΒ Β basis).Is it possible to capture this kind of user activity and export it into a SQL database for reporting?If yes, could you please outline:What needs to be configured to enable user activity tracking How to capture login/usage data How to export or make this data available in a SQL database Any recommended approach for building weekly/monthly user metricsΒ Secondly :Β I want to create an export plan using a post-processing plan in the IDE. Is it possible to make the export rule-based, instead of exporting the entire set of invalid samples?For example: If a rule checks for missing values, can the export return only the invalid samples for that specific rule? OrΒ Is it possible to export invalid samplesΒ by attribute, so that if the attribute is Last Name, the export includes only
Hello everyone!!!Β I have a classic use case to create data slicing on Catalog Item available in One web through One desktop plan. Can anybody help me with step-by-step process to do so and publish the slicing in One web.
Hi Team,I am using one desktop and trying to fetch the catalogitems along with the associated attributes from one metadata reader. However i am getting an null pointer error, would really appreciate if there are any fix or solutions around the sameβInternal error occurred during run of the plan: Cannot invoke "com.ataccama.one.client.impl.MdAncestor.getProperty()" because "this.ancestors[i]" is nullβ
Hi β@anna.spakovaΒ We have MongoDb as source. For a particular column most of the data are present but some data are not present. Please help to fix.Thanks!
Hello β@Lisa KovalskaiaΒ Β I need to bulk update the description of the rules which include a hyperlink. When I used ONE Desktop Plan it displays as string rather than link. Can you please help?
Hi,I want to create data quality rules that calculateΒ the Population Stability Index (PSI) on a categorical attributeΒ to detect distribution shifts over time.My goal is to build a flowΒ that:Uses a date column from the rule inputΒ to split the dataset into:Β a reference window (previous N days) a current window (most recent N days)Calculates category distributions (percentages) for both periods Computes the PSI between these two distributions.I would appreciate guidanceΒ on the best way to implement this and other kinds of drift metricsΒ in Ataccama on both categorical and numerical columns.
Hi Is there any way to fetch the entities like catalog item or business terms which are not published(Draft and new assets) from one desktop?I tried the workflow state as draft, but its giving me the complete list of both published and unpublished assets. Is there any way to isolate them?
Hi Is it possible to fetch the last update timestamp from the history tab of an entity for example Business Term from one desktop?
Using v16.3.Hereβs what Iβm trying to achieve.I have some data:"id";"name"1;"apple"2;"orange"Β I need to generate some xml, eventually to have the data looking like:Β The ultimate purpose is to send a SOAP call and that xml will be used as the payload for the call.I tried using the Complex XML Assigner, and it tells me off for not referencing my data, but I canβt figure out the syntax.Iβve defined the top level to use the data stream βinβ.And Iβve defined the βinβ object with the id and name column.Β How am I supposed to use this?
Hi I want to fetch the relationship between a attribute and the corresponding term items in one desktop ( Not Business term, might be kpi or lobs) any idea how to fetch those relationships? I tried using termInstance entity in one desktop but its only fetching business term related information.I have tagged the KPIs like normal business terms and those can be visible in the glossary term section of attributes. Appreciate some help on this
Hi ,Is there any way to extract the lineage details in a plan in one desktop? Is there any particular entity which i can use to fetch the details?
A Catalog ItemΒ has weekly scheduled full profiling that also runs anomaly detection. However, it is a dynamic CI, meaning the logic can be edited depending on requirements. In short, it means that the βtruthβ can vary depending on the requirement, meaning A, B, C was not an anomaly a year ago, but it is now.Β Currently, every profile ever run is stored, which makes anomaly detection less effective. Trends that were previously valid may no longer apply. Furthermore,Β retaining profiles from 7+ years ago is unnecessary and not allowed by law I suppose.A useful improvement would be an automatic limit on the number of stored profilings for a CI. When a new profiling run occurs, the oldest profiling would be removed once the limit is reached. A similar feature already exists in MP:Advanced settings β Results storage β Remove results after X runs.Applying this concept to Catalog Items would allow setting a limit (e.g., 25 runs), which should be sufficient for anomaly detection to set a trend a
Hi everyone,Iβve personally noticed quite a regression recentlyβafter one of the newer Ataccama updates (even in our Cloud environments!), we lost access to the MinIO GUI admin console and several useful storage management features.I was wondering what caused this until I came across a report that explains everything: MinIO has officially killed off its free version (Community Edition). On February 12, 2026, their GitHub repository was updated with a final, definitive message: "THIS REPOSITORY IS NO LONGER MAINTAINED".What exactly happened: For the past 18 months, the creators of MinIO have been systematically stripping features from the free version (which explains the missing GUI we are now experiencing). Public Docker images and binaries have been completely removed, halting the ability to patch security vulnerabilities (CVEs). The only supported option left is their commercial product, AIStor, with a starting price of $96,000 a year. Since Ataccama uses MinIO under the hood as
Hi all,Some time ago I posted a question ('Published by' details via GraphQL) about how to make visisble who published for instance a glossary term.I noticed that likeΒ this you can't show who may have deleted the asset.Does anyone have a clue how to retrieve this details via graphQL (or in a different manner)?Kind regards,Albert
Hello Team,I am trying to create a data quality rule for completeness, but it fails every time I click on evaluate.I tested my rule, and it works fine.Could you please advise me on this?Β Β This is the rule i createdΒ
Hi Team,I am seeking support to capture the Monitoring Project execution resultsβeither as an attachment or as a downloadable result linkβand automatically send notifications to a defined list of recipients.Do we have any documentation covering this scenario?Kindly advise on the recommended approach: should this be configured through the Web UI or through ONE Desktop?This requirement is high priority for us, as we need to set up and enable the notification workflow as soon as possible.Regards,Suriyanath TC
HiWe created SQL Catalog Item but it is not getting auto updated when the metadata changes in parent table. How to make it auto update?
Hi everyone,I wanted to share a simple optimization that gave me a massive runtime improvement in Ataccama ONE Desktop expressions: switching from regular expressions to plain substring search using indexOf().Previously, I used regex to check whether explanation fields contain a specific message.Β After switching to indexOf(), the runtime dropped from hours to seconds.AsΒ I understand correctly after what i foundΒ regex processing is based on a full Java regular-expression engine (java.util.regex), which is powerful but can be expensive if you only need a simple βcontains substringβ check.Expression example:case( indexOf(nvl(valid_rules_explanation, ''), 'text') >= 0, 1, indexOf(nvl(invalid_rules_explanation, ''), 'text') >= 0, 1, invalid_rules is not null, 0, 1)ONE expressions use 0-based indexing for string positions, so a match at the beginning returns 0, which is why >= 0 is used. indexOf(srcStr, subStr) returns the index of the first occurrence of subStr in srcStr. case(
Hi All,When we insert relations via Collibra writerΒ we have defined source/target fields in the writer step. There is only one way to send relations to Collibra. We got into a case where if 1 source can have many targets eg( 1 schema with 1000 tables) and you give schema in source and tableΒ in target and you define the Import File Size as 100, the writer does not breaks the calls in 100 records instead it will send 1 call with all 1000 records since 1 schema has 1000 tables. This makes sense as sending at once makes sure that all the tables get associated to 1 schema. If it will break it into 100 then only the last call with 100 records will get related to that schema.Β Now to solve this problem we can send the relations to Collibra in reverse direction as well (1 table has only 1 schema). In this case the writer will correctly batch the records in 100. But inorder to do that the collibra writer should be updating the json call it sends internally. Which will be a product enhancement.
Hi β@anna.spakovaΒ How to add a filter to a PPP that should pull columns only with DQ checks. This is because there is a limitation of columns(256) to write in excel from PPP but at source there are 500+ columns.
Hi,Can anyone please suggest the next level of certification afterΒ Ataccama ONE v15 | DQ&C Consumer Certification?Thanks in advance and Happy Learning!
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.