Discuss, learn, ask, suggest, share all things DQ&C π
Recently active
Hi All,When we insert relations via Collibra writerΒ we have defined source/target fields in the writer step. There is only one way to send relations to Collibra. We got into a case where if 1 source can have many targets eg( 1 schema with 1000 tables) and you give schema in source and tableΒ in target and you define the Import File Size as 100, the writer does not breaks the calls in 100 records instead it will send 1 call with all 1000 records since 1 schema has 1000 tables. This makes sense as sending at once makes sure that all the tables get associated to 1 schema. If it will break it into 100 then only the last call with 100 records will get related to that schema.Β Now to solve this problem we can send the relations to Collibra in reverse direction as well (1 table has only 1 schema). In this case the writer will correctly batch the records in 100. But inorder to do that the collibra writer should be updating the json call it sends internally. Which will be a product enhancement.
Hi β@anna.spakovaΒ How to add a filter to a PPP that should pull columns only with DQ checks. This is because there is a limitation of columns(256) to write in excel from PPP but at source there are 500+ columns.
Hi,Can anyone please suggest the next level of certification afterΒ Ataccama ONE v15 | DQ&C Consumer Certification?Thanks in advance and Happy Learning!
hi β@anna.spakova, β@Lisa KovalskaiaΒ Iβm trying to enable observability on snowflake database. I keep getting this warning(?) Freshness is supported for SQL sources only. I verified the official site of Ataccama documentation and I see that snowflake is supported by default for freshness check.Β However, I am unable to edit freshness settings for my source connection here. Could you please help if Iβm missing out on any configurations here?Thanks for your support as always!Β Β Β
HelloI want to change the layout of page from single column to two columns view. Could you guide me through the process?Β
Trying to run a plan on the server that will create a profile of a view. Before running the plan via the admin center, I created connection to the data source in the Runtimeconfig file. When trying to run plan, I am receiving the error message below:Β 2026-02-12 10:28:01 INFO: Validating model...2026-02-12 10:28:01 ERROR: Data source 'RDFINACT' specified by property dataSourceName must exist. [table_headerΒ (Jdbc Reader, offending property path=/dataSourceName)Β I have check that the entry in the runtimeconfig file is correct and that the plan file reflects correctly, however the issue is still occurring. Please can you point me in the direction of what to check to be able to resolve this issue.Β Β
Hi Community,Would be glad if I get help on whether we canΒ see actual (added or deleted) data rather than metadata marked as anomalous in DO dashboard or profile inspector inside ONE UI.Β
Hi Community,I have an Ataccama dashboard with two filters:Monitoring Project Name Processing Start TimeExpected behavior: When I select a Monitoring Project (e.g., MP-1) from the first filter, the second filter should update to show only the start times related to that project.Current behavior: The Processing Start Time filter doesn't change based on the Monitoring Project selection.This makes it hard to analyze Data Quality results for multiple projects in one dashboard, as the filters aren't synced.I don't want global filters. I need local dropdown filters where Processing Start Time options depend on the selected Monitoring Project Name.Is it possible to set up dependent/cascading filters in Ataccama dashboards?Any advice is appreciated. Thanks!
Hi Team,Is there any way to add rule level notification using desktop tool or graphql and assign the recipients?Β
Is there any global setting at Monitoring Project level to get DQ issue detected warning ifΒ DQ percentage is less than 95%.?14.5.3 version,Β warning seems to be given after below 60%.Β It means that ifΒ for catalog item in Monitoring project shows overall data quality less than 95%, it should be shown amber warning. instead of green ok.Β
HiI have a use case to track changes that have been made on ONE Data in ONE Web. Please find the expected process flow below:Run DQ evaluation on the catalog itemΒ β‘ pushed failed records to ONE DataΒ β‘ user make changes on ONE DataΒ β‘ ONE Data able to track the changesΒ β‘ push final changes to Snowflake tableMy questions would be can we track who make the changes, when and what changes have been made on ONE Web ONE DQ&C? I saw that this may be achieved in ONE RDM but unfortunately we donβt have that. What is an alternative to achieve this one the ONE Web DQ&C? Thanks in advance!
I have two Ataccama sandbox instances both of versionΒ 16.3.0In one instance, I can see catalog items while creating a visualization, but after selecting them, no records are displayed even though the records are present in the ONE data table.For example, consider the Turkey City table shown in the image. The left side of the image shows the visualization screen, while the right side shows the corresponding ONE data table containing the records.Β In case of another sandbox, I canβt even see any catalog items while creating visualization as shown in below screenshot.Β Is this issue occurring because I donβt have the appropriate access roles or permission levels, or could it be caused by something else?
Is it possible to read/extract Data Quality results using metadata reader? has anyone tried that. Can some one share a template if you have one?I dont want it to be a Post Processing Component. I rather want it as an independent Plan that can be scheduled to run daily at a specific time that extracts all the DQ results of all projects of that day. And then using JDBC write i want to add it to my database. And then run some powerBI reports.thanks.
How to Show a trend of data quality score ?Β Example : Trend of data quality scores is going up or low. 9/10 - Quality Score is 50%9/11 - Quality Score is 60%9/12 - Quality Score is 70 %9/13 - Quality Score is 80 %
Hi β@anna.spakovaΒ β@Lisa KovalskaiaΒ I have a requirement to duplicate existing rules for multiple use cases. I donβt want to do it manually by using Ataccama One UI but would like to achieve the same by parameterizing rule names (per use case). Can we make use of any Ataccama desktop features/APIs? Waiting for your inputs. Thanks!
Hi,Iβm trying to get some details/links regardingΒ APIs to read information from Ataccamaβs data observability feature.Looking forward to getting some inputs here.Thanks in advance!
Hi β@anna.spakovaΒ Is it possible to get rule count (number of rules ) for each βRule Definition Sourceβ in Data Stories?Β Thanks.Β
Hi, I am trying to configure landing page of ataccama one web to show results of selected monitoring projects only. I see there is option to add a test_page with admin access but it allows selection of only limited widgets. Is it not possible to show MP results on landing page of the user?Thanks in advance!
Under which entity type are the Passed count and Failed count stored in a Monitoring Project?In a situation where I want to export the result counts for each Monitoring Project, which entity type should be used in the ONE Metadata Reader?I have already checked Monitoring Project, but it only provides a result status (Success / Failed) and does not include the actual Passed and Failed record counts.Β
Export Monitoring Project Metedata + Results For Multiple Runs And VersionsΒ IntroductionΒ For DQ monitoring and reporting, it may be useful to extract the results of monitoring project reports into a spreadsheet, or to an external database. It may also be useful to extract multiple or all reports/runs for a monitoring project at once.The following topic covers a component created to export results, how it can be used, and how it was created (in case modifications need to be made).Β Β Scope of the ComponentΒ The component extracts DQ results from a monitoring project. The output is on the rule instance level, where each rule included in the monitoring project across all tables is output with its dq validity percentage, and the number of valid and invalid records for said rule. Each record is also output with a date field, to organize results by the report run date (as multiple reports may be included in one export)Β Using the ComponentΒ To use the component, move the component files to a fold
Hi,I would like to know if itβs possible to run python program from Ataccama one βΒ Transformation plans feature? If yes, how do we do it, which steps/components from desktop could be used?Β Really appreciate your suggestions here! β@Lisa KovalskaiaΒ β@anna.spakovaΒ Thanks!Β
Hi there!!I am looking for some documentation related toΒ capabilities of Ataccama v15.4 or v16.4 in terms of DQ of semi structured (json/parquet)Β or unstructured data altogether, if itβs supported what are the pre-requisites we need to set up.Please do share.Thanks in advance!
Hello everyone,Iβm trying to export specific details from my monitoring projects and would appreciate some guidance.For each monitoring project, I want to retrieve only the most recent run, including: Monitoring project name Monitoring project ID Stewardship information Result name Result status Result count -(PassedΒ Count/ Failed Count ) Date the run was executed.Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Β Iβm currently using a metadata reader to retrieve the monitoring project name, ID, and stewardship, which works as expected. However, when I add fields from the embedded Processing entity and join in the relevant columns, the export returns multiple rows per monitoring project, as it includes historical runs instead of only the latest one.Has anyone encountered this before? What is the recommended approach to: Filter or ident
hi Team,Β I just worked on a project with Purview and the way we set up DQ there was different. Creating data products and then creating DQ connection separately than the one used to scan the physical metadata.Β But here in Ataccama its different like here we can ceate DQ rules directly on to the Terms, and here I saw we create the source directly.Β Want to understand similarities and differences between Atacama and Purview from any experts who has spent time in both tools :)Β Β Thanks in advance.Β Regards,Vikas
What is the exam fee forΒ Ataccama ONE v13 Data Quality & Governance Foundation Level certification for attendees who exchange a minimum of 12 months hands-on experience for the must have training? How can we apply for the certification exam? Is the application process online or offline? Is the exam proctored?Β
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.