Discuss, learn, ask, suggest, share all things DQ&C π
Recently active
Hello All,I am using group aggregator in our plan but I am not sure how to make all the columns flowΒ from input till the end/output through group aggregator.Β
Hi,Could someone guide me on creating rules for the Productline field? I am following the lab exercise but am unable to find the option for selecting "is not from reference data."Any guidance would be appreciated.Thanks,Shikoh ZaidiΒ Β Β
I have 10 excel sheets, which need to be combined in one single excel sheet. can this be done in Ataccama?
I have a column in my catalog item which contains sensitive data. I have tagged this column with a Business Term. This business termΒ is tagged as PII in Data Protection Classification section in Glossary terms. Is there a way to show at catalog item level that this table contains PII data?
Hi everyone,Β Data Observability tab and AI functionality Β areΒ Β not available. How can I checkΒ SCD Type 2 using DQ rules?Data Freshness. How can I check Β using DQ rules? Datetime datatype is for eff_strt_dttm, itβs one column where data is, but I donβt know how make: Β today() >>>as datetime Β minus 1 day Β Β
Hi guys! Is there any opportunity to check data freshness in case we have Redshift connection?I see there is no such driver in freshness configuration drivers listΒ -Β https://docs.ataccama.com/one/latest/data-observability/data-freshness-custom-configuration.html. Β
Need supportΒ with AQL expression to filter terms based on a particular relationship type. Referring to Relations section under Glossary Terms.Β Β
Hi ,I am trying to access βMonitoring projectsβ through API calls. For this purpose , I have created service account in KeyCloak with βdefaultβ and βDQIT_adminβ IAM role access. Able to generate tokens with the service account. But unable to access βMonitoring projectsβ API , receiving 401 βUnauthorizedβ response.2 questions:How to check whether this service account is able to access the Ataccama application or not ? Any other or what level of access rights need to be provided to access API calls for a service account?Please note I am using Ataccama web application version 14.4.Β Β
HiI would like to ask whether we could do fuzzy check in Ataccama that involves two different datasets letβs say Set 1 and Set 2 from different data sources. Please note that both datasets have different number of columns but fuzzy checks involved only customer name and address. However, these datasets donβt have any unique identifier. Is it achievable in Ataccama and what would be the possible steps to achieve the results after the fuzzy checks? Thanks.
Hello everyone! I currently have a large group of catalog items that I am trying to assign aΒ Data Usage Licensing Agreement too. I know that I can manually add these through Atacama online, however because of the large number I was wondering if it would be possible to create a plan to do this for me? I have all the catalogItem ids already compiled I simply do not know how to assign the policy.While I do see the option to write to policy, I cant seem to set the parent as a catalog item. Any help would be appreciated.Β Thank you!!!Β
Hi ,Could someone guide me on creating rules for Name field.Rule : Name should not have any special characters but can have numbers and spaces.Β Ex: Jhon Leo - ValidJho1 Leo - ValidJho(Β Leo* - Not ValidΒ Β Regards,Bhuvi
Hello, iΒ have a report that we usually saved to hard drive that i would like to bring into Ataccama, the report is in semi structured format . does ataccama accept or work with semi structure data ?or do i need to convertΒ the report first before connecting to source ?
We are half-way into the end-to-end DQ guide! Just jumping on here? ReadΒ the first postΒ of the series πIdentifying data issues is just the beginningβwhat really matters is fixing them π οΈData quality improvement involves standardizing formats, removing duplicates, and setting up automated remediation workflowsβ. Whether itβs fixing customer records, cleansing addresses, or resolving inconsistencies, clean data means more reliable insights.Data transformation tools play a crucial role in making data fit for purpose, while matching and merging ensure that duplicate records donβt pollute your systems. Additionally, data remediation workflows enable businesses to track and resolve data quality issues efficientlyβ.Ultimately, improving data quality isnβt just about technologyβitβs about creating a culture where teams take ownership of data health. Organizations that prioritize continuous data improvement see better business outcomes and reduced operational risks.How did you manage to build
Hello, does anyone faced with issue when primary key/ nullable/ column size fields are gone after refreshing catalog item and rerun data select?I use ONE Web app v14, after setting attribute as primary key, nullable or defining column size then itΒ disappears after Β rerunning query.How did you solve this issue?Β
Hello guys, does someone know where I can find the information about all functions list that are available from Advanced builder while creating DQ rules? Will appreciate any help or advice, thanks.
Hi ,Kindly share your inputs on below scenario.I am trying to place the βMonitoring Projectsβ exportΒ β.csvβ file in a shared path/folder with in the organization. Purpose of this βReport need to accessed by different set of stakeholders who do not have Ataccama accessβΒ Is there a way to access this export file by any API calls or we can directly configure the shared folder path for example βS:/SharedPath/Ataccama/Exportsβ in output location field ?Β Β Note : This is on Ataccama ONE 14.4 version.Β Any input is appreciated.Β Thanks,Bhuvi
Hi,Could anyone help me on below scenario. I am using Ataccama ONE web 14.4.Β Millions of records are populated in testing environment from Production real time data. However , for testing purpose manipulated few 1K records. Is there any way in Ataccama where we can apply rules and perform βMonitoring Projectsβ only to the new records 1K created by giving any date created filter?Β Regards,Bhuvi
In the above image I want to clear all specialΒ characters expect .(dot) As their can be any thing in place ofΒ ! number may have *, &, %, $, etc. I tried it using trashnondigit() function but it will remove all the characters from the number, Is their a way to do it?
Hi everyone,Β Β Ready for the second part of our end-to-end DQ guide?Β Monitoring DQ is essential for building trust in your data assets.This post explores how data profiling, observability, and automated monitoring help organizations detect and address data quality issues in real-time, ensuring data remains accurate, complete, and reliable.Β Before starting, missed the first post? Check it out here πΒ Once your data is documented, the next step is understanding its quality. Without proper monitoring, data issues can go unnoticed, leading to poor decision-making. Data profiling helps by analyzing patterns, completeness, and accuracy, while data observability provides real-time monitoring to detect anomalies before they cause harmβ.Β A data quality monitoring system tracks key dimensions such as validity, completeness, and consistency, helping organizations demonstrate progress and ROI. Automate this process, detecting unexpected changes and flagging them for reviewβ.Β By continuously assessi
Hi everyoneCould you please advice if there is any instruction how smpt server can be configured for e-mail notifications?Where we can perform this configuration? Is there any option in Ataccama ONE web? I have checked this part of documentationΒ MMM Configuration :: Ataccama ONEΒ but it is still not clear where mmm configuration can be done
Hello all,I am on v14.5.3, so I havenβt seen the Data Slice feature hands on yet. Been reading the documentation on the Data Slice and its use in the monitoring project.Β Say for example, I have a table of transactions, and I have some statuses:Pending Active Inactive Cancelled Β Letβs say I have the following rules and the respective slices they need to be applied on:Rule 1 Status = βActiveβ Rule 2 Status in (βActiveβ, βPendingβ) Rule 3 Status = βPendingβ Β Is it then possible to create an βActiveβ slice, andΒ a βPendingβ slice?And then in my monitoring project, I add my catalog item, then I apply my Rule 1 to the Active slice, Rule 3 to the Pending slice, and Rule 2 to both the Active and Pending slices? Or something like that?Β Trying to gauge how we can use it, how much maintenance overhead there will be and the effort to try and start using this feature.Β Any insights from people whoβs already using v15 muchΒ appreciated!
Hi Community!Β In the last few monthsΒ theΒ focus of our articles was majorly onΒ features of ONE Web platform, from the basics to more complicatedΒ practices and now itβs time to move on to the next step. From next week we are moving on to ONE Desktopπ₯οΈΒ TodayΒ we will focus on Data Reconciliation, and coverΒ how you can utilize this feature effectively for seamless data consistency across multiple sources. Letβs get to it!Β In a nutshell, the Data Reconciliation featureΒ confirmsΒ that your migrated data from one database to another is intact and accurate, without any data leaks or glitches. It conducts high-level checks on data consistency by comparing attribute profile statistics and even attributes fingerprints (except for Snowflake data).Β Step-by-Step Guide to Data ReconciliationΒ 1. Create a Reconciliation Project in Data Quality:To kick off your data reconciliation journey, navigate to Data Quality and then select Reconciliation Projects. Here, you can either create a new project or edit
Hi everyone,Sometimes I'd like to select a large number of checkboxes in Ataccama, for example to profile a large number of Catalog items. Of course creating a plan is also an option, but not always the least time consuming.How do you do this with many checkboxes involved? There are browser extensions available for many browers, but not sure if those are secure enough. Any recommendations or tips?
Please advise if βBOX.COMβΒ is a data source that is supported out of the box, being that ONE can integrate with βBOX.COMβ using an existing JDBC orΒ API connector.Β
Use Case:Β For our Data Lose Protection initiative, we are profiling and classify OneDrive, SharePoint, etc and we have a requirement toΒ write the βsecurity term (data classification - restricted, confidential, etc)β to the asset sensitivity labels (metadata)Β
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.