Discuss, learn, ask, suggest, share all things DQ&C π
Recently active
Hello everyone,I'm currently facing an issue with accessing Tableau content through Ataccama. Although I've successfully connected to various Tableau Server sites, most of the content remains inaccessible due to group access restrictions. The only workaround I've seen so far is granting the connecting account a site administrator explorer role on Tableau, but I'd prefer to avoid this elevated access if possible.Has anyone encountered this problem and found a solution that doesn't involve using a site administrator explorer role?Any insights, workarounds, or experiences would be greatly appreciated.Thank you,Β Karine
Hello everyone,I was looking through the email templates and was wondering if it would be possible to create one for the tasks dashboard? I know its possible to enable these for monitoring projects, but would like to know if there's any way to also enable them for updates to tasks, ie task assigned, task status changed, task deleted etc. Searching through the documentation I haven't seen anything relating to this,Β Any help would be very much appreciated!
Hello,I am looking for guidance on ensuring automatic data masking/hiding during data exports to csv/excel filesΒ based on Data Protection Classification in Ataccama ONE.From the documentation, it appears that access to sensitive attributes (ones tagged with terms that haveΒ data classification tags applied to them) can be restricted for unauthorized users, but I would like to confirm:1.Β How can we configure permissions to ensure that unauthorized users can still export data but only receive masked/hidden values for classified attributes? What permissions do we give them?2. Is it possible to automatically apply masking transformations based on classification tags, so that even authorized users exporting data only receive masked values instead of raw sensitive data?3. Are there any recommended workflows for enforcing automatic masking at the export level while leveraging Data Protection Classification?Thank you,Karine
By using oneΒ urlΒ we imported multipleΒ tables structure from workday into Ataccama.Β if we need to query any specific imported table in ataccamaΒ is ataccam will dynamically updates the API endpoints ?Β
Hi everyone,We often get questions on integrations and in this post you can find several technologies that Ataccama can connect to, the prerequisites for integration, key rules to follow, and fundamental troubleshooting steps.πΒ Understanding these aspects ensures a smoother deployment and operation, minimizing potential integration issues. By following the guidelines provided, you can efficiently prepare your environment, meet technical requirements, and troubleshoot common challenges, ensuring seamless connectivity with Ataccama solutions.Β Ataccama comes with a set of default connections that work out of the box without requiring additional configuration. These connections include the most commonly used databases, cloud storage solutions, and other data sources, all pre-configured with the necessary drivers.Β For the majority of default connections, no manual setup is required β Ataccama automatically includes and manages the appropriate JDBC or API drivers, ensuring seamless integrat
Hi Community,The purpose of the follwing scenario is to update multiple term names and definitions. I have created a plan that writes the terms names, definitions and GID to a csv file. In that file I can make updates on the names and definitions. With another plan I read that file and write it back into Ataccama.That works well, except in the following case. The text in the Definition can be entered on multiple lines by using the Enter button. So OneWeb will show:Text on line 1.Text on line 2.Text on line 3.In the export (the csv file) the text will look like this:"[{""type"":""paragraph"",""children"":[{""text"":""Text on line 1.""}]},{""type"":""paragraph"",""children"":[{""text"":""Text on line 2}]},{""type"":""paragraph"",""children"":[{""text"":""Text on line 3}]}]"If you import the text like this, the content will not appear on 3 lines, but literally as above and on one line.How can I import the text so it is on 3 lines again?Thanks for any suggestion.Kind regards,Albert
For example, if there are multiple rules applied on an Attribute that is CDE then would it show filtered Data Quality Score based on the nested rule that is implemented. Can it be checked or configured in Ataccama One WebApp or it would need to be done in Ataccama One Desktop ?
In Monitoring Project Data quality rule suggestion works sometimes and it give rules already used or as per term assigned to catalog item but most of the time it doesn't work. At point of time, ruleΒ suggestions appear, and they disappear when you want to check again.Β How the rule suggestions work in Monitoring Project of Ataccama?Β Is there any pattern or do we have to do something so that we can rule suggestions?
Is there a way to identify usage stats, last login etc easily?Β or if someone has built a query to show this information?Β I would think the admin would have an easy where to manage users access / licenses etc
Is there a way to retrieve all the workflows deployed on the Ataccama runtime server? For instance, we can obtain all the monitoring projects and post-processing details from the Ataccama metadata model. Additionally, I would like to get the workflow names along with their associated plans and component files from the runtime server.
While importing the configuration in Monitoring Project from different monitoring Project, we can map catalog item but unable to it on column level.Β Here column names are getting changed in databrick layers (foundation, Enriched, curated).Β Is there any way to import configuration from one project to another project with column mapping as names gets changed?
Architectural Diagram for Data Quality and Governance
I am new to Ataccama and have some basics questions on how to start .is the ataccama one desktop and DQ analyzer are same tool orΒ different ? i have installedΒ ataccama one desktop but how to get trial license ?Β
How do we create a detection rule which either using both data andΒ metadata option in same rule or ability to add multiple detection rules on business glossary with AND and OR conditions both working together and not just one option?Β Β
Can the API response generated from the Data Quality Firewall feature be edited?
HiI have with great success been using your free desktop version of DQ Analyzer.But the license has run out. Last time I had this issue a new download and aΒ re-installation solved it.I have tried to do the same, but it did not work.Β Β See issue βDQ analyzer windows version updateβ for further details.Any advice what to do?
The Business wants this date attribute validated.Β I donβt know why, itβs a key field and I assume managed by the DB.Β Nonetheless, I need to build a rule.But I think itβs strange that the Data Type is DATEΒ while the date values are YYYY-MM-DD. I would expect to see DATE format data in theΒ MM-DD-YYY HH:MM:SS AM format.I donβt know how to code it in the date functions since it doesnβt have the standard date format and it doesnβt work in any string functions.Any ideas?Β Β
Hi everyone,Β If youβre looking for a way to bulk upload relationships between attributes and business terms in Ataccama, there are two main approaches you can use: Metadata Writer step and GraphQL API. Both methods allow you to establish these relationships efficiently.Option 1: Metadata WriterThe Metadata Writer method enables you to create relationships between attributes and business terms by structuring your data appropriately. Hereβs what you need to do:Entity: Use termInstance as the entity type. Parent ID: This should be the ID of the attribute you want to link. Target: This should be the ID of the business term you want to associate with the attribute. State: Set this value to published to ensure the relationship is active.Once youβve prepared a file containing these details, you can upload it using the Metadata Writer, automating the bulk linking process.Option 2: GraphQL APIAnother approach is leveraging the GraphQL API. This involves:Capturing the API requests made when manu
I have created a plan for data quality checks using Data Quality Indicator, and it will produce an excel file which flags each records with error_messages corresponding to each checks, and a summary txt file. Now, I have createdΒ a workflow using Run DQC and Send Mail step. The requirement is to soft code the below values in the email template.Summary excel fileBelow is the email body:Dear Business Users,Please find the attached Error Result (Error_Report.csv), which details the records that failed validation and their respective error types.Summary:Total Processed Records(Total):Β Total Error Records(Success_Count):Β Error Types(Code):Β We recommend reviewing the attached file and taking the necessary corrective actions. If you need further clarification or assistance, please feel free to reach out.Best regards,Β
Is there a method to create a single rule for identifying duplicate records based on all columns in a table? This rule should be applicable to all tables, regardless of the number of columns they contain.Current situation we need to add the column to use aggregated rule. It is very difficult if the columns are more than 10 or 15 in table.Β Β
I am making a DQ evaluation rule in ataccama one ui where I have to subtract each long value of catalogue item from its corresponding long value in lookup and if the difference is greater than 100, I want to raise that particular value as invalid sample, so far I am not able to achieve this, it would be great if anyone can help me with this.
Is there any way to get notification for data Profiling schedule failure with log details or successful.
Hi everyone,Β Managing email notifications effectively is essential for monitoring Data Quality and ensuring timely alerts. In this post, we will explore the differences between general and specific notifications and how to enable specific email notifications, as they are turned off by default in self-managed installations.What is the difference between general and specific notifications?General notifications are triggered based on predefined system-wide scenarios, such as monitoring failures or anomalies. These notifications alert users to general events occurring in the system, ensuring broad visibility into key operational issues. However, general notifications do not include detailed Data Quality results.On the other hand, specific notifications provide more granular alerts, tailored to particular data quality conditions, thresholds, or projects. These notifications are linked to specific configurations, allowing users to receive alerts based on structured errors, Data Quality issue
HiI have a sub-query in Snowflake that is using the function of LISTAGG and PARTITION BYΒ in multiple SELECT DISTINCT statements for example LISTAGG(DISTINCT TRIM(SUBJECT_REF), ' | ') OVER (PARTITION BY IDENTIFIER) AS EN_NUM_AGG, kindly see attachment to see the full SQL statement.Β Example of one of the subqueries:Β β¦en AS(SELECT DISTINCTΒ Β Β Β IDENTIFIER,Β Β Β ID,Β Β Β LISTAGG(DISTINCT ID, ' | ') OVER (PARTITION BY IDENTIFIER) AS ID_AGG,Β Β Β TRIM(SUBJECT_REF) AS EN_NUM,Β Β Β LISTAGG(DISTINCT TRIM(SUBJECT_REF), ' | ') OVER (PARTITION BY IDENTIFIER) AS EN_NUM_AGG,Β Β Β DQ_EN_CARD,Β Β Β LISTAGG(DISTINCT DQ_EN_CARD, ' | ') OVER (PARTITION BY IDENTIFIER) AS DQ_EN_CARD_AGG,Β Β Β DATA_SOURCE,Β Β Β ORIGINAL_SOURCEFROMΒ Β Β db.schema.view1Β Β Β WHEREΒ Β Β Β subj_type = 'English') ...I wanted to replicate the same in Ataccama ONE Desktop using the Group Aggregator step, whereI allocate each sub-query in one aggregation set with a condition ofΒ subj_type = '<value>'Β in the When condition. For each column in the SELE
Weβre using version 15.4, mostly in the web tool.Weβre trying to a subset of our input tables for testing before implementation the full table(s) in Production.We looked at using Data Slices, but we found that the ROWNUM feature of SQL met our purpose better:Β select * from (select * from dbname.tblname) where ROWNUM <=10000Our primary question is how do we link/connect the SQL View and/or the Data Slice to the DQ Rule.Β We believe that it occurs in the Monitoring Project.Β I looked thorough the Ataccama online documentation, and the Community,Β but I canβt find the options to make these either of these connections.Any ideas!Thanks!TimΒ
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.