Data Quality & Catalog ⚙️

Hi We are planning to use Atacamma DQ as a service and would like to use its DQ Engine to query and provide us counts. We would like to build a API call to Atacamma DQ with necessary SQL Query and connection parameters as part of API call, and would like to know if this SQL query can be executed on the Atacamma DQ and provide the results as an output back to API as a response. Please let us know the possibilities. Regards,Uma

Hello, is it possible to export a catalog item along with its associated terms?  As you can see in the screenshot below, I set the attribute called “last_update_hostname”  as confidential temporarily for an example, but when I export it to a file, I was only able to see the data values not the terms associated with it.   

The email notifications starts with “Dear Collegue”… and i was wondering - is there a mail merge kind of thing - that can be done to replace the generic addressing with speicific name of the individual it is being emailed to? And - if it is a role - may be we need to get into role membership to expand into names. Has anyone done that? 

Hi DQC online service experts,I have built an online service that writes data into RDM using Rdm importer. I put some validation logic into the component so that it would reject bad records from being written (e.g. value supplied does not exist in parent table). The rdm importer is going straight to confirm mode as we need the data to be automatically published and available. I've configured the integration output to provide the primary key and my explanation in the case that the component rejects the record. The app that is sending the data, are now saying that even if I provide an error explanation, the endpoint still provides a 200 response code. They have some in built error handling capability that they want to use, but they currently can't use it because the server responds 200. Is it possible for me to set a different response code e.g. 400, based on the data that is provided in the integration output?

Hello Community! I am looking to make a bit of an adjustment to my MMM in DQG version 14.5. Specifically, I would like to add a field for AD groups, so that they are validated at an entity level. I know I can write in AD groups and add them to the entity description (see image below), but I am also looking to enforce that idea. The entity summary includes a field to list an AD group, but this does not have any sort of legitimate ties to the actual external group.Any insight on how others have approached this topic or otherwise accomplished my goal is greatly appreciated. Thank you for your time.  Willoh

Hello! I am interested in hiding the global settings from users, at least some of them. I know this question has been asked before for version 13, but it was mentioned the approach is quite different in 14.5. Would appreciate any insight you all have. 

Hi everyone!Im not sure if this is possible, but I have not been able to find a query to find who the stewards are of a particular catalogItem. Specifically I am interested in getting the data owner and then using this in another part of my project.I do have the Attribute Id of the catalog item and my atacamma playground is working I just cant seem to find specifically what query I need the make.Thank you for any help!

Hi Team,we are just trying to convert the string timestamp format values to dateTime format in the expression transformation, when we tried to use  toDateTime(<column_name>,'YYYY-MM-DD HH:mm:ss','en') returning null- can someone help.

Hi Team,I am reading from collibra using collibra reader, some data has html tags like - <p> , <div> in it. Is there a way where we can filter out the html tags if its present in the data. like strip html tags like that. Let me know if more information is needed.Thanks.

Hi team,I am working on a story where a user needs to see the results of the monitoring project which is running.Like where the results are getting saved in the backend,in the tables.Need to create a pipeline for that like when we click the run monitoring button in Ataccama Web,a workflow in Ataccama desktop should run and the results should be saved in the database to look at to see how many records are passing and failing.So how can we create that pipeline?

Hello all, i have datalake gen2 parquet files in containers and folders. In the folder are delta.log file and parquets. Is there some way to merge these parquets to one table? This table should represent one current(up to date) table contains data from parquets. this is what i see now in ataccama. I want to merge these data to one table. Thanks for replies, Matus

Hi Team,I am trying to find how we can achieve completeness DQ control by comparing data in the file and the table irrespective of the position of primary key in either of them. Also, need to know how we can achieve the same by using the composite keys.

Hello,I hoped somebody has already worked this out so I don’t have to 🤣. I have a Epoch Unix Timestamp value that I want to convert into normal DATETIME format in Ataccama.e.g. 1711015200 I was expecting converted value to be 2024-03-21 10:00:00 (GMT).But when I do a toDateTime() on it, it gives me 1970-01-20 20:16:55. So I guessed wrong.I thought about using dateadd() but that one does not support seconds. Any ideas?

Hi We would like to publish the profiling results of a scan on to Azure service so that we can pick up those results and update it back to another reporting systems via Kafka or Azure Pubsub.What we are mainly interested is in how to achieve sending publish results to Azure post scanning in runtime without impacting the performance on PostgreSQL DB where profiling results are getting logged. Did any one encounter similar scenario and how did you achieve it.Regards,Uma

Hi everyone, Just wondering if Ataccama provides any best practice guides on naming conventions when working with the platform. This includes best practice for rule names, error names, sql catalogue item names etc.  Kind Regards,  Vishy

Hello, Is it possible to mask attributes that are classified as restricted/confidential using Ataccama One Web? I was able to assign rules and terms to attributes, but I was not able to create/apply any masking methods. Please let me know if anyone has tried this before. Thanks in advance!

Hi Team,I am trying to find how we can achieve completeness DQ control by comparing data in the file and the table irrespective of the position of primary key in either of them. Also, need to know how we can achieve the same by using the composite keys.

Hi,I have a question about the display of invalid samples when a specific section is selected. It's helpful that the invalid samples are based on that section's checks, but I'm wondering why all attributes are shown by default.Wouldn't it make sense to show only the attributes relevant to the failed rules, with an option to add more if needed? The current setup is a bit confusing.Thank you!

Hi community,Does anyone know about documentation about visualizing relationship types? On the documantation portal I found this, but that doesn't seem to cover the setup in the Graph Visualization section in the Application Settings. The documentation mentions “For more information, see Configure Graph Visualization.”, but that is a link to the page you are already on.Kind regards,Albert

Hello Dears! Would someone advise if there any watch outs once I want to rename Monitoring projects and DQ rules on ONE Web?I have running projects and DQ rules naming convention of which I would like to improve. If I just simply change names, won’t it have negative impact anywhere?Thank you. Kind regards,Maria

I would like to setup a generic data quality rule to check string length. Requirements for length checks differs per attribute. Say column1 needs to have max length of 10 column2 needs to have max length of 15 and so onIs it possible to create a generic rule to check string length, passing value of length as parameter?I am aware of attribute length insights available as part of DQ profiling results but I would like to make the check as part of monitoring project. Thanks!

HiI would like to get a summary of DQ checks and results like the one we have in ONE web like how many in % and count of broken rules, how many are passing and how many records do we have in total etc. in Ataccama ONE desktop. I tried looking out any related topic in the community but I could not find one. Is it possible to achieve this via Ataccama ONE desktop as we have an existing plan comparing data fields in two different sources. Do you mind sharing the suggested steps to achieve this? Thanks in advance!