Data Quality & Catalog ⚙️

I’m trying to build a GET API call to an external data provider.This provider requires me to send my GET call with the certificate.We managed to test it in POSTMAN, where I had to add the certificate in the Settings → Certificates menu: I have a .pfx file with a passphrase, and I needed to specify the host.This works on my laptop in POSTMAN. Now I’m trying to do the same call in ONE Desktop using JSON Call step.By way of googling, I’ve managed to convert my .pfx file into .cer, then I imported the .cer file into {DQC_HOME}/jre/lib/security/cacerts . Then I have restarted ONE Desktop. But when I call the API I’m still getting an error message from the other side saying my certificate is not sent. I have a suspicion that the certificate is sitting in the keystore but it is not us

Hey all!Now that incoming webhooks within Microsoft Teams is discontinued (Existing configurations will work until end of 2025), is there a plan for how teams will continue to integrate with notifications from Monitoring Projects? This was a big sell to a lot of our users, and now that we are unable to use incoming webhooks for new monitoring projects, I want to see if there is a plan to have a work around, or if it will be not supported in the future.    

Hello: I have a use case where when the data in a given column - for a key changes from previous day to next day - that should trigger an alert/notification For Ex: Security Ratings, and/or ESG ratings generally dont change for a given security. I have a table that has one record for each day for each security. And the ratings are in the columns of that table. Now - on a regular day - all ratings from previous day should be same for next day, and day after (until it changes). And on the day when it changes - i want to capture that security, ,what field changed - what was yesterday;s value vs todays value. The way - i would like to solve this - is create a SQLCatalog item - with previous day - and current day values combined into one dataset for each security and write scripts to compare them one by one, and report any changes. But I want to know if there is an out of box - date driven compare that can be done for this. 

hi Team, i need to get yesterday date in my workflow global variable, can you please help in getting.when i use toString(now(),"yyyy-MM-dd") -- printed me todays date when i use toString(now() - 1 ,"yyyy-MM-dd"), getting error as operator “-” can not be used

Hi, I am trying to write some rules to check the data type of attributes within sql tables or flat file columns. I am aware that profiling checks this but I have a requirement to check the data type as well. There don’t appear to be any parse functions in the interface. Any help would be appreciated, I am a noob so please be gentle :)

DQS matching component results are not reflected when bundle is deployed and the entity is re-processed. I did re-build the repo with the new Extended unifier but no effect. What could be a reason?

Hi,13.9.4Currently we have a monitoring project with several DQ rules applied. We also build in ONE Desktop an export functionality through components in order for the users to click one button and get a .xlsx file to see all the invalid records.ONE Deskptop component​​​​​When the .xlsx is downloaded and opened you will see the following:ExportAs you can see the same rules is shown multiple times with every time because a record can have multiple invalid rules applied on them hence the several options. This creates a list of invalid rules and for the user it's not a great experience to filter through the file. Is there a soluti

Is it possible to include attachments (containing invalid records) from the export tab of the monitoring project to the notifications sent out to the users?

Hello!I had a user pose the question of being able to view the plain values of lookup lists that came out of the box with Ataccama. When attempting to look at the lookup lists, it is unreadable from the Web UI, and the Desktop application. Is there any listed documentation of what these lookup lists contains, or a desktop plan  to transform the lookup lists into a plain English format?Thanks!

I have about 200+ rules in my rule library that i built over a period of last 2 years.Some of them I used Lookups. Later on I stopped using the rules in my moniotring projects, but the rules are still left in rule library. I want to disable the rebuildingo of lookups.  How do i find out which of my rules are using the Lookups? How to find them?

Hi everyone,I currently have a plan that is creating a main task and populating it with sub tasks that each link to individual tables. My issue at the moment is that sometimes this creates tasks with a huge amount of sub tasks that may seem daunting for people to try to work through.Currently the tables and their attribute ids are all stored in one excel sheet, so I was wondering if it would be possible to break it into separate excel files each containing 20 rows. If this is possible I would then be able to create additional tasks rather than just grouping everything in one.Thank you for any help!

Hi all! I am working on a monitoring project. I have a catalog item consisting 130 columns. I want to create a custom catalog item selecting only few attributes that I need to have them in my monitoring project.However, based on my previous experience: Once I have created a catalog item with selected attributes. Then I had to add new attributes according to my project needs. I have run the monitoring project again with new attributes of catalog item, then I lost my monitoring project. It showed errors for all DQ rules because as I understood from error message, DQ rules need to have attribute key ids, and with adding new attributes I have changed attribute key ids. Now, again I have a huge catalog item and I want to reduce the volume with selecting few attributes but I don’t want to face with the same problem again. If you have any suggestion it would be so great for me. Thanks !

Hello all, i have datalake gen2 parquet files in containers and folders. In the folder are delta.log file and parquets. Is there some way to merge these parquets to one table? This table should represent one current(up to date) table contains data from parquets. this is what i see now in ataccama. I want to merge these data to one table. Thanks for replies, Matus

I want to create another column using the filter step on the IDE. How do I concatenate foreign characters and fields with different data types into one field.Fields to concatenate is date field, special character (/), string and integer fields

Hi We are planning to use Atacamma DQ as a service and would like to use its DQ Engine to query and provide us counts. We would like to build a API call to Atacamma DQ with necessary SQL Query and connection parameters as part of API call, and would like to know if this SQL query can be executed on the Atacamma DQ and provide the results as an output back to API as a response. Please let us know the possibilities. Regards,Uma

Hello, is it possible to export a catalog item along with its associated terms?  As you can see in the screenshot below, I set the attribute called “last_update_hostname”  as confidential temporarily for an example, but when I export it to a file, I was only able to see the data values not the terms associated with it.   

The email notifications starts with “Dear Collegue”… and i was wondering - is there a mail merge kind of thing - that can be done to replace the generic addressing with speicific name of the individual it is being emailed to? And - if it is a role - may be we need to get into role membership to expand into names. Has anyone done that? 

Hi DQC online service experts,I have built an online service that writes data into RDM using Rdm importer. I put some validation logic into the component so that it would reject bad records from being written (e.g. value supplied does not exist in parent table). The rdm importer is going straight to confirm mode as we need the data to be automatically published and available. I've configured the integration output to provide the primary key and my explanation in the case that the component rejects the record. The app that is sending the data, are now saying that even if I provide an error explanation, the endpoint still provides a 200 response code. They have some in built error handling capability that they want to use, but they currently can't use it because the server responds 200. Is it possible for me to set a different response code e.g. 400, based on the data that is provided in the integration outpu

Hello Community! I am looking to make a bit of an adjustment to my MMM in DQG version 14.5. Specifically, I would like to add a field for AD groups, so that they are validated at an entity level. I know I can write in AD groups and add them to the entity description (see image below), but I am also looking to enforce that idea. The entity summary includes a field to list an AD group, but this does not have any sort of legitimate ties to the actual external group.Any insight on how others have approached this topic or otherwise accomplished my goal is greatly appreciated. Thank you for your time.  Willoh

Hello! I am interested in hiding the global settings from users, at least some of them. I know this question has been asked before for version 13, but it was mentioned the approach is quite different in 14.5. Would appreciate any insight you all have. 

Hi everyone!Im not sure if this is possible, but I have not been able to find a query to find who the stewards are of a particular catalogItem. Specifically I am interested in getting the data owner and then using this in another part of my project.I do have the Attribute Id of the catalog item and my atacamma playground is working I just cant seem to find specifically what query I need the make.Thank you for any help!

Hi Team,we are just trying to convert the string timestamp format values to dateTime format in the expression transformation, when we tried to use  toDateTime(<column_name>,'YYYY-MM-DD HH:mm:ss','en') returning null- can someone help.