Data Quality & Catalog ⚙️

Hi,In table ‘School’ I want to check two attributes, street and house number and see if they in combination appear in table ‘Address’. I know how to make a lookup which can check if street is in reference table Address, but I want to know if the combination street + house number as a record is in another table as a record.So below record 1 is valid, but record 2 and 3 both have house numbers in Address table, but not in combination with the street. Is this possible in ONE Web? School street house number 1 West street 45 2 West street 47 3 West street 49  Address street house number 1 West street 45 2 East street 47 3 North street 49  

I attended this community spotlight yesterday. Will there be slides/materials from this presentation made available?

Dear members,I am struggling with a step that rather reflects query/array logic than the logic of steps available in component editor.Task is to find the maximum from a range of values. I tried to retrieve it through a dynamic query written in a Representative Creator step, see details below:L1:= round((1-(levenshtein(W_CUA1,W_CUA1_MATCH)/(max(length(W_CUA1),length(W_CUA1_MATCH)))))*100,0);L2:= round((1-(levenshtein(W_CUA1,W_CUA2_MATCH)/(max(length(W_CUA1),length(W_CUA2_MATCH)))))*100,0);L3:= round((1-(levenshtein(W_CUA1,W_CUA3_MATCH)/(max(length(W_CUA1),length(W_CUA3_MATCH)))))*100,0);L4:= round((1-(levenshtein(W_CUA1,W_CUA4_MATCH)/(max(length(W_CUA1),length(W_CUA4_MATCH)))))*100,0);L5:= round((1-(levenshtein(W_CUA2,W_CUA1_MATCH)/(max(length(W_CUA2),length(W_CUA1_MATCH)))))*100,0);L6:= round((1-(levenshtein(W_CUA2,W_CUA2_MATCH)/(max(length(W_CUA2),length(W_CUA2_MATCH)))))*100,0);L7:= round((1-(levenshtein(W_CUA2,W_CUA3_MATCH)/(max(length(W_CUA2),length(W_CUA3_MATCH)))))*100,0);L8:= ro

Hi Everyone,On the Terms page, there is the views of ‘Published’, ‘Unpublished’, and ‘All’. We have an odd scenario where about 150 published Terms (of all types) are showing in ‘All’ but not in ‘Published’. When I search an abbreviation of these Terms, it doesn’t pick it up in Global Search.When I modify one of the Terms in limbo and the publish it, it appears in the ‘Published’ view and has all the expected Global Search functionality.Has anyone experienced this issue before, and identified an appropriate fix? I’m trying to avoid manually modifying and published 150 Term changes.Thanks for your time and support.Stu   

Hello, We’ve created three files, one component file that extracts metadata from Ataccama, one workflow file which helps coordinate communication with the runtime server, and one scheduler file to control the frequency of the runs for the extraction of the metadata. We’ve been running into issues when trying to get the files to run automatically from Ataccama’s GitLab cloud. Note - we did reach out to the tech support team to restart the orchestration server. The error message we’re currently getting is as follows: Process finished with result code 2. Detail: Unable to instantiate the given resource provider: com.ataccama.dqc.s3.resource.S3ResourceProvider$Type We’re unsure what this error means and how to troubleshoot it. We’ve already corrected the output location path for the text-writer steps in the component file to point to the proper s3 bucket within our organization. Any idea how we can fix this error and get the files to land in our s3 bucket?

We have some json which contains dollar signs e.g.{ "$guid": "2d5f7c9c-8e72-4f23-9538-8e07d4c5dcbc", "user": { "name": "Alice", "$guid": "e891cba7-5565-4c48-a2e1-02cd07f81f54" }, "orders": [ { "$guid": "77e4e751-80e8-470e-92c6-493361a9484f", "total": 100.50 }, { "$guid": "b1263c77-4e5f-4c1e-88e0-6df67ee99f61", "total": 250.00 } ]}I can’t get the json call step to read the $guid attribute as it just says invaild json path. Is there any work around to this?

Hi Community,Don't know if you ever have made changes to the page layout in OneWeb, but sometimes it can be an uncomfortable task: while often there is a preview option, for ‘create’ and ‘edit’ pages this is not the case. So after having made the changes and pressing Ctrl-s to save them, if you made a mistake it can turn out your screen will go white, without option to make a correction afterwards (yes, speaking from experience). Lately we had a bit of an awkward situation, that the System Changes screen in the Global Settings area was no longer accessible, showing an error message about a screen layout error. But we never applied any layout changes to the System Changes screen, so we were rather puzzled. I consulted Ataccama Support about this and I would like to share their solution.First conclusion by Support was that this was caused by an erroneous page layout from another page. Indeed we had done quite some development and experimenting (dev environment), so finally we figured out

Is there any to select multiple schedule jobs (data profiling, lookup and monitoring project) and disabled at once or enabled them at once?

Is there any way to get updated date, created date and deleted date of any entity via API. Basically we should get the data whatever we are seeing in history tab.Please let me know if we have any API query for that.

HelloCan we add custom DQ checks added by Ataccama users to the list of automatically suggested rules for a any attribute? If yes, how? 

These are some sample records generating through the One desktop plan. Finally, these results will send to the Responsible persons who can resolve these issues. So in this results, we have three issues assigned to two users, instead of sending two emails, how can we send one email to Mohit?In the Send email step, we are using HTML. Please see the below code.This is a sample email received.  

i have a sql catalog in one web and i have a file in sharepoint now what is the best way to compare the contents of sql catalog and file ?will virtual catalog help ? if yes how could i do it ?  my idea is to join sql catalog and file as full join in one desktop and use this joined data as a catalog in one web application . how to do it ?

Hello!My org wants to create a new column on the Terms overview page to display items from a referenced object array. Specifically, we want to display Data Protection Classification information there on the overview page in a column. At first, we were told this was not possible, but we have seen this done on another one of our overview pages that displays Policies, which is also a referenced object array.  This was created for us, and the json from the “Edit Page” screen looks like it is inherited from another entity. { "_type": "entity.page.listing", "children": { "_type": "entity.listing.v2" }} Here is what our current Terms overview page layout looks like:  And the JSON behind the layout: { "_type": "entity.page.listing", "children": { "_type": "relationships.hierarchyListing", "enableSelection": true, "columns": { "type": { "dataPath": [], "name": "Type", "after": "name", "renderer": { "_type": "glossary.termType.tableCell"

HI I need to find duplicate tables by comparing the row to row from two or more than two tables. i have 300 tables i need to find duplicate tables. Please help to find this out

Hello, I have a rule looking for unique vendors that is tied to a monitoring project.  The monitoring project is running on a regular basis; however, the report is not showing on the report tab of the monitoring project.  This is the only project I’m seeing this behavior.  Has anyone encountered this issue?  We are on version 16.1.

How to add notification to all the rules in monitoring Project for all the catalog items and set alert at 95% at once instead of doing it manually one by one?

Last week we noticed that the export files we created for the summary results of monitoring projects are no longer generating and landing in our S3 bucket. The component/scheduler/workflow were all created by an Ataccama consultant and so we never tamper with these in ONE Desktop. One thing that recently changed is the way the DPE works with the monitoring projects. We were having trouble with scheduled monitoring projects running (they would always fail). Our platform engineer determined that the scheduled runs were going to the wrong DPE so he forced it to go to the hybrid-DPE instead. The scheduled monitoring project runs are no longer failing, but coincidentally the summary export files stopped working the same day that the scheduled runs problem was fixed. Could the change with the hybrid-DPE be the cause of the issue?

Hi All,toDate(Input, “yyyy/MM/dd”) function is not throwing null when I am passing value “1/1/1”. Input datatype is string.can anybody help why it takes 1/1/1 as valid date value?Regards,Shefhali

Hey y’all, I was wondering if anyone had a quality rule or advice on how to construct a quality rule to check a date type field for formatting. I know there is the “matches” function for strings and that you can convert a date field to a string using “toString”, but that requires you to specify a format, which invalidates the point of the rule.The desired format is “MM-dd-yyyy”, as shown in what I’ve got so far.matches("^\d{4}-(0[1-9]|1[0-2])-(0[1-9]|[12][0-9]|3[01])$",toString(ATTRIBUTE_1, "MM-dd-yyyy"))

Can someone share the list of different types of APIs available for reading and writing of Metadata and Data that can be used along with their GraphQLs ?

Do we have any API that will trigger ONE Desktop jobs? We are doing some post DQ steps in databricks, we want to trigger ONE Desktop job from that notebook via API. Could anyone help me on this?

hi,I have a scenario where two columns ID and Value to be verified using DQ check together (like key value pair) against two columns of Table1 key (compared against ID) and name (compared against Value)I am using Atacama web, I see we can create lookup but it could be created only for one column and not both.Appreciate your suggestions here.Cheers!

I have a plan that reads a CSV file from my storage and writes the data to the Business Glossary page.What I Want to Achieve:I would like to enhance this plan to not only insert new terms, but also check for existing terms and update them if necessary to avoid duplicate If a term already exists and nothing has changed, it should be skipped. If the term exists but the definition (or any attribute) has been modified, it should update the existing entry with the new information. If the term does not exist in the glossary, it should be inserted as a new entry. Challenge:I noticed that some solutions in the community reference a unique ID for each term---community chat on bulk term update, but my business glossary terms currently do not have an ID field.Question:How can I structure the plan to perform insert, update, and skip logic effectively, What’s the best practice for comparing and managing term updates in this scenario?below is a snip of what my current plan that write only new pl

 Hi, I am using Ataccama One Desktop 15.4.0. In this case, I am creating a DQC (Data Quality Center) plan with an HANA database as the source. Now, in this database, I also have columns with GZIP data. I would like to unzip these in the DQC plan, but how? Unfortunately, the database does not have this feature. Such functionality does not exist in DQC either. Developing a custom step? It's possible, but apparently not encouraged by Ataccama. Perhaps you could recommend an approach. Best regards, Sergej

Hello, I am trying to make connectivity to ADLS in Azure subscription from One Desktop. What would be the Authentication token endpoin?