Data Quality &amp; Catalog ⚙️

Assigning Business Terms To Custom Folders

Hi Team,I am trying to add my Business Terms in two separate child folders inside my Business Term Folder(Not Data Domains). Just wanted to know if its possible or not?I have created two child folders inside from navigation in settingsBusiness Glossary→ Terms → Business Terms → Folder1Business Glossary→ Terms → Business Terms → Folder2But unfortunately i am not sure how to add Business Terms in those two folders specifically, the normal Business Terms are added directly in the parent folders. Do i need to do some changes in the metadata model for this one or need to create any AQL filter for this folders(Same as Datadomains). Any tips or help is highly appreciated.

676

published in Data Quality & Catalog ⚙️

Phil HolbrookAtaccamer

Building a nested GraphQL API call in ONE Desktop

ONE Desktop provides two ways to access the ONE platform data. Usually, it is easiest to use the Metadata Reader step, but sometimes you need a more complex query, or perhaps you are developing a Json API call to be used from another application entirely. In this case, you will want to start from a Json Call step.The plan I will describe is this: I’ve used a random record generator to “inject” a single row into the data flow to get things started because the Json Call executes once for each row on its input.The “out” output from the Json Call carries all columns from the input; and can also be used to carry connection error messages. I’ve not set that up, so I just sent all that to Trash.I’ve named each of the remaining outputs using a sequential numbered prefix. This manipulates the automatic alphanumeric sorting of the output connections so that the ordering is more logical than a list of element names would be. I’ve also set the layout of the step to horizontal so I can read the l

74910

BhuviData Voyager

Uniqueness DQ Evaluation rule

I am currently using 14.4.0.one-44751-landing-pa-230616-287787-f83b54a4 ONE web application version. While creating a Uniqueness Rule I am not getting WHEN condition as “is unique” and “is not unique” . Could someone help me understand why I am not getting the uniqueness condition instead Validity condition.

1012

mahesh ArData Pioneer

How can we handle csv output from API response

How can we handle csv output from API response?I tried to use json call ,SOAP call but it didn't work.Anyway, can we handle in One desktop csv output from API.

2208

Ajeesh_GUniverse Traveller

Execution Error

Hi,I am running a workflow that includes a task called 'Execute SQL'. This task updates some values in the SQL database, but the code is quite heavy. When the workflow reaches this task, I encounter the following error message. Can anyone assist?

404

RAZORXUniverse Traveller

Tagging of terms to attributes

Hi Is it possible to tag Terms to the attribute metadata present in one web, while importing the terms in bulk from one desktop?Ask: Attributes and Tables are already present in one web. Importing business terms from csv file using one desktop.So while importing the business terms using one desktop is it possible to directly tag those business terms with their corresponding attributes?(The tagging list also i want to provide in a csv file and don’t want to use the automated tagging from ataccama)

1697

JTHStar Blazer L1

DQ Rule Synchronise name with initials

Hi,I have two columns: first name and initials. # first_name initials 1 John J. 2 Robin Earl R.E. 3 Mark Tate Lynch M.T.L. 4 Bert Ern B.E. 5 Johan Flugg J.F. Is there a DQ rule that can check if the two columns are correctly in synch in what they should be? I understand checking the initials format is one thing, but I actually want to check if it is correctly formatted based on the first_name column. Looking for a preferred solution in ONE Web.

242

mbiteyeData Enthusiast

Monitoring Project Specific Notifications - Separated

I have been testing rule specific notifications within monitoring projects and it seems to add those notifications to the bottom part of the general notifications, but we are trying to see if we can receive separate emails due to different users needing to see specific issues.The documentation link is shown in the link below,https://docs.ataccama.com/one/latest/monitoring-projects/results-reports-notifications.html#specific-notifications

432

posted in Data Quality & Catalog ⚙️

Prasad RaniData Pioneer

I would like to get alert when any new data flagged with PII

Hello: I would like to create an alert - while scanning the datasets - if it flags any data to be PII (such as Social Security Number, Data of Birth, Tax Identification Number) etc., Is there a way to get alerted when a specific term is assigned to any catalog item attribute?

773

keithjankeData Voyager

Personal Information (PI) Term and Detection Rule

I’m hoping someone can help. I created a term called Personal Information (PI). I’m trying to create a detection rule to find all columns that are considered PI. Ideally, I would be looking at both the name and the data within. Is that even possible?

471

DhavalMData Pioneer

How to mark unique queries based on their structure?

I have data coming from a SQL database. For most queries, the structure of these queries remains the same, as shown in the picture, with only the attribute name changing. Now, I want to classify these queries as unique based on their structure rather than the attribute name.Demo DataThank you.Regards,Dhaval

833

published in Data Quality & Catalog ⚙️

kayhan.turkerAtaccamer

Passing a dynamic query into a JDBC reader

Hi community!Today, I have a quick tip to share on how to pass a dynamic query into a JDBC reader. If you are using ONE Desktop as part of your day-to-day this would be a good practice to implement when it comes to using the JDBC reader step.OverviewThe following is a working example of passing a dynamic query into a JDBC reader. Its overall structure consists of two plans that are run sequentially in a workflow. The idea is that the first plan will produce the query that the second plan (that includes our main logic) will use.In the above example, an audit table is read in the second DQC plan, but with a query that depends on information on the current state of the table (for example, the maximum of a particular record, record count, and latest refresh date). First Plan - Retrieving QueriesIn the first plan, functions and variables are applied to produce a .sql file that contains the JDBC reader query to be used.As an example, functions can include getting the current date to apply a

1832

Albert de RuiterRocket Pioneer L1

Text File Writer: adding a datetime as suffix to an output file

Hey all,I was wondering if you ever came accross the following requirement and has some tips maybe to implement it.The Text File Writer step can be used to create for instance log files. For tracking or governance reasons it may be necessary to keep all log files. But because the output file name is fixed, each time the file will be overwritten whenever a new one is created. Of course it is possible to manually add a datetimestamp to the file name after its creation, but that is a rather cumbersome approach. So I would like to be able to add a datetimestamp to the file name automatically. Does anyone have a suggestion?Kind regards,Albert

1686

OjaswiniStar Blazer L1

Environment variable $environment$ variable in the subject line in RDM notification

Hello,Has someone used $environment$ variable in the subject line in RDM notification or any other notification emails? We are experiencing an issue with the RDM when using the environment variable within our email notification template. When we configure the template to include $environment$ in the subject line, the received emails do not display the variable. Thanks,Ojaswini

1154

published in Data Quality & Catalog ⚙️

KaterinaAtaccamer

Enhancing Data Quality Evaluation with Component Rules in ONE Web

Speaking about data quality rules, we usually refer to DQ rule configuration in ONE web application. However, when it comes to referencing external sources or performing preliminary work or combining different sources, we may find that the capabilities within ONE Web are insufficient for our needs. For example, consider a scenario where we need to validate whether our data matches an external data source, such as ABN Lookup on https://abr.business.gov.au/. This is where component rules come in handy.The Task at Hand: Validate ABN Information.To implement this data quality (DQ) check, we require a component rule.Here's how you can configure the ABN validation component and use it for DQ evaluation: Configure a placeholder for the component Configuring Logic for the Component using ONE Desktop application Adding Changes to Runtime Configuration in ONE Web Application Configuring the DQ component rule Applying the RuleConfigure a placeholder for the componentNavigate to DQ s

3697

ritguptaData Voyager

Metadata Reader Plan to Export Column Names

Hi,I am looking for a plan to export column names for a catalog item in One Web. Can someone help me with it?Thanks

762

RoelantVosData Voyager

Reproducing the Term level Data Quality overview from GraphQL

Hi Ataccama community,I’m hoping someone with better grip on the Ataccama GraphQL model can shine a light on this. For internal reporting, we are looking to retrieve data quality details via the Ataccama GraphQL API. One of the requests it to produce an overview of the DQ score across the (rule’s) DQ dimensions. This is basically the same as is shown in the web UI when navigating to the ‘Data Quality’ tab for a Term. It shows the score broken down by dimensions, based on how the rules are defined.What I’m trying to do is retrieve the passed/failed rows at this level, so for each term and each dimension. This would allow me to summarise this into a score per dimension.However, I am unable to get this out of the API.I’ve approached this from both the ‘terms’ and ‘rules’ pathway. In both approaches I always end up with the ‘Overall Quality’ score for each term - not the per dimension details.The ‘rules’ query looks promising, but ultimately only returns the passed/failed records for the

1354

Raj YalakaData Voyager

How to Add Date Parameter to output file extension

Hi, I’m trying to add the data value to the file extension in the component but I’m not able to get the expected results. I have added a new string column using alter format step (tostring(today(), 'yyyy-MM-dd'). When I pass the column as $date or ${date} in the output filename, I’m not seeing the data on the output filename.

2704

ThanujaData Voyager

Audit config in One desktop

Can anyone guide me on how to generate an audit for every action, log it, and integrate the logs with the UI in Ataccama One Desktop? Any best practices or examples would be greatly appreciated!

623

Devi

Runtime error in JDBC reader: Error creating record

Encountering with Runtime error in JDBC reader, while running the basic profiling for a table from SQL Server. Full Error details -Runtime error in JDBC reader: Error creating record: column type: 'STRING', read value: '<null value>', read object type: '<null value type>', cause: Connection reset Looking for ideas troubleshooting this error.

442

may_kwokStar Blazer L3

Setup connection to an SFTP server in ONE Desktop

Hi folks,I’ve been given details to an SFTP server, and I can successfully connect to it using Winscp on my laptop: I tried to setup connection in ONE desktop:I put workflow task:But I get an error:14.11.2024 15:15:21 [INFO] Using following licenses:14.11.2024 15:15:21 [INFO] C:\Users\mkwok\license_hamilton_USER_v14_subscription_2025-01-29.plf14.11.2024 15:15:21 [INFO] ============================================================14.11.2024 15:15:21 [INFO] This is a subscription USER license for developers' laptops for "Hamilton". It expires on 2025-01-29.14.11.2024 15:15:21 [INFO] ============================================================2024-11-14 15:15:21 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'properties.encryption.keystore' property not specified2024-11-14 15:15:21 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvid

875

ritguptaData Voyager

Post Processing Transformation Plan in One Web

Hi,Can some help me with creating a post processing transformation plan that shows a different row for each DQ rule that has passed/failed on a particular field in the transformation plan in One Web UI. For Eg: I have 2 rules, a uniqueness check and a format check on the ID field. In the post processing output file, what’s the best way to see how I can split this for each rule and see the pass/fail metrics for each rule.Thanks

681

RAZORXUniverse Traveller

Policy Tagging to Business term or any other asset

Hi Team need your expert opinion on how to tag Policies to Business Terms or any other assets(Applying policies to asset types) in 14.5 version? I cannot see any options for the same is it any version limitation or any customization needs to be turned on. Any help is appreciated.

584

sumeyraData Pioneer

Writing DQ rule for interval values

Hello all,I want to create a DQ rule, In this rule I need to check a numeric field if the value is in the predefined interval or not. Let me give an example of logic. I have a column X contains ‘types of product’ and column Y contains ‘value of product’. And have a list of valid values. If the value of X is ‘abc’ then Y must be in the interval 1-30. If hte value of X is ‘xyz’ then Y must be in 1-200 and so on.I was going to create a lookup file for this one, but couldn’t be sure how to define intervals. Does someone know how to implement my DQ rule for this logic ? Thanks a lot !

253

NBalaguraData Voyager

Bulk editing of metadata using reference excel file

Hi Ataccama community. Could you please share examples of plans used for adding a new metadata entity and bulk loading values from excel file.We have an excel file with sensitivity level defined for each attribute. We need to add an entity called e.g. sensitivity level and to import this from excel file.

330