Learn & Share

Is there a way to put columns in a view with a static value? Like you can in a sql statement, such asSELECT col1, ‘this is a static value’ AS col2

Is there a way to create views in RDM that contain union statements combining queries to different tables?

We're currently working on a setup where different customers can see their own data in our Cloudera data lake. So when a customer looks at sample data or profiling data they should only see the row of their own data. I'm currently working on a solution for the profiling data. For this I want a service account for that customer to do the profiling. This service account can also only see the rows for that customer. I was thinking of creating a component for this that reads a database table with lists of customers, url resources and CIs (Hive tables) to profile. And then use a Json call that runs a GraphQL command to run the profiling as the correct service account. Unfortunately the url resource in the Json Call is the only part that cannot be parameterized (as far as I can see). The url resource has the authentication (One Desktop server connection), so that will not be the way to go then. Alternatively I was thinking of using authorization in the HTTP Header. Like this.But some experim

Hi everyone, Today we will cover how to use the search function in ONE Web Application 🔍Whether you're a business user looking for specific information or a technical user executing complex queries, our search engine has you covered. Let's dive in!There are two areas for search:Global Search: full-text search is enabled on the whole application and is a good starting point for searching entities and locating the area for the future detailed search if necessary. Search in Navigation Sections: combines full-text and filtering capabilities to query entities. Search options are restricted to the currently selected navigation section: for example, using the search bar in Catalog Items will only return results found within that entity and configured areas of search on this entity.1️⃣ Global Search: Discovering Catalogued EntitiesThe Global Search is your go-to tool for searching use cases across cataloged entities. It allows users to explore preconfigured entities like catalog items, terms,

Hello Ataccama team I would like to know if there is a reference about how to configure an external dpe using databricks on azure. Thank you

Hello:I would like to use GraphQL queries to extract results of a monitoring project - and load the results into my own database table for reporting and other purposes. I need to make it split the invalid records - in a way  - that each record should be for one failed rule - even if the primary key record - has multiple DQ issues (failed rules).Can some one help me with sample code on how you may have accomplished it - if you did such a thing? 

The response message was:null and response error was 'errorMsg:java.net.NoRouteToHostException: No route to host    at java.base/sun.nio.ch.Net.connect0(Native Method)    at java.base/sun.nio.ch.Net.connect(Net.java:579)    at java.base/sun.nio.ch.Net.connect(Net.java:568)    at java.base/sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:593)    at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:327)    at java.base/java.net.Socket.connect(Socket.java:633)    at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:121)    at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:180)    at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:326)    at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:605)    at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:440)  

Hello hive mind,I am calling an API that gets me some foreign exchange rate data (all from USD). The data that comes back is in this format:timestamp AUD EUR GBP 2024-04-24 12:00:00 1.538766 0.935636 0.803964  I’ve highly simplified this. There’s a possible169 currencies here, I’m only showing 3. I need to unpivot it and get it into this format:timestamp from_ccy to_ccy rate 2024-04-24 12:00:00 USD AUD 1.538766 2024-04-24 12:00:00 USD EUR 0.935636 2024-04-24 12:00:00 USD GBP 0.803964  My current plan looks like this: It is fine for 3 currencies. But not fine for 169!Anyone got any ideas for steps I can use to keep my plan clean and tidy? (And that I don’t have to make 169 copies of Alter Format 😱) 

Hello Ataccama team I am working with ataccama 14.5 , I would like to know if there is a documentation to know more about dpe service. Kind Regards

Hi everyone!In today’s post, I’ll walk you through the Policy Management module with best practices so that you can make the most of it in your organization. Let’s start with the basics: Understanding Policy ManagementPolicy Management is your one-stop hub for documenting and tracking policies and regulations that impact your entire organization. It's designed to help you stay compliant with regulations and internal policies. By using this module, you can easily define, organize, and monitor the rules and guidelines that guide your organization's operations. Navigating the Policy OverviewTo get started, head over to the Policy Management section on the left sidebar.Here, you'll find the All Policies tab that provides an overview of all your policies. Each policy is highlighted with different colors to indicate its status:No highlight: Published policy. Green highlight: Recently added policy. Orange highlight: Policy with requested changes. Red highlight: Policy with removal requested.C

Happy Wednesday Community! Today we will talk about workflows - let’s dive into it right away 🤿 Currently, workflows in Ataccama ONE are focused on the access request process. They offer additional automation for requesting changes to data access in ONE. Here are some key actions that workflows allow:If you have insufficient access rights on a node, you can request a higher access level from the node owner. The default assignee of the task can either approve or reject the request from the Kanban Board. For more information on tasks, check out our previous post on the community here.Before you can request access to entity data, make sure you meet the following prerequisites:The workflows:ableToStartRequestDataAccess trait must be enabled on the entity. Data access requests can only be enabled for the following entities: Catalog Item Source Location Connection Monitoring Project To view the list of workflows, navigate to Tasks And Workflows > Launched workflows tab. Here's what y

I have an xml file with a structure like this:<model xmlns="http://www.ataccama.com">    <entities>        <entity name="table1" />     <columns>             <column datatype="varchar(100)" name="abc" required="false" />             <column datatype="int" name="xyz" required="false" />             <column datatype="datetime" name="123" required="false" />     </columns>...I want to produce a data stream that combines the column name and data_type with the name from the parent entity node.  If I define the columns using xpath nm:model/nm:entitles/nm:entity/nm:columns/nm:column then I cannot access the entity name using ../../@name (or any xpath expression for that matter).  If I define the columns using entity level xpath epxression nm:model/nm:entitles/nm:entity and the columns with xpath nm:columns/nm:column/@name then I only get 1 record per entity with the first column only.   How can I get the entity name, column name, and column data

Hi,I created a Monitoring Project with a Catalog Item Loan from Source A. In the Monitoring Project I apply 100 DQ checks and I'm very happy. I want to change the source afterwards because I'm done checking the CI Loan from Source A and need to check the same CI (not same data) from Source B. Is it possible/doable to change the underlying Source A to Source B keeping the 100 DQ checks in the same Monitoring Project? I heard it was possible, but couldn't find it anywhere in the community.

Hi Community!I was wondering if anyone has used the Security term (as extension of term) functionality in OneWeb and if so how. There seems no documentation available from the Documentation portal or the Community to clarify the modeling choices. The node has the following properties regulation is a string instead of a reference to node regulation and responsiblePerson is also a string. The effectiveDate is not of type date but string as well. Why would this be?Anyhow, I would appreciate if anyone can shine some light on this.Thanks and kind regards!Albert

We want to profile Hive managed tables in our Cloudera data lake. This is only possible if the Hive managed table is defined as non transactional. However to turn of that feature you need to rebuild the table. We had a discussion with our architecture team and they don't want to turn off this functionality.The other option then is using Hive Warehouse Connector. It is known that this has some performance costs. But we want to test this anyway.Is there any documentation on using this feature?

Hey all, Has anyone been able to integrate with TWS for kicking off Reconciliation or Data Quality Project runs? I have users asking if their DQ Projects can run after their jobs have run which are scheduled by TWS. I was thinking that there has to be a way that Ataccama could listen for when a TWS job runs and finishes, it could kick off a DQ or Reconciliation project to also begin running. Has anyone successfully set this up before? either in the Orchestrative server or within Ataccama Desktop?Thanks

How can I map custom input parameter for Validation component in Ataccama One Web UI?   

I have a workflow that runs multiple components. In the workflow I have a parameter called load_id that I would like to use to query all kinds of tables later in the flow. But if you use a JDBC Reader in your component you can't use the parameter in the query. You could if you were able to do an Alter Format before the JDBC Reader, but JDBC Reader allows no input.I've seen some tips here in the Community, like these: But initially I still ran into some issues before I got it working. So I decided to share a working example.This is my very simple workflow.It only has a Run DQC task that will run the component.But let me show the global variables in my workflow. I hardcoded the load_id, so my query would get rows back. Now lets look at the configuration of the Run DQC task: As you can see, I run the parameterinquery.comp component and pass on the load_id with the expression """"+load_id+"""" .On to my component:The Random Record Generator is the start of this, because with the JDBC Reade

Hi Team, could someone please assist in getting idea of implementing checkpoints in master data consolidation process.?  as currently we observed MDM follows a one lengthy workflow of MDM data consolidation process from Data acquisition to publish data to the downstream systems [ data acquisition→ change detection → cleansing → match→ and then merge.]  during this entire flow execution if any one of the components failed after few hours due technical some issues, then it is required to restart this entire flow. just to avoid this we wanted to restart the jobs from the point where failure happens, is there any way to breakdown or separate the jobs or implement the check points to restart.? please suggest with the recommendations.Thanks, 

Hi Community,In a term's listing (overview) page you can click on the term's name after which the detail page for that term opens. If you click beside the term's name a kind of preview pane or side window opens, also showing details for that particular term. So like this:In the details screen it is possible to change the page layout, which is especially important after having added custom properties, so that a logical layout can be retained.It looks though that for this preview pane the layout cannot be changed. Does anyone of you know how to accomplish this?Kind regards,Albert

Please advise if you have any documentation that provides a short description on each Ataccama functions pertaining to user access:  for exampleAtaccama Function Description  Administrator Data Owner Data Steward Custodian System   Full access       User Management   Full access Editing access View metadata access View metadata access Source   Full access Full access Full access View metadata access Connection   Full access Full access Full access View metadata access Folder Folders in Workspace are intended for storing SQL catalog items and virtual catalog items (VCIs).  Full access Full access Full access Full access Location   Full access Full access Full access View metadata access Catalog Item   Full access Full access Full access View metadata access Term   Full access Full access Full access View metadata access Rule   Full access Full access Full access View metadata acc