Skip to main content

Learn & Share

Discuss data, share best practices, learn, and grow with Ataccama's Community.

1001 Topics
W
Data Voyager
WesTData Voyager
asked in Data Quality & Catalog ⚙️
Monitoring Project Summary Exports Not Generating/Landing in S3

Last week we noticed that the export files we created for the summary results of monitoring projects are no longer generating and landing in our S3 bucket. The component/scheduler/workflow were all created by an Ataccama consultant and so we never tamper with these in ONE Desktop. One thing that recently changed is the way the DPE works with the monitoring projects. We were having trouble with scheduled monitoring projects running (they would always fail). Our platform engineer determined that the scheduled runs were going to the wrong DPE so he forced it to go to the hybrid-DPE instead. The scheduled monitoring project runs are no longer failing, but coincidentally the summary export files stopped working the same day that the scheduled runs problem was fixed. Could the change with the hybrid-DPE be the cause of the issue?

110
W
Data Voyager
S
Data Pioneer
sumishaData Pioneer
asked in Data Quality & Catalog ⚙️
ADLS Connectivity from One Desktop

Hello, I am trying to make connectivity to ADLS in Azure subscription from One Desktop. What would be the Authentication token endpoin?

40
S
Data Pioneer
S
Data Pioneer
sumishaData Pioneer
asked in Data Quality & Catalog ⚙️
Parquet File output

Hi, I need to extract metadata using One Desktop and store in Parquet file format in ADLS. Do we have any recommendations on how this can be achieved in One Desktop?

478
S
Data Pioneer
Nick Robberds
Data Voyager
Nick RobberdsData Voyager
asked in Data Quality & Catalog ⚙️
Customised Dashboards

We would like to make a customised dashboard for observed data quality issues on a set of complex spreadsheets loaded into Ataccama via an S3 bucket. What are the best ways to create non standard dashboards rather than out of the box style data insights please?

20
Nick Robberds
Data Voyager
M
Data Enthusiast
mp_ataccamauserData Enthusiast
asked in Data Quality & Catalog ⚙️
IS the workspace that holds SQL Catalog Item (SCI) stored on Ataccama server? Or on the same database on which SCI is created

Hi I am new to Ataccama and would like to understand the Sql Catalog Item feature provided in Ataccama web v15.4.I am trying to create a sql catalog item on a table and unable to save it to workspace → new folderI am curious to know what level of access is needed on Ataccama to save the SCI. Also would like to know where exactly the SCI and it’s metadata is stored.

101
Lisa Kovalskaia
Ataccamer
A
Data Pioneer
akshayl09Data Pioneer
asked in Data Quality & Catalog ⚙️
Adding Notification to Monitoring project for all the rules

How to add notification to all the rules in monitoring Project for all the catalog items and set alert at 95% at once instead of doing it manually one by one?

50
A
Data Pioneer
G
Data Voyager
Gopal PatilData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Data Governance

Hi,How is data governance concepts used in Ataccama tool?

151
E
Ataccamer
A
Data Voyager
AH5Data Voyager
asked in Master Data Management & Reference Data Management 🛰️
detecting duplicate records upon import

re: Duplicate record checking upon inputting new records into RDM-WebI know about setting up the uniqueness check and validations on the data once. I have users in the Web portal potentially entering duplicate values, can we set up uniqueness checks BEFORE they publish records. So, any record that is deemed duplicate (on 1 or more columns) would not be publishable. If this question has already been submitted/answered, please direct me there.Thanks,

152
A
Data Voyager
O
Universe Traveller
onufryUniverse Traveller
asked in Data Quality & Catalog ⚙️
Qlik Reports

Hi everyone,I’m exploring ways to automate the import of Qlik reports (or datasets exported from Qlik Sense) into Ataccama’s data management platform using API-based workflows. My goal is to ensure that reference data or analytical results generated in Qlik can be seamlessly ingested into Ataccama for further processing, enrichment, or distribution to downstream systems.From what I understand, Qlik offers REST APIs for data export and integration, while Ataccama provides robust APIs for job execution and data ingestion. However, I’m looking for practical advice or examples on how to best orchestrate this integration—specifically: What is the recommended approach to export data from Qlik (e.g., via Qlik’s REST API or by generating CSV/Excel files from the load script) and then import it into Ataccama using its API? Are there any existing patterns, connectors, or scripts that community members have used to automate this process? How do you handle data validation, error handling, or s

191
R
Ataccamer
G
Data Voyager
girish.chalkeData Voyager
asked in Master Data Management & Reference Data Management 🛰️
http.nonProxyHosts

Hello,Looking for some help on using http proxy in RDM. We are trying to perform HTTP POST to external endpoint which is accessible only via proxy. Below param were added in JAVA_OPTS in onlinectl.sh file however   -Dhttp.nonProxyHosts is ignored and ataccama is pushing all https requests via proxy.!--scriptorstartfragment-->   -Dhttp.proxyHost=outbound-service-proxy.gateway.aws-euw1-np.mydomain.com \  -Dhttp.proxyUser=svc_nonprod_service_proxy_fdplife \  -Dhttp.proxyPassword=xxxx \  -Dhttp.proxyPort=80 \  -Dhttp.nonProxyHosts=localhost|127.0.0.1|*.uk-dwh.nonprod.aws-euw1-np.mydomain.com" !--scriptorendfragment-->

141
R
Ataccamer
O
Universe Traveller
onufryUniverse Traveller
asked in Master Data Management & Reference Data Management 🛰️
One Data on Hybrid Env

Hello Ataccama Community,I'm currently managing a hybrid deployment of Ataccama ONE, where our Data Processing Engines (DPEs) are running on-premise while the rest of the platform is in the cloud. I've noticed that the ONE Data module is not available in this setup, and attempts to enable or use it result in errors or feature flags being disabled.Could you please clarify: Why is ONE Data not supported in environments running purely on hybrid DPEs (both cloud and on-premise)? Is there a technical roadmap or timeline for when ONE Data will be available or fully functional in hybrid environments? Are there any recommended workarounds or alternative approaches in the meantime for organizations that require hybrid deployment but also need ONE Data capabilities? Thank you in advance for your insights!

80
O
Universe Traveller
S
Data Voyager
surendraData Voyager
asked in Data Quality & Catalog ⚙️
Integration with SharePoint

Is Ataccama support integration with SharePoint?

241
R
Ataccamer
C
Data Voyager
csapocheData Voyager
asked in Master Data Management & Reference Data Management 🛰️
Is there a way to change the default Referenced Data Display mode globally?

I’d like to default the referenced data display mode to “label” rather than “binding keys” as the default display mode option for all tables. See this link for details on how it is changed per table: Viewing Data in RDM :: Ataccama ONEIs there a way to accomplish this?

50
C
Data Voyager
T
Data Voyager
tyler manawesData Voyager
asked in Data Quality & Catalog ⚙️
How to create a column on the Terms overview page to display a referenced object array

Hello!My org wants to create a new column on the Terms overview page to display items from a referenced object array. Specifically, we want to display Data Protection Classification information there on the overview page in a column. At first, we were told this was not possible, but we have seen this done on another one of our overview pages that displays Policies, which is also a referenced object array.  This was created for us, and the json from the “Edit Page” screen looks like it is inherited from another entity. { "_type": "entity.page.listing", "children": { "_type": "entity.listing.v2" }} Here is what our current Terms overview page layout looks like:  And the JSON behind the layout: { "_type": "entity.page.listing", "children": { "_type": "relationships.hierarchyListing", "enableSelection": true, "columns": { "type": { "dataPath": [], "name": "Type", "after": "name", "renderer": { "_type": "glossary.termType.tableCell"

332
T
Data Voyager
A
Data Pioneer
akshayl09Data Pioneer
asked in Data Quality & Catalog ⚙️
Multiple job selection to schedule disable/Enable

Is there any to select multiple schedule jobs (data profiling, lookup and monitoring project) and disabled at once or enabled them at once?

60
A
Data Pioneer
A
Star Blazer L1
aish_TFStar Blazer L1
asked in Master Data Management & Reference Data Management 🛰️
MDM Instance output to represent Ids from each system

I want to convert the instance export table values to a new table/view.The instance export contains 3 columns that I want to utiliseSharing an example-I have the following instance table structure :MASTER_ID SOURCE_SYSTEM SOURCE_ID 001 sys1 1234 001 sys2 12232 001 sys3 1292 001 sys4 13432 001 sys2 12334  5 records from 4 different source system make a master record, I want to group it in such a manner that there is a single row for each source_system id. If a source system participate twice(with two unique records) in formation of master record, I want two rows representing the different source_ids and a column with the source system that participates twice. Here is how I intend the output table to be: MASTER_ID SYS1_ID SYS2_ID SYS3_ID SYS4_ID MULTIPLE_REC 001 1234 12232 1292 13432 SYS2 001 1234 12234 1292 13432 SYS2  Can someone help me with the ONE Desktop step I can use for this?I have explored using Aggregating Column A

252
A
Ataccamer
Albert de Ruiter
Rocket Pioneer L1
Albert de RuiterRocket Pioneer L1
asked in Data Quality & Catalog ⚙️
'Deleted by' details via GraphQL

Hi all,Some time ago I posted a question ('Published by' details via GraphQL) about how to make visisble who published for instance a glossary term.I noticed that like this you can't show who may have deleted the asset.Does anyone have a clue how to retrieve this details via graphQL (or in a different manner)?Kind regards,Albert

403
M
Ataccamer
W
Data Voyager
WesTData Voyager
asked in Data Quality & Catalog ⚙️
How to limit number of each DQ rule in invalid sample exports from One Desktop

Sometimes we have monitoring project results where a DQ check returns 1000 records because of so many rule failures. We want to limit the amount of records in the monitoring project export file for each DQ rule. If I only want to show X invalid samples per DQ check, how can I go about doing this? I initially thought of using a sequence step then filtering the final result, but this does not work because each rule needs its own sequence or count. Basically, I think I may need to group each DQ rule and apply a sequence to each group separately. This is how I am thinking of solving the problem. Any suggestions on what I can do? Thank you in advance for your help!

644
W
Data Voyager
M
Data Enthusiast
mp_ataccamauserData Enthusiast
asked in Data Quality & Catalog ⚙️
Unable to use the config file provided, exiting. - error

how to resolve ‘Unable to use the config file provided, exiting.’ error

221
M
Data Enthusiast
A
Data Voyager
Apurva KapoorData Voyager
asked in Data Quality & Catalog ⚙️
What the different types of APIs available for read and write of Metadata and Data that can be used ?

Can someone share the list of different types of APIs available for reading and writing of Metadata and Data that can be used along with their GraphQLs ?

385
T
Data Pioneer L2
A
Data Voyager
Apurva KapoorData Voyager
asked in Data Quality & Catalog ⚙️
Is there any list of APIs that I can refer for reading and wirting of the Metadata ?

Is there any list of APIs that I can refer for reading and writing of the Metadata ?

131
E
Ataccamer
M
Data Enthusiast
mp_ataccamauserData Enthusiast
posted in Data Quality & Catalog ⚙️
Ataccama learning and Certification path for newcomers

Hi,Can anyone please suggest the next level of certification after Ataccama ONE v15 | DQ&C Consumer Certification?Thanks in advance and Happy Learning!

90
M
Data Enthusiast
O
Universe Traveller
onufryUniverse Traveller
asked in Data Quality & Catalog ⚙️
Migrating Production Environment to Development

Hello Ataccama Community,We currently operate two Ataccama ONE environments: dev (for testing and experimentation) and prod (for business use). Our goal is to ensure that the dev environment closely mirrors prod, especially for configuration and metadata, so that testing is as realistic as possible.Ideally, we would like to perform a weekly migration from prod to dev—essentially overwriting the dev environment with the latest prod state. However, as I understand it, there is no automated way to fully clone the prod environment to dev, and migration of certain elements (like metadata model changes or monitoring projects) is either limited or requires manual intervention.Questions: Migration Feasibility: Is there any way to automate or script a full environment migration from prod to dev, or are we limited to manual processes for specific components? What are the main obstacles or unsupported features when trying to migrate Ataccama ONE environments? Best Practices for Environ

685
ivan.kozlov
Ataccamer
A
Data Pioneer
Ayush kumarData Pioneer
asked in Data Quality & Catalog ⚙️
Getting values from previous ataccama run (for monitoring project or profiling runs) and comparing them

I am working on a requirement where I have to check that any values which were present in previous profiling/monitoring project run inside column_A of table_1 should not be absent in current/latest run of column_A table_1 if those are present I have to highlight those, requesting community to help me with this.

345
E
Ataccamer
may_kwok
Star Blazer L3
may_kwokStar Blazer L3
asked in Master Data Management & Reference Data Management 🛰️
RDM REST API - using count and offset to get all records

Let’s say I have a table that has 500,000 rows.I need to query this table using REST API (because I want to get both published records and records still in edited/waiting for publish states).I have some params to filter the data with, but even with params, the result set could be say, 10000.I tried using the REST API using JSON call step in a plan, setting “count” to 10000, and the API says maximum is 1000.I see that the REST API provides the offset param as well. Is there an example of how I can use that offset param to paginate and query all the records that I will need, but in one plan/component?This component will be a part of a complex set of components as a larger operation, and I’d prefer to not have to create an extra .ewf and iterator for it, otherwise this whole thing gets too complicate for anyone else to understand… Any ideas?

326
Cansu
Community Manager

Badge winners

Show all badges

Let's shape the future of Ataccama together

Join User Research at Ataccama!
See new features and prototypes before everyone else, and have an opportunity to shape the future of new products.

Read more
Community Terms of Use & ConditionsCookie settings