Data Quality & Catalog ⚙️

If we use matillion ETL tool for  data integration to snowflake. Can we still see the lineage and transformation code in Ataccama?

Hi - I wanted more information on how to use the slices vs a SQL Catalog Item.The use case being often when I’m leveraging a slice I want to be able to do a start date of  >2023 , if it is part of a  quality program I want the data to keep updating i.e as new records come in. However, it seems like the slice is only really designed for the ‘previous’ so ignores current records i.e previous year = 2023, and I can’t set the custom date without an end date so it would be limited to a fixed time range.It seems like for the quality program is better served with the SQL CAT ITEM but I was curious if there was value with the slice I was missing or if I could accomplish the same objective with the slice ? Thank you, Lindsay  

Hi,I want to create a DQ aggregation rule that checks fields from two different tables for the group by clause. Is there a way to do this directly in Ataccama One Web UI.Thanks!

Hi,I am not able to access the transformation plan feature in v15.3 from both the Transformation Plan tab and from the monitoring projects tab. Can someone explain why is there a restriction on creating transformation plans and how can I get access to it?Thanks

I have a One Data table created by importing data from a .csv file.  I need to use some of the data in this table by joining it with an existing Catalog Item by creating a SQL Catalog Item so that I can implement some rules on it.  Where you select the source when starting to create the SQL Catalog Item I do not get an option to select oneData.  Is it even possible to do this in OneWeb?

Debugging - is this possible to i.e. setup some breakpoint and let the application run all the previous steps before selected one?I like using debug function on steps (CTRL+Shift+D). To debug below Step i need to first debug all the previous steps and then i am able to debug the current one.However, if I happen to update logic on some step from the top i then would need to run & debug all the previous steps before i could debug i.e. Multiplicative Regex Matching.Is this possible to automate the manual work here? I would like to create a breakpoint on Multiplicative Regex Matching and each time i could just click a button and it would self-debug from the start to my breakpoint. I looked in your documentation but didn’t found any solution for this. I found some debugging view in ONE Desktop but it doesn’t allow me to add breakpoints.Do i need to configure my debugger somehow to achieve the above? Szymek

Hi,I have a question about the rule logic display when a section is applied. In the report view, I can see the rule logic/implementation when I select a rule. However, once I select a section and do the same, I can only see the valid and invalid results, not the rule logic. Is there a reason behind it? Thank you!

Hi All, Is there a way to parse a copybook file in order to transform the data file into JSON/CSV? The use case is to be able to provide profiling metrics on the web via VCIs? Thank you😁 

When creating groups, are the names always public to everyone who uses the instance?  Or is there a way to create a group of groups that only the members of that groups can see?

Hi all,I have a file with a ¬ delimiter  and text qualifiers and in the file it looks fine but when I look at the local file system in Ataccama to bring the file into the catalog the ¬ shows as Z with an accent. Are there different regional settings in the config that need setting or changing or is this something else? Many thanks for any help Des

hi Team, i need to split a word based on a delimiter and try to add inceremental number to it, can you please help in acheiving this scenario.Input : select * from order;select * from customeroutput should be like select * from order - query 1, select * from customer - query 2i itried using split operator , but could not able to append the incremental number

Hi,We have a use case to accept a request from collibra with details like JDBC URL, username, password and query to Ataccama and I need to return the results and size of the results in reponse from Ataccama.Can you please share usecase/documentation for implementing this usecase in Ataccama.Regards,Rohith

Has anyone experience of integrating Ataccama with Alation Data Catalog?I’ve searched the support and knowledge base article without any success.

Hi all, what about if I had a fixed width file in the catalog with the first row as the header (in error). The column data comes in as one string which renders it unusable for profiling and DQ. How can I get these types of files into the catalog so I can use them in my monitoring project? I have used VCI’s before to add headers to csv files in the catalog and they work well. Kind regards Des

hi,i had a word like this “12345 - Data min”, i need to split this word based on - operator and get the first word.I had another requirement like split and save the words in another varaibleex : select * from emp;select * from customerquery variable should have splitted value like select * from empcan you help in implementing above scenario

Hi folks,Is there some way that I can display a notification banner on Ataccama ONE and RDM, to notify users in advance of any platform maintenance?I’d like to notify my users in advance if we have any planned works, including and not limited to platform version upgrades, or RDM model updates.

On the last 8 months we were working on deploy cloud resource to integrate databricks solution with ataccama dpe and develop jobs to execute on databricks and see the results on ataccama one. The deployment is executed on cloud provider side (aws - microsoft) and the configuration is manually so it takes time to set up with corresponding values, one of the task we would like to improve is the configuration of one databricks with unity catalog to be part of ataccama dpe. On past forums topics I saw helm is part of the tech stacks of ataccama and I am interested to know more about on. I would like to get more information kind of library to repository to understand helm on ataccama dpe. thank you

I’m building an API call request, where I first need to obtain an access token, before I make my actual API call.I have tested the 2-step process using 2 separate JSON calls successfully. The message body of the OAuth request looks like this. Sensitive info redacted: scope is a required parameter. The above call successfully retrieves my token. I tried to setup this as a Generic server:But there is no available space to specify the scope parameter. When I run my plan: I get:2024-09-04 09:33:16 INFO: Validating model...2024-09-04 09:33:16 INFO: Creating runtime...2024-09-04 09:33:17 INFO: Running runtime...2024-09-04 09:33:17 [JsonCall] DEBUG: IOException when making request GET https://preprod-api.londonmarketgroup.co.uk/reference-data/acord/v2/version HTTP/1.1java.io.IOException: Cannot get credentials for request. at com.ataccama.dqc.io.http.CommonHttpClient.makeRequest(CommonHttpClient.java:351) at com.ataccama.dqc.tasks.io.json.call.JsonCall$Runtime.run(JsonCall.java:425) at com.at

Hi,13.9.4In the Monitoring Project there's a way to only display the data quality of the last run via Advanced settings ​​​​​Is there also such a way to do accomplish this with Full Profiling on (SQL) Catalog Items?

I want the result of my monitoring project to appear in the dashboard in the Report section when I receive it by mail. Is it possible to amend the mail notification regarding this?The notification in mail should look like this: 

Hi community,Has anyone managed to connect Ataccama (we’re on PaaS), or even ONE Desktop, to a corporate network folder, download files, and work with it in .ewf workflows and components / plans?Yes I know Ataccama connects to S3 buckets / ADLS Gen2 containers, but the environment that I work in people are really used to shared network drives and a lot of applications are integrated with them. It would make my life a lot easier if I can make Ataccama connect into it.When I look at either the SCP or SFTP upload/download steps, it requires a server to be set up with Basic authentication - of course when I connect to the network drive personally I don’t need to enter any of that.Has anyone done something similar?

HiI have a workflow with Send Email step configured and this workflow will be pushed to orchestration server to run it. I have an attachment need to be included in the email notification generated from the workflow and realized that if I put only the file name for example RESULTS_ABC.xlsx, by default it will find it the same folder of the workflow that is being created. Let’s say if I put the RESULTS_ABC.xlsx in different folder like Data/Out, how do I configure it correctly at the Attach Files configuration as shown in the image below? I saw a discussion to use filePath variable but I am not too familiar with that. Could you please explain how can we achieve running the workflow and read the file that is stored from different folder so that it can attach in the email.