Learn & Share

Hi Ataccama community. Could you please share examples of plans used for adding a new metadata entity and bulk loading values from excel file. We have an excel file with sensitivity level defined for each attribute. We need to add an entity called e.g. sensitivity level and to import this from excel file.

Issue: We receive files to be tested against our DQ rules (Monitoring Projects) every 2 weeks. Each set of files is referenced by its date created (aka 2024-10-01,2024-10-14...). When running Monitoring Projects against these items we only get the Execution Date which can be different from the file date. When extracting data for reporting from ONE we only have the Extraction Date and don’t necessarily know which file date the plan results are for (sometimes have to rerun old files for new rules etc..). Question: Is there a way to add a custom attribute / parameter for when we run the Monitoring Project (at the processing id level) so we can report our DQ results by File date? The 2 options we could think of: In extraction component connect to the catalog items and get the file date which is in the table itself (tried this but we need to extract history so would need file date, catalog item, and Monitoring Project processing id to join with DQ Aggregation Results tasks in the component

I’ve recently noticed that some jobs I’m trying to kill, jobs which happen to running for much too long (~2 days), take a long time to kill. Is that a bug in the kill function or maybe related to the jobs themselves taking so long to run?

Hi All, I have a few observations regarding the source_id column in matching step of an entity in a MDM project. For context, source_id is a column with unique values (Primary Key in most cases) that we define to uniquely identify each record in a source system, connected to mdm hub. I was recently trying to test the match logic on OneDesktop using plan files. I used a very small subset of records from each source. Load Component In the project, source_id column(defined in load component) for one of these source system is “SOURCE_SYSTEM_NAME~^~pk_id”where SOURCE_SYSTEM_NAME is as string value and pk_id is the primary key. match component When we defined a match component in mdm project, we do not define standalone bindings but assumably “Id Column” would be mapped to source_id column if we are testing on OneDesktop as a plan. So, when I created a plan to test the match logic, I mapped “Id Column” to source_id (with source_id having string values as mentioned above). But when I run the

Hello everyone, We recently upgraded to version 13.9.3, and gained the ability to export DQ rules from one Ataccama environment and import them into another. This works great, but I need to do the same thing for our monitoring projects. I would like to be able to export them from DEV and import them into a higher environment. Unfortunately, there doesn’t seem to be a plan available in my version to export monitoring projects. Has anybody figured out a way to migrate monitoring projects without recreating them in each environment? Alternately, I am considering trying to write my own plan. Is there any documentation out there on how to write the JSON for export plans? Thanks!

If we use matillion ETL tool for data integration to snowflake. Can we still see the lineage and transformation code in Ataccama?

Hi - I wanted more information on how to use the slices vs a SQL Catalog Item. The use case being often when I’m leveraging a slice I want to be able to do a start date of >2023 , if it is part of a quality program I want the data to keep updating i.e as new records come in. However, it seems like the slice is only really designed for the ‘previous’ so ignores current records i.e previous year = 2023, and I can’t set the custom date without an end date so it would be limited to a fixed time range. It seems like for the quality program is better served with the SQL CAT ITEM but I was curious if there was value with the slice I was missing or if I could accomplish the same objective with the slice ? Thank you, Lindsay

Hi, I want to create a DQ aggregation rule that checks fields from two different tables for the group by clause. Is there a way to do this directly in Ataccama One Web UI. Thanks!

Hi, I am not able to access the transformation plan feature in v15.3 from both the Transformation Plan tab and from the monitoring projects tab. Can someone explain why is there a restriction on creating transformation plans and how can I get access to it? Thanks

I have a One Data table created by importing data from a .csv file. I need to use some of the data in this table by joining it with an existing Catalog Item by creating a SQL Catalog Item so that I can implement some rules on it. Where you select the source when starting to create the SQL Catalog Item I do not get an option to select oneData. Is it even possible to do this in OneWeb?

Debugging - is this possible to i.e. setup some breakpoint and let the application run all the previous steps before selected one? I like using debug function on steps (CTRL+Shift+D). To debug below Step i need to first debug all the previous steps and then i am able to debug the current one. However, if I happen to update logic on some step from the top i then would need to run & debug all the previous steps before i could debug i.e. Multiplicative Regex Matching. Is this possible to automate the manual work here? I would like to create a breakpoint on Multiplicative Regex Matching and each time i could just click a button and it would self-debug from the start to my breakpoint. I looked in your documentation but didn’t found any solution for this. I found some debugging view in ONE Desktop but it doesn’t allow me to add breakpoints. Do i need to configure my debugger somehow to achieve the above? Szymek

Hi, I have a question about the rule logic display when a section is applied. In the report view, I can see the rule logic/implementation when I select a rule. However, once I select a section and do the same, I can only see the valid and invalid results, not the rule logic. Is there a reason behind it? Thank you!

How to load result data from Ataccama ONE MDM to ERP systems like SAP?

I have a scenario where I do not want to deactivate the source party records in Ataccama, even though it no longer exists in the source. Is there a way to achieve this?

Hi All, Is there a way to parse a copybook file in order to transform the data file into JSON/CSV? The use case is to be able to provide profiling metrics on the web via VCIs? Thank you😁

When creating groups, are the names always public to everyone who uses the instance? Or is there a way to create a group of groups that only the members of that groups can see?

Hi all, I have a file with a ¬ delimiter and text qualifiers and in the file it looks fine but when I look at the local file system in Ataccama to bring the file into the catalog the ¬ shows as Z with an accent. Are there different regional settings in the config that need setting or changing or is this something else? Many thanks for any help Des

hi Team, i need to split a word based on a delimiter and try to add inceremental number to it, can you please help in acheiving this scenario. Input : select * from order;select * from customer output should be like select * from order - query 1, select * from customer - query 2 i itried using split operator , but could not able to append the incremental number

Hello, I am trying to use MPP step to derive some values from some free text field. I am struggling to parse any regex pattern for string like “A/B”. It seems to work but whenever there is / sign it just doesn’t parse it. I tried to escape it using \/ and also some other different options but nothing seems to work. What am I doing wrong? EDIT:Tried to parse similar REGEX against Regex Matching step and here it seems to work: Could it be possible that MPP step is parsing incorrectly? EDIT 2:I might have found the issue. I took Tokenizer part from our another component and it started working correctly. However, I still don’t understand exactly how Tokenizer works and the docs aren’t providing with great examples on how to understand it. Szymek

Please help/guide me on how to create parameters to enter values for a workflow in admin centre. I have an already configured workflow with parameters in Admin centre but I want to remove it. I am not aware of this change as it was made previously by another person. If there is some documentation in ataccama docs that someone could point me towards, that would also be great. TIA

Can we have duplicate source_id column values in mdm full load?