Learn & Share

I have been given a list of emails that I want to transpose—converting the data from rows to separate columns—and then concatenate these columns into a single row. How can I do that in the IDE? Original Data After Transpose Final Output Note: All the emails will be unique, so I don’t want them to be grouped. Could you please suggest how I can transpose these rows into columns and later merge them into one single row?Thank you.Regards,Dhaval

Does anybody need to ingest data into Ataccama by way of an excel file attached to an email?One of our business teams receive a “data feed” from an external supplier. It comes as an Excel attachment delivered by email.We have enquired, they do not have APIs. Excel via email is all we’ve got.As it stands, my integration will depend on the person receiving the email dropping the file into something like an S3 / ADLS Gen2, and for us to build a .ewf to poll the location regularly to ingest the data (into RDM).We’re on PaaS, v14.5.1 for now, soon to be v14.5.3.Don’t think the PaaS stack can automagically read emails and get attachments off. We’re not keen on the dependency on the person to drop the file into ADLS Gen2, but it seems to be my only option at the moment.Do I have any alternatives? 

We are trying to pass a csv file’s column which is generated from the Run DQC and contains a list of emails to the Send Mail’s “to” section. What are the other ways of passing a column to that particular section. Let me know if there are any alternative steps. This is the workflow planConfiguration of Send Mail:Regards,Emmanuel

we need to achieve completeness DQ control by comparing data in the file and the table irrespective of the position of primary key in either of them or by using composite keys. - This is in continuation with the query posted in ataccama community - Regarding DQ controls (ataccama.com) Do we have any step or document to follow on how we can import that file into ONE web app as catalog item and can we upload the file from local or we need to get that from the file system? Thanks,Karthikeyan.

I have created a rule that detects if a record is in the table more than once based on aggregation of 2 attributes in OneWeb application.  This gives a proper result in Invalid samples data and exports giving 2 errors if the record is in the table 2 times etc.  But the customer requires that only 1 record should be visible in Invalid samples and also in exporting to db.  It does not matter which one.  Is it possible to configure the result to do this?

Hi All,I have a scenario where I have loaded email table with 2 slightly different email data. Now next day source team sent the corrected data which is exactly equal to first data so the 2nd data gets updated but since it is exactly same it should get merged with first data but that is not happening. For email table we dont have any match rule. We just have defined a key rule on email address basically storing unique data for same load.First Loadid email 123 abc@gmail.com 124 abc1@gmail.com  2nd Loadid email 123 abc@gmail.com 124 abc@gmail.com  Now I have duplicate email data with 2 diff id. How can I fix this? I do not have party id in this table. Party and Email are linked using Party_Email table which is having relationship for both the entities.Party_Emailid party_id email_id 1 100 123 2 100 124  

Our experts here can’t seem to get it to work even with support team’s help.  If you happen to have had success and are willing to share some of the details, it would be greatly appreciated.  

Hi Team This is the continuation of the of the below thread about using reconciliation project for comparing a file with the table.Compare data between file and table (ataccama.com) The data compare is working fine when I followed the approach suggested.  But from this link (Data Reconciliation Best Practices 👾 (ataccama.com) - it is mentioned as (except snowflake data).So, what will be the approach for the snowflake related connections. I have one more question - for eg ., I have column fullName in source (which has a full name) in target I have two columns one has the first name and other column has the second name. Can we compare source column to target column1 and 2.  

Hello,I was wondering if someone has an idea to help my question about one of my DQ check. Basically let me explain what i have and what i want to achieve with them.I have; one list consisting 2 columns. Column A has unique values having 2 or 3 digits with a mixed combination of letters and numbers. Column B has names according to the column A. Here is the example: Column A Column B abc name1 abd name1 abe name1 abf name2 xy name3 1a1 name4 1a2 name4 1a3 name4 yz name5 yz1 name6  As you see, there is no corelation between column A and column B. I can’t assume if the value of column A is yz and value of column B is name5 then i have name5 for yz1 of column A.And I have a field in my data lets call it as column C. Column C has values with a mixed combination of digits and letters and with different length. Such as abc1231422ad , 1a3577afdg , yz4564sdfsfs can be example. And I have another field which is Column D having some other values. I want to check v

Hi  I want to search for a validation message on a field.For example if ABN is empty I can use Advance condition to write: ABN is null However in this case I want to search where the ABN contains a value which has a validation message attached to it, ie where an ABN field is detected to be incorrect as it contains either a dummy value, or it didnt pass a check. Usually these fields will be highlighted as they were scored higher in the cleanse layer in One Desktop For example ABN is 0000000000 at the source layer Is there a way I can search / filter records for their specific validation messages, as opposed to the content in the field. ( As the validation messages are not the actual input in the field, but score and explain what is wrong in the field) See photo attachedthanks  

Hi, I am getting this error while running the Load Operation for full load for one of the source system. Any help ,highly appreciated. 

Hi all,For Postgre SQL,when we are loading its only to our local.eg,if one member is loading the data in load operation,the post gre table that are populated are only visible to the member who loaded.How to enable the postgre table or see the table and its data which will be common to all user? Please suggest.

On a matching component if address table is mapped as shown in the screenshot. Why would the process still run for the address table for both insertion and deletion. while its not being used. How to avoid it run through it and why would it run through? it would not need a master_id associated wither as it is tied to parent by u_parent_id. 

I'm currently using the "start-server.bat" file within the Ataccama Desktop tool to manually start Ataccama Server. However, if I forget to start the server, certain workflows fail to execute. I've attempted to automate server startup using Windows Task Scheduler, but it's not working as expected. Is there a reliable method to start Ataccama Server independently of the Desktop tool, perhaps through a scheduled task or another approach?

Hello: I have a use case specifically for assigning a term. If the data is a 9 digit number and if the field name is NOT one of the list i want to exclude - then that term be assigned. I also have additional field names that i want to be tagged with that term - irrespective of value with in that field.As of now - iam able to create  separate rules one that runs on metadata and other runs on real data - and put a OR condition or AND condition between the two rules. But that is not addressing my use case very well. I need one rule that can refer to both real data and metadata.  OR - i should be able to give a complex join condition with more than two rules(Rule 1 AND Rule 2) OR (Rule 3) Has anyone done something like that?

Hi,I am getting this error while running the Load Operation for full load for one of the source system.Any help ,highly appreciated. 

I’m trying to build a GET API call to an external data provider.This provider requires me to send my GET call with the certificate.We managed to test it in POSTMAN, where I had to add the certificate in the Settings → Certificates menu: I have a .pfx file with a passphrase, and I needed to specify the host.This works on my laptop in POSTMAN. Now I’m trying to do the same call in ONE Desktop using JSON Call step.By way of googling, I’ve managed to convert my .pfx file into .cer, then I imported the .cer file into {DQC_HOME}/jre/lib/security/cacerts . Then I have restarted ONE Desktop. But when I call the API I’m still getting an error message from the other side saying my certificate is not sent. I have a suspicion that the certificate is sitting in the keystore but it is not used. Is there some way to ensure it is used? Some java parameter somewhere?

Hi All,I am very new to Ataccama and still exploring everything by myself. I have updated logical model (added new entities), load operation and then configured transformations. Saved and generated the project. But I cannot see the new entities in Postgresql. I was under assumptions that after generating the logical model, tables will be created automatically in postgre but that didn’t happen. Tried saving, generating, stopping and starting servers several time but no luck.Is there any steps to follow?ThanksFS

Hi, I have a requirement to ignore certain columns to not detect as a change when that field comes with a different values in the message.I tried applying the field in ignores comparison columns as shown below, but looks like when the message came in again with a new value for this field, it still got processed. Are there more steps to be done to ignore a field? Also to highlight, we consume data from Kafka streaming consumer.   

Hi All,I have created the logical model (Instance and master layer) and then configured the full load operation. I am now working on Transformations layer. Here for few new entities I can see only the clean and match component are generated automatically. Now I want to add merge component. How do I do that? I have the option to create new component under Files → engine → trans → party_address but then that will be blank and there is no Integration input/ output added which gets generated using the model. Am I missing any step? Just like party_address I have also added party_rel and here I can see all the 3 components. (Please refer the attached picture).ThanksFS

Hey all!Now that incoming webhooks within Microsoft Teams is discontinued (Existing configurations will work until end of 2025), is there a plan for how teams will continue to integrate with notifications from Monitoring Projects? This was a big sell to a lot of our users, and now that we are unable to use incoming webhooks for new monitoring projects, I want to see if there is a plan to have a work around, or if it will be not supported in the future.    

Hello: I have a use case where when the data in a given column - for a key changes from previous day to next day - that should trigger an alert/notification For Ex: Security Ratings, and/or ESG ratings generally dont change for a given security. I have a table that has one record for each day for each security. And the ratings are in the columns of that table. Now - on a regular day - all ratings from previous day should be same for next day, and day after (until it changes). And on the day when it changes - i want to capture that security, ,what field changed - what was yesterday;s value vs todays value. The way - i would like to solve this - is create a SQLCatalog item - with previous day - and current day values combined into one dataset for each security and write scripts to compare them one by one, and report any changes. But I want to know if there is an out of box - date driven compare that can be done for this. 

Records marked as match_override after being fixed on OGC. When the matching rules changed and subject is reprocessed, these records are being unchanged while they are supposed to match with other records. How do we [omnihealthdata].[dbo].[ids_override_match] and [omnihealthdata].[dbo].[ids_override_property] tables contain these records, did try deleting from these table and rebuild and reprocess with the new match rules but they would not match.