Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Business glossary - relationship types (part 2)Hi Community,In my previous post I presented the idea to implement new metadata entities for attribute and entity terms in the glossary. The reason for this is that it makes most sense to have more types of terms that best describe either a catalog item attribute (the attribute term) or a catalog item (the entity term).I finished the post with making a comparison to logical data modelling.In a logical data model the entity is described by its properties, so the attributes. An entity not only has descriptive attributes, but obviously also one or more attributes that identify a record of that entity, the primary key. Besides the primary key also an alternate key may exist (for instance an email address can be used as alternate key next to the client id). Or an attribute can act as foreign key to another entity. Such an attribute will then also exist in its parent entity.With the example of an attribute existing both as foreign key in one ent
When i am creating a new flow for export operation,it is not reflecting in the admin console to trigger the respective flowβs execution.Please help how to enable that in the admin console.Please suggest.
When trying to run export operation from localhost admin center, error is thrown sayingΒ "Origin code 3389682780300157351 used on InstanceEntity(address) record 37150 not found!". Here address is one of the entity being used in my export operation.Attaching the error log file here and below is the export plan for the full load for policymaster export.Any help,highly appreciated.Β
Hi Team,I am checking on connecting to Cosmos database from Ataccama One Desktop, can you please share any documentation or usecase available to do that.Β Thanks,Rohith
How can I edit existing lookup files to add new values? File location is βfiles βΒ data βΒ ext βΒ lkpβor how can I create a new lkp file in same path?
Hi All,From source I am getting only one column as FullName and there is no other column which can identify whether the Fullname is personβs name or a companyβs name. In Ataccam, is there any out of box functionality built which can parse the FullName column and identify the party type?If yes, then kindly do letΒ me know the steps which I need to perform to achieve this.ThanksFS
Need an automation to map Active Directory groups to access to groups and monitoring projects on Ataccama UI.Β
I have a use case where I want to store some client id and secret in my own companyβs Azure keyvault.Then I have a component which needs to use the client id and secret to authenticate against a 3rd party, so I can issue a GET call to get some data.Β So I am thinking:Runtime server authenticate against keyvault Runtime server issue a βget secretβ call to keyvault Keyvault sends back the secret Runtime server takes the secret and authenticate against 3rd party Runtime server issue a βget dataβ call to 3rd party 3rd party sends me back the actual dataΒ What authentication methods from runtime server to keyvault are supported? I had a look at Azure keyvaultβs documentation but I donβt think I understand it fully.Β https://learn.microsoft.com/en-us/azure/key-vault/general/authenticationΒ Has anybody else done it? Whatβs your experience?
Good Morning, I have a quick question in regards to loading data and how it appears into Ataccama from a database. I did not see this topic addressed but I wanted to reach out and ask this and see if this question made sense.In the Knowledge Catalog, if terms are βtable namesβ and attributes are βcolumnsβ as described in the documentation. How does Ataccama interpret duplicate attributes spread across separate tables of data? For example, how would Ataccama interpret two different tables that have duplicate titled columns within those tables? Especially if those column headers have different meanings across the tables. If any further explanation is needed feel free to send me a message.
Hi All,In my incremental table I am having 300K records which when I am trying to load in MDM, the server is getting crashed. Its running for 2-3 mins then throwing the error that βcant reach local host serverβ. We are in dev phase and using the local server.Β Some times it also throws the error βNot enough memory to load this pageβ. How do I fix this issue?I also saw the post for applying check points in full load but what about incremental load. How do we handle failures for incremental load and how can we optimize it more?Thanks. Your inputs will be much appreciated.
I have been given a list of emails that I want to transposeβconverting the data from rows to separate columnsβand then concatenate these columns into a single row. How can I do that in the IDE?Β Original DataΒ After TransposeΒ Final OutputΒ Note: All the emails will be unique, so I donβt want them to be grouped. Could you please suggest how I can transpose these rows into columns and later merge them into one single row?Thank you.Regards,Dhaval
Does anybody need to ingest data into Ataccama by way of an excel file attached to an email?One of our business teams receive a βdata feedβ from an external supplier. It comes as an Excel attachment delivered by email.We have enquired, they do not have APIs. Excel via email is all weβve got.As it stands, my integration will depend on the person receiving the email dropping the file into something like an S3 / ADLS Gen2, and for us to build a .ewf to poll the location regularly to ingest the data (into RDM).Weβre on PaaS, v14.5.1 for now, soon to be v14.5.3.Donβt think the PaaS stack can automagically read emails and get attachments off. Weβre not keen on the dependency on the person to drop the file into ADLS Gen2, but it seems to be my only option at the moment.Do I have any alternatives?Β
We are trying to pass a csv fileβs column which is generated from the Run DQC andΒ contains a list of emails to the Send MailβsΒ βtoβ section. What are the other ways of passing a column to that particular section. Let me know if there are any alternative steps.Β This is the workflow planConfiguration of Send Mail:Regards,Emmanuel
we need to achieve completeness DQ control by comparing data in the file and the table irrespective of the position of primary key in either of them or by using composite keys. - This is in continuation with the query posted in ataccama community - Regarding DQ controls (ataccama.com) Do we have any step or document to follow on how we can import that file into ONE web app as catalog item and can we upload the file from local or we need to get that from the file system?Β Thanks,Karthikeyan.
I have created a rule that detects if a record is in the table more than once based on aggregation of 2 attributes in OneWeb application.Β This gives a proper result in Invalid samples data and exports giving 2Β errorsΒ if the record is in the table 2Β times etc.Β But the customer requires that only 1 record should be visible in Invalid samples and also in exporting to db.Β It does not matter which one.Β Is it possible to configure the result to do this?
Hi All,I have a scenario where I have loaded email table with 2 slightly different email data. Now next day source team sent the corrected data which is exactly equal to first data so the 2nd data gets updated but since it is exactly same it should get merged with first data but that is not happening. For email table we dont have any match rule. We just have defined a key rule on email address basically storing unique data for same load.First Loadid email 123 abc@gmail.com 124 abc1@gmail.com Β 2nd Loadid email 123 abc@gmail.com 124 abc@gmail.com Β Now I have duplicate email data with 2 diff id. How can I fix this? I do not have party id in this table. Party and Email are linked using Party_Email table which is having relationship for both the entities.Party_Emailid party_id email_id 1 100 123 2 100 124 Β
Our experts here canβt seem to get it to work even with support teamβs help.Β If you happen to have had success and are willing to share some of the details, it would be greatly appreciated.Β Β
Hi TeamΒ This is the continuation of the of the below thread about using reconciliation project for comparing a file with the table.Compare data between file and table (ataccama.com)Β The data compare is working fine when I followed the approach suggested.Β But from this link (Data Reconciliation Best Practices πΎ (ataccama.com)Β - it is mentioned as (except snowflake data).So, what will be the approach for the snowflake related connections.Β I have one more question - for eg ., I have column fullName in source (which has a full name) in target I have two columns one has the first name and other column has the second name. Can we compareΒ source column to target column1 and 2.Β Β
Hello,I was wondering if someone has an idea to help my question about one of my DQ check. Basically let me explain what i have and what i want to achieve with them.I have; one list consisting 2 columns.Β Column AΒ has unique values having 2 or 3 digits with a mixed combination of letters and numbers.Β Column B has names according to the column A. Here is the example:Β Column A Column B abc name1 abd name1 abe name1 abf name2 xy name3 1a1 name4 1a2 name4 1a3 name4 yz name5 yz1 name6 Β As you see, there is no corelation between column A and column B. I canβt assume if the value of column A is yz and value of column B is name5 then i have name5 for yz1 of column A.And I have a field in my data lets call it as column C. Column C has values with a mixed combination of digits and letters and with different length. Such as abc1231422ad ,Β 1a3577afdg , yz4564sdfsfs can be example.Β And I have another field which is Column D having some other values.Β I want to check v
HiΒ Β I want to search for a validation message on a field.For example if ABN is empty I can use Advance condition to write: ABN is nullΒ However in this case I want to search where the ABN contains a value which has a validation message attached to it, ie where an ABN field is detected to be incorrect as it contains either a dummy value, or it didnt pass a check.Β Usually these fields will be highlighted as they were scored higher in the cleanse layer in One DesktopΒ For example ABN is 0000000000 at the source layerΒ Is there a way I can search / filter records for their specific validation messages, as opposed to the content in the field. ( As the validation messages are not the actual input in the field, but score and explain what is wrong in the field)Β See photo attachedthanksΒ Β
Hi, I am getting this error while running the Load Operation for full load for one of the source system. Any help ,highly appreciated.Β
Hi all,For Postgre SQL,when we are loading its only to our local.eg,if one member is loading the data in load operation,the post gre table that are populated are only visible to the member who loaded.How to enable the postgre table or see the table and its data which will be common to all user? Please suggest.
Hi Community,Iβd like to share some thoughts about the business glossary. After considering how we wanted to use the glossary, we applied customizations in the metamodel, so we have a specific implementation. I suppose that others have a different approach to using the glossary, so it would be great if we could share and discuss our visions. I am looking forward to your feedback!Letβs start.The business glossary provides a way to describe terms that have relevance to the organization. Obvious properties like name, definition and owner describe a term. It is possible to connect catalog items and its attribute to a term, so that physical data elements becomes meaningful.The question is, can we describe these elements with the same properties? (Indeed a rhetorical question)To logically describe a catalog item attribute, besides its name and definition also properties like its (logical) datatype, an indicator to mark a βpersonal identifying informationβ term and the GDPR classification.The
On a matching component if address table is mapped as shown in the screenshot. Why would the process still run for the address table for both insertion and deletion. while its not being used. How to avoid it run through it and why would it run through? it would not need a master_id associated wither as it is tied to parent by u_parent_id.Β
I'm currently using the "start-server.bat" file within the Ataccama Desktop tool to manually start Ataccama Server. However, if I forget to start the server, certain workflows fail to execute. I've attempted to automate server startup using Windows Task Scheduler, but it's not working as expected. Is there a reliable method to start Ataccama Server independently of the Desktop tool, perhaps through a scheduled task or another approach?
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.