Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
While trying to manuallyΒ merge 2 records, facing an error stating permission issue.Β Followed above mentioned step to merge records.Β Error messageΒ
Hi,I have two columns: first name and initials.Β # first_name initials 1 John J. 2 Robin Earl R.E. 3 Mark Tate Lynch M.T.L. 4 Bert Ern B.E. 5 Johan Flugg J.F. Is there a DQ rule that can check if the two columns are correctly in synch in what they should be? I understand checking the initials format is one thing, but I actually want to check if it is correctly formatted based on the first_name column. Looking for a preferred solution in ONE Web.
I have been testing rule specific notifications within monitoring projects and it seems to add those notifications to the bottom part of the general notifications, but we are trying to see if we can receive separate emails due to different users needing to see specific issues.The documentation link is shown in the link below,https://docs.ataccama.com/one/latest/monitoring-projects/results-reports-notifications.html#specific-notificationsΒ Β
Hello:Β I would like to create an alert - while scanning the datasets - if it flags any data to be PII (such as Social Security Number, Data of Birth, Tax Identification Number) etc.,Β Is there a way to get alerted when a specific term is assigned to any catalog item attribute?Β
Iβm hoping someone can help.Β I created a term called Personal Information (PI).Β Iβm trying to create a detection rule to find all columns that are considered PI.Β Ideally, I would be looking at both the name and the data within.Β Is that even possible?
I have data coming from a SQL database. For most queries, the structure of these queries remains the same, as shown in the picture, with only the attribute name changing. Now, I want to classify these queries as unique based on their structure rather than the attribute name.Demo DataThank you.Regards,DhavalΒ
Hello, from one of our source systems we were previously excluding any inactive addresses, contact details, etc. Our users have requested we load these records into MDM for visibility. My issue is that while we can add these records as is, they will not show as inactive on MDM. We could add aΒ source active flag but for consistency with other sources we would like them to show as inactive on MDM (Greyed out).Β We have considered doing a one time load of all the inactive instances and then excluding them from the daily load but because it is possible to create address and contact details as inactive from the source that would not work.Β I have explored using the delta load as it has a change type column that could be appropriate for our use case.Has anyone had to set records in MDM as inactive as part of the load not using the deletion strategy? What method did you use?I have also looked into creating new instance entities to store inactive records but that would be a large undertaking as
HiΒ @CansuΒ and AllIn the event if there is no change in the delta records coming in MDM except one of the Sequence Generated column, is their a way that the date field(Last Changed)Β gets updated with the date of the new row only on INSTANCE layer and not on the MASTER layer. So, if MDM ingests the delta record in Instance Layer and sees that there are noΒ changes detected on any columns except the sequence column and it has nothing to update the Golden Record already existing then it should update theΒ date field on Instance Layer only and not on Master Layer.Please let me know if you have any additional questions.Thank YouRitesh Ranjan
Hi community!Today, I have a quick tip to share on how to pass a dynamic query into a JDBC reader. If you are using ONE Desktop as part of your day-to-day this would be a good practice to implement when it comes to using the JDBC reader step.OverviewThe following is a working example of passing a dynamic query into a JDBC reader. Its overall structure consists of two plans that are run sequentially in a workflow. The idea is that the first plan will produce the query that the second plan (that includes our main logic)Β will use.In the above example, an audit table is read in the second DQC plan, but with a query that depends on information on the current state of the table (for example, the maximum of a particular record, record count, and latest refresh date).Β First Plan - Retrieving QueriesIn the first plan, functions and variablesΒ are applied to produce a .sql file that contains the JDBC reader query to be used.As an example, functions can include getting the current date to apply a
Hey all,I was wondering if you ever came accross the following requirement and has some tips maybe to implement it.The Text File Writer step can be used to create for instance log files. For tracking or governance reasons it may be necessary to keep all log files. But because the output file name is fixed, each time the file will be overwritten whenever a new one is created. Of course it is possible to manually add a datetimestamp to the file name after its creation, but that is a rather cumbersome approach. So I would like to be able to add a datetimestamp to the file name automatically.Β Does anyone have a suggestion?Kind regards,Albert
Hello,Has someone usedΒ $environment$Β variable in the subject line in RDM notification or any other notification emails?Β We are experiencing an issue with the RDM when using theΒ environment variable within our email notification template.Β When we configure the template to include $environment$ in the subject line, the received emails do not display the variable.Β Β Thanks,Ojaswini
Speaking about data quality rules, we usually refer to DQ rule configuration in ONE web application. However, when it comes to referencing external sources or performing preliminary work or combining different sources, we may find that the capabilities within ONE Web are insufficient for our needs. For example, consider a scenario where we need to validate whether our data matches an external data source, such as ABN Lookup on https://abr.business.gov.au/. This is where component rules come in handy.The Task at Hand: Validate ABN Information.To implement this data quality (DQ) check, we require a component rule.Here's how you can configure the ABN validation component and use it for DQ evaluation: βββββββConfigure a placeholder for the component Configuring Logic for the Component using ONE Desktop application Adding Changes to Runtime Configuration in ONE Web Application Configuring the DQ component rule Applying the RuleβββββββConfigure a placeholder for the componentNavigate to DQ s
Hi,I am looking for a plan to export column names for a catalog item in One Web. Can someone help me with it?Thanks
Hi Ataccama community,Iβm hoping someone with better grip on the Ataccama GraphQL model can shine a light on this.Β For internal reporting, we are looking to retrieve data quality details via the Ataccama GraphQL API. One of the requests it to produce an overview of the DQ score across the (ruleβs) DQ dimensions. This is basically the same as is shown in the web UI when navigating to the βData Qualityβ tab for a Term. It shows the score broken down by dimensions, based on how the rules are defined.What Iβm trying to do is retrieve the passed/failed rows at this level, so for each term and each dimension. This would allow me to summarise this into a score per dimension.However, Β I am unable to get this out of the API.Iβve approached this from both the βtermsβ and βrulesβ pathway. In both approaches I always end up with the βOverall Qualityβ score for each term - not the per dimension details.The βrulesβ query looks promising, but ultimately only returns the passed/failed records for the
Hi, Iβm trying to add the data value to the file extension in the component but Iβm not able to get the expected results. I have added a new string column using alter format step (tostring(today(), 'yyyy-MM-dd'). When I pass the column as $date or ${date} in the output filename, IβmΒ not seeing the data on the output filename.Β
Can anyone guide me on how to generate an audit for every action, log it, and integrate the logs with the UI in Ataccama One Desktop? Any best practices or examples would be greatly appreciated!
Unable to start keycloak locally on a Azure DevBox, When I run the keycloak.bat file from OneDesktop, it is immediately terminated as per console logs.Β Can anyone help with the diagnosis?
We are getting errors in the delta update flow for party and policy master and this is the error message.Β βcom.ataccama.nme.core.NmeExecutionException: Plan "/opt/ataccama/one/mdm-server-config-13.9.1.221107-11165-6e37fd24/Files/engine/export/Party_Master_Delta.comp" execution failed: runtime.error.sql.instance.processError - Transaction (Process ID 901) was deadlocked on lock | communication buffer resources with another process and has been chosen as the deadlock victim.βΒ Please advice if any help can be provided.Thanks !!
Encountering with Runtime error in JDBC reader, while running the basic profiling for a table from SQL Server.Β Full Error details -Runtime error in JDBC reader: Error creating record: column type: 'STRING', read value: '<null value>', read object type: '<null value type>', cause: Connection resetΒ Looking for ideas troubleshooting this error.
Hi All,We are facing performance issue while loading and exporting data in MDM. We have around 30 million records. We are loading data in chunks and initial few execution were very quick. After processing 20M we are observingΒ severe degrade in performance. Now even for 10K records the job is taking 8-10 hours for both load and export. We have applied parallelism wherever its possible. Is there any other thing which we need to consider/implement which will enhance the performance?TIA.
Hi folks,Iβve been given details to an SFTP server, and I can successfully connect to it using Winscp on my laptop:Β I tried to setup connection in ONE desktop:I put workflow task:But I get an error:14.11.2024 15:15:21 [INFO] Using following licenses:14.11.2024 15:15:21 [INFO] C:\Users\mkwok\license_hamilton_USER_v14_subscription_2025-01-29.plf14.11.2024 15:15:21 [INFO] ============================================================14.11.2024 15:15:21 [INFO] This is a subscription USER license for developers' laptops for "Hamilton". It expires on 2025-01-29.14.11.2024 15:15:21 [INFO] ============================================================2024-11-14 15:15:21 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvider reason=the 'properties.encryption.keystore' property not specified2024-11-14 15:15:21 [INFO] com.ataccama.lib.securityutil.javaencryption.DefaultEncryptionEngine messageId=createDefaultKeyProvid
Hi Team need your expert opinion on how to tag Policies to Business Terms or any other assets(Applying policies to asset types) in 14.5 version? I cannot see any options for the same is it any version limitation or any customization needs to be turned on. Any help is appreciated.
Hello all,I want to create a DQ rule, In this rule I need to check a numeric field if the value is in the predefined interval or not. Let me give an example of logic.Β I have a column X contains βtypes of productβ and column Y contains βvalue of productβ. And have a list of valid values. If the value of X is βabcβ then Y must be in the interval 1-30. If hte value of X is βxyzβ then Y must be in 1-200 and so on.I was going to create a lookup file for this one, but couldnβt be sure how to define intervals. Does someone know how to implement my DQ rule for this logic ?Β Thanks a lot !
I have an ETL process thatβs run on-demandΒ and refreshesΒ master data referenced by several Ataccama catalog items. Thereβs about 60 lookup items that are created from catalog item attributes that I need to update immediately following the master data refresh. I know thereβs a lookup item βUpdateβ button in the Ataccama web interface and a method to schedule refreshes; however, I havenβt been able to find a way to update lookup items on-demand, such as through a GraphQL mutation.Is there an available mutation for updating lookup items on-demand, or another method that could be utilized?
Taking reference of CDI Example, I have multiple contact values for the same person and I want all of these contacts to be a part of the contact master entity.Β I am not sure how the same instance record id will affect this. Will ataccama load both these records? Will both these records partivipate in match logic(same master_party_id, same_contact_type,same contact_value) or will it consider just the first one?Also, if someone can please confirm if the master_party_id is id for master record derived on processing of all party records?
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.