Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Hello community, I need to retrieve KeyCloak user information (e.g., email address) based on their username using Ataccama One Desktop. Has anyone done this before? If so, can you please share your experience or point me to some documentation?Thank you in advance for your help!
Hi, Iβm working with data stories, and Iβve created a custom metric to represent by using percentage format.This is the metric expression:iff(sum("Valid") + sum("Invalid") > 0, round(sum("Valid") * 100/ (sum("Valid") + sum("Invalid")), 2) / 100, 0)Both βValidβ and βInvalidβ are defined in Snowflake as REAL datatype.Iβve read this articleΒ Create Custom Attributes :: Ataccama ONEΒ and Iβm using round function, but it doesnβt work.Thanks in advance,GastonΒ
Hi Team,Is there a way to update the existing Term name or description or any property like termInstance from One Desktop metadata writer? I can only see option to add or delete but no update option. Any idea is highly appreciated.
Hi everyone!Β Iβm back with the second and last part of the GraphQL best practice series. First part was all aboutΒ authentication types & which one you should use and how to authenticate GraphQLΒ requests. This post will focus onΒ how to work with MMM in GraphQL - so letβs get into it.If youβd like to check out the first part Iβm sharing it here πΒ ONE Metadata Readers Or GraphQL?Β MMM is the name for the linked list that holds all metadata and the connections between them. Pretty much everything in MMM can be explored via GraphQL - as GraphQL is what happens behind the scenes in most steps/actions in ONE Desktop.As far as ONE Desktop is concerned, while ONE Metadata Readers are often all you need, highly nested queries and associated joins can become quite tricky to handle via ONE Desktop plans, and can sometimes be simpler to build by just running a specific GraphQL query. In addition to that,Β some things, such as raw profiling information can only be extracted via GraphQL.Β Exploring
Hi Team,I am trying to add my Business Terms in two separate child folders inside my Business Term Folder(Not Data Domains). Just wanted to know if its possible or not?I have created two child folders inside from navigation in settingsBusiness Glossaryβ Terms βΒ Β Business Terms βΒ Folder1Business Glossaryβ Terms βΒ Β Business Terms βΒ Folder2But unfortunately i am not sure how to add Business Terms in those two folders specifically, the normal Business Terms are added directly in the parent folders. Do i need to do some changes in the metadata model for this one or need to create any AQL filter for this folders(Same as Datadomains). Any tips or help is highly appreciated.
ONE Desktop provides two ways to access the ONE platform data. Usually, it is easiest to use the Metadata Reader step, but sometimes you need a more complex query, or perhaps you are developing a Json API call to be used from another application entirely.Β In this case, you will want to start from a Json Call step.The plan I will describe is this:Β Iβve used a random record generator to βinjectβ a single row into the data flow to get things started because the Json Call executes once for each row on its input.The βoutβ output from the Json Call carries all columns from the input; and can also be used to carry connection error messages. Iβve not set that up, so I just sent all that to Trash.Iβve named each of the remaining outputs using a sequential numbered prefix.Β This manipulates the automatic alphanumeric sorting of the output connections so that the ordering is more logical than a list of element namesΒ would be. Iβve also set the layoutΒ of the step to horizontal so I can read the l
I am currently usingΒ 14.4.0.one-44751-landing-pa-230616-287787-f83b54a4 ONE web application version. While creating a Uniqueness Rule I am not getting WHEN condition as βis uniqueβ and βis not uniqueβΒ . Could someone help me understand why I am not getting the uniqueness conditionΒ instead Validity condition.Β Β
IΒ have a full load already configured for a source system. This load component has 3 different entities(party, contact, address).I have used this to load data into mdm-hub as well.However, now we want to use a different source table for party entity and want to load only the records for party entity. I am planning on using a new full loadΒ with mappings only for the party entity. Will thiscreate new instance party records and make the old records inactive? bring any change to the records for contact and address entities?Β
Security Assertion Markup Language (SAML) allows users to use one set of credentials to log into many different websites. It is an open standard that allows identity providers (IdP) to pass authorization credentials to service providers(SP).Β SAML transactions use Extensible Markup Language (XML) for standardized communications between the identity provider and service providers. SAML is the link between the authentication of a userβs identity and the authorization to use a service.Β Items to consider prior to connecting to SAML- Best PracticeIt is important to understand how your organizationβs Active Directory is setup. Some pre-requisites needed can include things such as:Do you have a list of groups you need to import? If the answer is no, you may want to speak to your engagement manager from Ataccama to discuss in detail. In short, with AD Groups we can map Ataccama Roles to a single group. This benefit of doing this is, your internal dev-ops team wonβt have to manually add/remove u
Our Incremental load operation is taking huge time (2 hrs to process 5-7K records). We have applied all performance tuning things which is there in document. Apart from this we thought of loading data from DW to PostgreSQL (MDM DB) stage table and then will use that stage table as a source in Incremental load. Idea is when the server will be same for both source and target the computation will be faster.But this direct load job is failing with below error. Kindly help on fixing this. Or please recommend on any other approach.com.ataccama.nme.core.NmeExecutionException: Plan "C:\Users\EYKU4F\Ataccama\workspace\OmniChannelMDM_Latest\Files\engine\load\EPRISM_stg_eprism.comp" execution failed: runtime.error.jdbc_reader_error - nullcom.ataccama.dqc.model.environment.AbortedExecutionException at com.ataccama.dqc.model.elements.data.flow.RecordQueue.putBatch(RecordQueue.java:173) at com.ataccama.dqc.model.elements.data.flow.RecordQueue.access$100(RecordQueue.java:35) at com.ataccama.dqc.model
How can we handle csv output from API response?I tried to use json call ,SOAP call but it didn't work.Anyway, can we handle in One desktop csv output from API.
Hi,I am running a workflow that includes a task called 'Execute SQL'. This task updates some values in the SQL database, but the code is quite heavy. When the workflow reaches this task, I encounter the following error message. Can anyone assist?Β Β
Hi Is it possible to tag Terms to the attribute metadata present in one web, while importing the terms in bulk from one desktop?Ask: Attributes and Tables are already present in one web. Importing business terms from csv file using one desktop.So while importing the business terms using one desktop is it possible to directly tag those business terms with their corresponding attributes?(The tagging list also i want to provide in a csv file and donβt want to use the automated tagging from ataccama)
Hi community πΒ Every now and then, we hear from our users wondering if itβs possible to spice up their Master Data Management (MDM) interface with something a little more visual.Recently, I worked with one of our members who wanted to mark one of the records in a group as having a special meaning, so that it would instantly stand out to data stewards. While the logic behind selecting this record was complex, the outcome boiled down to a simple boolean flag, like cmo_preferred_flag = {true | false}. However, displaying such an attribute on the screen isnβt exactly thrilling:In earlier versions, it was possible to load an image file to represent things like this, but it required customization that was tricky to maintain. Plus, it often got wiped out when regenerating the MDM project. In our current versions (14.5.x / 15.x), weβve moved to SpringBoot, and for security reasons, loading external static content is no longer supported.So, can we solve this in a fun and practical way?The emoj
HiΒ Β We are noticing behaviour in our model where a source system will split from its golden id group when updated on matching criteria fields ( in this example address). However it only does this when the group of records was manually merged onto the golden id. It wont βjump shipβ and form a new golden id when the records previously auto merged based on the matched criteria we assigned in the model.Is there a way we can stop this splitting from happening when the source system is updated?Β For example we can see here the new golden id created with one SF recordΒ Β the previous group the SF record belonged to, shows a lot of manual merging in the Match Rule Name columnΒ Our rematch if changed section shows these fields are used for rematching:Β Β We want to keep rematching switched on, to bring other source systems into the group if they meet criteria, but we dont updates on the SF record itself to allow it to break out of the group. (We dont want βauto-splitsβ)Β thanks
While trying to manuallyΒ merge 2 records, facing an error stating permission issue.Β Followed above mentioned step to merge records.Β Error messageΒ
Hi,I have two columns: first name and initials.Β # first_name initials 1 John J. 2 Robin Earl R.E. 3 Mark Tate Lynch M.T.L. 4 Bert Ern B.E. 5 Johan Flugg J.F. Is there a DQ rule that can check if the two columns are correctly in synch in what they should be? I understand checking the initials format is one thing, but I actually want to check if it is correctly formatted based on the first_name column. Looking for a preferred solution in ONE Web.
I have been testing rule specific notifications within monitoring projects and it seems to add those notifications to the bottom part of the general notifications, but we are trying to see if we can receive separate emails due to different users needing to see specific issues.The documentation link is shown in the link below,https://docs.ataccama.com/one/latest/monitoring-projects/results-reports-notifications.html#specific-notificationsΒ Β
Hello:Β I would like to create an alert - while scanning the datasets - if it flags any data to be PII (such as Social Security Number, Data of Birth, Tax Identification Number) etc.,Β Is there a way to get alerted when a specific term is assigned to any catalog item attribute?Β
Iβm hoping someone can help.Β I created a term called Personal Information (PI).Β Iβm trying to create a detection rule to find all columns that are considered PI.Β Ideally, I would be looking at both the name and the data within.Β Is that even possible?
I have data coming from a SQL database. For most queries, the structure of these queries remains the same, as shown in the picture, with only the attribute name changing. Now, I want to classify these queries as unique based on their structure rather than the attribute name.Demo DataThank you.Regards,DhavalΒ
Hello, from one of our source systems we were previously excluding any inactive addresses, contact details, etc. Our users have requested we load these records into MDM for visibility. My issue is that while we can add these records as is, they will not show as inactive on MDM. We could add aΒ source active flag but for consistency with other sources we would like them to show as inactive on MDM (Greyed out).Β We have considered doing a one time load of all the inactive instances and then excluding them from the daily load but because it is possible to create address and contact details as inactive from the source that would not work.Β I have explored using the delta load as it has a change type column that could be appropriate for our use case.Has anyone had to set records in MDM as inactive as part of the load not using the deletion strategy? What method did you use?I have also looked into creating new instance entities to store inactive records but that would be a large undertaking as
HiΒ @CansuΒ and AllIn the event if there is no change in the delta records coming in MDM except one of the Sequence Generated column, is their a way that the date field(Last Changed)Β gets updated with the date of the new row only on INSTANCE layer and not on the MASTER layer. So, if MDM ingests the delta record in Instance Layer and sees that there are noΒ changes detected on any columns except the sequence column and it has nothing to update the Golden Record already existing then it should update theΒ date field on Instance Layer only and not on Master Layer.Please let me know if you have any additional questions.Thank YouRitesh Ranjan
Hi community!Today, I have a quick tip to share on how to pass a dynamic query into a JDBC reader. If you are using ONE Desktop as part of your day-to-day this would be a good practice to implement when it comes to using the JDBC reader step.OverviewThe following is a working example of passing a dynamic query into a JDBC reader. Its overall structure consists of two plans that are run sequentially in a workflow. The idea is that the first plan will produce the query that the second plan (that includes our main logic)Β will use.In the above example, an audit table is read in the second DQC plan, but with a query that depends on information on the current state of the table (for example, the maximum of a particular record, record count, and latest refresh date).Β First Plan - Retrieving QueriesIn the first plan, functions and variablesΒ are applied to produce a .sql file that contains the JDBC reader query to be used.As an example, functions can include getting the current date to apply a
Hey all,I was wondering if you ever came accross the following requirement and has some tips maybe to implement it.The Text File Writer step can be used to create for instance log files. For tracking or governance reasons it may be necessary to keep all log files. But because the output file name is fixed, each time the file will be overwritten whenever a new one is created. Of course it is possible to manually add a datetimestamp to the file name after its creation, but that is a rather cumbersome approach. So I would like to be able to add a datetimestamp to the file name automatically.Β Does anyone have a suggestion?Kind regards,Albert
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.