Discuss, learn, ask, suggest, share all things DQ&C π
Recently active
Β Hi everyone! In this post, Iβm going to walk you through how to ensure that changes made in the post-processing plan are visible across different user accounts.Issue DescriptionIn version 14.5 of ONE Desktop, there is an issue where if you create a post-processing plan for a monitoring project from one account, the changes are not reflected when another user logs into the same environment.SolutionTo fix this issue, you need to download the remote file every time before making any changes to the Post Processing Component to ensure you are editing the latest file.Steps to Fix the Issue1. Login to ONE Desktop:Connect to your server by navigating to Server -> New -> ONE Platform2. Create a Post-Processing Plan:Go to the Monitoring Project -> New -> Post-Processing Plan. Β 3. Download the Latest Changes:To get the latest changes from one account:Right-click on the Component. Select Download. Choose Download Remote File Β By downloading the remote file, you will get the latest c
Hi Team,Β I am working on task to check the number of rows in a column. I am using count of ATTRIBUTE_1 but not able to achieve it . can you please suggest a better approach. let me know if i miss anything.Β
Hello Ataccama teamΒ Checking ataccama admin center on resource section there is mentioned the JVM Heap Memory,I would like to know more about the Ataccama JVM Heap Memory configuration , as I understand Ataccama manage Java APIs (mmm comment, dpe,...) , I am curious to know if Ataccama has a configuration file to define the limits of JAVA memory to use on each ataccama api, or if Ataccama has a configuration file to manage the whole java resources.
Β Β Hi I'm Srija, Solutions Consultant here at Ataccama.In this post, we can see a workaround for changing the stewardship for out-of-the-box rules and terms along with the project related business terms and rules. This workaround helps to transfer the stewardship of business rules and terms to βOrganizationβ without causing the API error.How to perform the transfer of stewardship?ONE web applicationΒ By creating a custom plan to change stewardship for multiple business terms and rules.Β How to create a custom plan to bulk change stewardship for business terms and rules?In ONE desktop, you can use metadata reader steps from term or rule, and you can join with group metadata reader using stewardship name and name. In the JSON step, use the below GraphQL query to change the stewardship for terms or rules.{"query":"mutation TransferStewardship_rule($gid: GID!, $newStewardId: GID, $accessLevelForPreviousSteward: String) {Β Β ruleTransferStewardship(Β Β Β Β gid: $gidΒ Β Β Β newStewardId: $newStewardIdΒ Β
I am working on the usecase of comparing two different columns in two different csv files. I need to compare these column, remove any duplicates and merge them into single column. I am trying to use join component but not sure about this approach will work or any better solution is available to achieve this use case - If anyone can suggest a better apprach it will be helpful. - Thanks.
Hi everyone, me again π I work as a professional services consultant in Ataccama and I prepared another article for you, this time about some recommendations for integration with git, mainly for self-managed deployments. Specifically, when you have the DQG suite and you want to integrate your orchestration server. You can probably reuse some of these recommendations for other modules as well.Before you start reading, please note that I reused some of the already existing articles:https://community.ataccama.com/master-data-management-reference-data-management-92/one-desktop-git-recommendations-187?tid=187&fid=92I also recommend checking out this article in our documentation for working with git in our IDE:https://docs.ataccama.com/one-desktop/latest/projects/git.html#introduction-to-git-and-egitAlso please note, that this article doesnβt cover how to work with git in general, but more on how to work with the Ataccama projects, what files to version, what to look out for etc.Recomme
I have certain Business terms that i want to track on which fields are getting mapped from which datasets on a given day.Is there a way, i can send a notification to myself (and any others interested) on the occurance details of a term - and i schedule this to run periodically like every monday?Β To be specific, Iam want to track Social Security Number. I want to get a report every monday morning - with list of Catalog items and attributes that are mapped to this term. (from the occurances details).Β Is it possible?? How??Β Β
Hello! I am looking for assistance with applying filters to rules. Currently, I understand that the "where" clause can be used in rules, but it seems to apply to all records uniformly.Β What I need is a way to create a rule that only affects a subset of the data, so that the total count of records affected by the rule is different from the total count of records in the Catalog Item. For example, if I have a dataset with 1000 records, I want to create a rule that only applies to, say, 200 of those records based on specific criteria, without affecting the other 800 records. So if there is 100 records failing the result should be 100/200 instead of 100/1000.Is there a way to achieve this selective application of rules? Any guidance or examples on how to set this up would be greatly appreciated.Β Thank you!
is there a way to change the date format in ataccama one. i want the format to beΒ dd mm yyyy, what i have currently is mm dd yyyy
How can I run a .vbs file workflow. May be either βRun Shell Scriptβ or βRun Windows Commandβ. Or is there any other options available?Β I tied to run this through βRun Shell Scriptβ but it showing an issue with Interpreter(/bin/sh)Β
Hello can you please assist in finding out how to findΒ the duplicates in a column using one desktop.
For terms like USA Zipcode, USA Social Security Number etc., - the term is enabled with AI detection and it is getting tagged to hundreds of fields - most of them are NOT zipcode or SSN.Β Β If it was giving a score and recommendation, I would have discarded the recommendation, but it is assigning the term automatically and I have to go in and remove that - which became painful. I have now disabled the AI detection but is there a better way to tune it to make it work better?Β
hello everyone , I am unable to understand how to use representative creator step can you please explain it in detail with an example so that I am able to use it .Β Thank you.
HI Team,I am using one metadata writer for one of my use-case. In one-metadata writer there is an out option called recovery audit.Β Β May I know the use of this functionality. I tried checking in help contents I was not able to find any document related to this. If IΒ donβt want to use this recovery_audit is it possible?Β Β This is the error I am getting while running the plan. Let me know if more information is needed from my end.Β Thanks.
How can I run a .vbs file workflow. May be either βRun Shell Scriptβ or βRun Windows Commandβ. Or is there any other options available?Β I tied to run this through βRun Shell Scriptβ but it showing an issue with Interpreter(/bin/sh)Β Β
Hi everyone!I wanted to share some best practices when it comes to GIT version control, how you can organize your branches in a way that merges and rollbacks are more granular, making it easier as well to see what code changes were done whereΒ Typically, what I tell clients when they are using GIT integrated with Ataccama, is that they would essentially need to have a standard flow control process for their branches. What I mean by that, is that they should set up 1 main production branch, 1 development branch, and many feature branches. You can think about it like this, your Master branch can be thought of as your βProductionβ branch, your Development branch can be thought of as your βTestβ server, and each of those feature branchesΒ you can see it as your βDevβ server where you develop new code. How this works is simple yet effective:You start off with a main branch in your repo, we can call it βmasterβ Master can have either prior code or be empty, let's say it has some code in it alr
I have been trying for some time to build a data quality check/rule in Ataccama Desktop (using an advanced expression) to check where a defiend attribute is unique/distinct and have been struggling to find the correct function to use for this.In a tool like excel I woudl simply count the number of instances of each value and following that I would ensure that anything where the count was >1 failed this check but I have thus far been unable to find a way to perform a distinct count in this way. e.g.Β DistinctCount([Install_And_Leave_Flag]) = 1I understand that the profiling step nativley gives you this information but I require a way to do that via an advanced expression for my use case.Β Β
Hello everyone, I have a requirement of exporting ONE webapp's audit logs but not using the MinIO storage, is there any other way to export logΒ files through ONE Desktop IDE using any Api calls such as graphql converted into curl command in json call? Thanks!
Hello,I want to set up a single general email notification for various monitoring projects. Typically, I receive separate email notifications for each monitoring project, but I would like to receive only one emailΒ notification that consolidates the results of different monitoring projects. I know that I am supposed to use One Desktop but I donβt know which steps exactly. I would be grateful if you could help.Thanks in advanceπ
Hello CommunityΒ πI am trying to write a DQ rule using a regular expression, I have been using the βONE Expressionsβ documentation to help with this but I canβt seem to get it working. Can anyone advise where I am going wrong please??ExampleInput data:Value1 Value2 Value3 -1137.86 -5689.33 0.2 Β DQ rule I am trying to achieve:Value2 * Value 3 = -1137.866 Take only the first 2 decimals of the above bullet WITHOUT rounding = -1137.86 Check if value1 equals the value in the bullet above. (i.e.Β -1137.86 =Β -1137.86 so it should show as a valid result)How I have written this in Ataccama using a regular expression:Value1 is NOTΒ (substituteAll("(\d+\.\d{2})(\d+)","${1}",toString(Value2 * Value3))) Then result is INVALIDError I get:Using the test rule feature with the example input data above, it says that the result is INVALID when I am expecting it to be VALID. And only if I change Value1 to equalΒ -1137.866 then it will show VALID which is not what I want to achieve.Can anyone see wh
Hi,This may sound very easy, but: how do I retrieve records that have code = βAβ and more than one empty start dates? So in the end I want to see records 3 & 4 since they have the same id_#, code = βAβ and more than 1 empty start date. Would be ideal if this was in ONE WebΒ and not through ONE Desktop.Person id_# code start_date 1 1 A 1-1-2000 2 1 A 1-2-2000 3 1 A Β 4 1 A Β 5 2 A 1-1-2000 6 2 A 1-2-2000 7 2 A Β Β select *from Personwhere start_date is emptyand code = βAβgroup by id_#, codehaving count (*) > 1I tried to use count in advanced expressions, but can't seem to get it to work.
I am facing the problem that I have output from 4 components and the I am writing them on different text file writers is there any way I can combine the outputs into a single text file writer if not can I combine the outputs from the different components and write it in a single text file writer.
Hi Community,We have a scenario where an entire schema was imported as an Ataccama source. This resulted in over 700 tables/views brought in as catalog items.Is there a way to bulk delete all 700?Thank you.
Is it possible to create a data asset from an ETL job (SSIS or similar) so that this is included in the data lineage to allow for full impact analysisΒ
Currently only 4 sources are supported for data stories and they are mentioned below: Amazon Aurora PostgreSQL ONE Data PostgreSQL Snowflake We also use synapse as source for a lot of catalog items and it would be great if you can add synapse as well to the above.Β
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.