Discuss, learn, ask, suggest, share all things DQ&C 🔍
Recently active
Hi Community,I have used this community tutorial (thanks @anna.spakova !) and this part of the documentation portal to create a custom relationship (and an existing custom relationship as example). So that should be enough info, but still I encounter an issue. As follows.The relationship is between an extension of term (entity term) and custom entity application. The new relationship has been defined in entity entityTermSourceOfRecordRel as followsThis new entity has also been defined in entity metadata as array.A new relationship type has been defined for this purpose:In the entity term screen I have defined the realtionship as follows:{"_type": "relationships","relationshipPropertyPath": "/entityTermSourceOfRecordRel"}On the entity term screen I would now expect to be able a new relationship like this (from the example we already had implemented):Instead I only have the option to define a new relationship type, like:What am I overlooking? We are on version 13.9.Thanks and kind regard
Hey Everyone!We have a use case involving datastage and curious if anyone has worked with this in the past. We have a team who has datastage jobs that are triggered by a table being pushed information downstream. We are wondering if there is a way either in the web or desktop, if we can use the trigger files that are created by datastage, somehow plug into the datastage flow, or another way that would trigger a monitoring project simultaneously to run data quality checks against the load? if certain data is not loaded in correctly, it will break the connection for the two tables, and in turn break the job, and they want to see the population of what is breaking the join. Hope this makes sense! Thanks,Thomas
Hi everyone! I’m wondering if its possible to trigger or use the Review workflow from one desktop? For instance, im currently updating a large amount of attribute descriptions and am publishing them with one desktop. Whenever I use the One Metadata writer it will apply the descriptions automatically without further approval.I would like to know if its possible to write the descriptions and then have them sent to the tasks board for the data owner to review and approve or deny.Example of what im trying to do:Use one desktop to write descriptions to attributes Review workflow is triggered, and new descriptions are assigned to data owner for review (preferably in batches of 15-20 if possible) Owner either approves changes, causing descriptions to be updated or denies them causing no change to descriptionsThank you for any help!
Hello everyone!In this post, I’ll walk you through how to extract the description of all the columns and tables using the one desktop plan. Providing detailed descriptions and comments is a fundamental best practice in data management and data standards. This approach significantly enhances theunderstanding and usability of data.The summary of all the tables, attributes and their descriptions can be extracted using the below plan.1. Open a plan and add Attribute and Catalog Item metadata reader steps.2. The Attribute meta data reader helps to extract the attribute names, comments, description. Open the meta data reader and provide the column names as below and provide the Parent Id Column name as ‘CatalogItemID’.3. The Catalog Items meta data reader helps to extract the catalog Item name based on the catalog Item Identifier. Open the meta data reader and provide the column names as below and provide the Id column name as ‘catalogItemID’.4. Use the Join Step and join the meta data reade
Hi everyone! In this post, I’m going to walk you through how to ensure that changes made in the post-processing plan are visible across different user accounts.Issue DescriptionIn version 14.5 of ONE Desktop, there is an issue where if you create a post-processing plan for a monitoring project from one account, the changes are not reflected when another user logs into the same environment.SolutionTo fix this issue, you need to download the remote file every time before making any changes to the Post Processing Component to ensure you are editing the latest file.Steps to Fix the Issue1. Login to ONE Desktop:Connect to your server by navigating to Server -> New -> ONE Platform2. Create a Post-Processing Plan:Go to the Monitoring Project -> New -> Post-Processing Plan. 3. Download the Latest Changes:To get the latest changes from one account:Right-click on the Component. Select Download. Choose Download Remote File By downloading the remote file, you will get the latest c
Hi Team, I am working on task to check the number of rows in a column. I am using count of ATTRIBUTE_1 but not able to achieve it . can you please suggest a better approach. let me know if i miss anything.
Hello Ataccama team Checking ataccama admin center on resource section there is mentioned the JVM Heap Memory,I would like to know more about the Ataccama JVM Heap Memory configuration , as I understand Ataccama manage Java APIs (mmm comment, dpe,...) , I am curious to know if Ataccama has a configuration file to define the limits of JAVA memory to use on each ataccama api, or if Ataccama has a configuration file to manage the whole java resources.
Hi I'm Srija, Solutions Consultant here at Ataccama.In this post, we can see a workaround for changing the stewardship for out-of-the-box rules and terms along with the project related business terms and rules. This workaround helps to transfer the stewardship of business rules and terms to ‘Organization’ without causing the API error.How to perform the transfer of stewardship?ONE web application By creating a custom plan to change stewardship for multiple business terms and rules. How to create a custom plan to bulk change stewardship for business terms and rules?In ONE desktop, you can use metadata reader steps from term or rule, and you can join with group metadata reader using stewardship name and name. In the JSON step, use the below GraphQL query to change the stewardship for terms or rules.{"query":"mutation TransferStewardship_rule($gid: GID!, $newStewardId: GID, $accessLevelForPreviousSteward: String) { ruleTransferStewardship( gid: $gid newStewardId: $newStewardId
I am working on the usecase of comparing two different columns in two different csv files. I need to compare these column, remove any duplicates and merge them into single column. I am trying to use join component but not sure about this approach will work or any better solution is available to achieve this use case - If anyone can suggest a better apprach it will be helpful. - Thanks.
Hi everyone, me again 😊 I work as a professional services consultant in Ataccama and I prepared another article for you, this time about some recommendations for integration with git, mainly for self-managed deployments. Specifically, when you have the DQG suite and you want to integrate your orchestration server. You can probably reuse some of these recommendations for other modules as well.Before you start reading, please note that I reused some of the already existing articles:https://community.ataccama.com/master-data-management-reference-data-management-92/one-desktop-git-recommendations-187?tid=187&fid=92I also recommend checking out this article in our documentation for working with git in our IDE:https://docs.ataccama.com/one-desktop/latest/projects/git.html#introduction-to-git-and-egitAlso please note, that this article doesn’t cover how to work with git in general, but more on how to work with the Ataccama projects, what files to version, what to look out for etc.Recomme
I have certain Business terms that i want to track on which fields are getting mapped from which datasets on a given day.Is there a way, i can send a notification to myself (and any others interested) on the occurance details of a term - and i schedule this to run periodically like every monday? To be specific, Iam want to track Social Security Number. I want to get a report every monday morning - with list of Catalog items and attributes that are mapped to this term. (from the occurances details). Is it possible?? How??
Hello! I am looking for assistance with applying filters to rules. Currently, I understand that the "where" clause can be used in rules, but it seems to apply to all records uniformly. What I need is a way to create a rule that only affects a subset of the data, so that the total count of records affected by the rule is different from the total count of records in the Catalog Item. For example, if I have a dataset with 1000 records, I want to create a rule that only applies to, say, 200 of those records based on specific criteria, without affecting the other 800 records. So if there is 100 records failing the result should be 100/200 instead of 100/1000.Is there a way to achieve this selective application of rules? Any guidance or examples on how to set this up would be greatly appreciated. Thank you!
is there a way to change the date format in ataccama one. i want the format to be dd mm yyyy, what i have currently is mm dd yyyy
How can I run a .vbs file workflow. May be either ‘Run Shell Script’ or ‘Run Windows Command’. Or is there any other options available? I tied to run this through ‘Run Shell Script’ but it showing an issue with Interpreter(/bin/sh)
Hello can you please assist in finding out how to find the duplicates in a column using one desktop.
For terms like USA Zipcode, USA Social Security Number etc., - the term is enabled with AI detection and it is getting tagged to hundreds of fields - most of them are NOT zipcode or SSN. If it was giving a score and recommendation, I would have discarded the recommendation, but it is assigning the term automatically and I have to go in and remove that - which became painful. I have now disabled the AI detection but is there a better way to tune it to make it work better?
hello everyone , I am unable to understand how to use representative creator step can you please explain it in detail with an example so that I am able to use it . Thank you.
HI Team,I am using one metadata writer for one of my use-case. In one-metadata writer there is an out option called recovery audit. May I know the use of this functionality. I tried checking in help contents I was not able to find any document related to this. If I don’t want to use this recovery_audit is it possible? This is the error I am getting while running the plan. Let me know if more information is needed from my end. Thanks.
Hi everyone!I wanted to share some best practices when it comes to GIT version control, how you can organize your branches in a way that merges and rollbacks are more granular, making it easier as well to see what code changes were done where Typically, what I tell clients when they are using GIT integrated with Ataccama, is that they would essentially need to have a standard flow control process for their branches. What I mean by that, is that they should set up 1 main production branch, 1 development branch, and many feature branches. You can think about it like this, your Master branch can be thought of as your “Production” branch, your Development branch can be thought of as your “Test” server, and each of those feature branches you can see it as your “Dev” server where you develop new code. How this works is simple yet effective:You start off with a main branch in your repo, we can call it “master” Master can have either prior code or be empty, let's say it has some code in it alr
I have been trying for some time to build a data quality check/rule in Ataccama Desktop (using an advanced expression) to check where a defiend attribute is unique/distinct and have been struggling to find the correct function to use for this.In a tool like excel I woudl simply count the number of instances of each value and following that I would ensure that anything where the count was >1 failed this check but I have thus far been unable to find a way to perform a distinct count in this way. e.g. DistinctCount([Install_And_Leave_Flag]) = 1I understand that the profiling step nativley gives you this information but I require a way to do that via an advanced expression for my use case.
Hello everyone, I have a requirement of exporting ONE webapp's audit logs but not using the MinIO storage, is there any other way to export log files through ONE Desktop IDE using any Api calls such as graphql converted into curl command in json call? Thanks!
Hello,I want to set up a single general email notification for various monitoring projects. Typically, I receive separate email notifications for each monitoring project, but I would like to receive only one email notification that consolidates the results of different monitoring projects. I know that I am supposed to use One Desktop but I don’t know which steps exactly. I would be grateful if you could help.Thanks in advance😊
Hello Community 😀I am trying to write a DQ rule using a regular expression, I have been using the “ONE Expressions” documentation to help with this but I can’t seem to get it working. Can anyone advise where I am going wrong please??ExampleInput data:Value1 Value2 Value3 -1137.86 -5689.33 0.2 DQ rule I am trying to achieve:Value2 * Value 3 = -1137.866 Take only the first 2 decimals of the above bullet WITHOUT rounding = -1137.86 Check if value1 equals the value in the bullet above. (i.e. -1137.86 = -1137.86 so it should show as a valid result)How I have written this in Ataccama using a regular expression:Value1 is NOT (substituteAll("(\d+\.\d{2})(\d+)","${1}",toString(Value2 * Value3))) Then result is INVALIDError I get:Using the test rule feature with the example input data above, it says that the result is INVALID when I am expecting it to be VALID. And only if I change Value1 to equal -1137.866 then it will show VALID which is not what I want to achieve.Can anyone see wh
Hi,This may sound very easy, but: how do I retrieve records that have code = ‘A’ and more than one empty start dates? So in the end I want to see records 3 & 4 since they have the same id_#, code = ‘A’ and more than 1 empty start date. Would be ideal if this was in ONE Web and not through ONE Desktop.Person id_# code start_date 1 1 A 1-1-2000 2 1 A 1-2-2000 3 1 A 4 1 A 5 2 A 1-1-2000 6 2 A 1-2-2000 7 2 A select *from Personwhere start_date is emptyand code = ‘A’group by id_#, codehaving count (*) > 1I tried to use count in advanced expressions, but can't seem to get it to work.
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.