Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Hey Everyone!We have a use case involving datastage and curious if anyone has worked with this in the past. We have a team who has datastage jobs that are triggered by a table being pushed information downstream. We are wondering if there is a way either in the web or desktop, if we can use the trigger files that are created by datastage, somehow plug into the datastage flow, or another way that would trigger a monitoring project simultaneously to run data quality checks against the load? if certain data is not loaded in correctly, it will break the connection for the two tables, and in turn break the job, and they want to see the population of what is breaking the join. Hope this makes sense! Thanks,Thomas
Hi everyone! I’m wondering if its possible to trigger or use the Review workflow from one desktop? For instance, im currently updating a large amount of attribute descriptions and am publishing them with one desktop. Whenever I use the One Metadata writer it will apply the descriptions automatically without further approval.I would like to know if its possible to write the descriptions and then have them sent to the tasks board for the data owner to review and approve or deny.Example of what im trying to do:Use one desktop to write descriptions to attributes Review workflow is triggered, and new descriptions are assigned to data owner for review (preferably in batches of 15-20 if possible) Owner either approves changes, causing descriptions to be updated or denies them causing no change to descriptionsThank you for any help!
Hello everyone!In this post, I’ll walk you through how to extract the description of all the columns and tables using the one desktop plan. Providing detailed descriptions and comments is a fundamental best practice in data management and data standards. This approach significantly enhances theunderstanding and usability of data.The summary of all the tables, attributes and their descriptions can be extracted using the below plan.1. Open a plan and add Attribute and Catalog Item metadata reader steps.2. The Attribute meta data reader helps to extract the attribute names, comments, description. Open the meta data reader and provide the column names as below and provide the Parent Id Column name as ‘CatalogItemID’.3. The Catalog Items meta data reader helps to extract the catalog Item name based on the catalog Item Identifier. Open the meta data reader and provide the column names as below and provide the Id column name as ‘catalogItemID’.4. Use the Join Step and join the meta data reade
Hi everyone! In this post, I’m going to walk you through how to ensure that changes made in the post-processing plan are visible across different user accounts.Issue DescriptionIn version 14.5 of ONE Desktop, there is an issue where if you create a post-processing plan for a monitoring project from one account, the changes are not reflected when another user logs into the same environment.SolutionTo fix this issue, you need to download the remote file every time before making any changes to the Post Processing Component to ensure you are editing the latest file.Steps to Fix the Issue1. Login to ONE Desktop:Connect to your server by navigating to Server -> New -> ONE Platform2. Create a Post-Processing Plan:Go to the Monitoring Project -> New -> Post-Processing Plan. 3. Download the Latest Changes:To get the latest changes from one account:Right-click on the Component. Select Download. Choose Download Remote File By downloading the remote file, you will get the latest c
Hi Team, I am working on task to check the number of rows in a column. I am using count of ATTRIBUTE_1 but not able to achieve it . can you please suggest a better approach. let me know if i miss anything.
Hello Ataccama team Checking ataccama admin center on resource section there is mentioned the JVM Heap Memory,I would like to know more about the Ataccama JVM Heap Memory configuration , as I understand Ataccama manage Java APIs (mmm comment, dpe,...) , I am curious to know if Ataccama has a configuration file to define the limits of JAVA memory to use on each ataccama api, or if Ataccama has a configuration file to manage the whole java resources.
Hi I'm Srija, Solutions Consultant here at Ataccama.In this post, we can see a workaround for changing the stewardship for out-of-the-box rules and terms along with the project related business terms and rules. This workaround helps to transfer the stewardship of business rules and terms to ‘Organization’ without causing the API error.How to perform the transfer of stewardship?ONE web application By creating a custom plan to change stewardship for multiple business terms and rules. How to create a custom plan to bulk change stewardship for business terms and rules?In ONE desktop, you can use metadata reader steps from term or rule, and you can join with group metadata reader using stewardship name and name. In the JSON step, use the below GraphQL query to change the stewardship for terms or rules.{"query":"mutation TransferStewardship_rule($gid: GID!, $newStewardId: GID, $accessLevelForPreviousSteward: String) { ruleTransferStewardship( gid: $gid newStewardId: $newStewardId
I am working on the usecase of comparing two different columns in two different csv files. I need to compare these column, remove any duplicates and merge them into single column. I am trying to use join component but not sure about this approach will work or any better solution is available to achieve this use case - If anyone can suggest a better apprach it will be helpful. - Thanks.
Hi everyone, me again 😊 I work as a professional services consultant in Ataccama and I prepared another article for you, this time about some recommendations for integration with git, mainly for self-managed deployments. Specifically, when you have the DQG suite and you want to integrate your orchestration server. You can probably reuse some of these recommendations for other modules as well.Before you start reading, please note that I reused some of the already existing articles:https://community.ataccama.com/master-data-management-reference-data-management-92/one-desktop-git-recommendations-187?tid=187&fid=92I also recommend checking out this article in our documentation for working with git in our IDE:https://docs.ataccama.com/one-desktop/latest/projects/git.html#introduction-to-git-and-egitAlso please note, that this article doesn’t cover how to work with git in general, but more on how to work with the Ataccama projects, what files to version, what to look out for etc.Recomme
I have certain Business terms that i want to track on which fields are getting mapped from which datasets on a given day.Is there a way, i can send a notification to myself (and any others interested) on the occurance details of a term - and i schedule this to run periodically like every monday? To be specific, Iam want to track Social Security Number. I want to get a report every monday morning - with list of Catalog items and attributes that are mapped to this term. (from the occurances details). Is it possible?? How??
Hello! I am looking for assistance with applying filters to rules. Currently, I understand that the "where" clause can be used in rules, but it seems to apply to all records uniformly. What I need is a way to create a rule that only affects a subset of the data, so that the total count of records affected by the rule is different from the total count of records in the Catalog Item. For example, if I have a dataset with 1000 records, I want to create a rule that only applies to, say, 200 of those records based on specific criteria, without affecting the other 800 records. So if there is 100 records failing the result should be 100/200 instead of 100/1000.Is there a way to achieve this selective application of rules? Any guidance or examples on how to set this up would be greatly appreciated. Thank you!
is there a way to change the date format in ataccama one. i want the format to be dd mm yyyy, what i have currently is mm dd yyyy
Say now we have an term with more than 10 properties to display at the same time. Is it possible to (configure the metadata model so once we click the term it will) show all the properties without having to click this Show all button? Thanks in advance.
How can I run a .vbs file workflow. May be either ‘Run Shell Script’ or ‘Run Windows Command’. Or is there any other options available? I tied to run this through ‘Run Shell Script’ but it showing an issue with Interpreter(/bin/sh)
Hello can you please assist in finding out how to find the duplicates in a column using one desktop.
For terms like USA Zipcode, USA Social Security Number etc., - the term is enabled with AI detection and it is getting tagged to hundreds of fields - most of them are NOT zipcode or SSN. If it was giving a score and recommendation, I would have discarded the recommendation, but it is assigning the term automatically and I have to go in and remove that - which became painful. I have now disabled the AI detection but is there a better way to tune it to make it work better?
Let’s say a data consumer in my workplace is getting familiar with a data element (as term), and he/she want to know who the data owner is. Since we set the person reference for the roles in stewardship, the consumer need to 1. click the display name of the data owner, see the username of the referred user, and then 2. click that username to see the detail of that user, namely his/her user ID and email address.(1) Is it possible in any way the data consumers only need to click once from the display name of the data owner to his/her user detail?(2) Is the above workaround applicable for other reference objects (e.g. the policy reference)?Thanks a lot.
hello everyone , I am unable to understand how to use representative creator step can you please explain it in detail with an example so that I am able to use it . Thank you.
HI Team,I am using one metadata writer for one of my use-case. In one-metadata writer there is an out option called recovery audit. May I know the use of this functionality. I tried checking in help contents I was not able to find any document related to this. If I don’t want to use this recovery_audit is it possible? This is the error I am getting while running the plan. Let me know if more information is needed from my end. Thanks.
Hi everyone!I wanted to share some best practices when it comes to GIT version control, how you can organize your branches in a way that merges and rollbacks are more granular, making it easier as well to see what code changes were done where Typically, what I tell clients when they are using GIT integrated with Ataccama, is that they would essentially need to have a standard flow control process for their branches. What I mean by that, is that they should set up 1 main production branch, 1 development branch, and many feature branches. You can think about it like this, your Master branch can be thought of as your “Production” branch, your Development branch can be thought of as your “Test” server, and each of those feature branches you can see it as your “Dev” server where you develop new code. How this works is simple yet effective:You start off with a main branch in your repo, we can call it “master” Master can have either prior code or be empty, let's say it has some code in it alr
I have been trying for some time to build a data quality check/rule in Ataccama Desktop (using an advanced expression) to check where a defiend attribute is unique/distinct and have been struggling to find the correct function to use for this.In a tool like excel I woudl simply count the number of instances of each value and following that I would ensure that anything where the count was >1 failed this check but I have thus far been unable to find a way to perform a distinct count in this way. e.g. DistinctCount([Install_And_Leave_Flag]) = 1I understand that the profiling step nativley gives you this information but I require a way to do that via an advanced expression for my use case.
Setting permissions for groups via the IDE.Ensure your groups exists in KeyCloak first In the IDE go to your RDM Project and complete the following under "Security" Right click on Roles Select New role Add the name and description of the role (be sure to use the same names that you setup in KeyCloak) then click Apply and OK Expand the new role, and right click on Entities then select Edit… Add the Tables and the Table level permissions in the next window NOTE: Table permissions do not give column level permissions. Double click the number next to the table that you wish to setup permissions for Notice that there are options for "View for All Columns" and "Modify for All Columns." However, if you want to select only certain columns, you can do that below with the following steps. Add the column names you want permissions to be given for, and select View and/or Modify for the given column When complete, click Apply then OKTo ensure these permissions are applied to the Web Admin do
Hello everyone, I have a requirement of exporting ONE webapp's audit logs but not using the MinIO storage, is there any other way to export log files through ONE Desktop IDE using any Api calls such as graphql converted into curl command in json call? Thanks!
Let‘ say you have a graphQL query that works in a Postman or in Ataccama playground, and you want to use it in a plan in ONE Desktop. How to do it?You cannot simply copy and paste the JSON body into JSON call step. You have to reformat it. You can use the COPY CURL button in Playground (in the upper right corner) or similar button Code in Postman. That will create a curl command that also contains the body:PlaygroundCurl commandThis body can be then pasted into JSON call. The query method needs to be set as POST.JSON call step configuration Want to learn more about the graphQL API? Check out the documentation: https://support.ataccama.com/home/docs/aip/latest/development-guides/one-development-guide/one-api
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.