Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Letβs say a data consumerΒ in my workplace is getting familiar with a data element (as term), and he/she want to know who the data owner is. Since we set the person reference for the roles in stewardship, the consumerΒ need to 1. click the display name of the data owner, see the username of the referred user, and then 2. click thatΒ username to see the detail of that user, namely his/herΒ user ID and email address.(1) Is it possible in any way the data consumersΒ only need to click once from the display name of the data owner to his/her user detail?(2) Is the above workaround applicable for other reference objects (e.g. the policy reference)?Thanks a lot.Β
hello everyone , I am unable to understand how to use representative creator step can you please explain it in detail with an example so that I am able to use it .Β Thank you.
HI Team,I am using one metadata writer for one of my use-case. In one-metadata writer there is an out option called recovery audit.Β Β May I know the use of this functionality. I tried checking in help contents I was not able to find any document related to this. If IΒ donβt want to use this recovery_audit is it possible?Β Β This is the error I am getting while running the plan. Let me know if more information is needed from my end.Β Thanks.
How can I run a .vbs file workflow. May be either βRun Shell Scriptβ or βRun Windows Commandβ. Or is there any other options available?Β I tied to run this through βRun Shell Scriptβ but it showing an issue with Interpreter(/bin/sh)Β Β
Hi everyone!I wanted to share some best practices when it comes to GIT version control, how you can organize your branches in a way that merges and rollbacks are more granular, making it easier as well to see what code changes were done whereΒ Typically, what I tell clients when they are using GIT integrated with Ataccama, is that they would essentially need to have a standard flow control process for their branches. What I mean by that, is that they should set up 1 main production branch, 1 development branch, and many feature branches. You can think about it like this, your Master branch can be thought of as your βProductionβ branch, your Development branch can be thought of as your βTestβ server, and each of those feature branchesΒ you can see it as your βDevβ server where you develop new code. How this works is simple yet effective:You start off with a main branch in your repo, we can call it βmasterβ Master can have either prior code or be empty, let's say it has some code in it alr
I have been trying for some time to build a data quality check/rule in Ataccama Desktop (using an advanced expression) to check where a defiend attribute is unique/distinct and have been struggling to find the correct function to use for this.In a tool like excel I woudl simply count the number of instances of each value and following that I would ensure that anything where the count was >1 failed this check but I have thus far been unable to find a way to perform a distinct count in this way. e.g.Β DistinctCount([Install_And_Leave_Flag]) = 1I understand that the profiling step nativley gives you this information but I require a way to do that via an advanced expression for my use case.Β Β
Setting permissions for groups via the IDE.Ensure your groups exists in KeyCloak first In the IDE go to your RDM Project and complete the following under "Security" Right click on Roles Select New role Β Β Add the name and description of the role (be sure to use the same names that you setup in KeyCloak) then click Apply and OK Expand the new role, and right click on Entities then select Editβ¦Β Β Add the Tables and the Table level permissions in the next windowΒ Β NOTE: Table permissions do not give column level permissions. Double click the number next to the table that you wish to setup permissions for Notice that there are options for "View for All Columns" and "Modify for All Columns." However, if you want to select only certain columns, you can do that below with the following steps. Add the column names you want permissions to be given for, and select View and/or Modify for the given column Β Β When complete, click Apply then OKTo ensure these permissions are applied to the Web Admin do
Hello everyone, I have a requirement of exporting ONE webapp's audit logs but not using the MinIO storage, is there any other way to export logΒ files through ONE Desktop IDE using any Api calls such as graphql converted into curl command in json call? Thanks!
Letβ say you have a graphQL query that works in a Postman or in Ataccama playground, and you want to use it inΒ a plan in ONE Desktop. How to do it?You cannot simply copy and paste the JSON body into JSON call step. You have to reformat it. You can use the COPY CURL button in Playground (in the upper right corner) or similar button Code in Postman. That will create a curl command that also contains the body:PlaygroundCurl commandThis body can be then pasted into JSON call. The query method needs to be set as POST.JSON call step configurationΒ Want to learn more about the graphQL API? Check out the documentation:Β https://support.ataccama.com/home/docs/aip/latest/development-guides/one-development-guide/one-api
Hello,I want to set up a single general email notification for various monitoring projects. Typically, I receive separate email notifications for each monitoring project, but I would like to receive only one emailΒ notification that consolidates the results of different monitoring projects. I know that I am supposed to use One Desktop but I donβt know which steps exactly. I would be grateful if you could help.Thanks in advanceπ
Hello CommunityΒ πI am trying to write a DQ rule using a regular expression, I have been using the βONE Expressionsβ documentation to help with this but I canβt seem to get it working. Can anyone advise where I am going wrong please??ExampleInput data:Value1 Value2 Value3 -1137.86 -5689.33 0.2 Β DQ rule I am trying to achieve:Value2 * Value 3 = -1137.866 Take only the first 2 decimals of the above bullet WITHOUT rounding = -1137.86 Check if value1 equals the value in the bullet above. (i.e.Β -1137.86 =Β -1137.86 so it should show as a valid result)How I have written this in Ataccama using a regular expression:Value1 is NOTΒ (substituteAll("(\d+\.\d{2})(\d+)","${1}",toString(Value2 * Value3))) Then result is INVALIDError I get:Using the test rule feature with the example input data above, it says that the result is INVALID when I am expecting it to be VALID. And only if I change Value1 to equalΒ -1137.866 then it will show VALID which is not what I want to achieve.Can anyone see wh
We are on RDM v14.5.1, on PaaS, so underlying db is postgres.I need to query a table using the RDM Extended Reader step with a filter. The volume of this table will grow, so I much prefer to filter at the reader step, rather than bring the whole table into the plan and then filter, to manage performance.I have a column, from_date, that is datetime type. I have from_date in my data flow, and I want to query RDM for a day prior.Expecting that this is an SQL where clause, I tried to put in syntax compatible with PostgresΒ So I created a column called βrow_filterβ, with type string.Β Using postgres to_timestamp functionday_prior:=dateAdd(from_date,-1,'DAY');day_prior_string:=tostring(day_prior,'yyyy-MM-dd HH:mm:ss');"from_date=to_timestamp('"+day_prior+"','YYYY-MM-DD HH:MI:SS')"Β This one gave an error of:13.05.2024 13:10:00 [INFO] Ataccama DQC engine initialized.13.05.2024 13:10:00 [INFO] Creating runtime...13.05.2024 13:10:00 [INFO] Starting runtime...13.05.2024 13:10:00 [INFO]
Hi,This may sound very easy, but: how do I retrieve records that have code = βAβ and more than one empty start dates? So in the end I want to see records 3 & 4 since they have the same id_#, code = βAβ and more than 1 empty start date. Would be ideal if this was in ONE WebΒ and not through ONE Desktop.Person id_# code start_date 1 1 A 1-1-2000 2 1 A 1-2-2000 3 1 A Β 4 1 A Β 5 2 A 1-1-2000 6 2 A 1-2-2000 7 2 A Β Β select *from Personwhere start_date is emptyand code = βAβgroup by id_#, codehaving count (*) > 1I tried to use count in advanced expressions, but can't seem to get it to work.
I am facing the problem that I have output from 4 components and the I am writing them on different text file writers is there any way I can combine the outputs into a single text file writer if not can I combine the outputs from the different components and write it in a single text file writer.
Hi Community,We have a scenario where an entire schema was imported as an Ataccama source. This resulted in over 700 tables/views brought in as catalog items.Is there a way to bulk delete all 700?Thank you.
Is it possible to create a data asset from an ETL job (SSIS or similar) so that this is included in the data lineage to allow for full impact analysisΒ
Currently only 4 sources are supported for data stories and they are mentioned below: Amazon Aurora PostgreSQL ONE Data PostgreSQL Snowflake We also use synapse as source for a lot of catalog items and it would be great if you can add synapse as well to the above.Β
Hello,How we can delete one of the components in One Desktop? I created virtual catalogΒ item through One Desktop. Virtual catalog item has already been deleted but its component still remains.Β Β I want to delete its component as well. Β For example, I want to delete component βbranch_dwh_vs_lakeβ. How can I delete it from desktop?Thanks in advance,Β
I have a data set created and the query runs fine in a sql editor against my local database. I can deploy the configuration with no errors, but when I go to look at the data in Ataccama One I get Fatal error occurred and click on Details just gives me Internal error. The only thing I can think of is the query is rather long. Is there a max for data set sql? What is the best way to try to troubleshoot this? The error messages are not at all helpful.
Hi,Β I notice that for some of my terms, the visual Insights is visible and for others it is not. What is the reason for this?Second question: I would want to automatically assign terms. if the column is named wnplts then I want to assign the term Residence to it. Is there an easy way to do this? Detection rules seem to look at the value and not at the column name.kind regards, Jur DΓΆrdregter
Hey All!I am aware that only Stewardship owners have the ability to use the βDocumentβ button on a data source level, but is there a way that we can disable this button all together? If a user accidentally uses this feature, it eats up a lot of processing to import the metadata, and is a best practice that we are telling everyone not to use. Is there a way within the admin console to do this?Thanks!Β
Hi,I have certrain fields in my data that should be masked for all users. This is information like social security number and IBAN. Now users can see this data from the sample data tab and from the profile. Can I apply some some masking of these attributes without have to create a VCI or SCI for this? Ideally masking should be applied based on the term assignment: as soon as I map the data to IBAN it should be masked for all users.Regards, Jur DΓΆrdregter
Hi,We have several Monitoring Projects that are scheduled to run at 07:00. If for instance 1000 jobs are still in the queue those scheduled MP will run after the 1000 jobs (assuming the priority is the same; 0). In order to change this I have to go to DPM and change the priority of the scheduled MPs. Is there a way where I can schedule a Monitoring Project at a specific time, 07:00, with a certain priority (automatically)?
how do i do an exact field search?For Ex: I have a field named trd_settle_dateΒ - and when i search for that in the data catalog, it is Giving me all fields in catalog that either started with βtrdβ or had βsettleβ word some where in it etc.,Because of that, the search is giving so many unnecesary values in the list, and making it difficult to find the right one.How can i get Ataccama to perform exact match to my search string? If it doesnt find - its OK for it to give me βno items foundβ
Please advise if there is an easy way to capture how much volume of data in total we have to report up to our CIO?Β I was thinking creating a plan but that will execute forever.Β Any ideas?
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.