Discuss data, share best practices, learn, and grow with Ataccama's Community.
Recently active
Hello everyone!In the new version of Ataccama 14.5, Is it possible to add comments on tables and fields from the database automaticallyΒ to the Description field in Ataccama ONE, if the Description is empty and the Comment from the database is not empty?I will be very grateful for your helpπ€Thank you!
I know that it is possible to use variables in filenames in a Text Writer (see here:Β Text File Writer: adding a datetime as suffix to an output file (ataccama.com)). But what about the Request and Response Debug File in a Json Call?I have a component for ServiceNow integration and I want to reuse another component to retrieve incident details. But when I run the main component I get this error:File file://d:/Ataccama/workspace/SNOW/distribution/debug/03_getincdetails_request_debug.txt must not be multiplicatively accessed in writing mode.The only way to get it all working, is by removing the Request and Response Debug File in the Json Call that gets incident details. A possible way around this would be if I could use variables in the filenames. But this does not seem to work in the same way that variables work in Text Writer steps (by putting the variable name between { } ).Is there another way?
Hello everyone,Iβd like to set up access permissions in Ataccama One so that users within a particular stewardship group are limited to making changes only toΒ that specific group (e.g., adding/removing users from certain roles within thatΒ group)?For example, HR users should only be allowed to make user related changes within the confine of the HR group.However, the user management seems to be a global page and does not have stewardship-specific access. If anyone has insights on how to achieve this restriction, could you kindly share your workaroundThank youΒ in advance!Ben
Hi everyone, and happy Thursday!As Iβve mentioned starting this week, this post will be the last of the Ataccama ONE WebΒ Best Practice Series for a while becauseβ¦β¦Β we are moving on to ONE Desktop next week on!Β In this post, weβll cover Workflows, and I highly suggest checking out the Tasks article from yesterday before reading it if you havenβt checked that out. It will help out with laying the foundation for workflows.Let's explore how these workflows supercharge your access and review request processes.Β Demystifying WorkflowsIn the realm of Ataccama ONE, workflows are your dynamic companions for handling access and review requests.Access Request Workflows automate data access change requests. Imagine needing higher access to an asset β this workflow empowers you to request and assigns the task to an approver, who can then give it the green light or a gentle decline.Review Request Workflows introduce automation to review changes made to data assets and get them published. If you hold
Hello:I really appreciate the commnity helping me solve more use cases and get value out of the investment we made in Ataccama.Β Now - i have another area that i need help with.We have a vendor that drops a file every night - this is not comma delimited and not fixed length. Based on the first character of the line, it decides the format of that lineFor ex: if char(1) is - 1 - then the lenght of the file will be 10 characters with first 5 characters as identfier and next five char as status.But if the first character is 2 - that means it is a different type record (type 2), that has 100 characters in length - and each of them fixed length positions.Β Now - when i scan that file through Ataccama, it is thinking the file attributes based on the first row. But is there a way i can give the metadata to the profiler?And by the way, i need this to be a monitoring project that runs DQ on a demand basis (that i would like to trigger through Airflow when the file arrives)can some one give me some
Term Detection Rule: Based on metadataRules based on metadata use information about asset, e.g. description, Catalog Item or data source name.Is there an option to expand this function to detect our βadd custom metadataβ?Β Β For example:Β On the Catalog Item level: Data Classification, Criticality, and Data Asset TypeΒ Β
Hi all,Can I export lookup fileΒ and import to another environment?Β Β Thanks in advance.
Hello Community.Β I have a vendor who shared their data through Snowflake Data Sharing. We added it as a data source and scanned the source to add the objects into my Data Catalog. I even have a sccheduled job that scans this source everyday (end of day) for sample profiling.Today, we had an issue that 10 of the tables that were previously present in the shared data source, were dropped, two new tables created, and some of the tables, have new fields added, existing fields removed, some fields renamed.This source is about 300 tables, but some of the tables ahve about 700+ fields. So, I would like to know best way for me to get a report/alert/notification onany new tables added to the source any existing tables dropped any existing table modified with new fields added any existing table modified with existing fields dropped/removed.Β What is the best way to accomplish this?For the dropped tables that previously existed, my end of day profile job is showing error in the DPM (because the ta
Data Quality checks on catalog item can they automatically come into monitoring project when that item is added to MP?Β Here is my challenge:I have catalog items with 20 or more checks. If i add them to monitoring project - it does not automatically show as βData Qualityβ for that catalog item itself. And when i add the checks to the Catalog item, they are not coming to monitoring project when i add that catalog item to the MP.Iam needing to add/configure all the rules separaely - both at Catalog item level (to get DQ percent score for that object), and also at the Monitoring project level.Β Is it possible to add the DQ rules - just to the Catalog item, and when I add that catalog item to the MP, it should automatically bring the existing rules on that object into the MP?ββββ
HiWe are interested to export metadata information into excel or CSV using βExport list of Itemsβ option (see attached image).However, this is disabled in some screens.While there are ways to use desktop components to read metadata and export to CSV, this process is highly cumbersome and still doesnβt solve the purpose.Are there anyother alternatives?
Hello:Β I have a data source with 300+ tables. I have a daily profiling job (sample data).Sometimes, when a table gets changed, and a new field added/existing field dropped, when i open that table in Data Catalog, and in the βDataβ tab, it shows that βNβ number of metadata changes happened that are marked with a βyellow triangleβ symbol (warning/alert).But, Iam able to see the list of fields that got changes, but iam not able to figure out if it is a new field added or existing field dropped or existing field changed??How can i get this data?Β
How can I enable connection page to show glossary/business terms along with other properties. I tried editing the page template but not sure what details to add for fetching those details.Β
Hello Dears,Who went through migration from 13.9 to 14.5Β or even to 15.2? How did it go?We were planning to upgrade soon to 14.5, but were surprised realizing how much manual activities it will take from our side. Such as recreating all monitoring projects, lookup files, post processingβ¦Β My question: will migration to newer version always required so much manual intervention or it is only when it comes to migration from 13.9 to 14.5?Β Thank you in advance.Kind regards,MariaΒ
Is it possible to customise the subject (screenshot below) and add things like DQ rule or Project nameΒ by any chance?Β Currently it just returns βProject run finishedβ.Β Β I have some groups with several monitoring projects and would like to know the project name in the subject line itself.And having the ability to add overall Data QUality results of that MP in the subject line will be a definite plus.For Ex: βProject run finished for Security Master Start of Day at 5:05AM PST on 4/2/2024 with overall Data Quality of 84%β(the bold and underlined above would be variables available for that monitoring project)
We have recently upgraded to RDM V14.5.0 and are finding that if you leave the screen idle for 5-10 mins the system will log you out and back in immediately. When it logs you back in it has closedΒ all the tables that you had open previously.Β Β Also, when you want to close RDM and press the βLog outβΒ button it more often than not logs you out and then back in again. It takes a 2nd press of the βLog outβ button to finally log out.Β Is there a setting somewhere that will increase the idle time so we donβt keep losing the open tables and is the need for a double log out a bug or some setting that we need to change. Any help would be appreciated.
We needΒ the change datetime of rules, catalog items, attributes and monitor projects. How can we extract these using one Desktop.Β In One Web for these assets the history can viewed, but I don't see where I can get these change dates from.Β Where is the version information stored and how can we read that info?
Can we create a lineage in Ataccamma which shows the lineage from source till the target?There are many stages involved before reaching the target. This lineage should help me in doing root cause analysis when a column has a different value in the target(Delivery).Β can someone help me on this?
Hi everyone!Β This week weΒ continue to explore differentΒ features ofΒ Monitoring Projects β¨Each day this week,Β we will share a best practice post on Monitoring Projects. We are kicking it off with a popular feature - notifications πΒ General NotificationsThere are two types of notifications available: General and Specific. General notifications cover various scenarios such as monitoring failures, critical structure errors, new results availability, data quality issues, and anomalies. Specific notifications offer even greater granularity, allowing you to set custom data quality thresholds and filter conditions for triggering notifications.Adding General NotificationsTo set up notifications for predefined scenarios:Navigate to the Notifications tab of your project. Β Under General, select Add Notification to create a new notification or Edit an existing one. Provide a name for the notification. Choose the events that should trigger notifications (e.g., Monitoring failed, New version of re
Hi Community,Β Is it possible to customise the subject (screenshot below) and add things like DQ rule or Project nameΒ by any chance?Β Currently it just returns βProject run finishedβ.Β Β
Hello Team, require help, we are on MDM 13.9.3 β newly added columns to the Instance and Master entities are not visible in REST API calls, do we required to enable any configuration to visible those new attributes in get calls.? Β thanks in advance for your inputs.
When you create a workflow that runs components you sometimes want to pass through dates or datetimes from the workflow to the component. As far as I know you can only pass parameters asΒ strings. Because this is how you pass on the parameters in a Run DQC task:Β So what if you still want to use that date or datetime info in your component?Β Prepare the date time info in your workflowSo first of all we want to make sure that that load_datetime string contains all the date and time info we want. I've done this in a global variable in the workflow.So this is my expression for load_datetime:toString(now(), 'yyyyMMddHHmmss')(in case you didn't know: you can get to the Global Properties of your workflow by double clicking on the canvas of your workflow outside the tasks)And it looks like this:Β My workflow only consists of a Run DCQ Task:The configuration of it you can already see in the first screenshot in this post.Β The componentI've created a component with the sole task of demonstrating dat
Dear community,In the overview screen of an entity, like the business terms screen, each column has some predefined width. Some of the term names are long and are cut off because the column is too small.Is there a way to define the width of a column yourself?Thanks and kind regards!Albert
I have an Ataccama workflow (EWF file) developed in ONE Desktop that executes after an ETL job. The workflow kicks off multiple data quality monitoring projects, extracts and aggregates their results, generatesΒ a Tableau hyper file from those results and publishes it to Tableau server. Iβm currently executing that workflow on a dedicated server, but would prefer to deploy it to Ataccama server and execute it via an API call.Is there a way to deploy and execute workflows on Ataccama server?
We are on 14.5.1.We have a custom property on our terms, that currently is mandatory.We want to find out if we can change it to non-mandatory.Β When I click on edit on the property, it only allows me to edit the name.Is it possible to turn off the mandatory flag?
If I create a component with a step that maps an expression as a parameter, and call that component from a workflow, I get a βModel is not validβ exception. The attached provides a minimal example of this behavior. The component, param_test.comp, uses a random record generator with a single column, the expression of which is mapped to a parameter named βparam.β The parameter value is set to βparam_value.βΒ The workflow, param_test.ewf, calls the component, passing the parameter, βparam,β with value βparam_value.βIf the component is executed in isolation, execution completes successfully. If the component is executed from the workflow, the below error message is printed and execution halts. Is this a supported scenario? If not, how can I map a parameter value to a column within a component that is called from a workflow?25.03.2024 01:20:25 [INFO] Processor started25.03.2024 01:20:26 [INFO] Task 'Run DQC' : IN_QUEUE25.03.2024 01:20:26 [INFO] Task 'Run DQC' : RUNNING25.03.2024
Already have an account? Login
No account yet? Create an account
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.