Version 15.4 LTS is here! Updates to Data Observability, ONE AI, MDM & RDM
Hi everyone! 👋 Today, we're very excited to announce the release of v15.4 Long Term Support (LTS) 🎉As always, this release comes with number of new and highly-expected features, updates, and fixes. Let’s get into what’s new👇🟣ONEData Observability dashboardsIf you are new to Data Observability, DO dashboards provide a single place where you can find information on all data quality or schema change issues. You can run data observability manually, close issues, or add newly-discovered catalog items to your observed system.With 15.4 we are bringing a unified approach to tabs in the issues table, expanding the same functionalities to all tabs, namely: On the All Issues tab, you can now search for catalog items, the same way as on other tabs. On the Freshness tab, you can now sort issues by the Detected column, the same way as on other tabs. Complete DQ Evaluation Rule generation using GEN AIIn our last version 15.3, we brought the ability to create realistic and diverse datasets to test your DQ rules and get ONE AI to help you debug rules by generating example inputs.Now, you can use Generative AI to build full data quality rules including both inputs and rule logic, and quickly test and re-generate rules through new prompts. How?Switch to the Implementation tab of one of your DQ rules and select the Use AI to generate Rule logic and inputs option. Create a plain text prompt using natural language in the Define the rule field - and that’s all! Wait for ONE AI to generate the definition, edit and update if necessary.⚠️ Beware that, accepting the ONE AI input will overwrite any existing rule implementation.With this update any data engineer or steward can quickly begin building accurate rules with less time spent than ever. 🚀📌If you haven’t enabled your AI feature yet and on Cloud, you can see how here: Generative AI in ONE.Add preview and thumbnail screenshots for Report Catalog ItemsIf you are a PowerBI user, this update is for you! Previously, there were no report/dashboard thumbnails available at the CI listing page and added a layer of difficulty to get report previews.Now, we have brought an update that allows you to upload thumbnails and previews for all Report Catalog Items that will override the preview taken from the data source and will be used in your CI listing page. Without adding another subscription ✅Data LineagePreviously, there was limited information about objects imported to lineage repository in Ataccama ONE accessible for the users, and not all users were able to initiate lineage analysis from a catalog item which is not in the data catalog. As well as, the access to the list of dataflows and dataflow properties were limited.We’re happy to share that with v15.4, you can now browse, search, filter & sort and access to the all objects in the lineage repository.How?If you’d like to start a lineage or impact analysis:Open your Lineage assets screen, and search or filter for the catalog item to start the analysis. The analysis can be started simply by opening the item details and then the lineage diagram. For more information on lineage please check out our documentation or let us know your questions in the comments! 🟣MDM & RDMTasksWe are continuing to enhance our Tasks feature following the updates in v15.3 this time with improvements for roles, permissions and visibility.You can now modify task names, descriptions, and severity levels if you have edit permissions in your role. On the other hand, custom permissions will allow you to restrict task visibility only to entities that a role has permission to view. To learn more about roles and permissions, check out Configuring Permissions. In addition to these, we also brought some improvements for the navigation; changed the Assignee and Assignee group lists sorting to alphabetical for easier navigation, and have our task listings in MDM Web App display only one line of description, with full text accessible on hover and searchable using Ctrl+F.Export records with published changesYou can now export records with published changes both through the RDM Web App and RDM REST API and use them for auditing purposes outside of RDM.The export is available in the JSON format and contains information about the record primary keys, its identifier in the table, as well as the changed columns. This allows you to easily identify each record in a unique manner and see which values were modified, when, and by which user.To export records from the web application, open the Change Log tab and narrow down your record selection using filters. Select View and then Export. The exported JSON file is then downloaded to your machine. For details, see RDM Change Log.The Change Log tab now shows whether any filters are currently applied or whether you are viewing the full changelog. This way, you can quickly make sure you are exporting the records you are interested in, as the filters used also determine which records are included in the export file. You can find this information above the record listing. To export the changelog using the API, send a GET or POST request to the new /changelog endpoint. You can filter the records through query string parameters or the request body, respectively. To learn more about it, check out the RDM REST API page. 🟣Additional improvements & updates Remote Execution on Selected DPEs Now you can choose which engine will execute your plan remotely by specifying a DPE label in ONE Desktop. This is particularly useful when you work with multiple DPE instances, such as hybrid DPEs and standard DPEs, enabling you to direct your plan execution to a specific engine. Define which engines can connect to private on-premise data sources or direct demanding or complex jobs to a DPE with more resources available. Native Amazon SQS Streaming Connector New Matching Step Parallelism Configuration Find out all v15.4 improvements and fixes please check our documentation release notes here.Hope you’ve enjoyed our version 15.4 updates! Please let us know your thoughts, questions or suggestions in the comments below 👇