Hi all!
In this post, I’ll cover the latest features and updates for ONE Data in 14.5 If you have missed the previous posts on 14.5 updates & new features you can check them out here
Let’s get into it!
Data Deduplication
You can now deduplicate your datasets to easily create managed reference data. Once your reference data is ready, use it in DQ rules to continuously improve the quality of your data.
How? Start by opening the catalog item from which you want to extract reference data, then expand the three dots menu for a particular attribute and select Create reference table.
Choose your deduplication key (one or a combination of several attributes) and select any additional attributes that help you better describe your data. In addition to these, the table will also contain a frequency
attribute, which stores the number of occurrences for each record.
Review and update your data as needed and apply it in DQ rules.
DQ Metadata Automatically Updated
DQ metadata used in DQ filters is automatically updated each time you run a DQ evaluation and each time you edit a record (except for bulk edits). This ensures you're working with the latest DQ results available, which in turn facilitates the process of data remediation. It also allows you to use DQ filters on any ONE Data table, not only those created by importing invalid records from an existing catalog item.
If you edit one of the filtered records, it is validated on the fly and removed from your filtering results if it no longer fits the criteria. Additionally, a warning is displayed, informing you that the overall quality of your table might be outdated.
UX Improvements
Changes to Multi-edit Values Option
The Multi-edit values option is now called Bulk edit. To help prevent unwanted edits, you can see how many records are affected by your action as well as whether you are editing an entire attribute or a selection of records (filtered or not).
If you are editing a selection of records, you can also easily select which attribute to edit without having to select the records again.
Support for Copy-pasting
Copy and paste cells for faster inline data editing. Pasted cells are evaluated on the fly, allowing you to quickly spot issues in the data. When copying data between attributes of different types, cells are converted to the corresponding data type if possible, otherwise your action is ignored.
In addition, pasting cells overwrites any existing data and automatically adds additional rows if needed.
Improved Support for Microsoft Excel Files
When importing a Microsoft Excel file with more than one sheet, you can now choose which sheet to import. Select sheet option in the file import configuration or the first sheet in the file is selected.
Improved Table Creation
Creating an empty table now produces a template that you can further edit. Rename the table and modify the table structure by adding, removing, or renaming attributes, then start entering your data.
We have also reorganized the table creation menu. Selecting Create table in ONE Data now instantly generates a new table.
Easier Attribute and Table Renaming
We have made it easier to rename ONE Data tables and attributes. To edit, double-click the name in the header, provide a new value, and press Enter to save your changes.
Stay tuned for more!