Skip to main content

Pentaho+ documentation has moved!

The new product documentation portal is here. Check it out now at docs.hitachivantara.com. 

 
Version LDC
Hitachi Vantara Lumada and Pentaho Documentation

What's new in Lumada Data Catalog

  1. Last updated
  2. Save as PDF

Lumada Data Catalog 7.3 provides the following feature updates:

Term assignment using metadata

In Data Catalog 7.3, you can use metadata rules to assign business terms to data, which should improve the accuracy of term assignments.

See Getting started with business terms and term propagation for more information.

Business Rules enhancements

Lumada Data Catalog 7.3 enables you to use the metadata gathered during profile jobs in your queries. You can query both resource, columns, and term metadata. You can use term relationships in business rules and the column position in the business rule criteria. You can use metadata and data criteria in a single rule, and you can now use a regular expression to set rule criteria. Business rules can be used to:

  • Find and change sensitivity levels of data elements
  • Compute and set data quality scores on resources or fields
Unstructured data enhancements

Lumada Data Catalog 7.3 includes enhancements to unstructured data support. Support for scanning, profiling, and business term tagging has been added for the following unstructured document types:

  • Email files (.eml without attachments)
  • Microsoft Excel files (.xls and .xlsx)
  • Microsoft PowerPoint files (.ppt and .pptx)
  • Microsoft Rich text format (.rtf)
  • OpenOffice (.odf and .odg)
  • Text (.txt)

Data Catalog can now detect the language in the content of supported unstructured document types.

NoteFor performance reasons, only the first page of an unstructured document is scanned for language. If the first page of a document is non-text characters, the language won’t be able to be determined.

The Data Canvas now includes icons for supported unstructured data types. See Manage data sources for more information.

Custom property enhancements

The following enhancements have been added to custom properties:

  • Custom properties can now be applied to business terms and fields in addition to resources.
  • A single property can now have multiple values. For example, you can have multiple experts for a resource.
Glossary enhancements

The following enhancements have been added to the Glossary:

  • Added results for a Business Terms search to the global search results
  • Terms can be bookmarked so that you can share a link to the terms
  • Users can add ratings to terms
  • New term to term relationships
  • Data associations summary tab table (for Analysts)
  • Business rules summary tab table (for Stewards)
  • A new Associations tab for all relationships (new for all primary objects) containing all terms, rules, and data assets for primary objects
Public REST APIs

This release adds support for bulk operations with APIs and adds several new APIs. The new APIs are:

  • Get data entity by ID API
  • Update glossaries in bulk API
  • Create quality statistics API
  • Fetch quality statistics entities API
  • Create resource/field level lineage in bulk API
  • Update operation edges in bulk API
  • Add multiple sources API
  • Fetch last rule run by user API
  • Fetch quality statistics history API

See https://help.hitachivantara.com/Documentation/Lumada/Lumada_Data_Catalog/7.3/REST_API_documentation for more information.

Workflows for virtual folders

You can now use workflows to control changes to virtual folders, an important feature for governance.

See Manage workflows and Working with virtual folders workflow for more information.

Display of non-English characters

Data Catalog can now display non-English characters correctly in the Data Canvas and elsewhere.

Support for SMB as a data source

Data Catalog 7.3 adds support for the Server Message Block (SMB) file system as a data source.

See Manage data sources for more information.