Skip to main content
Version IIoT Core
Hitachi Vantara Lumada and Pentaho Documentation

Using Spark with IIoT Core Services

  1. Last updated
  2. Save as PDF

Spark is a unified open-source analytics engine for large-scale data processing in clustered environments.

The Kubernetes Operator for Apache Spark allows you to specify and run Spark applications just like any other workloads on Kubernetes. It uses Kubernetes custom resources for specifying, running, and conveying the status of Spark applications. For a complete reference on the custom resource definitions, see the API Definition for the Kubernetes Operator. For details on its design, see the Kubernetes Operator for Apache Spark Design. It requires Spark 2.3 and above, which supports Kubernetes as a native scheduler backend.

For information on how to use Spark with IIoT Core Services, contact your Hitachi Vantara representative.

Parent Topic
  • Administer

    Learn about system configurations and services running on IIoT Core Services and how to start up the IIoT Core Services UI.