Skip to main content
Version Pentaho
Hitachi Vantara Lumada and Pentaho Documentation

Administer Pentaho Worker Nodes

  1. Last updated
  2. Save as PDF

The Pentaho Server can be configured for worker nodes, after completing the installation and setup process, so that transformations and jobs can be run as work items. You can take advantage of worker nodes, for example when using Kafka, to scale out across clusters when you have workload increases. Results from the transformations and jobs occur normally within the Pentaho platform, while Hitachi Content Intelligence (HCI) provides monitoring for the health and performance of the worker node instances and services.

The monitoring reporting functions for worker instances and operations of worker nodes are performed by HCI. Master instances run an essential set of services, which includes the administration application, cluster-coordination, synchronization, and service deployment. Worker instances can run any services besides those listed above. More information on a work-item by work-item basis is available on Mesos , which is available on HCI.

Access the HCI Administration Application

You will need your username and password to access the HCI Administration Application.

Perform the following actions to open the administration app:

  1. Open a web browser to go to the HCI Administration Application:

https://<HCI-instance-IP-address>:8000

  1. In the Security Realm field, select the location where your user account is defined. To log in using the local admin account, select Local.
  2. Enter your username and password then click on the Log In button. The Home page appears.

HCI_Admin810_Main.png

Monitoring Overview

You can view the status of the HCI system, resource allocations, instances, and services.  

Perform the following actions to monitor the system and services:

  1. Open the HCI Administration Application and log in.
  2. Click Monitoring > Dashboard > Overview.  Pentaho Worker Nodes Services and Instances are displayed, including the state and status of the service and its resource allocations.

View Instances

You can view all Master and Worker instances, which are identified by IP address. Single-instance systems have one master instance while multi-instance systems have either one or three master instances.

Perform the following actions to monitor instances:

  1. Open the HCI Administration Application and log in.
  2. Click Monitoring > Dashboard > Instances. The Master and Worker instances are displayed, including their state, service units, and resource allocations.

WN_HCI_MonitoringDashboardInstances.png

View Services

You can access details, status, and results about the files running on worker nodes. Services perform functions essential to the health or functionality of the system. 

Perform the following actions to monitor services:

  1. Open the HCI Administration Application and log in.
  2. Click Monitoring > Dashboard > Services. Pentaho Worker Nodes Services are displayed, including the number of instances, state, and resource allocations.
  3. Select a service panel to view further details about that service.

HCI_Admin810_Mon_Dash_Services_Details.png

View Jobs

You can view jobs and transformations running on the worker nodes as work items.  

Perform the following actions to view the worker node queue for jobs and transformations:

  1. Open the HCI Administration Application and log in.
  2. Click Monitoring > Jobs.
  3. Review the list of jobs their associated system event logs.

HCI_Admin810_Mon_Jobs_WithEvents.png

Worker Node Logs

The logging function for worker nodes is provided by Mesos.  

Perform the following actions to view logs for jobs or transformations:

  1. Open a web browser to go to the Mesos Administration Application:

https://<HCI-instance-IP-address>:5050 

  1. Locate the name of the work item that you want to view and then click the individual Sandbox link in the Active, Completed, or Orphan Tasks section to navigate to the page that contains the logs for that job or transformation.

WN_Mesos_Task_Page.png

  1. Click stdout to view the logs for that job or transformation. The logs contain the task progress, or failure and the reason. 

WN_Mesos_Log_Access.png

  • You can retrieve the stored log files from 

opt/hci/log/com.pentaho.foundry.workernode

Learn More

Use the following articles to assist you in setting up HCI and Pentaho to use worker nodes.