Administer Pentaho Worker Nodes
The Pentaho Server can be configured for worker nodes, after completing the installation and setup process, so that transformations and jobs can be run as work items. You can take advantage of worker nodes, for example when using Kafka, to scale out across clusters when you have workload increases. Results from the transformations and jobs occur normally within the Pentaho platform, and the Administration Application provides monitoring for the health and performance of the worker node instances and services.
Monitor the Worker Nodes
The monitoring reporting functions for worker instances and processes are performed by PWN. Master instances run an essential set of services, which includes the administration application, cluster-coordination, synchronization, and service deployment. Worker instances can run any services besides those previously listed. More information on a work-item by work-item basis is available on Mesos and Chronos, which are also services available on PWN.
Access the PWN Administration Application
Perform the following actions to open the Admin App.
Procedure
Open a web browser to go to the PWN Administration Application:
https://<PWN-instance-IP-address>:8000
In the Security Realm field, select the location where your user account is defined.
To log in using the local admin account, select Local.Enter your user name and password, then click Log In. The Home page appears.
Click Admin App to open the tool.
View the Dashboard
Perform the following actions to monitor the system and services.
Procedure
Access the PWN Administration Application and log in.
By default, the application opens to the Dashboard page.Use the left-side menu to navigate the application.
You can view the Pentaho Worker Nodes services and instances, including the state and status of the service and its resource allocations.
View Instances
Perform the following actions to monitor instances.
Procedure
Access the PWN Administration Application and log in.
Click Instances.
The Master and Worker instances are displayed, including their state, service units, and resource allocations.Click on an instance to view details.
Monitor Services
Perform the following actions to monitor services.
Procedure
Access the PWN Administration Application and log in.
Click Services.
Pentaho Worker Nodes Services appear, including the number of instances, state, and resource allocations.Click on any service to view more details, including volumes, network, configuration, scale, and events.
View Jobs
Perform the following actions to manage jobs:
Procedure
Access the PWN Administration Application and log in.
In the left-side panel, click Jobs. Pentaho Worker Nodes Job Types are displayed, including its resource allocation.
Under Job Types, select a specific job to see triggered jobs status and resource allocation. You can also access its configuration.
Worker Node Queue
The jobs and transformations that are sent to worker nodes are queued in Chronos, the scheduling service. Based on the availability of resources, Chronos sends the request to a specific node for execution.
Worker Node Logs
You can configure the worker node logs to be sent to ELK stack via Kafka. The ELK can be
either internal or external to workerNode
.
Learn More
If you are new to Pentaho Worker Nodes and want to learn about the best practices and setup process, see Pentaho Worker Nodes.