Skip to main content
Version Pentaho
Hitachi Vantara Lumada and Pentaho Documentation

Set Up Worker Nodes on the Pentaho Server

  1. Last updated
  2. Save as PDF

Now that you have installed the Pentaho Worker Nodes product on a single instance of HCI, you are ready to enable Pentaho Worker Nodes on your Pentaho Server and configure it to run work items. In addition, you can enable secure communication between the Pentaho Server and the worker nodes.

Enable Pentaho Worker Nodes

After starting HCI, you will need to configure the Pentaho Server to delegate PDI transformations and jobs to the Pentaho Worker Nodes within the HCI instance. 

Perform the following steps in the Karaf environment:

  1. If you have not done so already, stop the Pentaho Server.
  2. Navigate to the pentaho-server/pentaho-solutions/system/karaf/etc/ directory and open the org.apache.karaf.features.cfg file with any text editor.
  3. Locate the featuresBoot property and add the pentaho-worker-nodes-ee feature.
# Comma separated list of features to install at startup 
#
featuresBoot=config,management,kar,cxf,camel,camel-blueprint,camel-stream,pentaho-camel-jms,pentaho-server,pentaho-monitoring-to-snmp,pentaho-metaverse,pdi-dataservice,pdi-data-refinery,pentaho-big-data-ee-plugin-osgi-obf,pdi-engine-configuration,pentaho-worker-nodes-ee
  1. Save and close the org.apach.karaf.features.cfg file. 
  2. Start the Pentaho Server. 
  3. Verify that the new configuration file pentaho.worker.nodes.cfg has been created in the following location: pentaho-server/pentaho-solutions/system/karaf/etc/

The Karaf OSGI framework allows a user to make configuration changes which will be applied in “real-time” to the environment when the configuration file is saved. 

Configure the Pentaho Worker Nodes

Once you have enabled Worker Nodes, you must configure the orchestration method, as well as the host and event logging connections for the Worker Nodes. This task assumes you are on the server or virtual machine for your HCI instance.

Perform the following steps in the configuration file:

  1. Navigate to the pentaho-server/pentaho-solutions/system/karaf/etc/ directory and open the pentaho.worker.nodes.cfg file with any text editor.
  2. Perform the associated action for each property listed in the table below:
Property Action Notes
orchestrator Change the value to 'mesos-chronos'.

If you wanted to return to standard Pentaho Server operation, set this property value to ‘None’.
wn-hostname Set the value to the IP address of the Chronos service running within your cluster.     To find the IP address of your Chronos service, browse to HCI Admin App > Monitoring > Services > Scheduling Service.
wn-port Set the value to the port number of the Chronos service running within your cluster. To find the port number of your Chronos service, browse to HCI Admin App > Monitoring > Services > Scheduling Service.
wn-setup-environment-variables Contains the variables TRUSTED_IP, REPOSITORY_IP and REPOSITORY_PORT. Set these values to the correct Pentaho Server IP, repository IP, and repository port number respectively.
 		  
wn-setup-volume-mapping   Contains the hostPath. If you have installed your Foundry product in a directory other than /opt/pwn then you will need to substitute /opt/pwn with your install path.
  1. Make the following changes for each value listed in the table below:
Property Action Notes
TRUSTED_IP Add ' ,\ ' (a comma and a backslash) after the value.

 
EVENTS_SENTINEL_HOST Uncomment (remove the hashtag (#) icon) and provide the following value: IP address of the host where HCI’s Sentinel service is running.     This value is located under the “# comma-separated key-value pairs of environment variables needed for Chronos job to launch a worker node” section.   
EVENTS_SENTINEL_PORT Uncomment (remove the hashtag (#) icon) and provide the following value: Port where HCI’s Sentinel service is listening. 
The default value is ‘8889’.		 This value is located under the “# comma-separated key-value pairs of environment variables needed for Chronos  job to launch a worker node” section.
  1. Save and close the pentaho.worker.nodes.cfg file. 

After the Worker Nodes are configured, all transformations and jobs submitted to the Pentaho Server will be processed using Worker Nodes. To return to standard Pentaho Server operation, set the orchestrator property value to ‘None’.

Enabling Secure Communication for Pentaho Worker Nodes

When setting up Pentaho Worker Nodes on a single instance, be sure to follow the steps for the secure setup in the Run the Setup Script task. Secure mode requires the use of a master HCI instance, so you should have applied the ‘-M’ and ‘-m’ parameter values prior to beginning this task.

To secure your Pentaho Worker Nodes configuration, you will need to perform the following tasks.

Generate a TrustStore Using the HCI System Certificate 

HCI comes with its own self-signed certificate, which is generated and installed automatically during system installation. You must provide this certificate to complete the trust relationship between the HCI and the Pentaho Server for SSL communication. 

Perform the following steps to add the HCI system certificate to a truststore:

  1. Ensure that the HCI instance and the Pentaho Server are running.
    1. Navigate to the pentaho-server/pentaho-solutions/system/karaf/etc/ directory.
    2. Check that the pentaho.worker.nodes.cfg file exists in the directory. If the file is not found, see Enable Pentaho Worker Nodes.
  2. Create a directory named ‘Security’ on the Pentaho Server host machine and change to this new Security directory.
  3. Copy the combined.pem file from <install-base-dir>/data/com.hds.ensemble.plugins.service.haproxy/certs/combined.pem and save it in the Security directory.
  4. Open a command line interface and enter the following command:

<jre_home>/bin/keytool -importcert -file combined.pem -alias <alias> -storepass <trust_store_password> -keystore <trust_store_name>

  1. Make a note of the absolute path to the truststore file and its password. You will need it when you configure the Pentaho Server Settings.

Enable Secure Communication

The following steps detail how to enable and establish a secure communication channel between the Pentaho Server and the Worker Nodes. 

Configure the HCI Settings

Perform the following steps in the Pentaho Worker Nodes administration site:

  1. Open a web browser and enter https://<HCI-instance-IP-address>:8000.

‘HTTPS’ is the required IP address to gain site access, even for unsecured communications.

  1. In the Security Realm field, select the location where your user account is defined. To log on using the local admin account, select Local. 
  2. In the Administration Login window, enter your user name and password, then click Log in. The Pentaho Worker Nodes window appears. This is the home page for the Pentaho Worker Nodes administration site. From here you can monitor work items and adjust system configuration settings. 

PWN_Admin_Home.png

  1. From the home page, click Monitoring. From the left side panel, click Dashboard, then click the Services option.

PWN_Admin_Home_Monitoring_DasboardMenu_SelectServices.png

The Pentaho Worker Nodes Services page displays. Within the Services Dashboard, you can view the Pentaho-Worker-Nodes panel in the right column. PWN_Admin_Home_Monitoring_ServicesPage_PWNPanel.png

  1. Click the Pentaho-Worker-Nodes panel. In the page that displays, you can view networking information. In the Network: External section, note the IP address listed for Host Address and the port number listed for PRIMARY_PORT. 

PWN_Admin_Home_Monitoring_Services_PWN_NetworkingSection.png

  1. Using the navigation bar at the top of the home page, click Home. 

PWN_Admin_NavigationBreadcrumbs_HomeButton.png

  1. From the home page, click System Configuration. From the left side panel, click Services, then click the Manage Services option. The Manage Services Wizard appears. 
  2. To run the Manage Services Wizard for the Pentaho Worker Nodes service, select the Pentaho Worker Nodes service panel then click Next. The next step in the wizard, the Select Actions page, appears.

PWN_Admin_ManageServicesWizard_StepOne_SelectPWN.png

  1. On the Select Actions page, select Configure and then click Next. The Configuration page appears. 
  2. On the Configuration page, select the Settings tab. 

PWN_Admin_ManageServicesWizard_StepThree_Configuration_SettingTab.png

  1. On the Settings tab, in the Security Configurations section, click in the Enable security field to set it to ‘Yes’ so you can set security for the Pentaho Worker Nodes on your HCI instance.

 PWN_Admin_ManageServicesWizard_StepThree_Configuration_Settings_SecurityConfiguration.png

  1. In the Security Configuration section, fill in the following fields:
Field Description
Pentaho Server's IP

Optionally, to create an extra layer of security that will only allow requests originating from the Pentaho Server, enter the IP address of the Pentaho Server in this field. If you enter a value in this field, then only the IP address in this field is granted access to the Pentaho Worker Nodes and no other servers can connect.  

Note that the IP address for the Pentaho Server must be a single, well-formed IP address.
Username

Enter the user name that you want to assign for requests from the Pentaho Server. 

Note: Your user name cannot contain the following characters, nor any spaces:

" , # $ \
Password

Enter the password that you want to assign for requests from the Pentaho Server. 

Note: Your password cannot contain the following characters, nor any spaces:

" , # $ \
  1. When finished, click the Update Service button at the bottom of the Confirmation page. Allow several moments for the service to restart.

Configure Pentaho Server Settings

These actions set the user name and password for Worker Nodes security and enable a secure communication channel.

Perform the following steps:

  1. Navigate to the pentaho-server/pentaho-solutions/system/karaf/etc/ directory and open the pentaho.worker.nodes.cfg file with any text editor.
  2. Perform the associated action for each property listed in the table below:
Property Action Notes
wn-hostname Set the value to the IP address used in the Network: External section of the Pentaho-Worker-Nodes  services page.

For more information, see Step 5 in Configure the HCI Settings.
wn-port Set the value to the port number used in the PRIMARY_PORT field in the Network: External section of the Pentaho-Worker-Nodes services page. For more information, see Step 5 in Configure the HCI Settings.
wn-security-enabled Set the value to ‘true’.  
wn-username Set the value to match the value entered in the Username field of the System Configuration> Services> Manage Services> Pentaho-Worker-Nodes configuration settings page. For more information, see Step 12 in Configure the HCI Settings.
wn-password Set the value to match the value entered in the Password field of the System Configuration> Services> Manage Services> Pentaho-Worker-Nodes configuration settings page. For more information, see Step 12 in Configure the HCI Settings.
wn-use-https Set the value to ‘true’.  
wn-trust-store Uncomment (remove the hashtag (#) icon) the setting and set the value to the absolute path of the truststore file that contains the system certificate.   For more information, see Step 6 in Generate a Truststore Using the HCI System Certificate.
wn-trust-store-password Uncomment (remove the hashtag (#) icon) the setting and set the value to the truststore password.     For more information, see Step 6 in Generate a Truststore Using the HCI System Certificate.
  1. Save and close the pentaho.worker.nodes.cfg file. Your file changes take effect immediately.

Run and Administer the Pentaho Worker Nodes Product

Use the following articles to assist you in running and administering Pentaho Worker Nodes: