Running PDI-CLI on GCP

Prerequisites for installing PDI-CLI on GCP

The following software must be installed on your workstation before installing PDI-CLI:

The PDI is needed to connect to the Carte Server for testing.
A stable version of Docker must be installed on your workstation. See Docker documentation.

Use the following steps to deploy PDI-CLI on the GCP cloud platform:

Download and open the package files that contain the files needed to install Pentaho.

Procedure

Navigate to the Support Portal and download the GCP version of the Docker image with the corresponding license file for the applications you want to install on your workstation.

NoteMake note of the image name for later.

Extract the image into your local Docker registry.

The image package file (<package-name>.tar.gz) contains the following:

Name	Content description
image	Directory containing all the Pentaho source images.
yaml	Directory containing YAML configuration files and various utility files.
README.md	File containing a link to detailed information about what we are providing for this release.

Before pushing the Pentaho image to GCP, you need to create a Docker registry in GCP.

Procedure

Create a Docker registry in GCP.
For instructions, see Store Docker container images in Artifact Registry.
Connect to the Docker registry using the following command:
```
gcloud auth configure-docker <YOUR_REGION>-docker.pkg.dev
```
To verify that the registry has been added correctly, run this command:
```
cat ~/.docker/config.json
```
Record the name of the registry that you have created in the Worksheet for GCP hyperscaler.

Perform the following steps to load and push the Pentaho Docker image to GCP:

Procedure

Navigate to the image directory containing the Pentaho tar.gz files.
Select and load the tar.gz file into the local registry by running the following command:
```
docker load -i <pentaho-image>.tar.gz
```
Record the name of the source image that was loaded into the registry by using the following command:
```
docker images
```
Tag the source image so it can be pushed to the cloud platform by using the following command:
```
docker tag <source-image>:<tag> <target-repository>:<tag>
```
Push the image to the GCP registry using the following command:
```
docker push <IMAGE_NAME>
```
Verfiy that the image has been properly loaded using the Google Cloud Console.

Create a Google Cloud Storage bucket and place your configuration files in any directory path in the bucket.

In these instructions, the following path is used as an example: gs://pentaho-project/my-bucket.

Perform the following steps to create and populate a Google Cloud Storage bucket:

Procedure

Create a Cloud Storage bucket as explained in the GCP documentation.
Add the Kettle transformation (KTR) and job (KJB) files that you want to use to the bucket.
If any of your jobs or transformations use VFS connections to the Google Storage buckets, perform the following steps:
1. Upload a copy of your GCS credentials file to the Google Storage bucket.
  For example gs://pentaho-project/my-bucket/<credentials-file>.json
2. Update any VFS connections that use this credentials file to point to the following path: /home/pentaho/data-integration/data/<credentials-file>.json
Copy your local .pentaho/metastore folder to the Google Storage bucket.
The .pentaho/ folder is located in the user home directory by default.
NoteYou must edit your GCS VFS connections before copying the .pentaho/ folder. If you need to change the VFS connections, upload the GCS credentials file and update any associated GFS connections again.
Copy any license files (*.lic) needed for the product(s) you will be using to the location specified by PROJECT_GCP_LOCATION.

Procedure

Navigate to Batch for Google Cloud at job creation and execution overview.
See instructions for running a GCP batch job at Job creation and execution overview.

Set the following environment variables in the Docker container:

Variable	Description
METASTORE_LOCATION	gs://pentaho-project/my-bucket/
PROJECT_GCP_LOCATION	gs://pentaho-project/my-bucket/
PROJECT_STARTUP_JOB	my-transformation.ktr Must be uploaded to your bucket. See Create a Google Cloud Storage bucket.
CREDENTIAL_FILE	<credentials-file>.json This is the credentials file described in Create a Google Cloud Storage bucket.
PARAMETERS (optional)	Any additional parameters to be passed to Kitchen or Pan.

Use the following worksheet for important information needed during installation and configuration of Pentaho.