Skip to main content

Pentaho+ documentation has moved!

The new product documentation portal is here. Check it out now at docs.hitachivantara.com. 

 
Version Data Integration and Analytics
Hitachi Vantara Lumada and Pentaho Documentation

AEL logging

  1. Last updated
  2. Save as PDF

Parent article

You can view logging information for transformations and jobs which are executed on the Adaptive Execution Layer (AEL). AEL logging provides information on details such as a step’s tuning options, global settings, and what cluster the step ran on. AEL logging uses the Spring Boot framework which can be customized for your environment. For instructions on customizing the Spring Boot framework, see the Spring Boot Reference Documentation.

Parent Topic
Child Topics

Activating AEL logging
AEL logging is installed and activated by default. To deactivate AEL logging, you will need to modify the application.properties file as described in the following instructions. Verify that you have the appropriate permissions to read, write, and execute commands in the following directories in the instructions.

Procedure

  1. Log on to the cluster and stop the AEL daemon as described in Step 6 of Configure the AEL daemon for YARN mode.

  2. Navigate to the design-tools/data-integration/adaptive-execution/config directory and open the application.properties file.

  3. Locate the following line of code: logging.config=./config/logback.xml

  4. Add comment tags for this line of code.

  5. Save and close the file.

  6. Restart the AEL daemon as described in Step 6 of Configure the AEL daemon for YARN mode

Parent Topic

Configuring AEL logging

When a log file reaches its maximum size, a new log file is created and the logging data is written to the new file. When the maximum number of log files is reached, the oldest log file is deleted and a new one is created.

The maximum log size is 10MB by default and the maximum number of stored logs is 10 by default. You can modify the log rotation parameters in the logback.xml file.

Parent Topic
Child Topics

Modify the XML file
The logback.xml file controls the size and number of the log files. Perform the following steps to modify the logback.xml file:

Procedure

  1. 1. Log on to the cluster and stop the AEL daemon as described in Step 6 of Configure the AEL daemon for YARN mode.

  2. 2. Navigate to the design-tools/data-integration/adaptive-execution/config directory and open the logback.xml file.

  3. 3. Edit the following settings:

    • maxFileSize

      The rotation file size. The maximum size of each log file is 10MB (default).

    • minIndex and maxIndex

      The number of log files in use. The maximum number of log files is 10 (default). The minimum number of log files is 0.

  4. 5. Save and close the file.

  5. Restart the AEL daemon as described in Step 6 of Configure the AEL daemon for YARN mode

Parent Topic