Data Integration Operations Mart
The Data Integration Operations Mart is a centralized data mart that stores job or transformation log data for auditing, reporting, and analysis. You can use the Data Integration Operations Mart to collect and query Data Integration log data. Then use the Pentaho Server tools to examine the log data in reports, charts, and dashboards.
The data mart is a collection of tables organized as a data warehouse using a star schema. Together, the dimension tables and a fact table represent the logging data. These tables must be created in the Data Integration Operations Mart database. Pentaho provides SQL scripts to create these tables for the PostgreSQL database. A Data Integration job populates the time and date dimensions.
Instructions for installing the DI Ops Mart depend on the method you used to install Pentaho:
Installing DI Ops Mart for a Pentaho Archive Installation.
Installing DI Ops Mart for a Pentaho Manual Installation.
Charts, reports, and dashboards using the DI Operations Mart data
To help understand the contents of the log, see Data Integration Operations Mart Reference.
Clean up DI Operations Mart tables
Perform the following steps to clean up the DI Operations Mart:
Procedure
Using the PDI client (Spoon), open either Clean_up_PDI_Operations_Mart.kjb for jobs or the Clean_up_PDI_Operations_Mart_fact_table.ktr for transformations.
Set the following parameters:
max.age.days (required)
The maximum age in days of the data.
schema.prefix (optional)
For PostgreSQL databases, enter the schema name followed by a period (.). This prefix is applied to the SQL statements. For other databases, leave the value blank.
Run the job or transformation.
Running the job or transformation deletes the data that is older than the maximum age from the data mart.
Next steps