Skip to main content

Pentaho+ documentation has moved!

The new product documentation portal is here. Check it out now at docs.hitachivantara.com

 

Hitachi Vantara Lumada and Pentaho Documentation

Get records from stream

Parent article

This step returns records that were previously generated by another transformation in a job. The records were passed to this step using either the Copy rows to result step or the Transformation Executor step. You can enter the metadata of the fields you are expecting from the previous transformation in a job.

NoteThis step produces one or more rows and cannot be placed within a stream. It must be the first step in a stream since it produces rows. If you want to add this data to an existing stream, you need to use a join step.

General

  • Step Name: Specifies the unique name of the Get records from stream transformation step on the canvas. You can customize the name or leave it as the default.

Options

Get Records from Stream Options

The Fields table contains the following columns:

ColumnDescription
FieldnameName of the field that contains the records from the previous result.
Type

Type of data. Options include:

  • Number
  • String
  • Date
  • Boolean
  • Integer
  • BigNumber
  • Serializable
  • Binary
  • Timestamp
  • Internet Address
Length
  • For a field with the type of 'Number', enter the total number of significant figures in a number.
  • For a field with the type of 'String', enter the length of the string.
PrecisionFor a field with the type of 'Number', enter the number of floating point digits. Otherwise, leave blank.
NoteThere is no validation performed on this metadata; it is intended as an aid during design.

Metadata injection support

All fields of this step support metadata injection. You can use this step with ETL metadata injection to pass metadata to your transformation at runtime.