0 / 0
Filter stage: Stage tab (DataStage)

Filter stage: Stage tab (DataStage)

The Stage tab for the Filter stage enables you to control aspects of the Filter stage.

The Stage tab allows you to specify an optional description of the stage. The Properties section lets you specify what the stage does. The Advanced section allows you to specify how the stage executes.

Properties

The Filter stage has the following properties:
Table 1. Properties
Category/Property Values Default Mandatory? Repeats? Dependent of
Predicates/Where clause string N/A Y Y N/A
Predicates/Output link Output link N/A Y N Where clause
Options/Output rejects True/False False Y N N/A
Options/Output rows only once True/False False Y N N/A
Options/Nulls value Less Than/Greater Than Less Than N N N/A

Filter stage: Where clause

Specify a Where statement that a row must satisfy in order to be routed down this link. This is like an SQL Where clause, see "Specifying the Filter" for details.

Output link

Specify the output link corresponding to the Where clause.

Output rows only once

Set this to true to specify that rows are only output down the link of the first Where clause they satisfy. Set to false to have rows output down the links of all Where clauses that they satisfy.

Output rejects

Set this to true to output rows that satisfy no Where clauses down the reject link (remember to specify which link is the reject link on the parallel job canvas).

Nulls value

Specify whether null values are treated as greater than or less than other values.

Advanced

This section allows you to specify the following:

  • Execution Mode. The stage can execute in parallel mode or sequential mode. In parallel mode the input data is processed by the available nodes as specified in the Configuration file, and by any node constraints specified on the Advanced section. In Sequential mode the entire data set is processed by the conductor node.
  • Combinability mode. This is Auto by default, which allows IBM® DataStage® to combine the operators that underlie parallel stages so that they run in the same process if it is sensible for this type of stage.
  • Preserve partitioning. This is Set by default. You can explicitly select Set or Clear. Select Set to request the next stage should attempt to maintain the partitioning.
Generative AI search and answer
These answers are generated by a large language model in watsonx.ai based on content from the product documentation. Learn more