0 / 0
Remove Duplicates stage in DataStage: fast path

Remove Duplicates stage: fast path

This section specifies the minimum steps to take to get a Remove Duplicates stage functioning.

To use a Remove Duplicates stage:

  • Double-click the stage to open the stage editor. On the Stage tab, go to the Properties section. Select the key column. Identical values in this column will be taken to denote duplicate rows, which the stage will remove. Repeat the property to specify a composite key.
  • On the Output tab, click Edit in the columns section and in the Maps from column input column, specify how output columns are derived.
Generative AI search and answer
These answers are generated by a large language model in watsonx.ai based on content from the product documentation. Learn more