0 / 0

External Source stage: fast path (DataStage)

Last updated: Mar 12, 2025
External Source stage in DataStage: fast path

This section specifies the minimum steps to take to get an External Source stage functioning.

Procedure

  • On the Output tab, in the Properties section, complete the following steps:
    • Specify whether the stage is providing details of the program (the default) or whether details will be provided in a file (by using the latter method, you can provide a list of files and arguments).
    • If you are using the default source method, specify the name of the source program executable. You can also specify required arguments that DataStage® will pass when it calls the program. Repeat this step to specify multiple program calls.
      You can use the following commands as values for the program:
      • cat
      • tar
      • gzip
      • gunzip
      • mailx
      • sendmail
      • grep
      • sed
      • base64
    • If you are using the program file source method, specify the name of the file that contains the list of program names and arguments.
    • Specify whether to maintain any partitions in the source data (False by default).
    • Specify how to treat rejected rows (by default the stage continues and the rows are discarded).
  • On the Output tab, in the Format section, complete the following steps:
    • Specify format details for the source data you are reading from, or accept the defaults (variable length columns that are enclosed in double quotation marks and delimited by commas, rows that are delimited with UNIX newlines).
    • Ensure that column definitions are specified (you can use a schema file for this if required).