Job design that uses a DataStage® Slowly Changing Dimension stage
Each Slowly Changing Dimension (SCD) stage processes a single dimension, but job design is flexible. You can design one or more jobs to process dimensions, update the dimension table, and load the fact table.
- Processing dimensions
- You can create a separate job for each dimension, one job for all dimensions, or several jobs, each of which has several dimensions.
- Updating dimensions
- You can update the dimension table as the job runs by linking the SCD stage to a database stage, or you can update the dimension table later by sending dimension changes to a flat file that you use in a separate job. Actual dimension changes are applied to the lookup table in memory and are mirrored to the dimension update link, giving you the flexibility to handle a series of changes to the same dimension row.
- Loading the fact table
- You can load the fact table as the final step of the job that updates the last dimension, or in a separate job.