Generating Incremental ETL Processes Automatically

Incremental ETL processes are used for the incremental maintenance of data warehouses, which is generally designed by users with ETL tools. Using existing methods of incremental maintenance of materialized views for reference, we put forward an approach to generate an incremental ETL process automatically from the full ETL process in this paper. Existing researches are focused on the incremental maintenance of materialized views in such circumstances which involve the operators of selection, projection, join and aggregation but difference operators excluded. Since difference operators are used frequently in an ETL process, we first discuss incremental maintenance of materialized views defined with difference operators in detail