Customizing the extract, transform, and load (ETL) process

The steps to customize the extract, transform, and load (ETL) process can be grouped under the following four stages: requirements, analysis, development, and deployment. This topic gives conceptual information of these four stages.
  1. Requirements

    At the requirements stage, you analyze the business requirement; for example, what need to be measured, what kind of reports are needed, what is the source for the data, and so on.

  2. Analysis
    At the analysis stage, you analyze the gaps between the default data warehouse schema and sample ETL builds and reports, and your requirements. For example:
    • You might need to customize the data warehouse schema if the default data warehouse schema does not satisfy your business requirements.
    • You might need to customize the data configuration files if the schema of your data source is different from what is implemented in the samples.
    • You might need to customize the ETL catalog if you want to load additional data on your data warehouse or populate your customized dimensions and facts.
    • You might need to customize the Framework Manager projects if you changed the data warehouse schema and want the changes to be reflected in the reports.
  3. Development

    At the development stage, you create the customized scenarios identified at the analysis stage, and test and verify the changes.

    How to implement some of the example scenarios listed as examples in the analysis stage are covered in the Tutorials.
  4. Deployment

    At the deployment stage, you deploy the changes to the data service server.


Feedback