IBM Tivoli Software IBM Tivoli Software

[ Bottom of Page | Previous Page | Next Page | Contents | Index ]


Overview

The following sections provide an overview of Tivoli(R) Data Warehouse and the warehouse pack for Tivoli Enterprise Console(R).

Overview of Tivoli Data Warehouse

Tivoli Data Warehouse provides the infrastructure for the following:

As shown in Figure 1, Tivoli Data Warehouse consists of a centralized data store where historical data from many management applications can be stored, aggregated, and correlated.

Figure 1. Tivoli Data Warehouse basic architecture
Tivoli Data Warehouse basic architecture

The central data warehouse uses a generic schema that is the same for all applications. As new components or new applications are added, more data is added to the database; however, no new tables or columns are added in the schema.

A data mart is a subset of a data warehouse that contains data that is tailored and optimized for the specific reporting needs of a department or team.

The central data warehouse ETL reads the data from the operational data stores of the application that collects it, verifies the data, makes the data conform to the schema, and places the data into the central data warehouse.

The data mart ETL extracts a subset of data from the central data warehouse, transforms it, and loads it into one or more star schemas, which can be included in data marts to answer specific business questions.

A program that provides these ETLs is called a warehouse pack.

The ETLs are typically scheduled to run periodically, usually during non-peak hours.

Overview of the Tivoli Enterprise Console warehouse pack

The Tivoli Enterprise Console product is a rule-based event management application that integrates system, network, database, and application management to help ensure the optimal availability of the IT resources in an enterprise. The Tivoli Enterprise Console product collects, processes, and automatically responds to common management events, such as a database server that is not responding, a lost network connection, or a successfully completed batch processing job. These events are stored in a relational database called the event database.

The base warehouse pack stores raw Tivoli Enterprise Console events in the Tivoli Data Warehouse. A raw event is an event that is generated by a source. The base warehouse pack stores the raw base attribute event information and it maps all of the values to event attributes in the Tivoli Data Warehouse. New to this fix pack, customer-selected extended attribute information is stored in the Tivoli Data Warehouse, except for the fully qualified hostname, fqhostname (which is processed as a base attribute).

Event information in the reports can be used for current problem diagnosis and for future problem trend analysis.

When the warehouse pack is installed, the following extract, transform, and load (ETL) processes are installed on the control server in the EC2_Tivoli_Enterprise_Console_v3.9.0_Subject_Area:

Process
Description
EC2_m05_ETL2_Initialization_Process
This process extracts the initial translated event status and severity data from the TWG.TRANSLATED_TERM table and stores it in the data mart severity dimension table and status dimension table.
EC2_c05_ETL1_Process
This process extracts the raw events from the Tivoli Enterprise Console event database, transforms the data, and stores it in the Tivoli Data Warehouse central data warehouse database.
EC2_m10_ETL2_Process
This process extracts event data from the central data warehouse, transforms the data to fit into the Tivoli Enterprise Console 3.9 data mart schema, loads the data into the data mart, and removes obsolete data as specified by a customer-specified pruning duration.

For more information, see ETL Processes.

The source of event data for the warehouse pack is the event database. The default name of the ODBC driver connection to the event database is TEC. If your event database is not a DB2 database, see Configuring database client drivers for information about installing and configuring your ODBC driver.

Source event information is contained in the following tables and views in the event database:

tec_t_evt_rep
Contains the base attributes of the events.
tec_t_status_event
Contains the mappings for the status of the events.
tec_t_severity
Contains the mappings for the severity of the events.
tec_t_slots_evt
Contains the extended attributes of the events.
tec_evt_filter
Contains the event classes that are moved by the central data warehouse ETL from the source database to the central data warehouse database.
tec_t_exts_filter
Contains the extended attributes that are moved by the central data warehouse ETL from the source database to the central data warehouse database.
Note:
You can use the DB2 Data Warehouse Center to view or sample the source event data in the tables if your event database is a DB2 database. However, you must modify the name of the table before you can view or sample the source event data if your event database is not a DB2 database. For the procedure to modify the schema name, see Changing the schema name.

The following types of data are stored in the central data warehouse:

This warehouse pack contains predefined reports that provide information about the base event information. For more information about the predefined reports that are provided, see Reports.

Data sources and targets

A source database contains the information that an ETL uses and a target is the database in which the output data from the ETL is stored.

The Tivoli Enterprise Console warehouse pack the central data warehouse ETL supports multiple event database sources; therefore, the EC2_TEC_Source can point to multiple event databases.

The Tivoli Enterprise Console warehouse pack uses the following data sources and targets:

Table 1. Data sources and targets
Name in DB2 Data Warehouse Center Description
EC2_TEC_Source This data source points to one or more event databases.
EC2_TWH_CDW_Source This data source points to the TWH_CDW database. It is used for central data warehouse ETL processing.
EC2_TWH_CDW_Target This data source points to the TWH_CDW database. It is used for central data warehouse ETL processing.
EC2_TWH_MART_Source This data source points to the TWH_MART database. It is used for data mart ETL processing.
EC2_TWH_MART_Target This data source points to the TWH_MART database. It is used for data mart ETL processing.

[ Top of Page | Previous Page | Next Page | Contents | Index ]