Task: Manage the Measurement System
This task identifies the day-to-day items that need to be accomplished to support the efficient and effective use of a performance measurement system.
Disciplines: Software Capability Improvement
Purpose
To support the ongoing use of the performance measurement system.
Relationships
RolesPrimary Performer: Additional Performers:
InputsMandatory:
    Optional:
    • None
    Outputs
      Main Description

      To efficiently use a performance measurement system, you must manage it daily.

      Although you will gather metrics, not all metrics identified in a measurement plan will be available nor useful at the beginning of the deployment. For example, in the context of a project lifecycle, code- and testing-related metrics will not be available yet. As you begin to collect these metrics, they are most useful to those who are working on the project. Metrics related to practice adoption and artifacts provide the first look at the effects of any change driven by the IT organization. Operational- and business-related metrics are aggregations, typically, so they are more useful as more collection points are included.

      Analyze measurement data at the project and organizational levels according to documented analysis procedures for each metric. Monitor results against defined operational objectives in order to assess the results of capability improvements.

      Ensure that reports are run on the appropriate timings.

      Also, mentoring will be required as new individuals begin to use the performance measurement system. This mentoring will address specific issues with the current tasks that individuals are performing.

      Validation of the impact of the measurement system can occur only with constructive feedback. As the measurement system is deployed to a broader user base, those responsible for maintaining the whole system for an IT organization become more removed from the day-to-day use by the various personnel and teams.

      It is crucial to seek feedback, rather than simply expecting it to come to you. Unfortunately, it is human nature to dislike change. Therefore, those who are responsible for the IT measurement system need to evaluate the relevance and value of the input before modifying the system. Decisions for modifying any portion of the measurement system should be based on whether or not the organizational and business objectives are being met or not. Although everyone that provides feedback should be thanked, personal likes and dislikes are of less importance than the needs of the organization and business.

      Key Considerations

      As you begin to collect measurement data, establish and maintain baselines of the organization's process performance to support analysis efforts.

      Variance in performance of the organization's processes due to project tailoring should be taken into consideration as baselines are created.  Categorize baseline subgroups according to tailoring factors and criteria such as project size and complexity. Confirm baseline approach with stakeholders and revise as needed.

      More Information