The score sheet is used by the evaluators to score the vendor's COTS package demonstration for each item defined in the
Vendor and Package Evaluation Workshop Description. The score sheet facilitates a
structured step-by-step flow through the vendor's demonstration of their COTS packages' capabilities.
Include in the score sheet the evaluation workshop agenda and schedule as a reference for both the evaluator and the
vendor. Its purpose is to remind both groups of the amount of time allotted for each demonstration area. Usually, there
is less time than there is function to demonstrate. Consequently, the schedule is included so all are aware of the
amount of time that the vendor has to demonstrate their COTS packages' capabilities in a functional area.
List in the score sheet the evaluators that are to participate in a given area. It is important to track the
participation of these evaluators so that the same evaluators will score all vendors. The same evaluators must
participate to maintain an objective score. The participants are listed to provide an easy way to track the required
evaluators.
List in the score sheet time allotted for each functional area. To obtain objective data, each vendor must have the
same time to demonstrate their product. The suggested time is listed so the vendor, with the facilitator's help, can
keep the demonstration on schedule.
Include a sequential numbering system for process area and functional area to help the vendor and evaluators identify
scripted areas being shown. The vendor will use these numbers as a reference, so the evaluators will know what function
is being demonstrated.
Include item descriptions that identify each function that is being scored. These descriptions are contained in the
Vendor and Package Evaluation Workshop Description and based on the critical use cases and critical nonfunctional
requirements. The listed item descriptions will ensure that an evaluator's score reflects how the demonstrated COTS
package supports these requirements.
|