Running manual tests

You can run a manual test script by running its associated test execution record.

Before you begin

Running a manual test requires a test case with an associated test script and one or more associated test execution records. These test execution records specify the execution environments for the test case. Thus, a test case that runs in the Firefox browser on a Windows® XP machine requires a different test execution record to run on a SUSE Linux® machine or to run in a different browser.

About this task

To a run a manual test:

Procedure

  1. Open an existing test case for which at least one test script and at least one test execution record have already been created.
  2. Click Test Execution Records.
  3. Select the test execution records that you want to run.
  4. Click the Run icon (Run).

    The Script Execution window displays, and an arrow is present to the left of the first statement.

  5. Step through the execution, one statement at a time, assigning a verdict to each statement after you perform it in the application that you are testing. The toolbar has five execution verdicts:
    • Pass (Pass)
    • Fail (Fail)
    • Inconclusive (Inconclusive)
    • Blocked (Blocked)
    • Error (Error)
    Note: In order to see the options for Blocked (Blocked) and Error (Error), click the arrow next to the Inconclusive (Inconclusive) icon.
  6. Enter the results of executing the step in the Actual Results field. To determine if a step is successful, compare the actual results with the expected results.
  7. Add an optional comment to one or several statements:
    1. From the toolbar, click the Add/Edit Comments icon (Comments).
    2. Type your comment in the Write Comments field, and click OK. The Comments icon (Comment) displays within each statement that has a comment.
      Note: If you want to display all comments inline, click the Show/Hide Comments Column (Show/Hide comments column) icon, and choose Show comments.
  8. Add an optional attachment to one or several statements. For example, you could create a screen shot of the application under test and attach it to the statement. To attach a file to a statement:
    1. From the toolbar, click the Attachments icon (Attachments). The Attachments View displays.
    2. Under the Result Attachments section, browse to the file, and click Open.
      Note: You can have multiple attachments for each step.
    3. Click OK. The Attachment icon (Attachment) displays within each statement that has an attachment.
  9. If you discover problems with the application under test, submit a defect:
    1. From the toolbar, click the Add New Defects icon (Add new defect). The Defects View displays.
    2. Many of the fields are populated with information from the test run. If necessary, edit the Defect form and click Save. The Defect icon (Defect) displays within each statement that has an defect.
  10. To assign the same verdict to all steps following the current step, click the Apply All icon (Apply all verdict), select a verdict from the dialog, and click OK.
  11. When the test run completes, click Close and show results at the top of the page to view the execution results.

    If necessary, you can modify the verdict and the weight distribution from the execution results. After you make an edit, be sure to click Save to save your changes.


Feedback