Rational Quality Manager integration overview

Integration with IBM® Rational® Quality Manager is implemented through the use of an adapter. The adapter is installed by default when you install either IBM Rational Performance Tester or Rational Service Tester for SOA Quality and is configured on the test machine.

The adapter can be run in three modes:

Note: The term test workbench refers to either Rational Performance Tester or Rational Service Tester for SOA Quality.

Using Rational Quality Manager

Refer to the Rational Quality Manager information center for detailed information on using Rational Quality Manager.

Viewing results

When you run a test script from Rational Quality Manager, the default report that is displayed during a test run is attached to the Rational Quality Manager results. This report can be customized. See Customizing reports for more information. You can also view the full run results from within the test workbench by opening the test workbench in the workspace configured to be used by the adapter. Additionally, if you are running a Rational Performance Tester schedule with performance requirements, the Performance Requirements report for the last user stage of the schedule will be attached to the Rational Quality Manager results.

For Rational Service Tester for SOA Quality service tests and Rational Performance Tester performance tests, the result completion state reported to Rational Quality Manager reflects the overall verdict of the test log associated to the run. See Test log overview for more information. In many cases a test may contain a failed verification point, but still be considered as passed. You should view the attached report in the Rational Quality Manager execution result and set the execution results status accordingly.

For Rational Performance Tester schedules, the result completion state reported to Rational Quality Manager is based on the overall Performance Requirements status. Only performance requirements for the last user stage defined in the schedule are covered by the report. If no performance requirements are specified, the result completion state in Rational Quality Manager will be set to inconclusive. In this case, you should view the attached performance reports and manually set the completion state in Rational Quality Manager. See Defining performance requirements in schedules for more information.

If the adapter is running from the command-line or as a Windows service, stop the adapter before opening the test workbench. When the workbench is opened, you can access the full test reporting and test log capabilities. Results for runs initiated from Rational Quality Manager can be found under the Rational Quality Manager Results project.

Troubleshooting

All modes of the adapter use the Eclipse error log. You can view the log by opening the workbench and clicking Window > Show View > Error Log. By default, warning and error messages are logged. You can turn on more detailed logging for the adapter by clicking Window > Preferences > Logging. The log component for the adapter is named com.ibm.rational.test.lt.rqm.adapter.

If you are running the adapter as a Windows service or from the command-line, you can view the adapter.log file without opening the test workbench.

Problem Solution or cause
Where do you look for errors or warnings? In the workbench, click Window > Show View > Error Log.
You do not see the adapter available for selection.
  • Verify that the Rational Quality Manager server address provided to the adapter is correct. Provide the correct address.
  • Check the login and password provided. Provide the correct password.
The adapter continuously fails to connect to Rational Quality Manager. Make sure that the server is running. If necessary, restart the server or check network connectivity.
The adapter shows up red in the selection dialog.
  • The adapter is not communicating with the server.
  • The adapter may already be in use.
You attempt to import a script from the adapter but no scripts are found.
  • Make sure the project path entered in the Rational Quality Manager is a project under the workspace associated with the running adapter. You need only to enter the project name. This is less error prone than typing the complete project path, but either forms are acceptable.
  • If running from the command-line or as a service, be certain the WORKSPACE_DIR set in adapter.config is the same path as seen in the select workspace dialog when running the test workbench. Be careful it's not set to a project folder under the workspace directory.
  • Make sure that you are not using a workspace containing a project that was copied from a shared location. A workspace containing projects from shared locations cannot be used for projects that are not shared.
The adapter is running from the command line or as a service and tests continue to fail. Run the adapter in GUI mode so that you can see what happens when the test workbench runs the test script.
Adapter Windows services does not start. A error message states that the service failed to start in a timely fashion. Ensure that the machine has .NET 2.0 or later. This platform can be installed from the Windows Update Site or manually. For more information on installing .NET, see http://support.microsoft.com/kb/923100.
When testing shared assets, the execution fails with an IOException. The most likely cause is that the Rational Quality Manager to UNC shared location is not setup correctly.
  • From Rational Quality Manager, ensure that you can access the UNC shared directory without being prompted for a password. You may have to map a drive on Windows for the RQM system to log into the UNC share.
  • Ensure that you have defined the shared resource in Rational Quality Manager under Admin > System Properties > Resources.
  • Ensure that the test-script points to a shared location that still exists. If you have associated a Rational Quality Manager test-script with a shared location that has changed (for example if the IP address has been reassigned) you might need to reassociate every test-script
  • Ensure that the UNC shared directory specified in Rational Quality Manager points to a project.
When testing shared assets, the execution fails with a low level model error. Ensure that the Rational Performance Tester adapter has the required protocol extensions installed. The test assets located on the shared location can only be run on an adapter workspace that supports those protocols.
Service tests created in a previous version of Rational Performance Tester or Rational Service Tester for SOA Quality are unable to execute. Upgrade every SOA asset to the latest version.

Known limitations


Feedback