Rational Quality Manager integration overview

Integration with IBM® Rational® Quality Manager is implemented through the use of an adapter. The adapter is installed by default when you install either IBM Rational Performance Tester or Rational Service Tester for SOA Quality and is configured on the test machine.

The adapter can be run in three modes:

Note: The term test workbench refers to either Rational Performance Tester or Rational Service Tester for SOA Quality.

Using Rational Quality Manager

See the Rational Quality Manager Information Center for detailed information about using Rational Quality Manager.

Viewing results

When you run a test script from Rational Quality Manager, the default report that is displayed during a test run is attached to the Rational Quality Manager results. This report can be customized. See Customizing reports for more information.

If you use Rational Quality Manager version 4.0 or later, you can view and analyze Rational Performance Tester test reports in Rational Quality Manager. You can analyze the test reports while the test is in running state and after the run is completed. To view the test reports in Rational Quality Manager, in the Execution Results dialog box click Analyze Results Interactively using Rational Performance Tester .
Note: To access reports from outside Rational Performance Tester workbench, you must enable the access from workbench. For more information, see the Access reports remotely topic.

You can also view the full run results from within the test workbench by opening the test workbench in the workspace that is configured to be used by the adapter. Additionally, if you are running a Rational Performance Tester schedule with performance requirements, the Performance Requirements report for the last user stage of the schedule is attached to the Rational Quality Manager results.

For Rational Service Tester for SOA Quality service tests and Rational Performance Tester performance tests, the result completion state that is reported to Rational Quality Manager reflects the overall verdict of the test log that is associated with the run. See Test log overview for more information. In many cases a test might contain a failed verification point, but still be considered as passed. View the attached report in the Rational Quality Manager execution result and set the execution results status accordingly.

For Rational Performance Tester schedules, the result completion state that is reported to Rational Quality Manager is based on the overall Performance Requirements status. Only performance requirements for the last user stage that is defined in the schedule are covered by the report. If no performance requirements are specified, the result completion state in Rational Quality Manager is set to inconclusive. In this case, view the attached performance reports and manually set the completion state in Rational Quality Manager. See Defining performance requirements in schedules for more information.

If the adapter is running from the command line or as a Windows service, stop the adapter before opening the test workbench. When the workbench is opened, you can access the full test reporting and test log capabilities. Results for runs that are initiated from Rational Quality Manager are under the Rational Quality Manager Results project.

Troubleshooting

All modes of the adapter use the Eclipse error log. You can view the log by opening the workbench and clicking Window > Show View > Error Log. By default, warning and error messages are logged. You can turn on more detailed logging for the adapter by clicking Window > Preferences > Logging. The log component for the adapter is named com.ibm.rational.test.lt.rqm.adapter.

If you are running the adapter as a Windows service or from the command line, you can view the adapter.log file without opening the test workbench.

Problem Solution or cause
Where do you look for errors or warnings? In the workbench, click Window > Show View > Error Log.
You do not see the adapter available for selection.
  • Verify that the Rational Quality Manager server address that is provided to the adapter is correct. Provide the correct address.
  • Check the provided login and password. Provide the correct password.
The adapter continuously fails to connect to Rational Quality Manager. Make sure that the server is running. If necessary, restart the server or check network connectivity.
The adapter is displayed as red in the selection dialog box.
  • The adapter is not communicating with the server.
  • The adapter might already be in use.
You attempt to import a script from the adapter but no scripts are found.
  • Make sure the project path that is entered in Rational Quality Manager is a project under the workspace that is associated with the running adapter. You have to enter only the project name. This is less error prone than typing the complete project path, but either forms are acceptable.
  • If running from the command line or as a service, be certain the WORKSPACE_DIR environment variable that is set in the adapter.config file is the same path as seen in the select workspace dialog box when running the test workbench. Be careful not to set the path to a project folder under the workspace directory.
  • Make sure that you are not using a workspace that contains a project that was copied from a shared location. A workspace that contains projects from shared locations cannot be used for projects that are not shared.
The adapter is running from the command line or as a service, and tests continue to fail. Run the adapter in GUI mode so that you can see what happens when the test workbench runs the test script.
Adapter Windows services does not start. A error message states that the service failed to start in a timely fashion. Ensure that the computer has .NET 2.0 or later. This platform can be installed from the Windows Update Site or manually. For more information on installing .NET, see http://support.microsoft.com/kb/923100.
When testing shared assets, the execution fails with and an IOException message is displayed. The most likely cause is that the Rational Quality Manager to UNC shared location is not set up correctly.
  • From Rational Quality Manager, ensure that you can access the UNC shared directory without being prompted for a password. You might have to map a drive on Windows for the Rational Quality Manager system to log into the UNC share.
  • Ensure that you have defined the shared resource in Rational Quality Manager under Admin > System Properties > Resources.
  • Ensure that the test-script points to a shared location that still exists. If you have associated a Rational Quality Manager test script with a shared location that has changed (for example if the IP address has been reassigned) you might need to reassociate every test script
  • Ensure that the UNC shared directory that is specified in Rational Quality Manager points to a project.
When testing shared assets, the execution fails with a low level model error. Ensure that the Rational Performance Tester adapter has the required protocol extensions installed. The test assets located on the shared location can only be run on an adapter workspace that supports those protocols.
Service tests that were created in a previous version of Rational Performance Tester or Rational Service Tester for SOA Quality cannot be run. Upgrade every SOA asset to the latest version.
The adapter cannot connect to the server, and one of the following error messages is displayed:
  • Communications error with server
  • Error occurred while registering the adapter
  • When using Rational Performance Tester 3.0 or later, the server URL that is configured for the adapter must exactly match the public URI of the Rational Performance Tester server. The server public URI is available on the Rational Performance Tester administration page. By default the administration page is at https://servername:9443/qm/admin.
  • The adapter user must be a member of the Rational Performance Tester project area. Open the project area administration page on the Rational Performance Tester server to determine whether the adapter user is a member of the project area. For Rational Performance Tester 3.0 and later, the adapter user must be a member in the test team member role, not the test team contributor role. This error can also occur if you have modified these roles from their defaults.

Known limitations


Feedback