Skip to main content

Creating a Report

QualityWatcher allows you to create reports based on a test run or test run plan. Reports provide greater insight into how a test run or test run plan performed, as well as a more holistic view of the pertinent information a tester, project manager, or business user, etc. would like to see at first glance. A report consists of three sections:

  • QualityMeter

  • Execution Summary

  • Suites Summary (Test Runs) or Configuration Summary (Test Run Plans)

Creating a Report for a Test Run

Creating a New Report in QualityWatcher
Creating a New Report in QualityWatcher
Give your report a name and select a test run from the test run dropdown list.
Give your report a name and select a test run from the test run dropdown list.
Creating a New Report in QualityWatcher
Creating a New Report in QualityWatcher
Newly Created Report (Overview View)
Newly Created Report (Overview View)

QualityMeter​

The QualityMeter section contains a QualityMeter at the top that gives a quality measurement for the application under testing. With this tool, your development and leadership teams will have a better understanding of what to expect regarding the quality of each build/release. Below the QualityMeter, you will see a count and a list of any test case deemed as a P1 that failed in the test run (High priority failed test cases). Click on the “View test case“ link to see the details about the failed test case.

QualityMeter Section
QualityMeter Section
Failed Test Case Details
Failed Test Case Details

Execution Summary​

The Execution Summary section provides and displays a detailed breakdown and count of all the test cases in the test run based on their status.

Execution Summary

Suites Summary​

The Suites Summary section provides a detailed breakdown of the test run results on a per test suite basis. You can click on any test suite or the “View detailed breakdown” link in the Execution Summary to switch from the “Overview“ view to the “Suites” view.

Suites Summary

Suites View
Suites View
Filtering in the Suites View
Filtering in the Suites View
Filtering in the Suites View
Filtering in the Suites View

Creating a Report for a Test Run Plan

Creating a New Report in QualityWatcher
Creating a New Report in QualityWatcher
Give your report a name and select a test run plan from the test run dropdown list.
Creating a New Report in QualityWatcher
Click Generate to create the report.
Click Generate to create the report.

Configuration Summary​

The overview for a report generated for a test run plan is very similar to that of a test run. The only difference is the Suites Summary section is changed to Configuration Summary and the Suites tab is also changed to tabs for each configuration.

Newly Created Report (Overview View)
Newly Created Report (Overview View)
Configuration Breakdown
Configuration Breakdown

The Configuration Summary section details the types and statuses of each configuration in the test run plan. A breakdown of the different test suites and test cases is displayed after opening one of the configuration tabs.