Creating a Report
QualityWatcher allows you to create reports based on a test run or test run plan. Reports provide greater insight into how a test run or test run plan performed, as well as a more holistic view of the pertinent information a tester, project manager, or business user, etc. would like to see at first glance. A report consists of three sections:
QualityMeter
Execution Summary
Suites Summary (Test Runs) or Configuration Summary (Test Run Plans)
Creating a Report for a Test Run
Creating a New Report in QualityWatcher |
Give your report a name and select a test run from the test run dropdown list. |
Creating a New Report in QualityWatcher |
Newly Created Report (Overview View) |
QualityMeter​
The QualityMeter section contains a QualityMeter at the top that gives a quality measurement for the application under testing. With this tool, your development and leadership teams will have a better understanding of what to expect regarding the quality of each build/release. Below the QualityMeter, you will see a count and a list of any test case deemed as a P1 that failed in the test run (High priority failed test cases). Click on the “View test case“ link to see the details about the failed test case.
QualityMeter Section |
Failed Test Case Details |
Execution Summary​
The Execution Summary section provides and displays a detailed breakdown and count of all the test cases in the test run based on their status.
Suites Summary​
The Suites Summary section provides a detailed breakdown of the test run results on a per test suite basis. You can click on any test suite or the “View detailed breakdown” link in the Execution Summary to switch from the “Overview“ view to the “Suites” view.
Suites View |
Filtering in the Suites View |
Filtering in the Suites View |
Creating a Report for a Test Run Plan
Creating a New Report in QualityWatcher |
Creating a New Report in QualityWatcher |
Click Generate to create the report. |
Configuration Summary​
The overview for a report generated for a test run plan is very similar to that of a test run. The only difference is the Suites Summary section is changed to Configuration Summary and the Suites tab is also changed to tabs for each configuration.
Newly Created Report (Overview View) |
Configuration Breakdown |
The Configuration Summary section details the types and statuses of each configuration in the test run plan. A breakdown of the different test suites and test cases is displayed after opening one of the configuration tabs.