Test coverage metrics

This document provides descriptions and calculations for test coverage metrics and statuses used In TestOps.

Configuration Coverage Metrics

• Coverage Rate: % executed unique test cases per UCC (OS/Browser/OS + Browser)

                 Executed Unique Test Cases per UCC (OS + Browser)
Coverage Rate = ------------------------------------------------------------- × 100%
                                  Total Unique Test Cases

• Pass Rate: % passed unique executed test cases per UCC (OS/Browser/OS + Browser)

            Passed Unique Executed Test Cases per UCC (OS + Browser)
Pass Rate = --------------------------------------------------------- × 100%
             Total Unique Executed Test Cases per UCC (OS + Browser)

Requiremnet Coverage Statuses

• Not Covered: Requirements with no linked test cases (critical gaps)
• Partially Covered: Requirements with incomplete test coverage (linked published test cases)
• Fully Covered: Requirements with complete test coverage (linked test cases, all passed)

note

Requirement status may change from Fully Covered to Partially Covered if a test known to pass suddenly fails in the most recent run.

Requirement Coverage Metrics

• Test Coverage: % requirements with all test case published

                Count of requirements with all test cases published
Test Coverage = --------------------------------------------------- × 100%
                                Total requirements

• Execution Coverage: % requirements with all published test cases executed

                     Count of requirements with all published test cases executed
Execution Coverage= -------------------------------------------------------------- × 100%
                                            Total requirements

• Pass Coverage: % requirements with all published, executed test case passed

                  Count of requirements with all published, executed test case passed
Pass Coverage = ------------------------------------------------------------------------ × 100%
                                            Total requirements