Skip to main content

Test coverage metrics

This document provides descriptions and calculations for test coverage metrics and statuses used In Katalon True Platform.

Configuration Coverage Metrics​

  • Coverage Rate: % executed unique test cases per UCC (OS/Browser/OS + Browser)
                 Executed Unique Test Cases per UCC (OS + Browser)
Coverage Rate = ------------------------------------------------------------- × 100%
                                  Total Unique Test Cases
  • Pass Rate: % passed unique executed test cases per UCC (OS/Browser/OS + Browser)
            Passed Unique Executed Test Cases per UCC (OS + Browser)
Pass Rate = --------------------------------------------------------- × 100%
             Total Unique Executed Test Cases per UCC (OS + Browser)

Requiremnet Coverage Statuses​

  • Not Covered: Requirements with no linked test cases (critical gaps)
  • Partially Covered: Requirements with incomplete test coverage (linked published test cases)
  • Fully Covered: Requirements with complete test coverage (linked test cases, all passed)
note

Requirement status may change from Fully Covered to Partially Covered if a test known to pass suddenly fails in the most recent run.

Requirement Coverage Metrics​

  • Test Coverage: % requirements with all test case published
                Count of requirements with all test cases published
Test Coverage = --------------------------------------------------- × 100%
                                Total requirements
  • Execution Coverage: % requirements with all published test cases executed
                     Count of requirements with all published test cases executed
Execution Coverage= -------------------------------------------------------------- × 100%
                                            Total requirements
  • Pass Coverage: % requirements with all published, executed test case passed
                  Count of requirements with all published, executed test case passed
Pass Coverage = ------------------------------------------------------------------------ × 100%
                                            Total requirements
Was this page helpful?

Table of Contents