Quick Guide for Users
This Quick Guide aims to help you understand and focus on the analytics features that matter most to your role, as a Product Owner, QA Manager, Automation Engineer, or Manual Tester.
Each section highlights the analytics features and documents most relevant to your responsibilities.
Product Owner​
As a Product Owner or Product Manager, or Business Analyst, you use TestOps analytics to track requirement validation, assess release readiness, monitor product quality, and communicate quality status to stakeholders. Below are key features you will likely find useful:
| Key Feature | Purpose |
|---|---|
| Release Health Dashboard | See Go/Caution/Stop signals for release decisionsCompare release quality and trends between releases |
| Quality Gates configuration | Customizable thresholds for pass rate, coverage, and defect density |
| Analytics & Trends Dashboard | View pass rate trends, failure rate patterns, and quality trajectory |
| Requirement Coverage Report | Identify coverage percentage, gap analysis, and risks |
| Requirement Traceability Report | Track requirement lifecycle from creation to validation |
| Defect Trend Analysis Report | View defect density, distribution, and resolution rates |
| AI Executive Briefing | Generate 3-part summaries (Quality Snapshot, Risk Assessment, Recommendations) for a release |
| External Report Sharing | Share secure, time-limited links for external stakeholders with customizable expiration |
QA Manager​
As a QA Manager or Test Lead, you use TestOps analytics to oversee team performance, track quality metrics, facilitate release decisions, and communicate testing status to stakeholders. Below are key features you will likely find useful:
| Key Feature | Purpose |
|---|---|
| Live Monitor Dashboard | Track active test runs and track progress for pre-defined goals. |
| Analytics & Trends Dashboard | Track pass rate trends and test activities |
| Quality Gates configuration | Control release' quality thresholds |
| Release Health Dashboard | See Go/Caution/Stop signals for release decisions |
| Configure Smart Tags Probabilistic Flakiness Score | Understand test flakiness and stability calculations |
| Test Run Analysis Report | View execution volume over time |
| Test Failure Analysis Report | Identify failure pattern for investigating and quality control |
| Requirement Coverage Report | Identify coverage gap |
| Defect Status Analysis Report | View defect density and distribution |
| AI Executive Briefing | Generate 3-part summaries (Quality Snapshot, Risk Assessment, Recommendations) for a release |
| External Report Sharing | Share secure, time-limited links for external stakeholders with customizable expiration |
Manual Testers​
As a Manual Tester (or QA Tester/Test Analyst), you use TestOps analytics to navigate test results, investigate failures quickly with AI, create defects with complete context, and validate requirement coverage. Below are key features you will likely find useful:
| Key Feature | Purpose |
|---|---|
| Test result details / Test run details | Understand test results and investigate failures |
| Test Results Analysis Report | Understand test results by projects & releases |
| Test Runs Analysis Report | Understand execution history |
| Test Case Health Analysis Report | Understand flaky tests & test stability |
| Test Failure Analysis Report | Recognize failure patterns for quicker troubleshooting |
| Probabilistic Flakiness Score | Understand flakiness and stability calculation logic |
| Requirement Traceability Report | Understand overall test and defect linkage |
| Requirements Coverage Analysis Report | View testing coverage % of requirements |
| Configuration Coverage Analysis Report | View environment coverage for a release/sprint |
Automation Engineers​
As an Automation Engineer or Test Automation Developer, you use TestOps analytics to create and monitor automated test execution, identify and fix flaky tests, analyze test performance, and optimize configuration coverage. Below are key features you will likely find useful:
| Key Feature | Purpose |
|---|---|
| Live Monitor Dashboard | Tracking active test runs |
| Test Runs Analysis Report | Understand execution history and trends and view test durations, for optimization. |
| Probabilistic Flakiness Score | Understand flakiness and stability calculation logic |
| Test Failure Analysis report | Recognize failure patterns to prioritize troubleshooting |
| Common Automation Errors Report | Recognize errors by grouping to troubleshoot quickly |
| Test Case Health Analysis Report | Understand flaky tests & test stability |
| Configuration Coverage Analysis Report | View environment coverage for a release/sprint |
| Requirements Coverage Analysis Report | View automated testing coverage % of requirements |
| Automation Progress Analysis Report | Automation progress and trends tracking |