Skip to main content

Quick guide for QA managers

In this guide, you'll explore some of the possibilities the Katalon Platform can offer to plan tests, organize tests, and analyze test reports.


Plan tests

Here is a quick guide for QA managers on planning tests using Katalon TestOps.

The test planning features in Katalon TestOps allow you to check release readiness and requirement coverage. To utilize this feature to the best of its capabilities, it is advised that you integrate Katalon TestOps with Jira.

To learn more about TestOps - Jira integration, you can refer to this document: Enable TestOps - Jira integration for test management

Once Jira integration is enabled, you can:
After creating a release, you can link test runs to a release. See: Link test runs to a release in TestOps

The Planning > Releases tab as shown in the image below allows you to view and analyze test releases and its readiness after linking your test runs to Jira releases.

The Release tab

The Planning > Requirements tab organizes your Jira requirements linked to your test cases. This tab also allows you to access and view test case coverage and traceability matrix reports.

The Requirement tab

If you have enabled BDD configuration in Katalon TestOps, you can also quickly check BDD test results in the Requirement tab. See: View BDD test results in TestOps

Organize your test cases

Here is a quick guide for QA managers on how to organize test cases in Katalon TestOps.

In Katalon Platform, you first need to upload your test scripts using the Git repositories to Katalon TestOps. This allows you to manage version control and synchronization in the Katalon Platform. See: Upload test scripts from the Git repository to TestOps

After uploading your test scripts from the Git repository, you can organize your tests in test suites or dynamic test suites.

If you want to run parallel tests with multiple browsers, you can add and manage your test suites in a test suite collection. See: Manage test suite collections in Katalon Studio.

Analyze your test reports

Here is a quick guide for QA managers on how to view and understand test reports in Katalon TestOps.

Katalon Platform provides several ways to gain a clear view of the overall readiness of your projects.

As part of your daily tasks, you will refer to the test reports to evaluate your testing progress. Go to your project > Reports on the Katalon TestOps dashboard to view your test reports.

The test reports popularly used by Katalon users are:

ReportWhat does it do?
Test ActivitiesShows your testing activities in daily/weekly/monthly periods. This enables faster troubleshooting and assists you in the decision-making process of your product cycle.

See: Test activities reports

Release ReadinessShows how ready your releases are. This allows you to:
  • Evaluate the status of the two most recent releases.

  • Oversee your release plan with reminders of the delivery date.

  • Monitor productivity to see progress in development and testing.

  • Highlight the total number of defects for each release.

See: Release Readiness reports
ProductivityTracks the total number of test cases you have created in your project in a daily/weekly/monthly period.

See: Productivity reports

QualityShows the test quality based on Flakiness Test Distribution (the distribution of test cases by their flakiness probability).

See: Quality reports

Platform CoverageShows the coverage of test runs or test results executed in corresponding environments.

See: Platform coverage reports

Requirement Coverage

Provides the coverage status of requirements for a given scope. This allows you to centralize all Jira and BDD requirements in one single place for reports and analytics.

See: Requirement coverage reports

Local Test EnvironmentShows the number of online and offline agents and the distribution of all agents by the operating system.

See: Local test environment reports