Quick guide for QA managers

Attention

This document covers TestOps Legacy version only.

This guide provides an overview of the possibilities that Katalon TruePlatform can offer when planning tests, organizing test artifacts, and analyzing test reports.

Requirements

• You have a Katalon account. You can create an account from the Katalon website.

• You have created a Katalon Project. See: Create an Account and Organization.

• You have connected a Git repository for your project. See: Configure a Git repository in Katalon True Platform.

Plan tests

As a QA manager, you must provide detailed test plans that outline the approach, objectives, scope, resources, schedule, and procedures for testing a software application.

Katalon True Platform facilitates test planning by allowing you to create releases and builds. Inside a release or a build, you can link all the testing requirements and check for release readiness or requirement coverage.

Katalon True Platform also supports integration with Jira. You can link test runs in Katalon True Platform with Jira requirements. See: Enable Katalon True Platform - Jira integration for test management.

Note:

• If you have not created and executed any test runs, refer to this guide: Quick guide for testers.

To create a release and link a test run, follow these steps:

1. In Katalon True Platform, go to Planning. In the Releases tab, click Create Release.

2. In the Create Release section, fill in the release information:

   • Name: the release version (e.g., release 8.0.0).
   • Start Date: when you want to start your release time frame.
   • Release Date: when your release ends.

3. Click Create.

Result: You have now created a release.

Once Jira integration is enabled, you can:

• Populate Jira releases. See: Populate Jira releases

• Link test cases to Jira requirements. See: Link test cases to Jira requirements

After creating a release, you can link test runs to a release. See: Link test runs to a release in Katalon True Platform

The Planning > Releases tab as shown in the image below allows you to view and analyze test releases and its readiness after linking your test runs to Jira releases.

The Planning > Requirements tab organizes your Jira requirements linked to your test cases. This tab also allows you to access and view test case coverage and traceability matrix reports.

If you have enabled BDD configuration in Katalon TruePlatform, you can also quickly check BDD test results in the Requirement tab. See: View BDD test results in Katalon True Platform

Organize your test cases

Here is a quick guide for QA managers on how to organize test cases in Katalon TruePlatform.

In Katalon TruePlatform, you first need to upload your test scripts using Git repositories to Katalon TruePlatform. This allows you to manage version control and synchronization in the Katalon TruePlatform. See: Configure a Git repository in Katalon True Platform.

After uploading your test scripts from the Git repository, you can organize your tests in test suites or dynamic test suites.

• To manage your tests in Katalon TruePlatform, see: Manage test suites in Katalon TruePlatform

• To manage your tests in Katalon Studio, see the following topics:

  • Manage test suites in Katalon Studio

  • Manage dynamic test suites in Katalon Studio

If you want to run parallel tests with multiple browsers, you can add and manage your test suites in a test suite collection. See: Manage test suite collections in Katalon Studio.

Analyze your test reports

Here is a quick guide for QA managers on how to view and understand test reports in Katalon TruePlatform.

Katalon TruePlatform provides several ways to gain a clear view of the overall readiness of your projects.

As part of your daily tasks, you will refer to the test reports to evaluate your testing progress. Go to your Project > Reports on the Katalon TruePlatform dashboard to view your test reports.

To learn more about test reports, see: Reports overview.

The test reports most referred to by Katalon users are:

Report	What does it do?
Test Activities	Shows your testing activities in daily/weekly/monthly periods. This enables faster troubleshooting and assists you in the decision-making process of your product cycle. See: Test activities reports
Release Readiness	Shows how ready your releases are. This allows you to: Evaluate the status of the two most recent releases. Oversee your release plan with reminders of the delivery date. Monitor productivity to see progress in development and testing. Highlight the total number of defects for each release. See: Release Readiness reports
Productivity	Tracks the total number of test cases you have created in your project in a daily/weekly/monthly period. See: Productivity reports
Quality	Shows the test quality based on Flakiness Test Distribution (the distribution of test cases by their flakiness probability). See: Quality reports
Platform Coverage	Shows the coverage of test runs or test results executed in corresponding environments. See: Platform coverage reports
Requirement Coverage	Provides the coverage status of requirements for a given scope. This allows you to centralize all Jira and BDD requirements in one single place for reports and analytics. See: Requirement coverage reports
Local Test Environment	Shows the number of online and offline agents and the distribution of all agents by the operating system. See: Local test environment reports

Next steps

Now that you've learned how to plan and organize tests in the Katalon Platform, as well as analyze test reports, you can explore Katalon Platform's other helpful features for QA managers.

• To learn more details on how you can organize your tests, see: Custom Fields and Tags.

• To learn more about how you can share your test reports to others, see: Share test reports via email in Katalon Studio.

• To extract more insights on how to improve your test performance, see: Compare test results in Katalon TruePlatform.