Skip to main content

Test Suite Collection

A Test Suite Collection (TSC) contains a list of test suites to allow users more options to plan their test execution.

To open a new Test Suite Collection, go to File > New > Test Suite Collection. The new Test Suite Collection page opens with two sections:

  • Execution Information: This section allows you to manage additional configurations for TSC execution.
  • Test Suite List: This section allows you to add one or many test suites into a collection

Manage Execution Information​

After creating a TSC, in the new Test Suite Collection page, click Execution Information to expand the section.

Execution Information

Execution mode Description
SequentialThis mode allows you to execute the test suites one after another.
ParallelThis mode allows you to execute the test suites at the same time. With this mode, you can also set:

  • Max concurrent instances: To set the maximum number of test suites executing at the same time.

  • Delay between instances (in seconds): From Katalon version 8.2.0 onwards, you can set the delay time between each test suite execution from 0-999 seconds.

This function reduces the risk of CPU spike issues when there are too many concurrent instances. When a test suite is ready to start, Katalon will print the following message in the Event Log tab: 
Test suite ${testSuiteID} is ready to start at ${currentTimeStamp}
. Event Log message

Manage Test Suite List​

After configuring the Execution Information section, to add test suites into a collection, follow the steps below:

  1. In the command toolbar, click Add to add a Test Suite.

    Click Add to add test suite

  2. The Test Suite Browser dialog appears, displaying all your Katalon Studio test suites. Select the test suites you wish to execute, then click OK.

  3. The selected test suites are added to the test suite collection accordingly.

    Add test suite into TSC

    FieldDescription
    Run withTo select the environment executed with the Test Suite.
    Run configuration

    To add extra information to execute with the selected environment.

    For example: Select mobile devices to be executed for Android environment



    ProfileExecution Profile that contains all variables values for each Test Suite execution. To learn more about the execution profile, you can refer to this document: Execution Profile
    RunTo choose the test suite you wish to run in the test suite collection. This is checked by default.
    Note:

    You can then configure each duplicated test suite individually, for example to run the same test suites in different environments.

Execute a Test Suite Collection​

  1. To run a TSC, from the main toolbar, click Execute.

    Run a test suite collection

  2. After the TSC execution, from the Test Explorerpanel, go to Reports to find test reports. To learn more about generating test reports, you can refer to this document: Test Suite Collection Report.

Submit and view test results in Katalon TestOps​

You can centralize test results including logs and attachments in Katalon TestOps. You can learn more about uploading test results to Katalon TestOps in this document: Upload Test Results to Katalon TestOps from Katalon Studio.

Schedule execution of Test Suite Collections remotely​

You can schedule a TSC execution on multiple servers with Katalon TestOps. To learn more about planning and monitoring all test activities in Katalon TestOps, you can refer to this document here: Schedule Test Runs.

To quickly schedule a TSC execution on Katalon TestOps from Katalon Studio, in the Test Suite Collection page, click Schedule on Katalon TestOps.

Schedule on Katalon TestOps