Skip to main content

Manage dynamic test suites in Katalon Studio

Last updated: August 2026

A dynamic test suite (DTS) is a test suite with multiple test cases added via a search query. You can dynamically add test cases based on the ID, name, tag, comment, and description of a test case.

This article shows you how to create and query test cases for execution in a dynamic test suite.

Create a new dynamic test suite​

To create a new dynamic test suite, do as follows:

  1. In the Tests Explorer panel, right-click at the Test Suites folder > New > Dynamic Test Suite.

    Create a new dynamic test suite
  2. Fill in the name and the description (optional).

    We name it Dynamic Test Suite 1.

    Create a new dynamic test suite dialog
  3. Click OK.

You have successfully created a new dynamic test suite.

Add test cases to a dynamic test suite​

To add test cases to a dynamic test suite in Katalon Studio, follow these steps:

  1. Open a test case, then switch to the Properties tab. Add a tag to your test case and save your test case. For example, we add a tag called kami.

    Add a tag to a test case
  2. Open a dynamic test suite. In the Query Provider section, select Built-in Search.

  3. Query Builder provides a convenient way to create and run a query in Katalon Studio. To open the Query Builder function, in the dynamic test suite view, click on Query Builder.

    The Query Builder dialog appears with the included information:

    • Id: to search by the exact IDs of a test artifact.
    • Name: to search by the name of a test artifact.
    • Tag: to search by the tag linked to test artifacts.
    • Comment: to search by the comments attached to test artifacts.
    • Description: to search by the description associated with test artifacts.
    The Query Builder dialog

    Every field in this Query Builder function can be applied to search for all types of test artifacts such as test cases, test suites, folders, etc. However, only test cases will be found and added to the dynamic test suite.

  4. Input your search criteria, then click Search. The query provider queries out the matching test cases.

    In this example, we find test case with the kami tag.

    Search results for test cases with the kami tag

Modify execution information​

Before executing a test suite or a dynamic test suite, you might want to modify the execution information, including timeout, retry, and email recipient list for test execution reports.

You can specify additional configurations for the test suite execution by expanding the Execution Information section as below:

Execution Information section

Set implicit timeout in a test suite execution​

In Implicit timeout, you can decide the timeout period that Katalon Studio waits for a page to be loaded by choosing one of the following options:

Implicit timeout options
  • Use default: Use the predefined default value in Project Settings > Execution > Default wait for element to timeout (in seconds).
  • User define: Set a custom waiting time. Input a value in seconds.

Retry after executing all​

Katalon allows you to rerun test cases in a failed test suite execution to identify flaky tests.

To do so, in the Retry after executing all text field, set the desired number of retry times. By default, this is set to 0.

Retry after executing all options

Choose one of the following options:

  • Retry all executions: Retry all test cases when the test suite fails.

  • Retry failed executions only: Retry only failed test cases when the test suite fails.

    For example, when a test suite execution fails, we want to rerun failed test cases in that test suite twice.

    In the Retry after executing all checkbox, we input 2 in the text field, then we choose the Retry failed executions only option.

    Retry failed executions only option

In this case, the test suite is executed three times in total. The first one is the main execution, while the latter two are the retried executions when the first execution fails.

Test suite retry progress

Katalon Studio automatically generates reports after each test execution.

Test execution retry reports

Execute a test suite​

To execute a test suite or a dynamic test suite, follow these steps:

  1. In Tests Explorer, open a test suite or a dynamic test suite.

  2. Click on the drop-down of Run and select an environment to execute the test suite.

    Run drop-down with execution environments

    If you only click on Run, Katalon Studio executes the test suite with the default execution environment defined in Project Settings > Execution > Default execution. See Execution settings in Katalon Studio.

  3. Click Run.

The Job Progress is triggered automatically to show the progress while your test suite is being executed.

Job progress

You can also run a test suite or a dynamic test suite in console mode. For detailed instructions on test execution in console mode, you can refer to this document: Command-line syntax in Katalon Runtime Engine.

Was this page helpful?