Dynamic Test Suite

Requirements: Katalon Recorder version 5.6.0 onwards.

With Dynamic Test Suites, you can add multiple test cases at run time via a search query. It allows users to execute test cases with certain tags dynamically.

In this article, we show you how to categorize test cases with tags and execute them in a dynamic test suite.

Categorize Test Cases with Tags

Notes:

A tag can be reused across test cases, but you can not have a duplicated tag in a test case.

Categorize test cases with Tags Management

The Tags Management function allows you to manage all tags in one place. You can add/remove or edit tags in one or many selected test cases.

Follow these steps:

  1. In the Actions panel, click Tags Management. The Tags Management dialog opens.

  2. In the opened dialog, the first interface shows you a list of existing tags and the number of test cases where the tags are present. If you have no tags, this page should be blank.

    List of existing tags
    • To add new tags, click Add new tag. The opened interface allows you to add new tags to one or many selected test cases. You can also add tags to all test cases in a test suite.

      Add new tags from tags management
      • Input the new tag name, then click Save to add tags to selected test cases.

        Add new tags from tags management
      • After adding tags, the tag icon is highlighted in the sidebar for this test case.

        Tags icon highlighted after adding tags
    • To remove tags, click Remove (Trash icon) of the tag you wish to remove. Katalon Recorder deletes it from all test cases.

      Remove tags in all test cases
    • To edit tags, click Edit (Pencil icon) of the tag you wish to edit. By default, Katalon Recorder will check the box of the test case where the edited tag exists. After editing the tags, click Save. The new tag will replace the previous one in all checked test cases.

      Edit tags in all test cases Save edited tags

      Notes:

      • If you wish to remove the edited tag from a test case, leave the box of the test case unchecked. In the above example, when changing the tag name from Dashboard to Calculator, if you uncheck the Test case 01 test case, there will be no tags named Dashboard or Calculator in this test case.

      • If you wish to add the edited tag to a test case, check the box of the test case you wish to add the tag. In the above example, when changing the tag name from Dashboard to Calculator, if you check the box of the UI Test test case, a new tag named Calculator will be added to this test case.

Categorize test cases from test case view

You can also add tags directly to a test case. To do so, open the desired test case. Click Add new tag in the test case header, then manually input the tag name or select an existing tag in the dropdown list.

Add tags from test case view

Categorize test cases from the Workspace sidebar

To quickly add new tags from the Workspace sidebar, click Tags Tag icon. A pop-up Tag this test case dialog allows you to manually input the tag name or select an existing tag in the dropdown list.

Add tags from the Workspace sidebar

Execute Dynamic Test Suite containing Categorized Test Cases

After categorizing your test cases with tags, you can now execute them in a dynamic test suite.

Create a new Dynamic Test Suite

To quickly create a new Dynamic Test Suite, click on a tag from the Workspace sidebar or the test case view.

Click a tag from the workspace sidebar

An Execute test case dialog opens, showing all test cases of the selected tag.

An execute test case dialog opens

Alternatively, you can also click Add (+) in the Dynamic Test Suite section from the Workspace sidebar to create a new Dynamic Test Suite.

Create a new dynamic test suite manually

Add categorized test cases into a Dynamic Test Suite

To add categorized test cases into a Dynamic Test Suite, select or type the tags of the desired test cases in the Input tags box. Each tag is separated by a comma. Then click Apply to query out the matching test cases.

For example: To add the test cases with the aTag_1 and atag_2 tags into the dynamic test suite, you can click on the aTag_1 and atag_2 tags or input aTag_1,atag_2 into the Input tags box, then click Apply. Katalon Recorder will query out the matching test cases.

Results after searching query

Run the Dynamic Test Suite

After selecting test cases, click Execute in the Execute test case dialog to create and execute the dynamic test suite with the specified query.

Execute the dynamic test suite

If you are running the test suite from the dynamic test suite view, click Play instead.

Click play in the test suite view

After executing the test suite, you can check the status of your test in the Log tab.

Notes:

For real-time monitoring and better reporting capabilities, consider integrating your project with Katalon TestOps. To learn more about TestOps integration, you can refer to this document: View execution reports in TestOps.

Feedback