Skip to main content

Manage Test Suites

You can create, update and manage test suites in Katalon TestOps.

By doing so, you save time creating the test suite in Katalon Studio and uploading it to a Git script repository on TestOps.

Create a Test Suite

Important:

Follow these steps:

  1. Sign in to Katalon TestOps and go to your project.

  2. Go to Test Management > Test Suites.

  3. Click on the + Test Suite button.

    The Create new Test Suite dialog appears as below.

    create new ts dialog

  4. Fill in the required information.

    • Test Suite Name: create a name for your test suite.
    • Script Repository: select the script repo.
    • Test Cases: select a test case, then click Add to add it to your new test suite.

      Note:
      • Test cases have to be added one by one.
      • You can only add test cases from the same script repo you have selected.
      • If you want to switch to a different script repo, click Remove to remove the added test cases manually first. Once all test cases have been removed, the Script Repository section is enabled again. You can then select a different script repo.

        remove test case

  5. Click Create.

    A test suite is created in Katalon TestOps.

    The newly-created test suite is stored in the TestOps folder under the relevant script repo.

testops folder

Warning:
  • The TestOps folder is a default system-generated folder and stores the test suite you have created in TestOps.

  • Katalon TestOps has a refresh feature where, if you clickRefresh, you can sync the latest version from your Git repos to TestOps. To ensure the default systemTestOps folder remains unaffected by this feature, Katalon TestOps ignores any other folder namedTestOps in your Git repos. Therefore, do not use the same name when you create test suites in other platforms (Katalon Studio and script repositories). By doing so, you can avoid losing data if you use the refresh feature.ư

Execute a Test Suite

See: Schedule Test Runs.

View a Test Suite

Similar to test cases, Katalon TestOps presents test suites in a folder-based view. See also: Manage Test Cases.

View test suites created in TestOps

To view a test suite created in TestOps, go to Test Management > Test Suites, select the script repository folder in the folder list on the left sidebar, then go to Test Suites > TestOps.

View test suites uploaded from a Git repository

Note:
  • Katalon TestOps supports integration with Azure Repos, Bitbucket, GitHub and GitLab.

To view a test suite uploaded from a Git repository, go to Test Management > Test Suites, select the relevant script repository, then click on the Test Suites folder.

  • If you have not run tests yet, the execution data section (last executed) is empty.
  • If you have run tests, this section contains information on your test executions.
Note:

If you cannot find your script repositories, you can refresh them to make test suites appear in folders on the Test Suites page. Follow these steps:

  1. Go to Configurations > Script Repositories.

  2. Select a script repository to go to the script repository page. script repo page

  3. Click Refresh Test Suite Collection in the top right corner.

  4. Go to Test Management > Test Suites, then select the relevant script repository.

  5. Click on the Test Suites folder.

    You can now view test suites from the script repository you have refreshed.

View test suites uploaded to a script repository

Warning:
  • This feature will soon be deprecated. We encourage you to use other supported sources.

If you upload tests as a .zip file, your test suites will not display on the Test Suites page yet.

You must execute tests on Katalon TestOps to generate the execution reports first.

After running tests, the test suites and their execution data will appear within Test Suites in the Uploaded Data folder.

View test suites from uploaded execution data

If you upload your execution data using the frameworks we support, or upload manually to Katalon TestOps (see: Upload JUnit and Katalon Studio Test Results to Katalon TestOps), you can also view test data on the Test Suites page.

Katalon TestOps supports uploading test results from the following frameworks:

After uploading the execution data, go to Test Management > Test Suites and click on the Uploaded Data folder.

You can see test suites and their execution data within Test Suites in the Uploaded Data folder.

Update a Test Suite

You can rename a test suite and add/remove test cases in the test suite you have created in Katalon TestOps.

Warning:
  • Katalon TestOps has a re-import feature where you can import test reports repeatedly. This feature only recognizes the original name of the test suite you have created. If you rename the test suite and then re-import reports, there is a high chance that TestOps does not recognize the new test suite name and consequently, it imports the wrong data. Therefore, rename your test suite with caution.

Follow these steps:

  1. Go to Test Management > Test Suites.

  2. Find your desired script repository in the folder list on the left sidebar.

  3. Go to Test Suites > TestOps.

  4. Click on the name of the test suite you created in TestOps (e.g. Test Suite TW Demo).

    The page appears as below.

    ts page edit button

  5. Click Edit in the top right corner.

    The page appears as below.

    script repo page

  6. Update the test suite.

    • You can edit the name in the Test Suite Name section.
    • You can search the test case in the Test Cases section, then click Add to add a test case.
    • You can remove a test case in the test case list by clicking Remove.
  7. Click Save to finish editing your test suite.

Delete a Test Suite

Important:
  • You must have a test suite already created in TestOps.
  • If there is any execution data associated with the deleted test suite, it will become a shell test suite and appear under the Uploaded Data folder.
  • If the deleted test suite is linked with any scheduled test runs, it will be unlinked from the schedule.
  • A shell-test suite is automatically created to store deleted test data.

For example:

When you go to Test Management > Test Suites and look at the test suite directory (on the left-hand side), you see the structure as given in the image below:

test suite structure

Consider that Folder A.1 has two test suites.

  • TS1 has been executed and contains execution data.
  • TS2 has not been executed.

If you delete TS1, shell test suites are automatically created under the Uploaded data folder to store the deleted TS1 test suite, as it contains executed data. See image below.

shell test suite

If you delete TS2, it will be removed from TestOps completely, as it does not contain executed data.

To delete a test suite, follow these steps:

  1. Go to Test Management > Test Suite.

  2. Click the test suite to view its details.

    script repo page

  3. Click the Delete button.

    The Confirmation dialog box appears.

    script repo page

  4. Click the Delete button in the dialog box to confirm.