Manual Test Run

Last updated: July 2026

This document shows you how to create and execute a Manual Test Run in Katalon True Platform.

Use Manual Test Runs to quickly validate test behavior without automation or for scenarios that are not yet automated. You can select test suites or individual test cases, execute them in a focused workspace, capture step-level evidence, and review consolidated results.

requirement

• You must have Project Admin, Tester, or Test Lead role to perform this action.

Create a manual test run

Try this with Katalon AI

You can create a manual test run with Katalon AI Assistant and let it execute AI-ready test cases for you. See Execute and monitor manual tests for more details.

1. Navigate to Executions > + Create > Create Manual Test Run.

2. Fill in the required fields:

   • Test Run Name: A descriptive name for this run.
   • Executor: Defaults to the current user; change if needed.
   • Release Version (optional): Link the run to a release.
   • Sprint (optional): Link the run to a sprint.

3. Click Select Tests to add available test suites and the test cases they contain. You can remove any selection with the minus icon.

   • Alternatively, select individual test cases. Katalon True Platform will automatically group them into a new test suite, which is created once you finish setting up the test run.

4. Click Select Configuration to choose the targeted testing environment (e.g., Windows 11 + Chrome 143).

5. Secrets & Variables: Expand this section to review or add project-scoped values to use during runtime. For setup details, see Secrets and variables in test runs.

   

6. Choose how to proceed:

   • Create Test Run: Create the run and open the manual test run details page, where you can choose to Run Manually or Run with AI.
   • Schedule: Pick a future time or create a recurring schedule.

note

If you plan to use Run with AI, write the manual test steps so the AI can consume those saved values clearly. For example, you can use plain language such as Enter the test lead email in the Email field or reference a saved key directly such as Enter {testleadPassword} in the Password field.

Execute a manual test run

After you create a manual test run, choose one of the following execution options from the manual test run details page:

• Run with AI: Execute the selected test cases with AI while keeping a human in the loop. Katalon AI runs the test steps and pauses when it needs your input. When prompted, provide guidance in the AI session so the run can continue. Review any pending AI-assisted results before ending the test run.
• Run Manually: Open the test run in TestPak, a workspace designed for manual execution. TestPak supports real-time collaboration, evidence capture, and traceable results for consistent testing.

Run with AI

Use this mode when you want to execute test cases with AI assistance. You remain in the loop and provide guidance in the AI session when Katalon AI requires human input.

1. In the Run with AI dialog, review the information then click Start AI Execution.
   Katalon opens the AI Sessions tab and initializes the test environment.
2. Monitor the run from the AI Sessions tab:
   • The left panel lists the test cases in the run.
   • The Test Steps tab shows the current step and its execution status.
   • The AI Log tab shows the AI actions, generated scripts, step results, and failure details.
   • The Video and Screenshots tabs show captured visual evidence from the AI session.
3. If Katalon AI needs your input, follow the prompt in the test step, enter guidance in Your Instruction, then submit it so the AI can continue.
4. Review the completed test case result. Katalon marks each step as passed or failed and shows a summary when execution is complete.
   If a test step fails, the AI Verdict appears with Katalon AI's assessment and suggested next action.
5. If a pending review banner appears, click Review Now to inspect the AI-assisted results before ending the run.
6. To stop the run before execution finishes, click End Test Run. If you let Katalon AI complete all test steps, the run ends automatically.

Run manually

Use this mode when you want to execute the test cases yourself. When you click Run Manually, the TestPak workspace opens.

1. Click Start to begin:

   • All test cases will initially appear with the status In Testing.
   • It also starts tracking the testing duration for that specific test case result.

2. Go through each test step and test case.

3. (Optional) Add Test Step Result or Comment the outcome for each test step.

   • If any test step is Failed, the test case is marked Failed.
   • If any test step is Blocked, the test case is marked Blocked.
   • If any test step is Skipped, the test case is marked as Skipped.

   Note: The test case status is automatically determined based on step-level results, but you can override it manually by reselecting another status from the dropdown menu in the test case view.

4. In Test Case Result, mark the test case as skipped, blocked, passed or failed.

   • If any case is Failed or Blocked, the entire test run is marked Failed.
   • If any case is Skipped, the entire test run is marked as Running.
   Test case statuses

   Status	Description
   Skipped	Case intentionally not executed or without a result.
   Blocked	Execution prevented by a dependency or issue.
   Passed	All expected outcomes met.
   Failed	One or more expected outcomes not met.

5. (Optional) Add Supporting Details:

   • Comments: Log contextual notes under Activities.
   • Attachments: Upload screenshots, logs, or documents.
   • Images: JPEG, PNG, GIF, BMP
   • Documents: PDF, DOC(X), XLS(X), PPT(X)
   • Videos: MP4, MOV, AVI (max 100 MB)
   • Logs: TXT, LOG (others 15 MB)

6. (Optional) Link a defect: click the bug icon to report or link a defect.

   Note: To use this step, you must first integrate your ALM (Application Lifecycle Management) tool with Katalon True Platform. For setup instructions, see:

   • Integrate Jira with Katalon True Platform
   • Integrate Azure DevOps with Katalon True Platform
   

7. Navigate Cases – Use Next / Previous to move between cases.

   • Progress auto-saves.
   • Cases without a result are marked Skipped.

8. Click End Test Run to finalize and review aggregated results.

   

Schedule mode

Use this mode for planned or recurring runs.

1. Click Schedule to open the Schedule Test Run dialog.
2. Set the start time and optionally a recurrence pattern.
   • The assigned executor will receive a notification 15 minutes before start time.
3. At the scheduled time:
   • Return to Executions, open the scheduled test run, and choose Run Manually.
   • Follow the same steps outlined in Run manually.

You can edit a scheduled manual test run before it starts. Katalon True Platform saves the updated schedule and configuration values for the next run.

Important Notes

• A test run marked NOT STARTED means it is scheduled for a later time.
• If a scheduled test run is assigned to another person, only that assigned executor can start it.
• The assigned person will receive a notification that the test run has been scheduled for them.