Skip to main content
Version: current

View test results and execution logs in Katalon TestOps

Katalon TestOps allows you to centralize and track execution data including test results, execution logs, and test report files. This article will shows you different ways to view test results and execution logs in Katalon TestOps.

View test runs reports in Katalon TestOps

To view test reports in Katalon TestOps, go to Reports.

The Test Runs page appears. By default, you're first navigated to the Overview tab. This tab provides you with an overview of execution trends, profile coverage and platform coverage of test runs over a period of time. To learn more about this Overview tab, you can refer to this document: Test runs reports overview in Katalon TestOps.

Switch to the Test Runs tab. In this tab, there are two sections:

  • Test Run by Status: This diagram shows the number of test runs with Passed or Failed status within 7/14/28 days.

  • All Test Runs: This section shows all test runs status, test results with its corresponding test environment and test configuration. The following table explains the data represented in each column.

    Column NameDescription
    StatusThis column shows the status of the test runs. There are four statuses as follows:
    • Passed

    • Failed

    • Terminated

    • In Progress

    IDThis column shows the hyperlinked test run ID. This hyperlink leads you to the corresponding test run page.
    NameThis column shows the test run name and the corresponding test suite/test suite collection name.
    Platform - ProfileThis column shows a test run operating system, browser and execution profile.
    TimeThis column shows the test run duration and executed date.
    TotalThis column shows the total test results of a test run. There are 5 test results as follows:
    • Passed

    • Failed

    • Error

    • Incomplete

    • Skipped

    Besides the Passed result, other test results are highlighted.
    ConfigurationThis column contains the test configuration including:
    • If you have run with an agent, you can see the hyperlinked session ID (e.g, #2288). This hyperlink leads you to the session log.

    • If you have linked the test run to a release/build, you can see the hyperlinked release/build name (e.g, Release 1). This hyperlink leads you to the corresponding release page.

    • If you have specified the build label and URL when running with Katalon Runtime Engine, you can see the hyperlinked build name. To learn more about specifying build label with Katalon command line, see: TestOps integration arguments.

    ByThis column shows the avatar of the test executor.

View test run results and execution logs in Katalon TestOps

To view details of a test run result, click the test run ID. Here, we click ID 3020.

Click test run ID

A Test Run: #<ID> page appears (e.g, Test Run: #3020). In the Summary tab, you can see the following information:

The summary bar

This bar shows the total number of test results including: Passed, Failed, Error, Imcomplete, Skipped status in the test run.

Previous Test Runs

This section gives you a brief look of how your test scripts perform overtime. In the following example, a scheduled test run AWS - SSRF - Local Agent - Test Suite - Flag ON was triggered on 29/08/2022 with a duration of 250ms. On 13/09/2022, the test run was triggered again but hanged on and finally timed out. This might indicate flakiness in your test scripts.

Previous test runs

Sessions

If you have run with an agent, you can see the sessions results in this section. To view the session logs, click the session ID. Here, we click session ID 2285.

View session logs

The Session: #<Session-ID> page opens. You can see the full session log, along with the run command in this page. If you want to re-run the test run, click Run at the right upper corner.

Failed Test Results

If the test run has failed test cases, you can see the failed test cases and the corresponding error in this section. To view the error and further analysis, click the test result ID. Here we click test result ID 102282108.

Click failed test results ID

The Test Result page opens. In the Result page, you can see:
  • Error message: This returns the specific reason why the execution fails.

  • Attachments: This attaches the captured screenshots and/or recorded videos to see what went wrong with failed tests.

  • Failed Assertions:: When you run tests with Katalon Studio, if you have used built-in assertion keywords with the verify prefix (e.g, WebUI.verifyElementPresent) or custom assertion keywords such as KeywordUtil.markPassed(message), KeywordUtil.markFailed(message), KeywordUtil.markFailedAndStop(message), you can see the failed assertions in this section.

  • Errors: This shows the full error log. You can download this file.

  • Logs: This shows the execution logs in each test step and the step status. This allows you to quickly troubleshoot which steps cause test failure. You can view this log in text view or tree view.

Besides the execution log, Katalon TestOps also analyzes and identifies similar failures so that you can quickly compare and pinpoint the root cause of any issues.

This page is where you can link Jira defects for test management. To learn more about linking Jira defect, you can refer to this article: Link test runs to Jira defects in Katalon TestOps.

The failed test results page

Test Suites

This section contains the execution information including the test suite name, execution profile, operating system and browser, duration and executed date. When you click the hyperlinked test suite name, you are navigated to its information page where you can see:

  • The test cases of the test suite

  • Execution history of the test suite

View test suite information

View test report files

To view uploaded test report files of a test run, go to Reports > Test Runs > click the test run ID you want to view the uploaded files > Files.

You can also download the test reports files.