View test results and execution logs in Katalon TestOps
Katalon TestOps allows you to centralize and track execution data including test results, execution logs, and test report files. This article will shows you different ways to view test results and execution logs in Katalon TestOps.
View test run results and execution logs in Katalon TestOps
To view details of a test run result, click the test run ID. Here, we click ID 3020.
A Test Run: #<ID> page appears (e.g, Test Run: #3020). In the Summary tab, you can see the following information:
This bar shows the total number of test results including: Passed, Failed, Error, Imcomplete, Skipped status in the test run.
This section gives you a brief look of how your test scripts perform overtime. In the following example, a scheduled test run AWS - SSRF - Local Agent - Test Suite - Flag ON was triggered on 29/08/2022 with a duration of 250ms. On 13/09/2022, the test run was triggered again but hanged on and finally timed out. This might indicate flakiness in your test scripts.
If you have run with an agent, you can see the sessions results in this section. To view the session logs, click the session ID. Here, we click session ID 2285.
The Session: #<Session-ID> page opens. You can see the full session log, along with the run command in this page. If you want to re-run the test run, click Run at the right upper corner.
If the test run has failed test cases, you can see the failed test cases and the corresponding error in this section. To view the error and further analysis, click the test result ID. Here we click test result ID 102282108.
Error message: This returns the specific reason why the execution fails.
Attachments: This attaches the captured screenshots and/or recorded videos to see what went wrong with failed tests.
Failed Assertions: When you run tests with Katalon Studio, if you have used built-in assertion keywords with the
verifyprefix (e.g,WebUI.verifyElementPresent) or custom assertion keywords such asKeywordUtil.markPassed(message),KeywordUtil.markFailed(message),KeywordUtil.markFailedAndStop(message), you can see the failed assertions in this section.Errors: This shows the full error log. You can download this file.
Logs: This shows the execution logs in each test step and the step status. This allows you to quickly troubleshoot which steps cause test failure. You can view this log in text view or tree view.
Similar Failures: TestOps analyzes all existing failed test results and identifies similar failures. By having failed test results centralized in one place, you can quickly compare and pinpoint the root cause of any issues.
Failure Reason: TestOps automatically assigns failure reason to the corresponding top-level exception of failed test results. Here, you click on the drop-down and change the suggested reason to a different category. You can also click on the Suggested Solution link to open the document for troubleshooting the failure.
Note:The Failure Reason capability is limited to the Premium and Ultimate plans of Katalon Platform. See: Katalon Platform Plans.
Jira Defects: You can link the test failure to Jira defects for test management. See: Link test runs to Jira defects in Katalon TestOps.
This section contains the execution information including the test suite name, execution profile, operating system and browser, duration and executed date. When you click the hyperlinked test suite name, you are navigated to its information page where you can see:
The test cases of the test suite
Execution history of the test suite
Add custom fields and tags to test results
- Navigate to a test run result by clicking its ID number.
- Navigate to the Custom Fields and Tags section, you can select from the dropdown list the custom fields and tags to assign to your test result. You can also see Add Custom Fields and Tags to test cases for references on how to add or remove custom fields and tags.
