Skip to end of metadata
Go to start of metadata

Once Test Reports are uploaded, Katalon Analytics will automatically analyze Katalon Studio test execution data to give you meaningful visualizations including charts, graphs, and filters. Katalon Analytics powerful dashboard allows users to have richer looks at test execution by presenting various reports such as Status, Duration, Performance, Execution Summary, and Execution Details. 

Status

The status of uploaded Katalon Test Execution. Users can view

      • Number of test cases
      • Number of execution
      • Status of test cases: Passed, Failed, Error, Incomplete

To filter the status of test cases, simply click on the status you don’t want to view to remove it from the graph

Duration

The time of each execution took to complete

Execution

Summary of Katalon Test Report

ID: The number of executions in the project

Status: The status of each report (Passed, Failed, Error, Incomplete)

      • Users can filter the status of the report to view only preferred status. Click on the drop-down menu of Status. Select the status
      • Started: Time and Date the test was run
      • Duration: The time that test took to finished
      • Total: The total number of test cases in one execution
      • Passed/Failed/Error/Incomplete: Status of TC and number of TC within an execution

View Execution Detail Report

Click on the ID of Execution to view the detail report:



Katalon Analytics will display following details about that report including ResultAll Failed TestsFoldersAll Tests

Result Dashboard

Katalon Analytics will show a pie chart to represent the number of each Test Cases status (Passed, Failed, Error, Incomplete)

  
StartedDate and Time of Execution
DurationTotal amount of time took to execute this test

All Failed Tests Table

Allows users to quickly view all test cases that have the status of Failed. The testing team will be able to locate quickly where exactly the test has failed.

Where

ID

This ID is a global ID of Analytic tools

Name

Name of test case

Folder

Containing folder of test case in Katalon Studio

Started

Time and Date of test case

Duration

The amount of time took to run the test case

Status

The status (Passed, Failed, Error, Incomplete) of the test case. Users can filter the status to see only preferred status

Age

Show the number of times this test case has the same status consecutively. (e.g. Status: Failed, Age: 5 → This test case has failed 5 times consecutively)

Flakiness

The reliability of test case after numbers of run

 

To view detail of a failed test case, click on the ID. Once clicked on ID, Katalon Analytics will display in-depth views about the test case. Users will able to view

Where 

Test case: LongTest>#1>…..

The location path of test case in Katalon Studio

Result

Status

Platform

Test Suite in Katalon Studio

Started

Duration

Flakiness

Age

Same Failure

Attachment – error logs or reports file from Katalon Studio

Errors

Users can quickly navigate to the error in the log of execution. Extracted from Katalon Studio execution log.

Console log

Katalon Studio execution log                        

View all executions dashboard

In Result, users can also view all the iteration execution of this test case. Click on View all executions of this Test Case

PerformanceThe performance of test case through iteration run. The duration of each iteration also shown
HistoryThe list of the number of iteration in a test case. To view detail, click on the ID of iteration (This is Katalon Analytics global ID)

Test Suites Table

Katalon Analytics display all test suites in the current viewing execution in the report. To view detail, click on the ID of Test Suite. Katalon Analytics will display in-depth look about the Test Suite. (Same as Failed Test Case detail above)

Where:

ID

Generated Analytic global ID

OS

Operating System was run on

Browser

Selected browser the test was run on

Status

The status of a test suite. Users can filter status to see only the preferred status of test suite

Total

The total number of test cases in this test suite

Failed/Passed/Error/Incomplete

The total number test case of each status is displayed as well

Folder Table

Katalon Analytics' Folder represents how test cases were organized and grouped in Katalon Studio. It has the structure of test cases in Katalon Studio Test Explorer

All Tests Table

List of all executed test cases in the current viewing execution. To view detail, click on the ID of the preferred test case. Katalon Analytics will display details dashboard about that test case. (Same as Failed Test Case detail above)

  • No labels