Katalon TestCloud Release Notes
November 27, 2024
New features
Added support for Selenium 4.
Added support for Katalon Runtime Engine (KRE) 10.0.0. However, due to major changes between KRE 9.x and 10.0, the KRE version for the Latest option is 9.7.3 until we observe high demand on KRE 10.0.
Enhancements
Improved performance and stability when collecting test artifacts.
[TestCloud Keyword plugin] Added Katalon Studio and KRE version 10.0.0 compatibilities.
[TestOps] Added
runFromTestCloud = true
capability tokatalon:options
for KRE version 10.x.Improved format consistency for desired capabilities configuration by nesting all desired capabilities in Dictionary Property Builder of
katalon:options
.
November 6, 2024
Enhancements
- Rearranged device list within the same OS version based on availability status:
From High, Medium, to Low availability
For devices with the same availability status, we arrange by alphabetical order.
Enabled the Terminate button in the History page for tests run on Local Agent.
Added
profiling:true
desired capability to track key performance metrics for mobile applications during automated testing, such as CPU consumption and network usage.You can upload mobile app up to 1GB in size. If a file exceeds the 1GB limit, an error message will appear.
October 16, 2024
Enhancements
Users can configure Appium version in the TestCloud desired capabilities settings using
appiumVersion
. If not specified, by default, TestCloud automatically selects the appropriate Appium version based on the device's OS.Minor enhancements with TestCloud desired capabilities.
Fixes
[Private device] Fixed the issue where Katalon Studio did not recognize the Private device license and the test execution failed with
Not enough parallel quota
message.
September 25, 2024
New features
When executing a test suite collection, users can now select specific mobile app for each test suite instead of one app for all test suites.
Enhancements
Added support for Chrome, Firefox, and Edge browser versions 125, 126, and 127 on Windows, Linux, and macOS.
Fixes
Resolved an issue of no video generated after a mobile native app test execution.
Resolved the error message issue when executing a native app session on Katalon Studio with an unavailable device.
Fixed an issue regarding
goog:chromeOptions
capability when running mobile browser test on Katalon Studio.Fixed an issue where the tunnel client status remained 'Active' due to user actions or desktop task termination.
August 28th, 2024
Fixes
[Native mobile application testing] Fixed the issue where the "Invalid app ID" error message did not appear when starting a session with a device that has an invalid app ID.
August 14, 2024
Enhancements
- When scheduling from the Schedule Test Run dialog, users can choose which tunnel to run local tests from the list of available tunnels.
- Users can execute UI tests that also include API calls by checking the Also Include API Calls option.
- The new tunnel version comes with enhanced performance and stability.
Fixes
- Resolved the naming issues of test report video.
- Resolved the issue where the Schedule Test Run dialog could not display more than 300 test suite collections.
July 30, 2024
Enhancements
Upgraded Appium to version 2.4 to ensure compatibility with Katalon Studio keywords.
July 10, 2024
New features
Supported the Katalon TestCloud Keywords plugin on Katalon Store to help users automatically load TestCloud keywords into Katalon projects. This eliminated the need for manual definition of keywords. See: Katalon Store and Download and verify files.
Supported beta and dev versions of browsers on Windows and macOS. These un-official versions are tagged with dev or beta when you select execution environment in the Schedule Test Run dialog.
Enhancements
Supported KRE 9.6 as the latest version for TestCloud execution.
Allowed Organization Owner and Admin to turn off tunnel clients. Previously, only the user who initiated a tunnel client could stop it. This is particularly helpful if the original owner is no longer part of the team, ensuring efficient resource utilization and security.
Fixes
Native mobile application testing: Added error message when the application does not match the device's OS. Previously, users had to wait for 15 minutes.
Testing with private devices: Added clearer error message when the device is de-allocated.
July 3, 2024
Fixes
Fixed execution errors with web service tests on private domain with TestCloud tunnel.
May 29, 2024
New features
TestCloud private device: Introduced TestCloud private mobile devices that are dedicated to your organization, allowing you to have more control over the test devices with a private environment, enhanced data privacy, and better session retention. See: Use TestCloud private mobile devices.
Enhancements
Supported Katalon Runtime Engine 9.4.0 as the latest version for TestCloud.
Fixes
Fixed the issue where video recording are not named correctly when executing test suite with Retry after executing all option.
May 22, 2024
Enhancements
Updated latest browser version for Windows, Linux, and macOS (Chrome 124, Firefox 124, and Edge 124).
April 24, 2024
Enhancements
Updated latest browser version for Windows, Linux, and macOS (Chrome 123, Firefox 123, and Edge 123).
Users can copy the application ID of uploaded mobile application to clipboard with the Copy AppID to clipboard button in Application repository.
Fixes
Naming of video reports: Fixed the issue with misnaming video reports when using the
openBrowser
andstartApplication
keywords.Fixed incorrect Visual testing statuses in the History page.
April 1, 2024
New Features
Supported setting geographic location. Users can dynamically set geolocation for web and mobile test execution. See: Set geographic location.
Supported network throttling. Users can simulate network conditions for web and mobile test execution. See: Configure network throttling.
Enhancements
Updated latest browser version for Windows, Linux, and macOS with Chrome 122, Firefox 122, and Edge 122.
Supported executing with KRE version 8.6.9 and 9.3.2 in TestCloud environment.
March 14, 2024
Enhancements
Mobile native application testing: When users select a mobile application build in the Schedule Test Run dialog, the builds are displayed along with their upload dates. This help users distinguish between multiple builds of the same application version.
February 28, 2024
New features
Added keywords for simulating biometric authentication in mobile testing. See: Biometric authentication.
Updated the latest browser version for Windows, Linux and macOS, with Chrome 121, Firefox 121, Edge 121.
Enhancements
Supported Smart Wait: When Smart Wait is enabled in a project in Katalon Studio, TestCloud can execute test suites of the project with Smart Wait.
Supported Katalon Runtime Engine 9.3 as the latest version in Test Run Scheduler.
Fixes
History page: Fixed the issue where duplicated profiles are displayed in a row.
History page: Displayed the full list of failed test results Failed Test Result and Sessions, instead of limiting to only 50 items.
January 31, 2024
New features
Introduced the new History interface that helps users easily track, search, and filter all created test runs. See: View execution history.
Updated the latest browser version for Windows, Linux and macOS, with Chrome 120, Firefox 120, Edge 120, and Safari 17.
Enabled executing tests from uploaded zip repositories.
Enhancements
Users can now run test suite collection in TestCloud with the pre-configured retry setting for each test suite from Katalon Studio.
Mobile testing can be executed successfully with mobile devices that are compatible with Appium 2.x.
Katalon Runtime Engine 9.2 is now available as the latest version in TestCloud.
Fixes
Fixed broken TestCloud Tunnel Configuration page.
Revised the Test Environments section to display TestCloud environments specific to the current project.
December 6, 2023
Enhancements
Supported UTF-8 encoding for test scripts. You can now run test scripts that contain special characters in TestCloud in Chrome 119, Firefox 119, and Microsoft Edge 119.
Supported the latest browser versions on Windows, Linux, and macOS, with Chrome 119, Firefox 119, and Microsoft Edge 119.
November 21, 2023
New features
Added the Camera injection keyword that simulates capturing images in mobile applications. See: Camera image injection.
Enhancements
Users can execute test in TestCloud with the latest version of Katalon Runtime Engine (KRE). In the Schedule Test Run dialog, if you select "latest" for KRE version in Advanced Settings, the scheduler will automatically select the latest KRE version that supports your test environments.
Allowed uploading multiple versions of a mobile native application with the same application ID. All the versions of an application are displayed in the Application Repository.
Provided
FileExecutor
custom keyword to download and verify files when executing WebUI tests with TestCloud. See: Download and verify files.
October 25, 2023
Enhancements
- Updated latest browser versions for Windows, Linux and macOS (Chrome 117, 118; Firefox 117, 118; Edge Chromium 117, 118) for TestCloud environment in TestOps and Katalon Studio.
- [TestOps] Users can always see video recording when executing in Linux without enabling Screen Recording from Katalon Studio, regardless it passed or failed.
- [TestOps] When executing tests with Windows, macOS, and mobile environments, users can see proper video recording in the Test Result section.
Addressed the API key expiration:
- Updated API key that saved in TestCloud tunnel configuration to system API key.
- If the user has only expired API key, they can't schedule test or trigger a test run until they has at least one active API key in their API key list.
September 27, 2023
Enhancements
- Added Chrome 117 on Linux for Cloud Studio test execution.
- Users can identify which video recording belongs to which test case when executing mobile testing.
- Adjusted the default time out value in the Schedule Test Run dialog to 180 minutes.
September 13, 2023
Enhancements
Update latest browser versions for Windows, Linux and macOS (Chrome 116, Firefox 116, Edge Chromium 116) for TestCloud environment in TestOps and Katalon Studio.
August 30, 2023
New features
- When executing Cloud Studio test suites in TestCloud environments, users can take screenshot using the
takeScreenshot
keyword then view this screenshot, along with the screenshots in the Files tab of Test Run. - A screenshot is automatically taken and displayed at every failed test step in log. Users can view screenshots in the Test Result tab of Test Run.
Enhancements
- Renamed Use TestCloud tunnel toggle to Private/Local Testing .
- When the Private/Local Testing toggle is turned on, the status of available TestCloud Tunnel is displayed. If no tunnel is configured, there is a link to navigate to the TestCloud Tunnel setup section.
August 16, 2023
Enhancements
All Cloud Studio users have 4 TestCloud parallel sessions:
- These sessions are distributed between Cloud Studio test case editor and Cloud Studio test suites execution in TestCloud environment.
- If a user runs out of 4 parallel sessions, the execution with Cloud Studio test suites can be queued but Cloud Studio test cases execution in debug mode (test case editor) won't be created.
- This session limit is independent of Katalon Studio tests.
August 2, 2023
Enhancements
User can execute tests with Cloud Studio test suites stored in the Katalon Cloud default test storage and view test results / reports. See: January 19th 2021.
User can execute tests with Cloud Studio test suites stored in the Katalon Cloud default test storage and view test results / reports. See: January 19th 2021.- Turned off the Repeat toggle by default in the Schedule Test Run dialog. This helps users avoid repeating test runs and exceeding TestCloud quota unintentionally.
July 12, 2023
Enhancements
You can now select the Web Service option when selecting the execution environment for individual test suites in a test suite collection.
June 21, 2023
New features
Users can execute tests with TestCloud environments in CI/CD tools using Katalon Runtime Engine (KRE) commands without a KRE license; only TestCloud subscription or trial is required. Executing tests on TestCloud mobile browsers from CI/CD pipelines is limited to test suite collection.
Enhancements
Users can schedule test run in TestCloud environment with the latest browser versions: Chrome (111-114), Firefox (111-114), and Microsoft Edge (111-114) for Windows and Linux; Firefox (111-113) and Microsoft Edge (111) for macOS. See: Supported browsers.
April 25, 2023
New features
Users can run tests on Edge browser in IE mode with TestCloud environment from TestOps.
March 28, 2023
Enhancements
Users can schedule test run in TestCloud environment with the latest browser versions of Chrome (108-110) , Firefox (107-110) on Windows, Linux and macOS; Edge Chromium (108-110) on Window and macOS.
- Improved the test scheduling dialog:
Users can see the environments configured for test suites when running a test suite collection.
Users can save or cancel environment configuration.
March 1, 2023
New features
Enabled scheduling tests on Safari browser from Katalon Studio.
Enhancements
Improved sample mobile test projects for iOS and Android. Users can connect sample mobile projects to run with TestCloud environment in TestOps.
Launched a new interface of the test scheduling dialog in TestOps. The new interface helps improve navigation in test scheduling flow. See: January 19th 2021.
December 15, 2022
Enhancements
Added new versions of Chrome (104-107), Firefox (103-106), and Edge Chromium (104-107) for Windows, Linux, and macOS. See Supported browsers.
Added a banner on the top of the Katalon TestOps page to notify trial users when their TestCloud free trial is about to be expired.
November 29, 2022
New features
Enabled scheduling tests on macOS from Katalon TestOps.
Enabled scheduling tests on Safari version 10-16 from Katalon TestOps.
Enabled executing tests on Internet Explorer version 11 (IE mode in Microsoft Edge) from Katalon Studio.
Added the option to set desired capabilities for browsers and applications. When executing your test with TestCloud environment on TestOps, these desired capabilities would be applied. See Set desired capabilities for TestCloud environment.
October 3, 2022
New features
Introduced the capability to override execution environment of individual test suite when executing a test suite collection. See: Trial Period - January 20, 2022.
Introduced Mobile Native App testing, which allows users to upload mobile applications to TestOps and schedule automated mobile tests. See: Mobile native app testing with TestCloud.
September 5, 2022
New features
- Introduced the beta version of Mobile Browser Testing that allows you to schedule test on mobile browsers of iOS and Android. See: Run test on mobile browsers in TestOps.
GA Release - April 6, 2022
New features
- Enabled scheduling tests on the TestCloud Windows environment from Katalon Studio.
- Enabled scheduling tests in TestCloud headless browsers environment from Katalon TestOps.
- Enabled scheduling tests on websites behind a proxy.
Enhancements
- Removed warning about untrusted files when setting up TestCloud tunnel on macOS/Windows.
- Improved performance and stability when running test suite collections.
- Improved Windows node start-up time by pre-building Selenium Grid Docker Image when building TestCloud AMI instead of downloading the Docker Image every time.
- UI/UX improvement when running TestCloud via Katalon TestOps.
Fixes
- [Bug] Unauthorized tunnel management API access.
Trial Period - January 20, 2022
New features
- Introduced TestCloud trial period as the new multi-browser testing environment in Katalon Studio, Katalon TestOps, and Katalon Runtime Engine. See: Integrate TestCloud with TestOps and Integrate TestCloud with Studio.
- Enabled users to use TestCloud tunnel to execute tests in both public and private domains. See: TestCloud tunnel.
- Allowed users to contact Katalon at success@katalon.com to buy extra usage quota when running out of free trial package quota.
- Supported new versions of Chrome (96, 97), Firefox (95, 96), Microsoft Edge (96, 97).
Enhancements from Beta version
- Stabilized TestCloud tunnel performance for testing in private domains:
- Improved resilience of TestCloud proxy server.
- Queued up the execution if the number of requests exceeds the parallel quota.
- [UI] Displayed the Trial tag for the TestCloud option when scheduling test runs in TestOps.
- [UI] Displayed the TestCloud option when clicking on Run to execute tests in Katalon Studio.