Test Execution Overview
Katalon Platform offers a variety of test execution solutions, giving testers the flexibility of choosing the execution environments and behaviors. This document is an overview of test execution methods offered by Katalon Platform and their common use cases.
Test methods
Katalon Platform provides scalable test executing solutions across local, on-premises, and cloud environments. Specifically, the platform offers the following methods.
Local: You can develop and execute your tests right away with Katalon Studio or with the command-line interface of Katalon Runtime Engine (KRE). See: Execute tests with Katalon Studio overview and Execute tests with KRE.
Cloud-based: With TestOps and TestCloud, you can execute tests on most common browsers and operating systems, and on different devices specific to your application under test. See: Test execution with TestOps and January 19th 2021.
CI/CD Integrations: We provide a pre-configured Docker image equipped with KRE - the Katalon Docker Image (KDI). With this image, you can implement test executions in containers of any CI/CD pipeline. See: CI/CD integration overview.
Integrations with other vendors for cloud execution
Besides the provided methods, you can further extend Katalon tools by integrating with other software testing vendors. These integrations allow you to execute Katalon tests in cloud environments and devices created by other platforms, for web or mobile applications.
The integrations for test execution include:
| Product | Description | Supported Katalon Studio versions |
|---|---|---|
| TestCloud | Execute tests on the cloud with the most popular browsers, operating systems, and mobile devices. See: Supported environments for Katalon TestCloud. | |
| AWS Device Farm | Execute your Katalon test scripts with devices provided on AWS Device Farm by using aws-device-farm-integration. | |
| App Center | Execute your Katalon test scripts with devices provided on App Center Test by using Sideload to package Katalon projects in JUnit format. | |
| BrowserStack | Execute your tests on BrowserStack Selenium Grid from your Katalon Studio instance. | v7.0.0+ |
| CircleCI | Set up a CircleCI test environment to schedule and execute tests remotely with Katalon TestOps. | |
| Docker image |
| |
| Kubernetes | Create a Kubernetes (EKS) test environment to execute or schedule Test Runs in Katalon TestOps. | |
| Kobiton |
| v7.0.1+ |
| LambdaTest | Run your tests on LambdaTest Selenium Grid from your Katalon Studio instance. | v7.8.0+ |
| Sauce Labs | Execute tests with Sauce Labs profiles and view Katalon test execution results on Sauce Labs using the Sauce Labs Integration from Katalon Store. | v7.0.0+ |
| Custom integration via Desired Capabilities | Define Desired Capabilities in different environments for a Katalon project. | v7.0.0+ |
| pCloudy* | Execute mobile and web automation tests with Katalon Studio on pCloudy mobile devices and browsers. |
Use Cases
The following are some common use cases for test executions in Katalon TestOps.
Record and replay your tests in Katalon Studio to validate basic test cases. See: Execute a test case.
Pass your Katalon test projects to KRE and execute the tests in your development environment with headless mode. See: Command Builder in Katalon Studio.
Self-host a local TestOps agent that contains KRE and execute tests. See: Create a local test environment with an Agent.
Map your TestOps project with a test repository (hosted on GitHub, GitLab, ...) and schedule test runs. See: Trigger test runs manually.
Integrate to the CI/CD pipeline of your choice with KDI to execute tests with code changes. See: CI/CD integration overview.