Katalon TestOps Release Notes
March 27th 2024
New features
Introduced the Katalon Report Uploader, which allows the automatic pushing of test results to XRAY. This makes syncing Gitlab runs easier.
Introduced the ability to choose a subdirectory when configuring a Git Repository.
March 13th 2024
New features
Introduced the ability to link any custom Xray issue type with user-defined test artifacts on Katalon. Learn more here: How to enable the Xray integration.
Enhancements
Improved executions by ensuring TestOps Local Agent's compatibility with the latest version of KRE (9.3).
Upgraded the Jira Plugin for compatibility with Jira Data Center 9.12.x.
March 6th 2024
New features
Introduced a new feature called User Group. The Organization Owner/Admin can now create a group of users and invite their group to any Project at once without having to invite every single user.
March 5th 2024
New features
Introduced a new feature called Daily Summary Email, which provides users with email reports of their execution results.
Enhancements
Now displaying the total number for Failed Test Results and Linked Defects in the navigation tab of Test Run Reports.
February 20th 2024
New features
Introduced Bank Transfer as a new payment method. This payment method is applicable to US customers with a business domain and an annual subscription. For more details, you can refer to: Bank transfer payment.
January 31st 2024
New Features
Added the ability to preview Jira issue information when hovering over linked defects in Test Results lists, as well as a button to go directly to its corresponding Jira issue.
Introduced AI Control feature. The Account Owner can now disable all AI-powered features of Katalon within an Account. For more details, you can refer to: Enable/disable AI features in an Account.
Introduced a new Organization section on the Account admin page which shows your organization's general information. This page also replaces the Account Homepage displayed when users log in to TestOps.
Enhancements
Enhanced UI for Test Results lists to show more information.
Enhanced the Failed Test Results page to display all exceptions from all Test Results, as well as providing more filter options.
Disabled Virtual Data Analyst from generating insights if disallowed based on configurations from Account Settings.
The TestOps admin page is now divided into 2 separate pages - one for the Account level and the other for the Organization level.
The Owner and Admin can now check who invited new users to the Organization in the User Management.
Bug fixes
Deployed a fix within the test run level logic of TestOps that now prevents the following scenarios from causing executions to get stuck at the incomplete status:
Failed test results based on a browser error.
Running a test suite collection with a universal configuration.
January 17th 2024
New features
Re-introduced the ability for users to upload ZIP files in order to import their tests into TestOps, optimizing their workflows by not limiting them to only uploading via Git repositories. See: Upload a Script Repository to TestOps.
Pushing TestOps reports and test runs to Xray will automatically push a corresponding PDF and a ZIP file too. This ZIP file contains all artifacts of the reports, unlike before when we only pushed the PDF reports. See: Manually push Katalon test result to Xray.
Introduced the Project Detail page in the Project Management section for project information and membership management.
Enhancements
Allowed all Project roles to invite multiple users to the project. This includes users who haven't joined the Organization yet, provided that users' emails have the same business domain as the Organization Owner.
Changes
Offline license generation is no longer supported. Active offline licenses are still working until their expiry dates. When an offline license expires, you can switch to using an online license.
January 10th 2024
Enhancements
Added a list containing suggested defects that show when linking test results within the Report Defect feature.
Enhanced automation rules where new matched test results will not auto-link if the defect is already marked as resolved.
Enhanced UI to make it easier for users to view more information regarding linked defects for a particular test run or test result.
Enhanced the Refresh button's responsiveness in the Dashboard, Defect, and Requirements pages.
December 20th 2023
New features
Introduced Katalon Platform's new structure which applies to Organizations created from December 20th, 2023 onward. Katalon now has 3 management levels: Account level is the highest, followed by the Organization level, then Project levels. To learn more about the new structure, you can refer to Administrative Roles and Permissions.
- At the Project level:
- Allowed the Owner or Admin of an Organization to invite multiple users to multiple projects even if they have not joined the Organization.
- Allowed the Owner or Admin of an Organization to view details of all Projects under their Organization.
Allowed to auto transfer ownership to the Organization Owner if the Owner of any Project is removed from an Organization.
Introduced a new page on TestOps called "Organization Setup". This page consolidates features like test environments, TrueTest configurations, and more. It provides users with a streamlined method to configure their organization's properties directly within TestOps.
Test environments have now been relocated to the Organization Level, granting users the ability to establish test environments and assign them to the relevant projects independent of Team Level limitations.
Enhancements
The Project Management section is now on the TestOps Admin page.
Once an Organization configures Custom Domain and SSO, the login settings for all users is set to enable login with SSO and disable login with username/password by default .
December 12th 2023
New features
Introduced new functions for the Slack integration. You can now configure it to send you notifications in a Slack channel based on defects updates.
Introduced a new toggle feature that only shows Failed/Error/Incomplete test results that haven't been linked to a defect yet.
Enhancements
Revamped the Jira add-on button behavior and its banner.
December 6th 2023
New features
Introduced automatically attached PDF reports for pushed Xray Test Executions' matching TestOps reports.
November 29th 2023
New features
- Introduced Automation Rules for test defects which allows you to automatically link specific defects to to matching test results to help minimize manual linking. Learn more about it here: Defects Report automations.
November 22nd 2023
New features
To enhance user productivity and streamline workflows on TestOps, we now allow bulk operations with test suites. You can:
Move multiple test suites
Duplicate multiple test suites
Delete multiple test suites
Bug fixes
Report Defect dialog automatically closed itself.
November 15th 2023
Enhancements
Removed the invitation accept step. When an Account Owner invites a user who shares the same non-public email domain, the user can immediately join the organization without having to accept the invitation email.
November 8th 2023
New features
To enhance user productivity and streamline workflows on TestOps, we now allow bulk operations with test cases. You can:
Add multiple test cases to a test suite
Move multiple test cases
Duplicate multiple test cases
Delete multiple test cases
Enhancements
Users who connect Xray Tests to TestOps test cases now have their linked test cases displayed in the Katalon Platform section of the Jira plugin.
You can now enable or disable the Jira plugin for specific Jira projects.
The automatic linking of an undeletable Release to a Schedule was reportedly a challenge for some users. This has been modified; users can now link a Release to their Schedule instead of it being linked automatically.
October 31, 2023
New features
- Users can now seamlessly create new Jira issues from TestOps after investigating a failed test result. Linking issues to a Jira ticket with current test results can be done without leaving TestOps.
Enhancements
TestOps' Jira integration has been revamped when it comes to: setting up configurations, choosing a project, and creating a Webhook.
Added Refresh button to fetch latest Jira tickets & fields configuration.
Defect reporting behavior related to linking tparticular test results to existing issues on Jira has been revamped.
Enhanced the notification mechanism for sending messages via Slack and Email.
October 30th 2023
New Features
- You can now sign in to Katalon TestOps with your Google account.
- Added a banner to notify Account Owner and Admins to purchase more licenses, arrange the account membership, or assign licenses to the members. If no action is taken within 90 days, users will be blocked from using free Katalon Studio. For further information, refer to Free Offerings term in Terms of Use.
Enhancements
- [Cloud Studio] You now can create and execute test cases with Cloud Studio without being counted towards the quota in Product Utilization of Katalon TestOps.
- [License Management] You now can select multiple users at a time to revoke users' licenses.
- Redirected all Administration login pages to a centralized sign-in page: Katalon login page.
October 25th 2023
New features
Introduced a new feature called Instant Run. This allows users to quickly execute test cases in Cloud Storage directly from the Test Explorer view. This allows users to rapidly produce their Cloud Studio test case reports and derive insights from them with one click.
Bug fixes
Fixed a failure to add additional licenses for an existing product.
October 11th 2023
New features
Users can now add test cases to test suites directly from the Test Case table or Test Case details page, allowing for easier test case organization.
Enhancements
The delete function in TestOps' test suite screen has been relocated to the triple dot menu at the upper right corner.
The pop-up dialog for the delete confirmation dialog has been updated.
Redirected the download link for Katalon Studio. It now leads here.
October 9th 2023
New features
Allowed Organization Owners and Organization Admins to seamlessly add new users to a team right after sending invitations for them to join the organization. For more details, refer to: Invite users to join an Organization.
October 5th 2023
New features
Users can now view the value of Severity fields on the Defects page.
Enhancements
Migrated the database for the Severity field to the Defects page.
Enhanced the Jira field fetching mechanism to get the Severity field.
Updated the display Priority with the format "icon - value" in a Defects page.
Reduced the number of searches when a user changes the time filter on the Test Run page.
September 6th 2023
New features
- Introduced enhanced starter packages: Upgrade options for starter users, including those who already purchased a starter package and those joining this phase, can now seamlessly ascend to a higher-tier package within the subscription cycle of the initial package. Users can enjoy aligned pricing and simplified renewals for additional products within a seamless subscription cycle.
Enhancements
[UI/UX] The Your current subscriptions section will transform into a collapse/expand panel. By default, it will be collapsed whenever users visit the Subscription Management page.
[UI/UX] The Get more single products section will be converted into a collapse/expand panel. For starter users, it will stay collapsed by default when they land on the Subscription Management page.
August 30th 2023
New features
[TrueTest] Now displays the "data tracking" status of AUTs. They can be either Inactive, Active, or Paused.
[TrueTest] Associates a specific error when generating a map with corresponding error documentation.
[TrueTest] Review test cases of archived maps in the script repository.
- [Test Management] Users can now perform quick actions directly on test cases or test suites such as renaming, editing, duplicating, and moving.
[Test Management] Users can now schedule test runs directly from both test suite list view and the test suite detail page. Note that this is not available for test cases/test suites stored in Git repositories.
Enhancements
[TrueTest] Improved the quality of AI-generated test cases.
[Platform Settings] Project Settings has been removed and consolidated with Project Configurations within settings.
[Virtual Data Analyst] Enhanced the AI-blocks so users can refresh and add tracking events.
August 15th 2023
New features
Released the beta for Virtual Data Analyst. It's a new feature that uses the capabilities of generative AI to analyze TestOps data and subsequently create actionable insights. Read more about it here: Virtual Data Analyst.
August 2nd 2023
New features
Added Katalon Cloud. It's the new default bucket for all new projects. It's designed to enhance the user experience by providing a seamless and convenient way for users to publish, manage, execute, and report tests directly on the Katalon Platform. See: January 19th 2021.
Users can execute tests with Cloud Studio (Beta) from Katalon Cloud, as well as view results or reports similar to how it works when using a Git repository.
Enhancements
The Repeat toggle in the Schedule Test Run dialog in TestOps is now toggled off by default.
Changed the notification text when running the Mobile Native App testing feature.
Bug fixes
TestCloud will update its Local Engine automatically instead of using a fixed version.
July 27th 2023
Enhancements
Created a notification banner for Account Owners or Billing managers to receive to remind them should their Test Results usage reach 75%. It links to subscription management to help them adjust their quotas accordingly.
Fixed how user support slots work in the event that a selected member is removed from the Organization.
June 7th 2023
New features
Introduced the free use of Visual Testing Professional (VTP) for TestOps. Any current and future users can create as many checkpoint images and subsequent test results until they hit their test result quota for their subscription tier.
Enhancements
The onboarding flow for users newly invited to an organization has been improved. They will now go straight to the TestOps homepage for a quicker start.
Fixes
Fixed a bug regarding support management slots not properly reflecting allowed quota.
Fixed another bug in support management where all members could be removed from assigned support slots. This is no longer possible.
Fixed an error in On-premises' license server regarding data migration.
May 18th 2023
Enhancements
Added a notification banner to remind users to verify their email addresses if they have not completed the email verification process.
May 11th 2023
New features
Introduced the tree view for script repository which allows choosing multiple test cases for a test suite.
Introduced ability to run test cases with configured data binding.
Now on project pages, Katalon TestOps interacts with you by dynamically rewriting on the displaying page instead of loading entire new pages.
April 12th 2023
Enhancements
Visual Testing: Hide the "Visual Testing" drop-down list in the Schedule Test Run dialog (Advanced Settings) when scheduling with Katalon Command and Generic Command. Users now specify the baseline collection ID in the command argument.
March 28th 2023
Enhancements
Introduced the ability to create Jira Webhook integration with Katalon Platform.
Introduced Defects Report with trendline graph and useful insights to the defects in Katalon test runs.
March 20th 2023
New features
Introduced a new feature to the current On-Premises package: Katalon Platform On-Premises, a new solution designed for enterprise users with strict security and privacy policies. Users have access to TestOps features similar to the current Katalon Platform offerings such as managing users and projects through the administration module, scheduling execution, and visual testing of projects in the isolated On-Premises deployment.
Enhancements
From now on, Katalon On-Premises only supports Linux distros that are Debian-based and CentOS-based. Windows and MacOS are no longer supported.
March 1st 2023
Enhancements
Enhanced Xray Katalon integration experience by linking Katalon test result URL under Xray test run and show linked Katalon defects as Xray Defects under Xray test run.
February 22nd 2023
Enhancements
Introduced the ability to share filtered test runs report via URL. Now users within an organization can copy the URL of a report chart and send to each other, with filters such as time range, profile, release/build retained in the chart view.
Bug fixes
The Failed/Passed run ratio was not calculated correctly due to the implicit inclusion of Incomplete test run. The Incomplete test run was removed from the Failed/Passed ratio and test run statistics bar.
February 1st 2023
Enhancements
[Custom Fields & Tags] Improved the inheriting mechanism so that incomplete and in-progress test executions also have custom fields and tags assigned.
[Custom Fields & Tags] Allowed overwriting custom fields and tags if they were assigned both through Katalon Studio with Katalon Runtime Engine (KRE) and through TestOps interface.
[Xray integration] Showed on Xray/Jira interface the TestOps test environments. This enhancement allowed the ability to search for test executions on Jira based on test environments.
[Xray integration] Showed on TestOps interface the Xray test executions that were linked with TestOps test run.
[UI/UX] Polished the wording and center-aligned the elements within the header TestOps navigation bar.
[UI/UX] Added the external icon to View Profile button under the user profile section. Also within the user profile section, Notification settings has been renamed to User settings.
[UI/UX] Displayed the count of test cases being executed, grouped by their status in the test execution status progress bar.
- [UI/UX] Improved test execution report chart behavior:
Dynamically adjusting bar length and labels based on window size.
Expanding Daily Group filter limit to 90 days.
Hiding the report header when scrolling down.
Eliminating vacant spaces among chart columns.
January 5th 2023
Enhancements
[Custom fields and tags] Allowed users to assign custom fields and tags to test runs in Katalon Runtime Engine (KRE) commands. See: TestOps integration arguments.
December 7th 2022
New features
[Custom fields & tags] Allows users to organize their test artifacts. See: Custom Fields and Tags.
Assign custom fields or tags to test case, test schedule, and test run
Assign custom fields or tags to test entities when uploading reports from external sources
Filter test entities on TestOps
Limited analytical filtering with custom fields and tags
[Xray integration] Allows users to link their manual & automation test from TestOps to Xray. See: Configure Xray Integration in Katalon TestOps.
Link TestOps test case with Xray test on Jira
Link TestOps test schedule with Xray test plan on Jira
Automatically/manually push TestOps test run to Jira as Xray test execution
Manage Xray test execution with release versions and evidences from TestOps
Synchronize TestOps test results to Xray test run
Users who adopt Robot framework can now orchestrate testing activities by integrating with TestOps: the status of visual test cases developed by Robot framework can be promptly driven by Visual Testing results.
Supported the multi-year subscription plan.
Enhancements
Changed a UI text: The button "Submit a Ticket" is now "Submit a Support Case" to maintain consistency with the header on the Katalon Platform portal.
Implemented an API for project creation in Reports and Analytics.
- Test Run Report enhancements:
Synchronize test run list and test result by status chart
Customizable filter
Interactive search bar
Advance Time range filter
Fixes
Allowed the Account Owner/ Account Admin to assign a Visual Testing Professional product to a member's license before they accept the invitation.
- Fixed the issue where users cannot assign KRE-Nodelock after clicking the Back button.
Added a notice message for users who exceed 50 accounts limit.
Fixed the issue where creating a default project after signing up on Katalon Platform did not generate default custom fields.
Fixed the mismatched test run results in some user cases of purchasing or canceling subscription plan.
November 29th 2022
New features
- Visual Testing Professional (VTP):
- Introduced the Pixel Sensitivity adjustment feature. See: Adjust the pixel sensitivity level.
- Introduced the Default Comparison Method feature in a baseline collection. See: Default Comparison Method.
- Introduced the Upload Images and Create Baseline Collection features. See: Upload baseline images/collection.
November 9th 2022
New features
Displayed the number of Organizations and Users per plan on the Subscription Management page.
Introduced one more sub-tier for the Ultimate plan - 20000 Test results.
Allowed Team Owner and Team Admin to edit Project Name in Project Management.
Allowed Account Owner and Account Admin to assign KSE/KRE licenses right after sending invitations to new member users.
Users can go to Welcome Page from their Profile Page, which simplifies user navigation.
Enhancements
Added a sample project called First Project in every newly created organization. Users can interact with the data in this project to learn about TestOps features.
Removed the redundant pop-up where users must select standalone apps before processing the checkout.
Provided Guidelines for users who reach the limit of the Katalon Platform quota so they can adjust their subscription plan accordingly.
Allowed users to delete their Account if they do not have any subscriptions or cancel auto-renewal.
[UI/UX] Removed the View Demo Site button on the navigation bar.
[UI/UX] Removed the Schedule Sample Test Run button on the Test Execution page.
[UI/UX] Removed the Quick Guide button on the Profile menu.
Fixes
Removed the incorrect name and incorrect quota of Katalon Platform for the Free tier when users are in the trial plan.
Fixed bugs that are relevant to Assign Licenses and Inviting User flows.
Fixed HTML injection issues.
October 26th 2022
Enhancements
Added a user survey to help new users start to use Katalon TestOps with the right edition of Katalon Studio.
Improved the Smart Scheduler to set proper date for test execution.
Added the Skipped category for test result status.
October 12th 2022
New features
Introduced root cause analysis for each failed test result. Failed test results are now automatically associated with failure reasons. See: Failure reason.
Introduced the Failed Test Results tab that shows statistics of failed test results.
Enhancements
Added the option to download Katalon Studio - Standalone Edition directly in TestOps.
Removed the requirement for typing in the test run ID when users want to terminate a test run.
Updated the Test Scheduler UI with more accurate wording and tooltips.
Fixes
Fixed the Katalon integration extension issue (on Chrome).
September 21st 2022
New features
Implemented the Katalon TestOps onboarding tours for testers and QA managers.
Introduced the Account level to handle billing management. One organization belongs to only one Account. The Billing Manager role is now moved to the Account level. See: Administrative Roles and Permissions.
Enhancements
Added the option to download Katalon Studio and Katalon Runtime Engine in the navigation bar.
August 2nd 2022
Enhancements
[Jira integration] Fetched the Start Date and Release Date for populated Jira releases. See Populate Jira releases.
[UX/UI]:
In the Profile dropdown list:
Added the option to view release notes.
Added the option to download Katalon Studio.
Changed UI text from Community to Community Portal.
Changed UI text from Submit a Ticket to Submit a Support Case.
Removed Feature Requests and Bug Reports buttons. You can now submit feature requests and report bugs via the Forum.
In the Test Execution tab:
Changed UI text from Pre-Installed Katalon Studio Location to Pre-Installed Katalon Runtime Engine Location in the Schedule Test Run dialog.
Changed UI text from Katalon Studio version to Katalon Runtime Engine version in the session details.
In the Settings panel:
Added the Support Management button in the TestOps Admin settings. This option allows an organization owner or administrator to assign supported slots to members for ticket submission.
[Visual Testing]:
Enabled the ability to move and edit applied-all ignored zones. See Apply an ignored zone to all baseline images.
Added the Analyzing status to the comparison methods when the process is being run.
July 5th 2022
New features
[Reports] Introduced the Incomplete status for test runs.
Enhancements
Upgraded dependencies to version 1.3.3-AC for the Jira cloud add-on.
Optimized data fetching from Git repositories.
- [Visual Testing]:
Allowed an ignored zone to be applied to all baseline images in a baseline collection.
Allowed an ignored zone to be deleted in all baseline images in a baseline collection.
Enabled navigation back to the baseline collection details from the baseline collection history.
Combined the Results and Checkpoints tabs into one Results tab in the Visual Test Run section.
Fixes
- Bug: Could not clone Bitbucket repository from a branch containing
/
(e.g.,test/develop
).Note:Users need to upgrade the agent to the latest version 1.7.4.
June 7th 2022
New features
- Visual testing:
Introduced the Configure Ignored Zones feature. See: Add an ignored zone to a baseline image.
Introduced the Visual Baseline Collection feature. See: Baseline collection.
Added Visual Testing option in the Schedule Test Runs dialog to associate test runs with a baseline collection.
Enhancements
[Visual Testing] Enabled marking multiple checkpoints as passed or failed.
[Test Case Management] Added Flakiness, Last Updated, Average Duration, Last Executed in the Test Case filter search.
[Test Case Management] Added the status for each test case, the No. of execution column and enabled all linked requirements to be displayed in the Requirements column.
May 9th 2022
New features
- Implemented the new design for Project Dashboard, adding new dashboards (Productivity and Quality). See: Introduction to TestOps Dashboard.
- Introduced two AI-powered features for visual testing (two additional comparison methods supported by AI engine). See: Visual Testing Overview.
Enhancements
- [Integration] Enabled compatibility for Jira version 8.19.1 with Katalon TestOps adds-on.
- [UI/UX] Separated Visual Testing from Reports module. Visual Testing has now become an independent module on TestOps.
- [UI/UX] In the Test Runs page, added filters for operating system and browser with their corresponding columns in the All Test Runs grid.
March 29th 2022
New features
Introduced the Test Runs Overview module. See: Test Runs Overview.
Allowed access to a demo site from the organization's dashboard.
Introduced onboarding tours for key TestOps functionalities.
Enhancements
[UI/UX] Disabled the Survey Monkey in the Test Run Details page.
[Script Repository] Required username and PAT input when creating a new Git script repository.
[UI/UX] Retained the state of previous page in the Test Suite Details page.
[UI/UX] In the Schedule Test Run dialog, when choosing Test Suite for type:
- Added Chrome (headless) and Firefox (headless) options in the Run with dropdown list.
- Removed the currently-selected TestCloud platforms if choosing a different browser from the Run with dropdown list.
[UI/UX] Allowed automatic navigation to the TestOps folder in which the new Test Suite has just been created.
[Administration] Introduced the new license types. See: Sunsetting plan for node-locked and floating licenses.
February 28th 2022
New features
Introduced AWS CodeCommit for test scheduling and test management. Read more: Upload Test Scripts from a Git Repository.
Enhancements
- [Test Suite Management] Enabled test suite deletion.
- [UX/UI] [Test Suite] Allowed script repository to be indicated under loading.
- Disabled .zip script repository uploads for unused projects.
- [UX/UI] [Schedule Test Run] Appended path to test suite name when scheduling test run with Test Suite type.
- [UX/UI] [Schedule Test Run] Made TestCloud as default option in environment selection.
Fixes
- Bug: Resolved security bugs.
January 20th 2022
New features
- Introduced test suite functionalities for TestOps. Users can create, execute and manage test suites. Read more: Manage Test Suites.
- Introduced the design for test suite management. Read more: Manage Test Suites.
- Introduced GitLab and Azure Repos integration for test scheduling and test management. Read more: Upload Test Scripts from a Git Repository.
- Introduce TestCloud Trial Period as a new multi-browser testing environment. Read more: TestCloud Overview.
Enhancements
- [Integration] Enabled users to merge existing test results when configuring a new script repository integration.
- [Test Case Management] Enabled the script repository folder refresh in the directory view.
- [UX/UI] Enabled users to resize the test management directory view.
- [UX/UI] Indicated that the script repository is loading.
- [TestCloud] Displayed Trial tag for TestCloud environment option when scheduling test runs.
December 13th, 2021
New features
Introduced a new design for test case management. Read more: Manage Test Cases.
Enhancements
[UI] Updated the navigation bar.
[UI] Added breadcrumbs of Test Case paths in the Test Case's detailed page.
Fixes
[Bug] Cannot schedule test runs from Katalon Studio when moving refreshed Test Suite Collection to the queue.
November 2nd 2021
New features
Introduced further capabilities to current Mark as Passed/Failed feature. Read more: Override Test Result status.
- Improved Test Run report with new stacked bar chart
Introduced TestCloud as a test environment to schedule a Test Run (for beta users only). Read more: Integrate TestCloud with TestOps
Enhancements
- [UI] Updated Organization and Project navigation menu
[UI] Updated Settings menu
[UI] Automatically remove machine ID when user is removed - Activate License validation
[UI] View original & latest status in test result
[Reports] Added confirmation dialog before sharing reports via email
Fixes
[Jira Integration] Can not refresh Jira status if user has deleted Jira release
[Access Log] Access Log records do not have IP Address values
September 29th 2021
New features
Introduced Test Orchestration for Bitbucket repositories (sequential and parallel mode). Read more: Upload Test Scripts from a Git Repository.
Introduced a new flow to schedule test runs. Read more: Schedule Test Runs.
Enhancements
[Subscription] Enabled subscribing to TestOps Business via a "Get Quote" email.
[License Management] Added max session timeout in Idle TimeOut.
[UI] Updated invitation UI in User Management.
[UI] Allowed to select Test Environment in Schedule Test Run dialog.
[UI] Allowed to create Test Run Type without running or scheduling.
[UI] Updated information in Script Repositories view (Create & Edit).
[UI] Consolidated Schedule Test Run button colors.
[Access log] Added email address to access log files.
[Test Run Type] Added sorting value by time.
[Test Run Type] Removed data in Last Run column.
[Reports] New confirmation dialog when exporting test run reports.
[Reports] Allowed viewing re-run test results via email.
[Jira integration] Synced Release status from Jira.
[Jira integration] Enabled refreshing Jira release status in TestOps.
Fixes
[Agent] Local Agent status (online/offline) failed to show up when scheduling test runs.
[Jira integration] Katalon Studio and TestOps integration (com.katalon.katalon-jira-plugin) failed HSTS Validation from Connect Security Requirements Tester.
[Maintenance mode] Chart did not display and show error message after navigating to the Summary by Test Result page.
July 26th 2021
New features
Introduced Auto-distributed execution. Users can automatically distribute tasks to active and available Agents. Learn more: Auto-Distributed Execution.
Introduced Test Usage Validation. Users can view how many test runs remain until their subscription quota is capped.
- Introduced Similar Error Suggestion. Users can view all common errors of their failed test results in the centralized view.
Enhancements
Enhanced filters for Reports & Analytics.
- Enhanced component release summary.
- Enabled component to show test percentage in release readiness.
Enhanced wizard for framework integration.
Build visible under Configuration section for each Test Run.
Fixes
- Could not filter API log by timestamp.
- testRuns (Number of test runs) field could be manipulated into invalid values.
- Long pending messages in Retry function.
- Path Injection, Zip Slip vulnerabilities.
- Occurrences where the app would break because of a missing LD config file.
- Uncommon error when creating thumbnail.
- User could fetch other organization's invoices from Payment Success screen.
- Week/day view of calendar would show wrong test runs when updating time zone.
- Manually uploading Katalon Reports in TestOps sometimes failed.
Agent could not override Execution Mode of Test Suite Collection when executing with KRE 8.0/ 8.0.5 versions.
Removed: polling message prompts for certain errors.
June 22nd 2021
New features
Added Re-run Test Results to the Test Results summary. See: View Re-run Test Results in TestOps.
Enhancements
Updated maintainer column in Flaky Test list.
Updated UI for Integration function.
Enhanced security when updating Git test projects.
Fixes
Fixed a bug where users could not:
- migrate subscriptions.
- send an invitation email.
- calculate statistics for empty Test Runs.
- download a large Test Run as .xsls file.
- delete the execution.
Fixed the missing profile name on the execution page.
- Fixed search field for execution that doesn't re-run.
- Clarified the message for adding Users to Teams successfully.
May 26th 2021
Enhancements
Filter test runs by Build Name. Learn more.
View Release Readiness in TestOps Dashboard. Learn more.
April 26th 2021
New features
Integration with Pytest. Learn more
Integration with Kobiton. Learn more
Test Suite-based parallel execution. Learn more
Enhancements
New release of Katalon agent version 1.7.
Improve performance for Test Planning calendar view.
March 8th 2021
New features
Introduce a new term — Build — that is used in Katalon TestOps. Learn more.
Create and manage Builds in Test Planning. Learn more.
The "Task" feature has been removed.
Enhancements
- Introduce a new and improved Katalon TestOps User Interface.
January 19th 2021
New features
Monitor Test Runs in a calendar view. Learn more
Manage Test Runs with similar configurations with Test Run Types. Learn more
View Release Readiness by Test Case status & Test Run history. Learn more
Manage Katalon Studio Test Results (BDD and non-BDD). Learn more
Automatically detect assertions in each Test Case for better quality evaluation & failure investigation.
Balance loads between multiple Test Environments. Learn more
Support reports for Visual Testing. Learn more
Create an Agent for Docker Environment. Learn more
Create a Kubernetes Environment. Learn more
View reports of Web Services & Test Objects.
View abnormal Web Services for faster failure detection. Learn more
View Requirement coverage heat map. Learn more
Detect the flakiness of Test Cases. Learn more
Enhancements
Simplify the Local Test Environment setup process.
Enhance CI integrations.
Enhance UI/UX
Simplify the Local Test Environment setup process.
Enhance navigation to recent projects and on-going Test Runs.
Enhance Jira issue lists.
Centralize Test Run data for better collaboration.
[Visual Testing] Incorporate reports into Test Run results.
[Visual Testing] Provide execution comparisons with visualization.
View Test Sessions with logs submitted from Test Environments.
Support sharing Test Run report via email.
Provide shortcuts to access reports.