Override test results status in Katalon TestOps
Automated tests produce test results automatically. This means that test results are fixed unless you manually update the status of a test result to reflect actual expectations.
In Katalon TestOps, you can edit the status of a test result and provide a reason for the change to notify your team of the change.
This feature also allows you to:
keep a clear record of why a test result has been changed, who changed it, and the reason for the change.
find out whether the status of a test result has been manually modified and what was its initial status.
see the whole history of status changes.
Change the status of a Test Result
Changing the status of a Test Result affects the status of a Test Run and its Test Suite. You should override Test Results statuses with caution. See TestOps Formulas for definitions of Status (Test Run) and Status (Test Suite).
Follow these steps:
-
Sign in to Katalon TestOps and go to your Project.
-
Go to Reports > Test Runs.
-
Click on a Test Run ID, then select the Test Results tab.
You can see the list of all test results and their details (Status, ID, Name, Time, Assertions, Links) here.
-
Click on the Extension icon of the Test Result you want to change.
-
Click Mark as Passed (for a failed/incomplete/error Test Result) or Mark as Failed (for a passed Test Result). See TestOps Formulas for definitions of Status (Test Result).
A box pops up asking you to choose a reason for the status change.
-
Select an option, then submit the new status for this Test Result.
View status change details of a Test Result
You can see the detailed information and description of a status change once the status has been modified.
Select the Test Results tab, click on a Test Result ID, then select the Comments tab.
You can then check the following information:
- the name of the member who changed the status of a Test Result.
- the history of that Test Result's status changes.
- the reason for each status change.
View the summary of a Test Result's status change
No matter how many times a test result has been modified, you can always view the full history of changes.
Follow these steps:
-
Select the Test Results tab.
-
Mouse over the Information icon next to the Test Result status, then click View changes log.
Now you can view the following information:
- the original status of a Test Result.
- the latest status of that Test Result.
- further detailed changes of that Test Result.