You can set up a baseline image to compare it with the screenshot of the next Test Run. Follow these steps:
Select a screenshot to see the details.
Select Mark as Passed at the top right corner of a screenshot, then close the screenshot.
An Unsaved label now appears on the Results page.
Click Save to baseline.
Note:
If you run a Test Suite for the first time and the Test Suite has passed, the screenshots are automatically marked as Passed and there is no Save to baseline button. You can open a screenshot and click Failed, then switch back to Passed so that the Save to baseline button appears.
If you run the Test Suite again and the new screenshots of this test execution are different from the baseline images, the status of this Visual Test Run is then marked as Unresolved. To resolve these images, follow these steps:
Click on the ID of the unresolved Visual Test Run.
Select the unresolved checkpoint.
You see a drop-down list in the Comparison Method section. The three options include: Pixel, Layout, Text Content. For detailed information of each comparison method, see: TestOps Visual Testing.
Select one of the three options to start comparing the new screenshot (on the right) with the baseline image (on the left).
Note:
Comparison Method is enabled only if the status of the screenshot is mismatched.
If you select Pixel, check the Diffs between two images (the differences are highlighted in red). See: Pixel-based comparison.
If you select Layout, check the Identical, Distinguishable and Missing/New boxes to see the differences highlighted in green/red/pink color respectively. See: Layout-based comparison.
If you select Text Content, check the Identical, Shifted and Missing/New boxes to see the differences highlighted in green/blue/pink color respectively. See: Content-based comparison.
Click Mark as Passed or Mark as Failed to resolve.
Note:
The Unsaved label appears whenever you change the status (Passed or Failed) of a screenshot. If you click Save to baseline, the new Passed screenshot replace the older baseline image. Katalon TestOps then compares between the new baseline image and screenshots of the next Visual Test Run.
Specifying ignored zones is especially useful when testing a website with some dynamic and changing content (such as pop-up ads on specific areas). Visual testing can ignore such content while comparing captured images with the baseline one.
In TestOps Visual Testing, you can configure an ignore zone in a baseline image and apply this ignored zone to all baseline images in the baseline collection. You can also delete the ignored zone(s) in all baseline images.
Adding an ignored zone to the same area in multiple baseline images could become time-consuming if there are more than one baseline image. With TestOps Visual Testing, you can apply an ignored zone to multiple baseline images in a baseline collection.
To apply an ignored zone to all baseline images within one baseline collection, follow these steps:
You can delete an ignored zone in one baseline image and/or all baseline images in the baseline collection.
An ignored zone applied to one baseline image only is displayed in purple. To delete it, click on the ignored zone and select the Delete ignored zone icon.
An ignored zone applied to all baseline images is displayed in yellow. To delete it, follow these steps:
Click on the ignored zone and select the Delete ignored zone icon.
The Delete all ignored zones box pops up.
Click Delete all zones to confirm your action.
Click Save to temporarily save the configuration.
Click Save Changes to permanently save this configuration.
The ignored zone is now deleted in all baseline images of the baseline collection.