A single view for examining a test run, as well as inspecting and modifying a test.
Click on a test row in the Tests list table and a dropdown appears with recent test runs for the test. You can click on these rows to view the specific test run, or click the “Edit” button on the test row to load the test definition page. The test definition page displays a table of all historical runs for the test that are within the account’s retention period. Click any row to load the specific test run view.
Back in the left panel, below the metadata section, is the test definition, which is displayed as a simple text description of the ordered test steps. The test steps are highlighted in-sync as the video plays so that you can easily identify the currently executing test step.
Test steps are interactive and clicking on one opens a new panel with detailed information about the test step’s execution in the current test run.
The Selectors section lists the selectors that were captured at test recording time that uniquely identify the element that the test step interacts with. Additionally, this section shows the outcome of using these selectors to identify the element in the current test execution. The test executor will use the selectors one at a time to query for elements on the page until it finds a unique, visible element. The first selector that matches a unique, visible element displays a green check mark, and any selector that wasn’t used at all is grayed out.
As a page’s HTML changes over time, these selectors may no longer uniquely identify a visible element. If this happens, the selector list displays the reason why the selector failed to find an element. These include the selector not finding any elements (not found), the selector matching more than one element (not unique), and the selector matching an element that is out of the viewport (not visible).
If the test step requires entering input text into an element on the page,
either via an
then that text content is displayed in the Input Text section.
Any test step that interacts with an element that displays visible text will display the Expected Text section, and will show a “diff” view comparing the expected text to the actual observed text during the current test run. In this example below, the expected text was “7:50 PM” but the actual text displayed was “8:57 PM”.
Visual Observe test steps display both the baseline image of the element and the actual image of the element captured during the test run. If the images differ, then a third image, called the “delta” image, is displayed next to the images. The third image shows the pixel-by-pixel differences between the baseline and the actual image, with the different pixels highlighted in red.
Reflect captures all of the attributes for the element that a test step interacts with.
The attributes section displays the values both at test recording time,
as well as at test execution time if the values differ.
In this way, you can verify the presence of key attributes such as
Several of the test step detail sections expose editable elements used to modify the configuration of the test step (and ultimately the test definition). See Test Editing for full information about the editing actions that Reflect supports.