A single view for examining a test run, as well as inspecting and modifying a test.
Clicking on the name of a test in the Test List view opens the test detail view and displays the test’s most recent test run. This view contains both information about the test and its execution, as well as controls for modifying the test definition and metadata.
The test’s basic metadata appears at the top of the left panel. This metadata section includes the ability to rename a test with the pencil icon, and change the test’s associated tags. The “Run Now” button executes a new test run of the current test, and the “History” button opens a new panel that shows the historical runs of the test, with the most recent run at the top.
Back in the left panel, below the metadata section, is the test definition, which is displayed as a simple text description of the ordered test steps. The test steps are highlighted in-sync as the video plays so that you can easily identify the currently executing test step.
Test steps are interactive and clicking on one opens a new panel with detailed information about the test step’s execution in the current test run.
The first section lists the selectors that were captured at test recording time that uniquely identify the element that the test step interacts with. Additionally, this section shows the outcome of using these selectors to identify the element in the current test execution. The test executor will use the selectors one at a time to query for elements on the page until it finds a unique, visible element. The first selector that matches a unique, visible element displays a green check mark, and any selector that wasn’t used at all is grayed out.
As a page’s HTML changes over time, these selectors may no longer uniquely identify a visible element. If this happens, the selector list displays the reason why the selector failed to find an element. These include the selector not finding any elements (not found), the selector matching more than one element (not unique), and the selector matching an element that is out of the viewport (not visible).
If the test step requires entering input text into an element on the page,
either via an
then that text content is displayed in the Input Text section.
Any test step that interacts with an element that displays visible text will display the Expected Text section, and will show a ‘diff’ view comparing the expected text to the actual observed text during the current test run. In this example below, the expected text was “7:50 PM” but the actual text displayed was “8:57 PM”.
Visual Observe test steps display both the baseline image of the element and the actual image of the element captured during the test run. If the images differ, then a third image, called the “delta” image, is displayed next to the images. The third image shows the pixel-by-pixel differences between the baseline and the actual image, with the different pixels highlighted in red.
Reflect captures all of the attributes for the element that a test step interacts with.
The attributes section displays the values both at test recording time,
as well as at test execution time if the values differ.
In this way, you can verify the presence of key attributes such as
Several of the test step detail sections expose editable elements used to modify the configuration of the test step (and ultimately the test definition). See Test Editing for full information about the editing actions that Reflect supports.