Interpreting Metrics
When a test is running and after it has completed, you will be able to easily see many key performance indicators (KPI) so you can verify the status and outcome of the test. Many of the metrics and KPI presented in VPT are aggregated over the entire result set. This data will give you a picture of the overall experience users interacting with your application will have. The major metrics and what they mean are explained in the Metrics Captured article.
Interpreting Success Criteria
You can find a test run’s result as defined by its Success Criteria in two ways: on Test Run tables found throughout VPT and on the test run’s Summary page.
On the tables, you’ll see the Result field populated with an icon or with text denoting the success or failure of a test. One of five possible indicators will be shown here:
Double Hyphen (--) : The test is still in progress.
Green Check: The test passed all criteria.
Red X: The test failed on one or more criteria.
Not Applicable (N/A): The test did not use criteria.
Red Exclamation Mark: VPT encountered an error when evaluating the test’s criteria.
On the summary page, if the test used Success Criteria, you’ll see the Result described in the summary header.
Clicking on the Result text will open a modal that breaks down the Result by each criterion.
Here you will see the Result of each criterion, the Key Performance Indicator (KPI), Comparison, and Threshold values defined in the test’s configuration, and the Actual value of the selected KPI generated by the test.
On mobile screens and when the window width is too small to display all five columns, the KPI, Comparison, and Threshold values will be abbreviated into a single Description column.
