Skip to end of metadata
Go to start of metadata

You can define a custom test quality criteria which will determine the outcome of the test. The criteria include a list of condition thresholds that, if exceeded, will fail the test.

There are four conditions to choose from:

  • Page goal misses
  • Transaction goal misses
  • Request errors
  • Request Timeouts

To enable the test quality criteria:

  1. Navigate to the Pass/Fail configuration settings (a).
  2. Select and enable the desired conditions to monitor (b).
  3. For each criterion, set the percent threshold for violations (c).

Setting any threshold to 0 will trigger a threshold violation if there is at least one instance of the condition. If, at the end of the test, there are any threshold violations, then the test did not pass the test quality criteria and will fail.

For example, choosing page goal misses and setting the threshold to 10 will trigger a threshold violation if 11% of pages missed their goals.

A complete list of Pass/Fail Qualification properties is provided in Test Pass/Fail Qualification

Note: If the test was started from a command line or a batch and failed, a status code one will be returned. For more about the command-line interface, check Automation.

  • No labels