Release date - Dec-30, 2019

New Features and Improvements:

Breakthrough Upgrades:

  1. Goal-oriented testing: 
    • Set a performance goal, and StresStimulus will ramp-up VUs until the goal is reached.
    • Request-per-second goal: Ramp up VUs until reaching the desired hit rate (req/sec)
    • Transaction time goal: Ramp up VUs until a transaction response time exceeds the desired time.
  2. Testing web sockets. Now you can record and load test scenarios with web socket frames. 

  3. Detailed test execution log. A runtime test log helps to analyze test events and troubleshoot test execution. 

More Versatile Test Designer for Higher Productivity:

  1. Dynamic Extractors. Extractor definitions (e.g., text before/after and regular expression properties) now can include other source variables like extractors, functions, and generators. Previously, only constant strings were supported. 
  2. Concatenating expressions for parameters. Now a parameter can be a concatenation of constant values and a data generator. 
  3. More robust object management on the test case tree. Removing objects (e.g., sessions or transactions) from a parent container with one click. 
  4. Emulating user scenarios with random dropdown selection. An extractor can now return a random dropdown selection index.  
  5. More robust data generators. Using data generators with the on-read evaluation cuts down on the number of needed data generators significantly. 
  6. More granular response validators. Now global response validators can be defined for responses of a given content-type. 
  7. Path remapping. Now along with host remapping, you can remap path when only a part of URL is changed.  
  8. Detecting an incomplete token correlation.

Friendlier to new user UI to shorten the learning curve:

  1. Automatic databinding parameters with datasets.  New default databinding simplifies parameter creation.
  2. Easier extractor troubleshooting. The length of the recorded and replayed extractors is displayed after the Verify operation. Different length can indicate an incorrect extractor. 
  3. Displaying entry examples in text boxes (e.g., in the recording wizard, the First Transaction field shows "Example: OpenApp or Login").
  4. Presenting the next step guidance (e.g., after creating a parameter, the dialog "Create more like this" pops-up ).
  5. The cleaner UI hides unimportant details  (e.g., when the think time is specified on the test case level, it is hidden in pages and transactions
  6. Editing a selected test case in a group

Simplified Scenario Recording:

  1. More robust desktop scenario recording. Multiple-process filtering can be used now for scenarios recorded from applications using several processes. 
  2. Recording from a machine with several users. Now you can record web traffic from other users logged on the same test server, including System users and services. 
  3. Recording from iOS 13 devices, which have hardened security.

More Test Execution options:

  1. Manual VU count adjustment during the execution of distributed tests.  Increase the VU count on the controller and load agents in real-time as needed.  
  2. Support for agent-specific test data. You can now designate dataset rows to specific load agents using the agent-binding column.  
  3. More control over the VU path. You can customize behavior regarding the next execution steps after a VU encountered an error.  
  4. Support for executing last iteration transactions (e.g., log-out) in time-based tests. In the previous versions, such support existed only for iteration-based tests.   
  5. Support for loops that rely on the previous iteration data using copy extractors.   
  6. More control over loops. You can define a custom action if a loop fails to meet exit condition after maximum repeats.  
  7. Manage performance testing from Jenkins. The integration plug-in facilitates automatic testing.  
  8. More versatile loops with variable data on iterations. Iteration source variables (iteration bound datasets and iteration data generators) inside loops, will be evaluated on every iteration loop.   

Enhanced Reporting:

  1. Export any tabular data to a csv file.     
  2. Export activity diagram data to a csv file,  
  3. Reporting test results for any individual load agents. After a distributed test completion, you can open a performance report based on the data collected by the load agent.  
  4. Automatically emailing results upon test completion.   
  5. More versatile external reports. Export transaction, page, and test case graphs in external reports. 
  6. Reporting max concurrent VU load during the test.  

Multiple other features and improvements, including:

  1. Offline activation now supports multi-machine licenses. When creating an offline activation request for a machine under a multi-machine license, you can specify the number of VUs.  
  2. Support for extended ASCII characters in datasets. 
  3. Enable StresStimulus Fiddler add-on, even if Fiddler is installed for other users on the machine.   
  4. Silent installer for easier enterprise rollouts.  

  • No labels