Release date - Jun-30, 2020
New Features and Improvements
Azure Cloud testing Support:
- With a few mouse-clicks provision load agents on Azure.
- Chose VMs from any Azure datacenter worldwide.
- Select the load agent machine's tech specs.
- No additional licensing cost (requires active maintenance), only standard Azure fees apply.
- Use Azure VM profiles for auto-provisioning load agents on-demand before the test starts.
- Automatically delete the cloud instance when the test is over to avoid unnecessary Azure charges.
- Mix and match Azure and AWS load agents.
More Versatile Test Designer:
- Extractor scope extended to a Test Case Group. Previously, an extractor could be used to create parameters only within the same test case. Now you can create parameters using extractors in another test case.
- Ability to Verify a test case group. Previously, only one test case could be verified at a time. Now you can verify multiple test cases combined in a test case group.
- More robust authentication module. It now incorporates a property grid that provides multiple configuration options in a consistent and scalable way.
- Cloning extractors. When cloning requests or any object with requests such as transactions or loops, StresStimulus will copy all extractors to the clone.
- In the previous versions, every VU must have a corresponding row in the server authentication grid with credentials, even if the VU did not use server authentication. As a result, some dummy rows with credentials were required. In the new version, this is no longer necessary as credentials can be used more efficiently on demand.
- Previously, dataset row binding to a VU was done in design-time by VU number. It required allocating data rows for all anticipated VUs even if they will not be instantiated nor access the dataset. In the new version, dataset row mapping to a VU can be performed in run-time on-demand only for VUs that require databinding.
Enhanced Correlation and parameterization:
- Decimal encoding extractors. This encoding can now be applied to an extractor one or several times.
- More control over cookies handling. If the server does not send cookie value in the previous response, StresStimulus sends the recorded values. Now, you have an option to send empty cookies instead.
- Detecting autocorrelated extractors that are too short and automatically suggesting how to correct the extractor's definition.
Ease of Use for Higher Productivity:
- Simplified Validators. Now when creating a validator, you can see the recorded response to visualizing the text you want to validate.]
- Easier troubleshooting authentication script. After Verify, you can now display credentials used under the Server Authentication. It can help to distinguish authentication issues between scripting or incorrect credentials.
- Option to Opt-in/opt-out recording web socket frames. It helps to ignore web sockets traffic unrelated to the test case to avoid false-positive errors.
- Verify tree now contains some extractor info to quickly find correlation issues when the error happened on a request with a green checkmark.
- In a test with multiple test cases, you can verify any of them without leaving the context of the current test case that you are working with.
- On the test case tree toolbar, added the "Expand to the right" button that restores the left panel size after shrinking it by clicking "Collapse to the left."
More Realistic Emulation:
- Option to emulate users restarting browser on every iteration. Previously the user session identified by a cookie was always carried over to the subsequent iteration (autocorrelated). Now there's an option to emulate a user restarting web browser on every iteration by eliminating session persistence between iterations.
- Easier to use random extractors. Previously to simulate random clicks using a random extractor, it was required to specify a minimum and maximum occurrence. Now StresStimulus can determine this information automatically.
- Better load generator performance. It allowed a significant reduction in "gaps" that could happen before when testing super-fast applications using load generators with limited system resources.
Enhanced VU distribution UI that now provides:
- VU distribution by Test Case, then by Load Agent or in reverse order.
- Recalculation of VU distribution by mix weight or ratios for Test Cases, and Load Agents.
- Overwriting the calculated VU distribution for any Test Case, and Load Agents for more granular distribution.
- Quick adjustment of VU distribution before running the test.
More Test Execution options:
- More robust test workflow objects. If…then and do…while objects now support conditional expressions that can be based on not only on a constant string and extractor value match but also on scriptable variables.
- More control over the request concurrency. Select Content-type to determine playback concurrency by content-type, (e.g. *.aspx pages requested sequentially, images requested in parallel). Select Recorded Concurrency to determine playback concurrency as recorded.
- Client certificate authentication by VU. Now you can specify a unique client certificate for every VU.
- The automated distribution of file upload scenarios. Now test files used in the upload scenarios are automatically synchronized from the controller to the load agents before the test start. Only file changes are replicated for higher performance.
- The Total transactions completed per sec curve is added to the KPI graph in the runtime dashboard, and the test result graph view.
- Agent Report. Now each agent generates a report that includes all performance metrics collected on this agent.
- More detailed reporting. VU activity diagram in the test report and transaction subreports now additionally displays iteration duration without think time.
- Error View in the Page and Transaction subreports. It displays details of errors that occurred on a particular page or transaction.
- Test activity interactive diagram. Previously the test activity diagram displayed statistics for the entire test. On the new activity diagram, you can select any time interval and receive statistics for that time interval.
- Transaction activity interactive diagram. The same improvement is made for transaction and page activity diagrams.
- Faster reporting. Added the Activity table to the test repository database for more rapid test result calculations and retrieval.
- Transactions per second are added in the test result – Summary View, Performance Metrics section.
- Enhanced external reports. Display a tooltip with the full path when hovering over the long request paths. In the prior versions, the long request paths were difficult to see.
- The number of Completed Transactions and Pages are added in the test result – Summary View, Performance Metrics section.
- Coherent graph visualization in the run-time dashboard. A consistent scale and the timeline auto-scroll are maintained during the test progress. Previously graphs did not consistently scale.
- The test result now displays the version of StresStimulus that executed the test.
Other Improvements including:
- Added support for the MS Edge browser when recording on Windows server 2019, 2020, and some older servers with the latest service packs.
- Improved the UI for pasting into the authentication grid.
- Scriptable variables code recovery if a crash is to occur.