After recording a test case, it's highly recommended to verify it. If you run a test without verification, you may encounter issues related to incorrect or incomplete test configuration. The purpose of verification is to discover such issues.
This information should be used to add some configuration settings that will fix verification errors or warnings. After all verification errors and warnings are resolved, all the test errors are likely related to your website’s inability to handle multiple users properly.
During verification, StresStimulus replays the recorder test case once with one virtual user in debug mode. Reissued sessions are automatically compared with the corresponding recorded sessions, and the recorded and replayed server responses are analyzed. After the verification is completed, errors, warnings, configuration recommendations, and other diagnostics are displayed.
Note: Some Test Profile settings, such as browser type and network type are not simulated during verify.
To start the Verify process:
1. Click Verify & Auto-Config (a) in the workflow tree.
2. A pop-up dialog Verify the Test Case (b) will appear.
3. Sometimes it is desirable to verify the test case with a different VU. For example, if a test case uses a dataset to parameterize an authentication form, then you might want to verify a few times under different credentials each time. To simulate a different VU, set the numeric boxes to the desired VUs (c) and # of iterations (d) to verify.
It is sometimes beneficial to verify more than one iteration. For example, you might want to make sure you have no errors on subsequent iterations when a login transaction is marked to run on the first iteration only.
4. Optionally, you can specify a session number, after which Verify will stop, to save time. For example, if the error/warnings occurred in sessions 20, 22, 40, 42, 60 … and you just addressed session 20; then you can run Verify to session 40 or 42. To do so, enter the session number in the Stop after session box (e).
5. You can add a description for each verify run (f) so that you can keep track of the changes you make to your test case between Verifys.
6. During verify, the test case is replayed at a slower pace to give a user a chance to preview succession of web pages that appear in the web view. To run verify at a faster pace without the page preview, check Quick Verify box (g). This option will persist for future verifies.
7. Click Verify. The session grid will display sessions as they get issued in real time.
Tip: If during test case verification, some errors or warnings are discovered, they should be reviewed one by one in the order of appearance from top to bottom. Depending on the situation, use the appropriate technique to address them. For example, create a missing parameter, delete a request that should be excluded from the test or ignore warnings that are irrelevant to the test's execution. After that, re-run Verify and move to the next error warning resolution. Since you should only focus on the next 1-2 errors/ warnings, there is no need to Verify the entire test.
8. During the test replay, the browser object displays the sequence of the web pages as they get accessed. This helps to quickly determine whether the test case is replayed correctly. For example, if the pages in the browser object repeatedly display the login screen or error messages, it is an indication of authentication or session integrity issues.
9. The following options are available to control the verification process:
The Verify progress bar displays real-time time statistics, including the number of processed sessions, and detected errors and warnings.
Info: During verify, the timeout mechanism is disabled. StresStimulus will wait for all responses to come back, and the wait time is not limited by the timeout of the request.
10. If verification determines that there are too many redundant extractors which can be safely deleted, it will prompt you to confirm their deletion. Autocorrelation sometimes creates excess extractors to avoid correlation errors. They should be deleted to reduce resource utilization.
11. After Verify is completed, a new tab (j) will appear. It displays Session Verification tab (k) with a tree showing the outcome of verification for each session and the test case overall.
12. Next, to every request, there is a status image describing the outcome. One of 4 statuses can be assigned to a session.
13. To display a subset of sessions with the same status, click one of the filtering buttons (l) on the toolbar session verification: Errors, Warnings or Notifications. To display all sessions, click URLs.
14. To display a tooltip with a specific error or warning, mouse-over a session (m).
15. To view session content, double-click the Recorded or Replayed node (n) and Session Inspector (o) will appear.
16. Right-click a session to display the context menu. To compare recorded and replayed sessions, click Compare (p) in the context menu or on the toolbar, and the Compare Sessions Inspector (q) will appear. Session Inspectors are described in the next section.
17. The Verify command also generates an Extractor Verification Tree (r). In a separate tab, it displays extractor values, errors (if the extractors cannot be validated) or warnings (if the extractors are not used).
18. Click Verify Description (s) to see the test case you verified, the time or the description. You can also modify the description here.
19. By default, the verification tree shows the test case hierarchy as transactions > pages > sessions. If you wish to show sessions only, check the "Show sessions only" box (t).
Tip: You can export a session replayed during verify and save it as a .saz file. To do so, right-click anywhere in the verification tree, then select Export Replayed.