icon_plus_one

1

icon_less_one

question

GUI mass test tools and test procedures


Anyone having experiences with GUI mass test tools and test procedures allowing for non functional tests of highly dynamic Webportal applications?
The application consists of QT based Widgets for a dynamically composed web GUI which includes also Plugins. The test tool and procedure needs to allow verifying how the backend servers scale when hundreds of user activities on the GUI are fired against the Portal.
Tools like Squish and Ranorex are fine for functional tests but suffer in mass tests from the fact that response times will vary with user load causing individual test sessions to stall (buttons becoming too late available, etc.). Standard HTTP traffic recording and playing like Loadrunner does is not sufficient due to the dynamics created by the user interaction.


01

Opened by Christoph Ruhsam, ISIS Papyrus Academy Senior Manager, ISIS Papyrus Europe AG
Dec 13, 2012.



recommanded this question


Answer this question


icon_plus_one

2

icon_less_one
02

Elsane Guglielmino Project manager, Agileload
Dec 17, 2012

recommanded this answer



Hi Christoph,
Standard HTTP traffic recording is not enought for an "out of the box" scenario creation, you need to parametrized the generated script in order to take into account all the dynamic data. But with some parametrization, you can absolutly do mass load testing of QT based Widget apps with Agileload.

The tool strenght :

1: Reduced Scripting Time - AgileLoad use Automatic Modeling to manage complex transaction. It is possible to teach AgileLoad how to manage these dynamic parameters which saves time not only in the 1st script but in all subsequent scripts against the same application

2: High Performance System Quickly - AgileLoad combs through the monitoring results (database, web server, operating systems etc.) and detect anomalies automatically. Remediation advice for each anomaly found is given to ease your tuning and bottleneck resolution.

3: Executive Summary of the performance profile of your application - Reports can be tailored - even before the test runs - for different stakeholders with each report containing relevant data for each stakeholder (DBA, management ecc..) . These custom reports templates can be generated on the fly when needed.

4: Cost effective : Agileload is in a Freemium model, which means
- free to download
- free for scenario creation and validation with 10VU
- pay "on-demand": you choose the maximum of concurrent users (VU) and a number of days for your test runs
- same license can be used "on premise" or/and for "cloud" load testing
- no extra cost for specific monitoring modules

For your "Proof of concept", the tool can be downloaded here:
http://www.agileload.com/signup-download

You can make your first steps looking at our learning center :
http://www.agileload.com/learning-center

Have a look at some of our videos :
http://www.agileload.com/video-center/-in-Category/Categories/agileload-tutorial/scripting

Our price list :
http://www.agileload.com/Product/products_list.aspx

Our team is available for support at : support@agileload.com

Best regards,
Elsane Guglielmino
http://www.agileload.com
Add comment

Christoph Ruhsam 01 Christoph Ruhsam ISIS Papyrus Academy Senior Manager, ISIS Papyrus Europe AG

Dec 17, 2012
Thanks for your feedback.
We have found the described tool during research work but could not deduce from the provided information that it relates to QT GUIs in conjunction with mass tests.
Do you have more specific information and share experiences with real mass tests? Could you provide references? How many users were simulated in total and how many users could be run on a single test machine? How many of these machines would be needed to simulate e.g. 1.000 concurrently working users?

Elsane Guglielmino 02 Elsane Guglielmino Project manager, Agileload

Dec 18, 2012
Hi Christoph,
Of course, we can provide references.
The number of users to be run on a single test machine depends mainly on the work to be done by the scripts (a lot of parsing, subrequest mode, user waiting time..)

From experience, in subrequest mode you can simulate 500 users by machine. In protocol mode, 1000 users. We have already made shots of 30000 and 40000 VU on dedicated test platforms for banking webportals.
If you need a demo, we can setup a Webex.
Regards,
Elsane

icon_plus_one

0

icon_less_one
02

Olivier Hanoun Senior Consultant, Neotys
Dec 17, 2012


Hi Christoph,

Have you heard about NeoLoad from Neotys (www.neotys.com)?
It is a load-testing software for web and mobile apps.
NeoLoad is designed to load-test web-services and dynamic applications like AJAX or plugins.

I work for the company but do not believe my opinion is biased. To make yourself your own idea, I invite you to download the trial version on our website. This version is fully functionnal and ready to load-test your apps!

Regards,Olivier Hanoun.
Add comment

Christoph Ruhsam 01 Christoph Ruhsam ISIS Papyrus Academy Senior Manager, ISIS Papyrus Europe AG

Dec 18, 2012
Hello Olivier,

We have found your described tool also during our research work but could not
deduce from the provided information that it relates to QT GUIs in
conjunction with mass tests.
Would you have more specific information
and share experiences with real mass tests? How many users were simulated in total and how many users
could be run on a single test machine? How many of these machines would
be needed to simulate e.g. 1.000 concurrently working users?

Regards

Christoph