HPE Software Products: StormRunner Load Practitioner Forum
Share |

SLA Status Failed when 90th Percentile is less than SLA ThresholdOpen in a New Window

In the StormRunner report the SLA status is showing as failed even though the 90th Percentile value is less than the SLA Threshold. In these cases the % Breakers is greater than 10%.

Where the % Breakers is less than 10% the SLA Threshold for these transactions is showing as passed.

Does the report fail the SLA Status  when the % Breaker is over some threshold? I'm guessing 10%

I don't get how a transaction can be considered to have a failed SLA status when the 90th Percentile is less than the SLA threshold.

Example 

SLA Status  = Failed,  90th% = 2.622, SLA Threshold = 3.000, % Breakers = 17.647

How can this be considered to be a failure if  90% of transactions have a response time of less than 2.622 secs? 

How is % Breakers calculated? The doco doesn't say.

 

 

Re: Creating a HTTP / ICA (Citrix) script but no script generate in citrix in the LR 12.53Open in a New Window

Hi xianling,

as mentioned already, you should move / cross-post your question in the LoadRunner Forum
Community Home -> Software -> Products -> LoadRunner / Performance Center / StormRunner Load
for VuGen recording issues.

Greetings
Siggi

 

Error reportingOpen in a New Window

HP Stormrunner is incorrectly reporting on errors.

When on the "Analyzing Test Results" page, clicking on "script errors" should bring up a list of all errors (see attached), but the error ID doesn't match the ID in the Error Message. In this example, only two types of errors (and hence only two screenshots) appear, but if I download the CSV with all the error messages in it, there are seven different errors (two of which match the Error ID, the other five don't).

To make things worse, after a few days, the real errors (visible only in the CSV file), no longer appear in the downloaded CSV file, making it impossible to review (as Firefox saves these files in a temp folder)

Has anyone else experienced this?

 

 

 

Stormrunner Runtime Settings across multiple test scenarios do not retain individual settings.Open in a New Window

Hello

I recently added 6 test scenarios on the same project. 

I setup 3  test scenarios to start with, did some runs and then later configured a further three test scenarios

3 of the scenarios share the same scripts - so there are two sets of identical scripts (uploaded zip files)  - one set is shared by 3 scenarios the other set by the remaining 3 scenarios.

The first three senarios appear to have linked runtime settings - that is - if i adjust the pacing in one of these 3 test scenarios then the pacing also changes in the other two. I can't see how these 3 tests are linked. The second set of 3 test scenarios also do this.

 

The 2 sets of 3 test scenarios do share a similar name - apart from one word high/medium/low. They also share the same 'additional attributes'. I have tried renaming them and still they appear to be 'linked. 

I see there is a disclaimer in the runtime settings box 'Note ! Changes will affect the script in related tests' - what does this mean and what are 'related' tests? Is this the cause of the problem or am I missing something here - do I have to have 6 projects with 1 test in each? None of the tests can actually share the same runtime settings in my configuration, all 6 have a unique configuration.

 

 

Best of Show on Tour 2017: March 28 - Apr 6 in GermanyOpen in a New Window

Join us for the  Best of Show on Tour where we will present the latest trends and developments in Application Delivery Management. Providing high-quality applications quickly and reliably, creating a positive digital user experience – these are the declared goals of IT and development departments. These can be achieved with Continuous Testing, agile development and DevOps. We will show you how on the Best of Show on Tour. At the same time, we would like to take the opportunity to kick off the HPE German Testing Community – a format which is already well received in Switzerland and which we would like to offer our German customers as a platform for knowledge exchange, best practice sharing, networking and collaboration among peers. Don’t miss this opportunity in a city near you and register now! (The events will be conducted in German language.)

Agenda & registration

 

Stormrunner Load Injectors FirewallOpen in a New Window

Hi,

I am configuring a test using Stormrunner with 6 on premises load injectors.

What firewall procedures are needed to allow traffic to pass through. Is there a range of ports?

Thanks

 

Stormrunner Load GeneratorsOpen in a New Window

Hi,

I am configuring a test for next week on Stormrunner. I have 2 scripts, one of the scripts use cloud load generators and the other uses multiple on premise load genrators.

When creating the test I can only select either "Cloud" or "On premise" Load Generators. How can I use a combination of both? At the  moment I am just using  a trial version.

Thanks

 

Stormrunner winlet replayOpen in a New Window

Hi,

I have created scripts using Vugen12.53 recording as winlet instead sockets.

LR controller replays the script option "Winlet replay instead of Sockets" enabled with no issues.

As there is very limited runtime settings in Stormrunner will it take the other extended settings from the script? Is there an option to enable Winlet?

Thanks

 

Java VUser: One or more of the scripts included in this test appear to be in an invalid formatOpen in a New Window

When attempting to execute a StormRunner test scenario that contains a Java VUser script I'm seeing the following error message.

Error ID: -1017

One or more of the scripts included in this test appear to be in an invalid format.
........
Error: Java VM internal error:Error Loading jvm.dll.

The script in question currently works through Performance Center.

Any suggestions on what would be causing StormRunner to say that this script is in an invalid format?

 

HPE LoadRunner and StormRunner Load compareOpen in a New Window

Hello everyone,

When I was on HPE Discover I got an introduction of HPE StormRunner,
We are currently is using HPE LoadRunner.


Could someone help me to point out/clarify the big difference between LoadRunner and StormRunner Load.

as I understood the form of license is new for StormRunner.
You pay for virtual user hours.
Also StormRunner is 100% cloud-based application.

What is more the key-factors for StormRunner Load?.

 

Also what is the big difference if we compare StormRunner Load with LoadRunner.

 

Thank you in advance

 

 

 

HPE Performance engineering annual surveyOpen in a New Window

https://www.surveymonkey.com/r/hpe_pe2017

HPE Software R&D constantly strives to improve its products, and values your feedback.
We want to better understand your usage of HPE performance testing solutions, so that we can enhance your experience with those solutions.

How can you help? Participate in our annual survey and earn your chance to win one of five $100 Amazon gift cards!

The survey covers HPE’s performance testing suite of tools, including Performance Center, LoadRunner, StormRunner Load, Network Virtualization & Service Virtualization.

To increase your chance of winning, forward the survey to relevant colleagues, and copy us at plv_cost@hpe.com - your name will be entered again in the raffle!

Thank you and good luck,
HPE Performance Engineering R&D team

Survery_PE.jpg

 

Storm Runner - Testing Soap based WCF ServicesOpen in a New Window

Hi All ,

We are trying to find out if Storm Runner can be used for testing Soap based WCF Services... Could not find any articles related to the same

Regards
Sabarish

 

 

 

 

 

 

How to change percentile value in StormRunner ReportOpen in a New Window

I have pre-set the percentile value in my SLA to 90 prior starting the test. After the test is finished, how do i check the 95th percentile values of the transactions that are evaluated in my test?

 

Unable to upload Truclient Script in StormRunnerOpen in a New Window

I have made a zip file of the truclient script and when I try to upload the script in StormRunner, the upload fails after few minutes. I get the message "Cancelled uploading script xxxxx.zip". I am trying to evaluate the product. Thanks

 

ChatOps for StormRunner Load: Let's CommunicateOpen in a New Window

What is ChatOps?

ChatOps, a term widely credited to GitHub, is all about collaboration in the Dev/IT workforce. By bringing your tools into your conversations and using a chat bot modified to work with key plugins and scripts, teams can automate tasks and collaborate, working better and faster.  (the full article)

In other words for ChatOps we need a "chat room" and a "bot". For our first steps we choose "Slack" as chat room and "Hubot" (GitHub’s bot written in CoffeeScript and Node.js) as our bot.

What is HPE StormRunner Load?

Hewlett Packard Enterprise StormRunner Load is a Software as a Service (SaaS) solution for Web and mobile application performance and cloud testing, for both internal and external applications. Its capabilities include:

  • Performance test script authoring and editing at the UI and API layers of a Web or mobile application
  • Test planning
  • System monitoring of the application under test
  • Test execution and management of the cloud-based test infrastructure

It’s only natural that one will want to create a ChatOps bot so that we can communicate with StormRunner Load through. After doing some research, I found out that there wasn’t a bot created for StormRunner Load, so I decided to develop one by myself.

Beginning the creation process

This is where StormRunner Load Public API came in handy. The API exposes many capabilities of the product that you can perform against it. is very well documented and easy to use. In addition, it allows you to try the API for yourself in your browser to examine how the REST calls work.

snippet from SRL bot in Slacksnippet from SRL bot in Slack

In my case, I created a ChatOps bot (written in CoffeeScript/JavaScript, get more information on how to create a bot), in which you can communicate with your tenant of StormRunner Load. I originally used a framework named Hubot, but updated it to Hubot-Enterprise. When the chatting with the bot, it performs several REST calls against StormRunner Load:

  • List all projects
  • Set the project you are working
  • Get results for a specific test
  • Run a test (and receive a URL to view the run)

This is only a portion of the capabilities offered by StormRunner Load Public API. Get more information on StormRunner Load Public API here.

You can also find the bot in our GitHub repository here.

Don't forget to follow us on Twitter @HPE_LoadRunner.

***This is an open source project (under Apache 2 EULA)

 

Git integration in StormRunner - managing your testing scripts in GitOpen in a New Window

This post was written by Wei Sun, Lynn Liu from the StormRunner Load R&D team  

 

As a performance engineer, you could have many testing scripts for various projects you are working on. To efficiently manage your testing artifacts, you need a version control system like Git, SVN etc. The distributed nature of Git is a perfect fit to the Agile testing nowadays. It allows users to be more flexible in how they collaborate on projects.

In recent StormRunner 2.2 release, Git integration was introduced to allow you to connect your Git repository to your StormRunner tenant, not only from your internally hosted Git repository, also GitHub, GitLab and Atlassian Stash (Bitbucket). Using the integration, you can directly upload your scripts to StormRunner from your Git repository. If the scripts had been updated in your Git repository, you can easily synchronize the changes by one click.

Here we use a small example to demonstrate how the Git integration simplifies your script management. The demonstration will show you how to seamlessly sync the script between Vugen and StormRunner. More about ‘VuGen now connects you to Git repository’.

1. Configure StormRunner Git Agent, connect it to your tenant. See how to configure the StormRunner Git Agent.

  • Start the Git Agent Configuration tool to specify the URL of your repository.
  • Git agent needs read-only permission to your repository.
  • The supported URL prefixes are: HTTP, HTTPS and git.

1.png

 

  • If the repository is private, enter credentials by clicking Advanced

3.png

 

  • Click Retrieve to get branches from your repository.
  • You can run multiple Git agents (even on the same machine) to use multiple repositories or branches.
  • If the agent is connected, its status is displayed as ‘Connected’ in StormRunner. And Upload from Git option for scripts will be enabled.

22.png

 

23.png

 

5.png

2. Choose Upload from Git. Click Add to upload scripts via selected Git Agent.

6.png

  • Additionally, you can use the cool ‘Label’ functionality to manage your test scripts easily

24.png

 

3. Vugen Git integration

  • Start Vugen, go to Version Control -> Git Options -> Import from remote repository. It will clone the remote repository to the local path.

7.png

 

  • Start ‘DotNet1’ project from local repository and modify the script as you want. Save the changes locally and then commit to remote repository.

           -> Note you could configure git ignore list or untrack file to reduce the size of your script.

8.png

 

  • The change on comment & modified time indicates that the ‘DotNet1’ script had been updated in the repository.

9.png

 

  • Now, we can synchronize the ‘DotNet1’ script in StormRunner via clicking Sync selected.

10.png

 

  • After syncing, ‘DotNet1’ script has been updated accordingly.

11.png

  • Now you can run load test with the updated script.

That’s it! We urge you to try out this new capability to see how it will help you shorten your scripting and uploading process. Try it out

 

SnapshotOpen in a New Window

Hi,

Do we have snapshot from the runs for the error ?

Thanks

 

 

How to Use the Jenkins Plugin for StormRunnerOpen in a New Window

This post was written by Huan Feng (Ramsey), Lynn Liu, Wei Sun from the StormRunner Load R&D team  

 

Today’s engineer is likely to be working on code that is continuously integrated into the main source code repository. Continuous Integration systems such as Jenkins help ensure that unit tests and other tasks are automatically run whenever a build takes place. A task that more and more developers are running as part of their continuous integration suite is load testing their software.  Users of StormRunner Load can take advantage of HPE’s StormRunner Jenkins plugin to run their tests automatically. This post describes the four simple steps you can take to make this happen.

1. Install the latest version of the plugin to your Jenkins server

  • Download the StormRunner Jenkins plugin.
  • To upload the plugin to your Jenkins server, navigate to Jenkins in your browser, and select Manage Jenkins > Manage Plugins > Advanced from the Jenkins menu. From the Upload Plugin section, upload the “JenkinsStormPlugin.hpi” that you downloaded in the previous step.
  • Restart your Jenkins server.

2. Configure StormRunner plugin in Jenkins

  • Navigate to Jenkins and select Manage Jenkins > Configure System:

1.png

  •  Enter your credentials in the HPE StormRunner section:

               -> Note that to validate the credential inputs are correct, you can click the Test Connection.

2.png

 

  • In case of connection failure caused by proxy configuration, go to Manager Jenkins > Manage Plugins > Advanced. Enter your proxy configuration and click Validate Proxy to check. More Details about Jenkins behind Proxy.3.png

     

  • Click Save to save your settings.

3. Create and configure a new job to run a StormRunner test

  • From the Jenkins menu, select New Item.

 

4.png

 

  • In the resulting screen, enter an item name and select the Freestyle project option, and click OK:

 5.png

  • Select Add build step > StormRunner run loadtest

 

6.png

  •  Configure the Tenant, ProjectID, TestID and SendEmail parameters: 

7.png

                      -> Note that to find your test’s TestID, you can navigate to StormRunner Load, and go to Load Tests > General for information:

8.png

 

  • Click Save to save your settings.

 4. Build the job and view the output

  • Go to the Jenkins dashboard, select the job and click Build Now:

9.png

 

  • When the build has completed, click Console Output to view the log:

         -> Note that the StormRunner Jenkins plugin generates both a .csv and an .xml file in the workspace folder after the build completes:

 

10.png

 

That’s all there is to it.  Four simple steps to run your StormRunner Load tests as part of your continuous integration! Take StormRunner out for a free spin, here’s where you can sign up for a free trial now.

 

Tweet to us at @HPE and let us know what you think! | Friend HPE on Facebook | Follow HPE on Linkedin 

 

unable to add jmeter script in storm runner load testOpen in a New Window

i have created load test, in which i want to import my jmx, but i am unabel to import the same i.e i do not see any option . when i click upload it says add custome files where as when i explicitly click on jmx it says unsupported format.

 

Script is failing while executing through StormrunnerOpen in a New Window

We have recorded the script in TruClient 12.50 protocol. The script is passing in outr local when run with single vUser but fails when run in Storm runner. We got the run time settings in the TC and we did add the auto configuration script for our network. 

We were able to execute the script in Storm runner with 50% pass rate. But when we checked the application manually the action was not performed there.

Any comments on how to debug this script?

Contact Us

Vivit Worldwide
P.O. Box 18510
Boulder, CO 80308

Email: info@vivit-worldwide.org

Mission

Vivit's mission is to serve
the Hewlett Packard
Enterprise User
Community through
Advocacy, Community,
and Education.