HPE Software Products: StormRunner Load Practitioner Forum
Share |

Storm Runner - Testing Soap based WCF ServicesOpen in a New Window

Hi All ,

We are trying to find out if Storm Runner can be used for testing Soap based WCF Services... Could not find any articles related to the same

Regards
Sabarish

 

 

 

 

 

 

How to change percentile value in StormRunner ReportOpen in a New Window

I have pre-set the percentile value in my SLA to 90 prior starting the test. After the test is finished, how do i check the 95th percentile values of the transactions that are evaluated in my test?

 

Unable to upload Truclient Script in StormRunnerOpen in a New Window

I have made a zip file of the truclient script and when I try to upload the script in StormRunner, the upload fails after few minutes. I get the message "Cancelled uploading script xxxxx.zip". I am trying to evaluate the product. Thanks

 

ChatOps for StormRunner Load: Let's CommunicateOpen in a New Window

What is ChatOps?

ChatOps, a term widely credited to GitHub, is all about collaboration in the Dev/IT workforce. By bringing your tools into your conversations and using a chat bot modified to work with key plugins and scripts, teams can automate tasks and collaborate, working better and faster.  (the full article)

In other words for ChatOps we need a "chat room" and a "bot". For our first steps we choose "Slack" as chat room and "Hubot" (GitHub’s bot written in CoffeeScript and Node.js) as our bot.

What is HPE StormRunner Load?

Hewlett Packard Enterprise StormRunner Load is a Software as a Service (SaaS) solution for Web and mobile application performance and cloud testing, for both internal and external applications. Its capabilities include:

  • Performance test script authoring and editing at the UI and API layers of a Web or mobile application
  • Test planning
  • System monitoring of the application under test
  • Test execution and management of the cloud-based test infrastructure

It’s only natural that one will want to create a ChatOps bot so that we can communicate with StormRunner Load through. After doing some research, I found out that there wasn’t a bot created for StormRunner Load, so I decided to develop one by myself.

Beginning the creation process

This is where StormRunner Load Public API came in handy. The API exposes many capabilities of the product that you can perform against it. is very well documented and easy to use. In addition, it allows you to try the API for yourself in your browser to examine how the REST calls work.

snippet from SRL bot in Slacksnippet from SRL bot in Slack

In my case, I created a ChatOps bot (written in CoffeeScript/JavaScript, get more information on how to create a bot), in which you can communicate with your tenant of StormRunner Load. I originally used a framework named Hubot, but updated it to Hubot-Enterprise. When the chatting with the bot, it performs several REST calls against StormRunner Load:

  • List all projects
  • Set the project you are working
  • Get results for a specific test
  • Run a test (and receive a URL to view the run)

This is only a portion of the capabilities offered by StormRunner Load Public API. Get more information on StormRunner Load Public API here.

You can also find the bot in our GitHub repository here.

Don't forget to follow us on Twitter @HPE_LoadRunner.

***This is an open source project (under Apache 2 EULA)

 

Git integration in StormRunner - managing your testing scripts in GitOpen in a New Window

This post was written by Wei Sun, Lynn Liu from the StormRunner Load R&D team  

 

As a performance engineer, you could have many testing scripts for various projects you are working on. To efficiently manage your testing artifacts, you need a version control system like Git, SVN etc. The distributed nature of Git is a perfect fit to the Agile testing nowadays. It allows users to be more flexible in how they collaborate on projects.

In recent StormRunner 2.2 release, Git integration was introduced to allow you to connect your Git repository to your StormRunner tenant, not only from your internally hosted Git repository, also GitHub, GitLab and Atlassian Stash (Bitbucket). Using the integration, you can directly upload your scripts to StormRunner from your Git repository. If the scripts had been updated in your Git repository, you can easily synchronize the changes by one click.

Here we use a small example to demonstrate how the Git integration simplifies your script management. The demonstration will show you how to seamlessly sync the script between Vugen and StormRunner. More about ‘VuGen now connects you to Git repository’.

1. Configure StormRunner Git Agent, connect it to your tenant. See how to configure the StormRunner Git Agent.

  • Start the Git Agent Configuration tool to specify the URL of your repository.
  • Git agent needs read-only permission to your repository.
  • The supported URL prefixes are: HTTP, HTTPS and git.

1.png

 

  • If the repository is private, enter credentials by clicking Advanced

3.png

 

  • Click Retrieve to get branches from your repository.
  • You can run multiple Git agents (even on the same machine) to use multiple repositories or branches.
  • If the agent is connected, its status is displayed as ‘Connected’ in StormRunner. And Upload from Git option for scripts will be enabled.

22.png

 

23.png

 

5.png

2. Choose Upload from Git. Click Add to upload scripts via selected Git Agent.

6.png

  • Additionally, you can use the cool ‘Label’ functionality to manage your test scripts easily

24.png

 

3. Vugen Git integration

  • Start Vugen, go to Version Control -> Git Options -> Import from remote repository. It will clone the remote repository to the local path.

7.png

 

  • Start ‘DotNet1’ project from local repository and modify the script as you want. Save the changes locally and then commit to remote repository.

           -> Note you could configure git ignore list or untrack file to reduce the size of your script.

8.png

 

  • The change on comment & modified time indicates that the ‘DotNet1’ script had been updated in the repository.

9.png

 

  • Now, we can synchronize the ‘DotNet1’ script in StormRunner via clicking Sync selected.

10.png

 

  • After syncing, ‘DotNet1’ script has been updated accordingly.

11.png

  • Now you can run load test with the updated script.

That’s it! We urge you to try out this new capability to see how it will help you shorten your scripting and uploading process. Try it out

 

SnapshotOpen in a New Window

Hi,

Do we have snapshot from the runs for the error ?

Thanks

 

 

How to Use the Jenkins Plugin for StormRunnerOpen in a New Window

This post was written by Huan Feng (Ramsey), Lynn Liu, Wei Sun from the StormRunner Load R&D team  

 

Today’s engineer is likely to be working on code that is continuously integrated into the main source code repository. Continuous Integration systems such as Jenkins help ensure that unit tests and other tasks are automatically run whenever a build takes place. A task that more and more developers are running as part of their continuous integration suite is load testing their software.  Users of StormRunner Load can take advantage of HPE’s StormRunner Jenkins plugin to run their tests automatically. This post describes the four simple steps you can take to make this happen.

1. Install the latest version of the plugin to your Jenkins server

  • Download the StormRunner Jenkins plugin.
  • To upload the plugin to your Jenkins server, navigate to Jenkins in your browser, and select Manage Jenkins > Manage Plugins > Advanced from the Jenkins menu. From the Upload Plugin section, upload the “JenkinsStormPlugin.hpi” that you downloaded in the previous step.
  • Restart your Jenkins server.

2. Configure StormRunner plugin in Jenkins

  • Navigate to Jenkins and select Manage Jenkins > Configure System:

1.png

  •  Enter your credentials in the HPE StormRunner section:

               -> Note that to validate the credential inputs are correct, you can click the Test Connection.

2.png

 

  • In case of connection failure caused by proxy configuration, go to Manager Jenkins > Manage Plugins > Advanced. Enter your proxy configuration and click Validate Proxy to check. More Details about Jenkins behind Proxy.3.png

     

  • Click Save to save your settings.

3. Create and configure a new job to run a StormRunner test

  • From the Jenkins menu, select New Item.

 

4.png

 

  • In the resulting screen, enter an item name and select the Freestyle project option, and click OK:

 5.png

  • Select Add build step > StormRunner run loadtest

 

6.png

  •  Configure the Tenant, ProjectID, TestID and SendEmail parameters: 

7.png

                      -> Note that to find your test’s TestID, you can navigate to StormRunner Load, and go to Load Tests > General for information:

8.png

 

  • Click Save to save your settings.

 4. Build the job and view the output

  • Go to the Jenkins dashboard, select the job and click Build Now:

9.png

 

  • When the build has completed, click Console Output to view the log:

         -> Note that the StormRunner Jenkins plugin generates both a .csv and an .xml file in the workspace folder after the build completes:

 

10.png

 

That’s all there is to it.  Four simple steps to run your StormRunner Load tests as part of your continuous integration! Take StormRunner out for a free spin, here’s where you can sign up for a free trial now.

 

Tweet to us at @HPE and let us know what you think! | Friend HPE on Facebook | Follow HPE on Linkedin 

 

unable to add jmeter script in storm runner load testOpen in a New Window

i have created load test, in which i want to import my jmx, but i am unabel to import the same i.e i do not see any option . when i click upload it says add custome files where as when i explicitly click on jmx it says unsupported format.

 

Script is failing while executing through StormrunnerOpen in a New Window

We have recorded the script in TruClient 12.50 protocol. The script is passing in outr local when run with single vUser but fails when run in Storm runner. We got the run time settings in the TC and we did add the auto configuration script for our network. 

We were able to execute the script in Storm runner with 50% pass rate. But when we checked the application manually the action was not performed there.

Any comments on how to debug this script?

 

Does it possible for Tru-Client script to take a screen-shot at a set point in a test ?Open in a New Window

Does it possible for Tru-Client script to take a screen-shot at a set point in a test in storm runner where transaction or page are exactly failed?

 

Is stormrunner load support multi protocol scripts execution?Open in a New Window

I am trying to upload scripts of multiprotocol Web/Html+webservice and it says the protocol is not supported at present.

 

Process/Steps to Install Client Certificate in Storm Runner - Load GeneratorsOpen in a New Window

What is the Process/Steps to Install Client Certificate in Storm Runner - Load Generators? 

How long does it take to get the Load Generators IP address in Storm Runner? 

Not able to open the support ticket using Trial login? 

 

 

StormRunnerLGSetup.exe downloadOpen in a New Window

I have been playing around with StormRunner on a trial basis.  I would like to install the Windows OPLG but have been unable to find a download link for the installer.  Can anyone point me to the URL to download the installer for the Windows OPLG?  Thanks.

 

Function: vugen_crypt_encrypt();Open in a New Window

Hi All,

I searched for "Password decryption without using lr_decrypt()", I found the following script:

Action()
{
    char* plaintext = "my secret password";
    char encryptedBuf[100];
    char decryptedBuf[100];
 
    lr_load_dll("C:\\Program Files\\HP\\LoadRunner\\bin\\VuGenCallback.dll");
 
    lr_output_message("plaintext: %s", plaintext);
    vugen_crypt_encrypt(plaintext, -1, encryptedBuf);
    lr_output_message("encrypted: %s", encryptedBuf);
    vugen_crypt_decrypt(encryptedBuf, decryptedBuf);
    lr_output_message("decrypted 1: %s", decryptedBuf);
    lr_output_message("decrypted 2: %s", lr_decrypt(encryptedBuf));
 
    return 0;
}

I tried using this in my script where I have parametrized the password and I am retrieving the password from a file and then using the following function to encrypt the retrieved password.

vugen_crypt_encrypt(password, -1, encryptedBuf);

I did not understand the parameter "-1" passed as an argument to the function. So, I tried replaying the script replacing -1 with different values. The results are as follow:

1) vugen_crypt_encrypt(password, 0, encryptedBuffer);

Action.c(5): Notify: Parameter Substitution: parameter "P_password" = "bean"
Action.c(10): Encrypted Password: 5805bc44e
Action.c(12): Decrypted Password 1:

2) vugen_crypt_encrypt(password, 1, encryptedBuffer);

Action.c(5): Notify: Parameter Substitution: parameter "P_password" = "bean"
Action.c(10): Encrypted Password: 5805bbdc48
Action.c(12): Decrypted Password 1: b

3) vugen_crypt_encrypt(password, 2, encryptedBuffer);

Action.c(5): Notify: Parameter Substitution: parameter "P_password" = "bean"
Action.c(10): Encrypted Password: 5805bc6a0dc5
Action.c(12): Decrypted Password 1: be


4) vugen_crypt_encrypt(password, 3, encryptedBuffer);

Action.c(5): Notify: Parameter Substitution: parameter "P_password" = "bean"
Action.c(10): Encrypted Password: 5805bcf452e2b9
Action.c(12): Decrypted Password 1: bea

5) vugen_crypt_encrypt(password, 4, encryptedBuffer);

Action.c(5): Notify: Parameter Substitution: parameter "P_password" = "bean"
Action.c(10): Encrypted Password: 5805bd2065c80caa
Action.c(12): Decrypted Password 1: bean

6) vugen_crypt_encrypt(password, 5, encryptedBuffer);

Action.c(5): Notify: Parameter Substitution: parameter "P_password" = "bean"
Action.c(10): Encrypted Password: 5805bf999db5ce92ed
Action.c(12): Decrypted Password 1: bean

It seems -1 will work for any encrypted string lenght.

What you all think? I am looking for your valuable comments.

Regards,

Sachin

 

Stormrunner custom report?Open in a New Window

Hi all,

Stormrunner allows you to customise your test run dashboard and thus view many different kind of graphs, with different filters if needed. Whether during the run or in the Results section.

Is there any way to publish a custom dashboard in a report (PDF, Word...)?

There is a Report section in Stormrunner that allows you to export a report (or the drop-down menu in the graphs dashboard section), but it's standardised and you are not able to add or remove graphs or data from it.

 

Thanks in advance!

Best,

Cynim

 

Unable to run a load test - licence conflict (Trial vs. Yearly)Open in a New Window

Hi,

I have installed a few days ago a Trial Version of Stormrunner on MyAccount - it came along with trial versions of VUHs, that are limited in the load they can generate (hits/sec).

After another few days, I've purchased new VUH licences (API for HTTP and UI for TruClient) and they have been added to my account.

The problem is that when I launch a test (1 HTTP script, 2 TC scripts, LGs distributed across AWS and Azure), Stromrunner keeps on using the trial VUHs that are still on my account!
And since our tests need to go beyond the load limitation (here it needs to go beyond 50 hits / sec), the test stops right after it launches (see Capture2.PNG).

Is there a way to select the correct VUH licences that are highlighted in red in Capture.PNG, or even erase all trial VUH licence on my account?

As this is a blocker for our load test and we're in a very tight deadline, we need this to be resolved ASAP, please!

Thanks very much in advance.
Best regards.

 

Some Queries on HP Storm RunnerOpen in a New Window

Hi

 I am working on evaluating HP StormRunner. I have some basic queries. 

1.  I understand it supports New Relic and other APM integration. Can we get transaction & server level  metrics from APM in load test reports?

2. Can we do report comparison b/w two runs of a load test within the platform or only way is to download the CSVs and compare again ?

3. What is the relvenace of setting a  report run as a benchmark ? 

4. What kind of SLA configurations options are provided in the StormRunner.

 

 

 

 

Technical Storm Runner documentationOpen in a New Window

Hi everyone,

I am looking for technical documentation about Stormrunner. We' d like to use the service but our security ask for details before going forward.

questions are :

- Is it possible to have a architecture schema of Strom Runnner 

- Does the amazon VM are deleted just after the Loadtest.

- Where are stored the result of the run, and could it be possible to download them.

- Can we have the IP of LoadGenerator in order to white list then.

Thanks for replying.

Best Regards

Romain

 

Performance Engineering News - September 2016Open in a New Window

Network Capture Express v3.0 - Now Available!
Explore your real network conditions

Network Capture Express (NCX) v3.0, a FREE mobile application, is available at the Google Play and iTunes store. NCX measures and captures the network conditions (latency, bandwidth and packet loss) from your mobile phone/tablet, from anywhere and on any global current carrier and it applies the current network type (Wi-Fi, LTE, 4G) on your application under test URL. It generates a file that can be replayed alongside performance, functional or mobile testing scripts. Unlike other network measurement tools, which can just confirm that your carrier is fair, NCX measures the conditions against your AUT and the outcome is recorded as a file. Read more about it in this blog.

 

Get up-to-date on performance testing by attending these on-demand performance webinars

The COST (Customer Oriented Scenario Testing) team is responsible for generating customer and user influence in our product development lifecycle. Over the past few months, Performance and Lifecycle Virtualization COST, together with representatives from R&D, hosted several webinars for our customers and partners. If you didn’t have chance to join, you can find here the WebEx recordings, including the list of questions and answers.

 

Black Friday is coming: Prepare by load testing now
Last year, 103 million Americans shopped online over the Thanksgiving/Black Friday weekend. Are you and your shopping interfaces ready for that kind of customer load and impact on the bottom line? By load testing your mobile app and website make sure you are prepared for the number of transactions that are headed your way. Read more...

 

What’s New in HPE Mobile Center

It’s no secret that good mobile user experience is a must to achieve business goals! This can be a daunting task. But HPE Mobile Center - Mobile application lifecycle software will help you take care of your user. This is one session not to miss! Sign up at Vivit for this webinar on October 6th!

 

Summer travel and the need for great website performance!

Whether you are a seasoned traveler or an accidental tourist, chances are you have experienced the unpleasant side effects of busy travel season—delayed departures, canceled flights, overbooked flights, crowded trains and bus stations, sold out hotels and more. What happens when thousands and thousands of frustrated travelers and travel agents try to reach the same booking engines? Read more about it in this blog.

 

Reaching the new frontiers of load testing

The modern reality of digital transformation demands that companies deliver applications faster - without sacrificing quality and performance. Hewlett Packard Enterprise is a recognized leader in the performance engineering and testing "space”, and with every new software release, we continue to solidify our position as a forerunner and innovator. This blog sheds light on the next frontiers of load testing, focusing on three topics: Internet of Things (IoT), Chaos Engineering and Big Data. Read more…

 

Upcoming Webinars

Oct 6 – 11:00 AM EDT What’s New in HPE Mobile Center

 

Past Webinars
Continuous Testing: The Key To Increasing Delivery Speed And Quality In Your DevOps Pipeline

Performance Engineering Tools

What’s New in HPE LoadRunner and HPE Performance Center 12.53

 

HPE Performance Engineering Solutions
HPE StormRunner Load
HPE Network Virtualization
HPE Service Virtualization
HPE LoadRunner
HPE Performance Center

Try StormRunner Load Now!

Download the Market Guide to Performance Testing by Gartner

 

 

HPE SiteScope on Prem (trial)Open in a New Window

On the trial version of StormRunner 'HPE SiteScope on Prem' is disabled.  Is this because it is a trial version or is this feature not currently functional?

I cannot proceed to a paid version of StormRunner without knowing whether it will actually be able to meet my requirements.

Contact Us

Vivit Worldwide
P.O. Box 18510
Boulder, CO 80308

Email: info@vivit-worldwide.org

Mission

Vivit's mission is to serve
the Hewlett Packard
Enterprise User
Community through
Advocacy, Community,
and Education.