Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner...

16
© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013

Transcript of Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner...

Page 1: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Performance testing beyond basics HP LoadRunner protocols under the covers

Shane Evans / June 12th, 2013

Page 2: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

“When all you have is a hammer, everything looks like a nail.”

Bernard Baruch

Page 3: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 4

LoadRunner: The Broadest Technology Support

DNS

But what if your application isn't supported?

Page 4: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 5

With flexibility comes added complexity

Understanding the types of protocols

• TruClient, SAPGUI GUI

• Ajax/Web Click & Script Object

• Web/HTTP, FTP, SMTP, ODBC Transport

• Junit, nUnit, Selenium Unit Test

• Java, C/++/#, VBScript, JavaScript… Native Language

Increasin

g flexib

ility

Page 5: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 6

Customization Options With great power, comes great responsibility…

Custom Code

Add functions to scripts for:

• Additional verification

• Flow Control

• Parameter manipulation

Data Format Extensions

Translate different data formats into XML for simpler validation and parameter search.

• JSON

• Unicode

• GWT

• Define your own…

Template APIs

Manually create scripts using standard languages and Vuser APIs. Supports:

• ANSI-C

• C++

• C#

• Java

• VBScript

• JavaScript

Depending on your application, you may employ one OR many of these solutions

Protocol SDK

• Allows the development of custom protocols for use with unique or proprietary systems.

• Partner focused licensing model allows for easy repackaging.

Import DLLs

Ability to import DLLs and call actions directly from the Virtual User script.

• Reduces memory footprint for each VU

• Allows integration with proprietary applications

Page 6: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 7

Custom Code

Available Protocols: All

Languages: C, C++, C#, Java, VBScript, JavaScript

Produce dynamic, flexible business logic

Page 7: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 8

Data Format Extensions

Available Protocols: Web/HTTP

Languages: C

Transform complex data structures into easy to read and use XML

web_custom_request("pct_5",

"URL=http://localhost:8081/TestApp",

"Method=POST",

"Resource=0",

"RecContentType=text/plain”,

"Snapshot=t19.inf",

"Mode=HTML",

"EncType=text/plain; charset=utf-8",

"Body="6|0|10|http://localhost:8081/TestAppObj2/testapp/|8DA419C161ADC2D5A55F756C38D05D3A|com.test.client.GreetingService|greetServerObj|com.test.client.ComplexObject/38396855|GWT User|java.util.HashSet/1594477813|java.lang.String/2004016611|add string1|add string2|1|2|3|4|1|5|5|5|0|0|0|0|0|6|7|2|8|9|8|10|1001|1999|“,

LAST);

Page 8: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Data Format Extensions Demo

Page 9: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 10

Template API scripting

Available Languages: C, C++, C#, Java, VBScript, JavaScript

Create powerful scripts using your favorite languages

Supports MS Visual Studio and Eclipse!

Page 10: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 11

Reduce, Reuse, Recycle

Importing External DLLs

Reduce memory usage per VU for large scale tests

Reuse 3rd party code

Recycle between scripts with common functionality

lr_load_dll()

Page 11: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 12

Performance Validation SDK

Tools Provided: Documentation, IDE

Develop your own protocol to sell or share with the community

Page 12: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Additional Advanced Features

Page 13: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 14

Build Load Test scripts during Development

• Integration with MC Visual Studio and Eclipse

Run Unit Tests in Load Test Scenarios

• Support for nUnit and Selenium tests as part of LoadRunner scenarios

• Load Scenarios as part of Unit Testing

Add Performance Tests as build steps in Jenkins

• For automated test scheduling and execution

• Report pass/failure by defined SLA

Test Early, Test Often

Performance Testing for Continuous Delivery

Test

Page 14: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 15

Build complex Scenarios to match your complex business

New Virtual Table Server (VTS)

All-new VTS provides centralized storage and access of your Load Testing data for unmatched Business Process flexibility.

• Fast NoSQL Database for sharing data between virtual users

• Web Console for simplified admin

• Easy Import/Export of test data

• Integrated scripting APIs

Page 15: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. 16

Winsock Sometimes the right tool is actually a hammer…

Use the Winsock protocol to:

• Record complete request/response stream directly from the Windows Sockets layer

• Reproduce client traffic verbatim

• Solve compatibility issues with proprietary application technologies

Page 16: Performance testing beyond basics - My Load Test · Performance testing beyond basics HP LoadRunner protocols under the covers Shane Evans / June 12th, 2013 ... • Load Scenarios

© Copyright 2013 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.

Thank you