© 2008 MindTree Consulting© 2010 MindTree LimitedCONFIDENTIAL: For limited circulation only

Going Open Source in Performance Testing

July 2010

© 2010 MindTree LimitedCONFIDENTIAL: For limited circulation only

Agenda

Going Open Source in Performance Testing

Look Before you Leap – Limitations

Ideal Solution

Zooming in – Scripting Phase

Capturing the Essence of a PT Script

Generating Scripts

Little Help in Debugging

How it Helped

Road Ahead

Slide 2

© 2010 MindTree LimitedCONFIDENTIAL: For limited circulation only

Going Open Source in Performance Testing

Slide 3

FEATURES

C O S T

JMeter + Framework

Load Runner

VSTS

OpenSTA

JMeter

NeoLoad

Grinder

© 2010 MindTree LimitedCONFIDENTIAL: For limited circulation only

Look Before you Leap – Limitations

Slide 4

Scripting

Test Execution

Reporting Analysis

Limited debugging techniques

Extension needed for few protocols

No auto-correlation

options

Cannot monitor test machines

Lack of complete test execution

setup

Distributed mode takes more effort

Limited reporting features

Additional data processing

required for Final report

No support for performance

analysis

© 2010 MindTree LimitedCONFIDENTIAL: For limited circulation only

Ideal Solution

Slide 5

ScriptingTest

ExecutionReporting Analys

is

• Script Development Helper Utilities

• Performance Test execution accelerators

• Monitoring solutions

• Structured Result Data

• Report Creation Tool

• Basic bottleneck analysis tools / Utilities

Comprehensive solution around open-source tools

MindTree PT Helper Kit

MindTree Performance Execution, Monitoring and

Reporting Framework

MindTree DB Bottleneck Analysis Package

© 2010 MindTree LimitedCONFIDENTIAL: For limited circulation only

Zooming in – Scripting Phase

Slide 6

Generate basic PT script

Parameterize /correlateDebug

Performance Test Scripting Lifecycle

Scripting

Record scenario

Final script

© 2010 MindTree LimitedCONFIDENTIAL: For limited circulation only

Capturing the essence of a PT Script

Slide 7

Web RequestType of requestHeader parametersQuery string parametersPost parameters

CustomFormat.

xml

Browser MindTree

Proprietary PT Helper Kit

Web Servers

HTTPLog Proxy Plugin

HTTPLog converts the web

requests into custom format

© 2010 MindTree LimitedCONFIDENTIAL: For limited circulation only

Generating Scripts

Slide 8

Browser

MindTree Proprietary PT Helper Kit

Web Servers

HTTPLog

CustomFormat.

xml

JMeter2.1.1

JMeter2.3.1

VSTS

Script Generator

TOTAL SCRIPTING TIME

TRADITIONAL WAY

Using PT HELPER TOOLKIT

2 hours 1 hour, 05 min

#Request: 6#Parameters:7

© 2010 MindTree LimitedCONFIDENTIAL: For limited circulation only

CustomFormat

.xml

CustomFormat

.xml

Little Help in Debugging

Slide 9

HTTPLog Proxy PluginBrowse

r

HTTPLog Proxy PluginPerformanc

e Testing Tool

DiffReport

HTTP Diff

TOTAL SCRIPTING TIME

TRADITIONAL WAY

With PT HELPER TOOLKIT

3 hours, 30 min

2 hours

#Request: 20#Parameters: 12

MindTree Proprietary PT Helper Kit

© 2010 MindTree LimitedCONFIDENTIAL: For limited circulation only

How it Helped

Pocket friendly solution

Tool independent scripting approach

Scripting phase in parallel with the planning phase to reduce performance test cycle duration

Time required to create a initial draft of the script is constant irrespective of the complexity

Overcomes the recording and debugging shortcomings found in open source load generation tools

Slide 10

© 2010 MindTree LimitedCONFIDENTIAL: For limited circulation only

Road Ahead

Enhancing HTTPLog to recording responses for every request

Implement an Auto Correlation Engine in Script Generator which will handle dynamic parameters automatically

Slide 11

© 2010 MindTree LimitedCONFIDENTIAL: For limited circulation only © 2010 MindTree Limited

Slide Separator

Slide 12 © 2010 MindTree Limited

www.mindtree.com

Successful

Customers

Happy People

Innovative

Solutions

Successful

Customers

Happy People

Innovative

Solutions

Our Mission

Ramanath Shanbhag(ramanath_shanbhag@mindtree.com)