Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016...
Transcript of Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016...
![Page 1: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/1.jpg)
BASEL BERN BRUGG DÜSSELDORF FRANKFURT A.M. FREIBURG I.BR. GENEVA
HAMBURG COPENHAGEN LAUSANNE MUNICH STUTTGART VIENNA ZURICH
Free Load Testing Tools for
Oracle Database16 Nov 2016, DOAG Konferenz, Nurnberg (D)
Christian Antognini
@ChrisAntognini
![Page 2: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/2.jpg)
Our company.
Free Load Testing Tools for Oracle Database – Which One Do I Use?2 16/11/2016
Trivadis is a market leader in IT consulting, system integration, solution
engineering
and the provision of IT services focusing on and
technologies
in Switzerland, Germany, Austria and Denmark. We offer our services in the
following strategic business fields:
O P E R A T I O N
![Page 3: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/3.jpg)
COPENHAGEN
MUNICH
LAUSANNE
BERN
ZURICH
BRUGG
GENEVA
HAMBURG
DÜSSELDORF
FRANKFURT
STUTTGART
FREIBURG
BASEL
VIENNA
With over 600 specialists and IT experts in your region.
Free Load Testing Tools for Oracle Database – Which One Do I Use?3 16/11/2016
14 Trivadis branches and more than
600 employees
200 Service Level Agreements
Over 4,000 training participants
Research and development budget:
CHF 5.0 million
Financially self-supporting and
sustainably profitable
Experience from more than 1,900
projects per year at over 800
customers
![Page 4: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/4.jpg)
16/11/2016 Free Load Testing Tools for Oracle Database – Which One Do I Use?4
Technology on its own won't help you.You need to know how to use it properly.
![Page 5: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/5.jpg)
@ChrisAntognini
Free Load Testing Tools for Oracle Database – Which One Do I Use?5 16/11/2016
Senior principal consultant, trainer and partner at Trivadis
http://antognini.ch
Focus: get the most out of Oracle Database
Logical and physical database design
Query optimizer
Application performance management
Author of Troubleshooting Oracle Performance (Apress, 2008/14)
OakTable Network, Oracle ACE Director
![Page 6: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/6.jpg)
Agenda
Free Load Testing Tools for Oracle Database – Which One Do I Use?6 16/11/2016
1. Introduction
2. Free Load Testing Tools I Use
3. Summary
![Page 7: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/7.jpg)
Free Load Testing Tools for Oracle Database – Which One Do I Use?7 16/11/2016
Introduction
![Page 8: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/8.jpg)
Common Situations Leading to Database Load
Generation
Free Load Testing Tools for Oracle Database – Which One Do I Use?8 16/11/2016
Perform usability and functionality checks of tools or utilities that require a
non-trivial load to be carried out
Assess the performance of a (new) platform or storage subsystem
Verify whether a set of SQL statements executed on a specific environment
and/or configuration fulfils the expected performance requirements
![Page 9: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/9.jpg)
Golden Rule
Free Load Testing Tools for Oracle Database – Which One Do I Use?9 16/11/2016
Use the right tool
for the right job!
![Page 10: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/10.jpg)
Free Load Testing Tools in My Toolbox
Free Load Testing Tools for Oracle Database – Which One Do I Use?10 16/11/2016
Swingbench
The Silly Little Oracle Benchmark (SLOB)
Apache JMeter
![Page 11: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/11.jpg)
Free Load Testing Tools for Oracle Database – Which One Do I Use?11 16/11/2016
Swingbench
![Page 12: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/12.jpg)
What’s Swingbench?
Free Load Testing Tools for Oracle Database – Which One Do I Use?12 16/11/2016
Load generator designed to stress test Oracle Database
Includes four configurable synthetic benchmarks
OrderEntry, SalesHistory, CallingCircle and StressTest
Extensible with user-defined transactions (StressTest provides an example)
Consists of several CLI and GUI utilities
Developed by Dominic Giles
Available at http://www.dominicgiles.com/swingbench.html
![Page 13: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/13.jpg)
What Can Swingbench Do?
Free Load Testing Tools for Oracle Database – Which One Do I Use?13 16/11/2016
Carry out, with minimal effort, all necessary operations to run one of the four
provided benchmarks
Create test schema (incl. data population)
Generate load
Store key performance indicators about test run
![Page 14: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/14.jpg)
Swingbench Key Components – Setup
Free Load Testing Tools for Oracle Database – Which One Do I Use?14 16/11/2016
Three wizards, that also expose a CLI, are available: OrderEntry, SalesHistory
and CallingCircle
StressTest doesn’t have a wizard because it requires no setup
XML file config dataoewizard
shwizard
ccwizard
![Page 15: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/15.jpg)
Swingbench Key Components – Load Generation
Free Load Testing Tools for Oracle Database – Which One Do I Use?15 16/11/2016
swingbench
minibench
charbench
XML file
XML fileresults2pdf
PDF file
config
load KPI
![Page 16: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/16.jpg)
Swingbench: Demo
Free Load Testing Tools for Oracle Database – Which One Do I Use?16 16/11/2016
![Page 17: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/17.jpg)
Swingbench: Example of Utilization (1)
Free Load Testing Tools for Oracle Database – Which One Do I Use?17 16/11/2016
Purpose
Observe the impact of a vMotion
started while a database server
is subject to a non-trivial load
Benchmark
OrderEntry, scale 10
900 transactions/second
![Page 18: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/18.jpg)
Swingbench: Example of Utilization (2)
Free Load Testing Tools for Oracle Database – Which One Do I Use?18 16/11/2016
0
20
40
60
80
13:5
8:0
8
13:5
8:1
8
13:5
8:2
8
13:5
8:3
8
13:5
8:4
8
13:5
8:5
8
13:5
9:0
8
13:5
9:1
8
13:5
9:2
8
13:5
9:3
8
13:5
9:4
8
13:5
9:5
8
14:0
0:0
8
14:0
0:1
8
14:0
0:2
8
14:0
0:3
8
14:0
0:4
8
14:0
1:0
2
14:0
1:1
3
14:0
1:2
3
14:0
1:3
3
14:0
1:4
3
14:0
1:5
3
14:0
2:0
3
14:0
2:1
3
14:0
2:2
3
14:0
2:3
3
AA
S
Time
vMotion took 79 seconds
![Page 19: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/19.jpg)
Free Load Testing Tools for Oracle Database – Which One Do I Use?19 16/11/2016
The Silly Little Oracle Benchmark
(SLOB)
![Page 20: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/20.jpg)
What’s SLOB?
Free Load Testing Tools for Oracle Database – Which One Do I Use?20 16/11/2016
Platform performance and stability-testing framework that
makes Oracle Database execute SQL statements
Synthetic benchmark
Consists of a few scripts
Developed by Kevin Closson
Available at https://kevinclosson.net/slob/
![Page 21: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/21.jpg)
What Can SLOB Do?
Free Load Testing Tools for Oracle Database – Which One Do I Use?21 16/11/2016
Create one or several test schemas (incl. data population)
Generate load
Random PIO and/or LIO
Read only or read write
Lite or heavy redo generation
Store DB as well as OS key performance indicators about test run
![Page 22: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/22.jpg)
SLOB Key Components – Setup
Free Load Testing Tools for Oracle Database – Which One Do I Use?22 16/11/2016
slob.conf config datasetup.sh
![Page 23: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/23.jpg)
SLOB Key Components – Load Generation
Free Load Testing Tools for Oracle Database – Which One Do I Use?23 16/11/2016
runit.sh
slob.conf
AWR
reports
iostat
mpstat
vmstat
awr_info.sh
text file
config
load
![Page 24: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/24.jpg)
SLOB: Demo
Free Load Testing Tools for Oracle Database – Which One Do I Use?24 16/11/2016
![Page 25: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/25.jpg)
SLOB: Example of Utilization (1)
Free Load Testing Tools for Oracle Database – Which One Do I Use?25 16/11/2016
Purpose
Find out the maximum number
of random IOPS (and their
average latency) that a storage
subsystem can sustain
Benchmark
100GB
Read-only PIO/LIO
![Page 26: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/26.jpg)
SLOB: Example of Utilization (2)
Free Load Testing Tools for Oracle Database – Which One Do I Use?26 16/11/2016
72563
93546
103718 103299 101258
48 64 96 128 160
Ph
ysi
cal
Read
s p
er
Seco
nd
Sessions
2.9 2.8 4.0 5.2 6.3
31 33
44
60
78
48 64 96 128 160
Late
ncy i
n M
illi
seco
nd
s
Sessions
db file sequential reads db file parallel reads
![Page 27: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/27.jpg)
Free Load Testing Tools for Oracle Database – Which One Do I Use?27 16/11/2016
Apache JMeter
![Page 28: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/28.jpg)
What’s JMeter?
Free Load Testing Tools for Oracle Database – Which One Do I Use?28 16/11/2016
Application designed to load test functional behavior and measure
performance
No out-of-the box benchmark available DIY
Consists of several CLI and GUI utilities
Open source project supported by a number of contributors
Available at http://jmeter.apache.org/
![Page 29: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/29.jpg)
What Can JMeter Do?
Free Load Testing Tools for Oracle Database – Which One Do I Use?29 16/11/2016
Many things!
For the intent of this presentation:
Execute SQL statements
through JDBC
Verify whether the executions
return the expected output
and/or in the expected time
Store key performance
indicators
But it’s “only” a framework… it requires
time to “code” a benchmark
Use real schema with data
Use the SQL statements to be
verified
– Bind variables can be either
generated or provided as input
![Page 30: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/30.jpg)
SLOB Key Components – Load Generation
Free Load Testing Tools for Oracle Database – Which One Do I Use?30 16/11/2016
front end
GUI/CLI
test plan
user
defined
output
text file
config
loadKPI
log
![Page 31: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/31.jpg)
JMeter: Demo
Free Load Testing Tools for Oracle Database – Which One Do I Use?31 16/11/2016
![Page 32: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/32.jpg)
JMeter: Example of Utilization (1)
Free Load Testing Tools for Oracle Database – Which One Do I Use?32 16/11/2016
Purpose
Verify that a set of queries
performs acceptably under load
Verify that the DB server
supports the expected load
Benchmark
33 distinct queries, each with each
own set of bind variable values,
randomly picked out
100 queries/minute
![Page 33: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/33.jpg)
JMeter: Example of Utilization (2)
Free Load Testing Tools for Oracle Database – Which One Do I Use?33 16/11/2016
0
500
1000
1500
2000
2500
3000
3500
4000
407
408
503
114
303
111
115
112
308
101
301
117
204
113
118
105
306
116
505
120
201
504
304
305
307
404
403
401
501
203
202
502
302A
ve
rag
e E
lap
se
d T
ime
[m
s]
Query
![Page 34: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/34.jpg)
JMeter: Example of Utilization (3)
Free Load Testing Tools for Oracle Database – Which One Do I Use?34 16/11/2016
AAS during a period of 13 minutes
![Page 35: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/35.jpg)
Free Load Testing Tools for Oracle Database – Which One Do I Use?35 16/11/2016
Summary
![Page 36: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/36.jpg)
Comparison
Free Load Testing Tools for Oracle Database – Which One Do I Use?36 16/11/2016
Swingbench SLOB JMeter
Can generates load forOracle
Database
Oracle
Database
any DB with
JDBC support
Synthetic benchmark
User-defined benchmark ()
Effort to implement minimal minimal low high
GUI
CLI for automation with scripts
Distributed load generation
![Page 37: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/37.jpg)
Tool of Choice for Common Situations Leading to
Database Load Generation
Free Load Testing Tools for Oracle Database – Which One Do I Use?37 16/11/2016
Perform usability and functionality checks of tools or utilities that require a
non-trivial load to be carried out
Swingbench
Assess the performance of a (new) platform or storage subsystem
SLOB
Verify whether a set of SQL statements executed on a specific environment
and/or configuration fulfils the expected performance requirements
Apache JMeter
![Page 38: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/38.jpg)
Summary
Free Load Testing Tools for Oracle Database – Which One Do I Use?38 16/11/2016
No single tool can cover all
requirements
If used correctly, Swingbench and
SLOB are simple and effective tools
To run a specific set of SQL
statements don’t spend time build
your own script/tool, use JMeter
![Page 39: Free Load Testing Tools for Oracle Database - Home: … · Application performance ... 8 16/11/2016 Free Load Testing Tools for Oracle Database –Which ... and stability-testing](https://reader034.fdocuments.in/reader034/viewer/2022051509/5b049e427f8b9a41528cc3e8/html5/thumbnails/39.jpg)
Questions and Answers
Christian Antognini
Senior Principal Consultant
@ChrisAntognini
16/11/2016 Free Load Testing Tools for Oracle Database – Which One Do I Use?39