About Benchware Ltd€¦ · Keynote at TPC Technology Conference 2009, Revised Selected Papers,...

About Benchware Ltd

Company Profile

April 2014

copyright © 2014 by benchware.ch slide 2

1 Mission and Methodology

2 Key Performance Metrics

3 Benchware Services

4 Benchware Licenses

5 Discovery Workshop

6 Summary

Contents


Quality assurance Calibrate efficiency of Oracle platforms

Identify performance bottlenecks

Platform evaluation Quantify price-performance ratio of Oracle

platforms

Capacity planning Deliver key performance metrics of Oracle

platforms for capacity planning

The performance of complex Oracle platforms is unpredictable

File System Volume Manager

Database System

Storage System

O/S Server

DataG

uard

Ne

two

rk Fu

sion

I/O In

terco

nn

ect

Storage N

etw

ork

FC, IP

, IB

Application(s)

Co

mp

lex Ora

cle pla

tform

Middleware

Ora

cle ap

plica

tion

Benchware Mission


Simulate application load using representative Oracle performance tests

Monitor key performance metrics for processor performance (CPU)

server performance (SRV)

storage performance (STO)

load performance (DBL)

database scan performance (DBS)

OLTP transaction performance (DBX)

data aggregation performance (DBA)

Use Oracle database software to generate all kinds of loads for cpu, server, storage and database performance tests

Key Performance Metrics of Oracle platforms

Benchware Monitor

Benchware Loader


Database System

Storage System

O/S Server

DataG

uard

Ne

two

rk Fu

sion

I/O In

terco

nn

ect

Storage N

etw

ork

FC, IP

, IB

metering point

Co

mp

lex Ora

cle pla

tform

Benchware Methodology


Requirements to performance tests

Relevant for OLTP, DWH and analytic Oracle platforms

Fair

Repeatable

Verifiable

Economic and fast

Adaptable to customer platform

Capable to provoke new technologies to its limits

[1] Karl Huppler (IBM): The Art of Building a Good Benchmark. Keynote at TPC Technology Conference 2009, Revised Selected Papers, Lecture Notes in Computer Science LNCS 5895, Springer 2009 [2] C. Mohan (IBM): Impact of Recent Hardware and Software Trends on High Performance Transaction Processing and Analytics. TPC Technology Conference 2010, Revised Selected Papers, Lecture Notes in Computer Science LNCS 6417, Springer 2011

Benchware performance tests meet following requirements


Requirements to Key Performance Metrics

Source: www.bmw.de

Simple and generally understandable. How fast is your car? And how fast is your Oracle platform?


Oracle Server (SRV) Performance Tests Server-bound in-memory SQL transactions without any I/O operation

OLTP systems

DWH systems

Proof of Server

efficiency

Key Performance Metrics

Unit

in-memory SQL

full scan – all rows per transaction

primary key access – 1 row per transaction

secondary key access – Ø 25 rows per transaction

scalability virtualization

cc-numa

speed service time throughput

[µs] [ms] [µs] [ms]

[dbps] [tps] [rps]

Methodology

Oracle CPU Performance Tests CPU-bound operations with typical Oracle data types

OLTP systems

DWH systems

Proof of CPU

efficiency


Unit

pl/sql operations

arithmetic addition, string operations, SQL built-in functions

multithreading virtualization

encryption

speed throughput

[s] [ops]

pl/sql algorithms

fibonacci, prime numbers

[s] seconds [ms] milli seconds (10-3) [µs] micro seconds (10-6)

[dbps] database blocks per second [rps] rows per second [tps] transactions per second [ops] operations per second

[MBps] Mega Byte per second [GBps] Giga Byte per second [iops] i/o operations per second

Library of Oracle performance tests

less important

important

very important


Methodology

Oracle Storage (STO) Performance Tests I/O-bound operations for all typical Oracle I/O operations

OLTP systems

DWH systems

Proof of Storage

efficiency


Unit

sequential I/O

1 MByte, read and write

data integrity tiering, pooling virtualization

replication

service time throughput

[µs] [ms] [MBps] [GBps]

[iops] random I/O

8 kByte (default), read and write





less important

important

very important

Oracle OLTP (DBX) Performance Tests I/O-bound operations for all typical Oracle I/O operations

OLTP systems

DWH systems

Proof of Storage

efficiency


Unit

OLTP select

primary key access – 1 row per transaction secondary key access – Ø 25 rows per transaction

scalability speed service time throughput

[ms] [s] [ms] [s]

[rps] [tps]

OLTP update

primary key access – 1 row per transaction secondary key access – Ø 25 rows per transaction


Oracle Load (DBL) Performance Mixed resource usage: CPU, memory, storage

OLTP systems

DWH systems

Proof of Database efficiency


Unit

transactional data load

via buffer cache configurable tx size

scalability LGWR process


[μs] [ms] [s] [μs] [ms] [s] [rps] [tps]

direct bulk load

scalability compression

LGWR process



Methodology





less important

important

very important

Oracle Data Aggregation (DBA) Performance Mixed resource usage: CPU, memory, storage

OLTP systems

DWH systems

Proof of Database efficiency


Unit

data aggregation & reports

simulated by creating b-tree indexes

scalability sorting









6 Summary

Contents


Key Performance Metrics for Performance Calibration

Does a platform meet performance requirements?

Are vendor's performance numbers achievable?

Are there any performance bottlenecks in the platform, which have impact to application performance?

Deliver answers to questions like . . .


Key Performance Metrics for Platform Evaluation

Which platform provides best price-performance ratio, taking into consideration Oracle license costs?

How to get adequate figures in a short time for management decisions?

1.0 1.1

0.7

1.0

2.5

2.1

Current System New System A New System B

Price

Performance



Key Performance Metrics for Capacity Planning

What are the performance limitations of a platform?

How much of the resources are already utilized?

How much reserve of resources is still available?



Key Performance Metrics for Quality Assurance

Platforms are always subject of system changes hardware components will be exchanged

software will be upgraded

configuration parameters will be adapted

What is the impact of system changes to platform performance?

Does the platform at least deliver the same performance after the system change?








6 Summary

Contents


Benchware Services

Benchware has a strong foundation in core technologies such as Oracle database software, server and storage systems

Benchware offers following consulting services

Performance Analysis & Optimization

System Architecture

Benchmarking

Platform Evaluation

Consulting Services


Benchware Services

Oracle Platform Performance Health Check – Performance Assessment Benchmark Week

Duration 1 week

Deliverables

Complete Benchmark Report of one Oracle platform with all important Key Performance Metrics concerning CPU, Server System, Storage System and Database System

Oracle AWR reports for all representative database operations and load profiles

Qualitative rating of KPM’s in comparison to best-of-class Oracle platforms

Management presentation

License Fee included

Service Fee included

Travel expenses included

Fix price project Switzerland

Europe

United States

16’750 CHF

16’750 EUR

22’500 USD

Benchmark as a Service







6 Summary

Contents


Benchware Licenses

Benchware offers a license model for those customers, who would like to run Oracle platform benchmark tests frequently and independently

Benchware Monitor

Benchware Loader


Database System

Storage System

O/S Server

DataG

uard

Ne

two

rk Fu

sion

I/O In

terco

nn

ect

Storage N

etw

ork

FC, IP

, IB

metering point

Co

mp

lex Ora

cle pla

tform




3 Benchmark Services

4 Products and Licenses


6 Summary

Contents


Half-day workshop discussing current trends and technologies for Oracle platforms Engineered systems and converged platforms

CPU technologies

Server technologies, in-memory processing, virtualization, Oracle licensing

Storage technologies, integration of flash technology

Benchmark Results for HP, HDS, IBM, Oracle server and storage systems

Target audience: System Architects, Manager IT Engineering & IT Operation

Request complete data sheet for Discovery Workshop [email protected]

Discovery Workshop

Technology trends for Oracle platforms


Discovery Workshop

Public benchmark results on www.benchware.ch/benchmark




3 Benchmark Services

4 Products and Licenses


6 Summary

Contents


Summary

Benchware was founded in 2011

Self-financed company with no external capital or investors

Its legal form is that of a private limited company


Summary

Focused on Oracle database software only

Hardware vendor independent

Holistic approach in designing, tuning and benchmarking Oracle platforms and applications

Unique methodology

Value proposition


Summary

Benchware Consultants have a long experience track record

Oracle RDBMS experience since 1984 (Oracle Version 3)

Performance tuning and benchmarking since 1993 (Oracle Version 7)

Oracle Engineered Systems since 2010 (Exadata V2)

Value proposition


Summary

2011 2012 2013 2014

Maintenance

Licenses

Services

+ 31 %

+ 63 %

Year-to-year revenue growth


IT vendors HP European Performance Center HDS TechOps Center Local swiss organization of HP, IBM, Intel, Sun

IT service provider Inventx, Swisscom

Financial industry Accarda, Julius Bär, Pictet, Sarasin, Vontobel,

Migros, Raiffeisen, UBS, Credit Suisse, ING-DiBa, SIX Group

Public sector Swiss Post, Cineca, Canton Basle, Canton

Lucerne, VRSG, Federal Office for Information Technology

Health care

Labor Risch, Roche

Technology

Nagravision/Kudelski

Insurances

Concordia, CSS, Mobiliar, SwissRe, SUVA

Chemicals

EMS

Telecommunication

Swisscom, Sunrise

Consumer Goods

Charles Vögele, Fenaco, Koch Neff Volckmar

Summary

Following organizations have used our benchmark methodology and services

www.benchware.ch

[email protected]

swiss precision in performance measurement

About Benchware Ltd€¦ · Keynote at TPC Technology Conference 2009, Revised Selected Papers,...

Documents

Transcript of About Benchware Ltd€¦ · Keynote at TPC Technology Conference 2009, Revised Selected Papers,...