Emulex 8Gb Fibre Channel HBAs

Thanks for joining today’s webcast. We will begin at 9:00 am, Pacific Daylight Time.

To receive a call back, provide your phone number when you join the event, or call the number below and enter the access code.

Access code: 932 758 952

Call-in toll-free number (US/Canada): 1-877-668-4493

Call-in toll number (US/Canada): +1-408-600-3600

Global call-in numbers: http://support.webex.com/support/phone-numbers.html

2© 2011 Emulex Corporation

Fibre Channel and 8GFC

Fibre Channel remains dominant storage NW– Highest performance, availability, scalability

8GFC is now >75% of all HBA sales

IO Intensive apps driving need for 8GFC– Database– Data warehousing– Virtualization & private cloud– Backup– Rich media

It’s about more than bandwidth– IOPS, application response time, CPU efficiency, data integrity, and manageability

– More important than ever with new x86 platforms and Flash acceleration for databases

3© 2011 Emulex Corporation 3© 2012 Emulex Corporation

8GFC Improvements vs. 4GFC

Feature 8GFC 4GFC

More IOPS 200k 150k

Latency Improvements Up to 30% faster

Greater Throughput 800Mb/s per port 400Mb/s per port

Server Architecture: MSI-X Yes No

PCIe 2.0 1.0a

Virtualization: vPorts 255 100

Exchanges (XRI) per port 4096 1000

Enhanced Diagnostics Yes No

Non-volatile data Yes No

T10-PI Enhanced Data Integrity Yes No

4© 2011 Emulex Corporation

Ubiquitous Platform Availability: Emulex LightPulse 8Gb Fibre Channel HBAs

8Gb/s HBAsSingle

Dual

Quad

8Gb/s Blade

5© 2011 Emulex Corporation

Enhance 4G Infrastructures with 8G HBAs

LightPulse LPe12002 8GFC HBA vs. LPe11002 4GFC HBA Storage arrays support 4Gb/s port connectionsOrder entry & data warehousing workload

– Oracle Orion I/O tool, SwingBench load generator– Benchmarks results:

16% Improvement in I/O Latency

15% more IOPS Nearly 2x data warehousing throughput

6© 2011 Emulex Corporation

Database-Optimized HBAs

Advantages of Using Emulex 8G HBAs

12

Performance

•37% greater total IOPS

vs competition•20-30% better

latency •>2x Dual

Channel IOPS vs competition •Ideal for P2V

migrations

Management

• Twice the management in

half the time• Powerful QoS,

availability, diagnostics• Vision performance management

Highest Availability

• Best HBA reliability: >10 million MTBF

• Best system reliability:

operates 27° Cooler

• No downtime FW upgrades

Database Throughput

• 15% better transaction rates

• Up to 33% more effective CPU

• Self-tuning performance

• 7 of 10 Top TPC-Cs

7© 2011 Emulex Corporation

Unique Manageability for Databases: OneCommand Manager

OneCommand Manager (OCM)• Central lifecycle management &

automation • Multi-protocol - FC, FCoE, iSCSI, NIC• Broad OS support• Unique online FW and driver upgrades• Powerful deployment, configuration,

availability, QoS, diagnostics management

OneCommand Manager for VMware vCenter• Native software plug-in with vCenter

look and feel• Extends vCenter with real-time OCM

lifecycle management for Emulex HBAs and UCNAs

Provisioning Utilities

Update Utilities

Management APIs OCM SDK

8© 2011 Emulex Corporation

9© 2011 Emulex Corporation 9© 2012 Emulex Corporation

Deploying 8Gbps Fibre Channel with Oracle Databases

James Morle

10© 2011 Emulex Corporation 10© 2012 Emulex Corporation

Who Am I?

James Morle

– Founder of Scale Abilities Ltd

– Co-founder of the OakTable Network (www.oaktable.net)

– Oracle ACE Director

– Author of Scaling Oracle8i and co-author of Oracle Insights

– Over 20 years large scale Oracle experience, 30 years in professional IT

11© 2011 Emulex Corporation 11© 2012 Emulex Corporation

Who Are Scale Abilities?

UK-based global consultancy specializing in full-stack Oracle-based architectures

– Full system architecture– Proactive Performance Management– Reactive Performance Management

12© 2011 Emulex Corporation 12© 2012 Emulex Corporation

Our Emulex Partnership

Commissioned by Emulex for an independent evaluation of their Fibre Channel products

– Scale Abilities always retains 100% editorial control over published content– Emulex retains control over whether or not to publish

13© 2011 Emulex Corporation 13© 2012 Emulex Corporation

Agenda

A bandwidth and latency refresher

Bandwidth and Business Intelligence

A primer on configuring Oracle for high-bandwidth throughput

A look at the testing performed and results obtained for the whitepaper entitled “Deploying 8Gbps Fibre Channel with Oracle Databases”

Q&A

14© 2011 Emulex Corporation 14© 2012 Emulex Corporation

Bandwidth and Latency Refresher

What is Bandwidth?

What is Latency?

15© 2011 Emulex Corporation 15© 2012 Emulex Corporation

Give me 1000x1MB chunks

2 Gbps Pipe 200x 1MB

2 Gbps Pipe

2 Gbps Pipe

2 Gbps Pipe

2 Gbps Pipe

200x 1MB

200x 1MB

200x 1MB

200x 1MB

200x 1MB 200x 1MB 200x 1MB 200x 1MB

Bandwidth

16© 2011 Emulex Corporation 16© 2012 Emulex Corporation

Latency

Give me a single 4KB chunk

2 Gbps Pipe 4KB

4ms

4ms=1/250s=250 sequential reads per second 10ms

10ms=1/100s=100 sequential reads per second

2 Gbps Pipe

17© 2011 Emulex Corporation 17© 2012 Emulex Corporation

Bandwidth and Business Intelligence

Bandwidth is a critical success factor in business intelligence (BI)

– BI queries frequently need to access a large proportion of available data

– Indexed access paths become less efficient than full or partial scanning

– Scanning rate equals bandwidth

– Higher scan rates mean faster queries

SAN performance matters for getting data from disk to the CPU

18© 2011 Emulex Corporation 18© 2012 Emulex Corporation

The Balancing Act

Storage, SAN and Server CPU must be balanced to achieve optimal throughput

For example: Oracle Database Machine (Exadata)

19© 2011 Emulex Corporation 19© 2012 Emulex Corporation

Tuning Focus:High Bandwidth Oracle

Key configuration points for high bandwidth throughput– Large I/Os– Asynchronous Processing and Prefetching– Parallel Execution

20© 2011 Emulex Corporation 20© 2012 Emulex Corporation

Large I/Os

8KB Read

1MB Read

Data Transfer

21© 2011 Emulex Corporation 21© 2012 Emulex Corporation

Async I/O

Ability to issue I/O requests without waiting for the response

Allows other tasks (such as processing, or other read requests) to take place while waiting for I/O to return

22© 2011 Emulex Corporation 22© 2012 Emulex Corporation

Blocking vs Async I/O

Processing

ServicingI/O

Blocking I/O

t

Processing

ServicingI/O

Async I/O(and prefetch)

23© 2011 Emulex Corporation 23© 2012 Emulex Corporation

Oracle Parallel Execution

Storage

Oracle Processes

Serial Parallel

24© 2011 Emulex Corporation 24© 2012 Emulex Corporation

Testing 8GFC

Bandwidth focused tests to demonstrate throughput of 8GFC versus 4GFC

– Large reads– Async I/O and prefetching– Parallel Execution

25© 2011 Emulex Corporation 25© 2012 Emulex Corporation

LPe11002 4Gbps FC

LPe12002 8Gbps FC

Disk Array(Write-back cached)

TMS RamSan x5

4x 4Gbps each(20 total)

2x 4Gbps

Brocade 6510

IBM x3850 X5

Test Hardware

26© 2011 Emulex Corporation 26© 2012 Emulex Corporation

OneCommand Manager

27© 2011 Emulex Corporation 27© 2012 Emulex Corporation

OneCommand Manager

28© 2011 Emulex Corporation 28© 2012 Emulex Corporation

OneCommand Manager

29© 2011 Emulex Corporation 29© 2012 Emulex Corporation

OneCommand Manager

30© 2011 Emulex Corporation 30© 2012 Emulex Corporation

Test Configuration

8GFC and 4GFC cards are enabled and disabled at the switch

Five RamSan-400 SSDs: read and write latency 15 microseconds

Engenio e6000: 48 spindles - RAID-5

dm-multipath used to insulate Oracle ASM from the changing underlying devices

31© 2011 Emulex Corporation 31© 2012 Emulex Corporation

Large Tables

Engenio: ‘BIGTABLE’

RamSan: ‘SSD_BIGTABLE’

SQL> select segment_name,bytes/1048576 size_mb 2 from dba_segments 3 where segment_name like '%BIGTABLE';

SEGMENT_NAME SIZE_MB-------------------- ----------SSD_BIGTABLE 12307BIGTABLE 630618

32© 2011 Emulex Corporation 32© 2012 Emulex Corporation

Engenio Query

select /*+ parallel(bt,8) */ count(*) from bigtable bt

33© 2011 Emulex Corporation 33© 2012 Emulex Corporation

RamSan Query

declarei number;j number;beginfor i in 1..1000 loop select /*+ parallel(bt,32) */ count(*) into j from ssd_bigtable bt;end loop;end;

34© 2011 Emulex Corporation 34© 2012 Emulex Corporation

Key Discoveries

What’s the real difference between 4GFC and 8GFC?– Equal theoretical bandwidth – 4x4 = 2x8– Right?

35© 2011 Emulex Corporation 35© 2012 Emulex Corporation

Results

Bandwidth MB/s

4GFC 8GFC 8GFC0

200

400

600

800

1,000

1,200

1,400

1,600

SS

D a

nd

E

ng

en

io

SS

D o

nly

SS

D a

nd

E

ng

en

io

36© 2011 Emulex Corporation 36© 2012 Emulex Corporation

Further Detail

8GFC - Both queries active

8GFC - Only SSD query active

Switch between 8GFC and 4GFC

4GFC -Both queries active

Switch back to 8GFC

37© 2011 Emulex Corporation 37© 2012 Emulex Corporation

Conclusions

Optimal Oracle configuration is essential to utilize full SAN bandwidth

Tests show a surprising increase in bandwidth of 13%– Sufficient to knock an hour off an 8-hour batch run, if it spends the majority of its

time waiting on I/O

38© 2011 Emulex Corporation 38© 2012 Emulex Corporation

Q&A

Contacts:– James Morle:

• Email: James.Morle@scaleabilities.co.uk• Twitter: @jamesmorle @scaleabilities• Blog: www.scaleabilities.co.uk/author/morlej

– Emulex: – Barbara Porter• Email: barbara.porter@emulex.com• Papers/blogs/tech tips/app notes: www.implementerslab.com