World's Fastest Database Machine · City . 3 Oracle Exadata Database Machine ... disks to ASM...

Oracle Exadata: The World‟s Fastest Database Machine

Marek Martofel

Oracle

Month, Day, Year

Venue

City

3

Oracle Exadata Database Machine One architecture for …

• Data Warehousing

• OLTP

• Database Consolidation

Exadata is Oracle‟s strategic database platform for ALL Oracle Database

workloads

© 2011 Oracle Corporation

4

Exadata Hardware Architecture Pre-integrated, optimized Oracle Database platform

• Database Pool

– Intel-based database servers

– Oracle Linux or Solaris 11

– 10 Gig Ethernet (to data center)

• Storage Pool

– Intel-based storage servers

– Up to 336 terabytes raw disk

– 5.3 terabytes Flash storage

• InfiniBand Network

– Internal high-bandwidth connectivity

A complete system – compute, storage and network; pre-configured,

balanced and optimized.


5 Copyright © 2011, Oracle Corporation and/or its affiliates – 5 –

Base configurations

• Exadata Database Machine X2-2

• Exadata Database Machine X2-8

Expansion for Exadata

• Exadata Storage Expansion HC

Expansion for database servers

• Exadata X2-2 Memory Expansion Kit

Exadata Database Machine Available Editions

6

Start Small and Grow

Field Upgradeable

Full Rack

Half Rack

Balanced Incremental Scaling for OLTP and DW

Quarter Rack

Copyright © 2011, Oracle Corporation and/or its affiliates – 6 –

7 Copyright © 2011 Oracle Corporation and/or its affiliates – 7 –

X2-2 Database Server (Sun Fire X4170 M2)

Processors 2 Six-Core Intel® Xeon® X5675 Processors (3.06 GHz)

Memory 96 GB (12 x 8GB) expandable to 144 GB (18 x 8GB)

Local Disks 4 x 300GB 10K RPM SAS Disks (Hot-Swappable)

Disk Controller Disk Controller HBA with 512MB Battery Backed Cache

Network 2 x InfiniBand 4X QDR (40Gb/s) Ports (1 Dual-port PCIe 2.0 HCA)

4 x 1GbE Ethernet Ports

2 x 10GbE Ethernet SFP+ Ports (1 Dual-port 10GbE PCIe 2.0

network card based on the Intel 82599 10GbE Controller technology)

Remote

Management

1 Ethernet port (ILOM)

Redundancy Redundant Hot-Swappable power supplies and fans

8

X2-8 Database Server (Sun Fire X4800)

Processors 8 x Eight-Core Intel® Xeon® X7560 Processors (2.26 GHz)

Memory 1 TB (128 x 8 GB)

Local Disks 8 x 300GB 10K RPM SAS Disks (Hot-Swappable)


Network 8 x InfiniBand 4X QDR (40Gb/s) Ports (4 Dual-port PCE 2.0 Express

Modules)

Two Network Express Modules (NEM), providing a total of

• 8 x 1GbE Ethernet Ports

• 8 x 10 GbE Ethernet SFP+ Ports (via 4 Fabric Express Modules

(FEM) based Intel 82599 10GbE Controller technology)

Remote

Management


Redundancy Redundant Hot-Swappable power supplies and fans

Copyright © 2011 Oracle Corporation and/or its affiliates – 8 –

9 Copyright © 2011 Oracle Corporation and/or its affiliates – 9 –

Exadata Storage Server X2-2 (Sun Fire X4270 M2)

Processors 2 Six-Core Intel® Xeon® L5640 Processors (2.26 GHz)

Memory 24 GB (6 x 4GB)

Disks 12 x 600 GB 15K RPM High Performance SAS (hot-swap)

OR

12 x 2 TB 7.2K RPM High Capacity SAS (hot-swap)

Flash 4 x 96 GB Sun Flash Accelerator F20 PCIe Cards


Network 2 InfiniBand 4X QDR (40Gb/s) Ports (1 Dual-port PCIe 2.0 HCA)

4 Embedded Gigabit Ethernet Ports

Remote

Management


Power Supplies Redundant Hot-Swappable power supplies and fans

10

Exadata Software Architecture Intelligent storage, standard Oracle Database

• Database Pool

– Oracle Database 11g

– Oracle RAC (Real Application Clusters)

• Storage Pool

– Intelligent storage

– Hybrid Columnar Compression

– Smart Flash Cache

Storage software innovations uniquely deliver extreme performance

and storage efficiency


11

Exadata Software Architecture Overview

LIBCELL

DB Server

LIBCELL

DB Server

LIBCELL

DB Server

Single-instance DB RAC DB

Exadata Server

OEL

CELLSRV

IORM

MS

RS

Exadata Server Exadata Server

Enterprise Manager

Cell Control CLI

(cellcli/dcli)

SSH

iDB Protocol over InfiniBand with Path Failover

Single ASM cluster ASM ASM ASM

InfiniBand Storage Switch/Network

DB Instance

DBRM

DB Instance DB Instance

DBRM DBRM

OEL

CELLSRV

IORM

MS

RS

OEL

CELLSRV

IORM

MS

RS

12

Exadata Storage – Hard Disk Drives

• 12 x 600GB High Performance or 2TB High Capacity

Uniquely identified by serial number

Automatically created by MS when new disks are inserted

Manually created using CellCLI initially

MS automatically recreates these entities for replacement disks

Manually add grid disks to ASM diskgroups

After that, if a physical disk is replaced, auto management feature will automatically online the corresponding ASM disk

13

Exadata Storage – Flash

• Each card has 4 x 24GB FDOMS

• Each storage cell has 4 Flash cards

• Total of 16 x 24GB flash celldisks per cell

(seen as FDOMs)

• Used for Smart Flash Cache, Smart Flash

Log, and Flash Grid Disks

CELLDISK ASM disk GRIDDISK

FLASHCACHE

OR FDOM

Automatically created by MS

FLASH LOG

MS automatically recreates these entities for replacement disks

14

Select sum(sales) where salesdate= ’17-Nov-2010’…

Sum

Return entire Sales table

What Were Yesterday‟s

Sales?

Discard most of

sales table

Traditional Query Problem

• Data is pushed to database server for processing

• I/O rates are limited by speed and number of disk drives

• Network bandwidth limits performance and concurrency


15

Select sum(sales) where salesdate= ’17-Nov-2010’…

Sum

Filter Sales for Nov 17 2010

What Were Yesterday‟s

Sales?

Exadata Smart Scans Improve data warehouse performance by at least 10x

• Data intensive processing runs in Storage Servers

• Rows and columns filtered as data streams from disk

• Parallelize query execution and remove bottlenecks


16

Oracle Exadata Hybrid Columnar Compression

• Data stored by column and then compressed

• Query mode for data warehousing tables

– Typical 10X compression ratios

• Archival mode for old data

– Typical 15- 50X compression ratios


17

Infrequently Used Data

Frequently Used Data

Exadata Smart Flash Cache Extreme performance for OLTP applications

• Frequently-accessed „hot‟ data cached in flash storage

• Process data at 50Gb/second

– Compressed data up to 500Gb/second

• Up to 1.5 million I/Os per second


18

Exadata Smart Flash Log

• Outliers in log writer IO slow down a

lot of clients

• Outliers from any one copy of the

mirror affect response time

• Performance critical algorithms such

as space management and index

splits are sensitive to log write latency

• Legacy storage cannot differentiate

redo log IO from other IO

foreground

client

Log Buffer

Log writer

foreground

client

foreground

client

foreground

client

ASM mirror 1

Log file member

ASM mirror 2

Log file member

19

Exadata Smart Flash Log

• Smart Flash Log uses Flash as a Parallel

write cache to disk controller cache

• Whichever write completes first wins (disk

or flash)

• Reduces response time and outliers – “log file parallel write” histogram improves

– Greatly improves “log file sync”

• Uses almost no flash capacity (0.1% of

capacity)

• Completely automatic and transparent

• Differentiates Exadata from competition for

OLTP

20

Exadata Smart Flash Log IO Path

1. Database issues redo log write

request to the Exadata cell

2. CELLSRV simultaneously issues

write request to both Flash and Disk

3. CELLSRV acknowledges redo log

write to the database as soon as the

faster of disk write or flash write

completes

E – Redo log writes saved on flash are

written to disk from flash only if there

were errors with the original disk write

request.

Note – Redo Log is permanently stored

on disk and is only stored temporarily on

flash.

CELLSRV

DB

Disk

Flash

1

2

2

3

E

21

Enabling Smart Flash Log

• Requirements

• Exadata Storage Server Software 11.2.2.4 or later

• Oracle Database 11.2.0.3 and BP1 (when supported on

Exadata) or Oracle Database 11.2.0.2 and BP11

• Enabling Smart Flash Log

• Automatically created in new cells with 11.2.2.4 or cell

software upgraded to 11.2.2.4

• Automatically enabled in Oracle database 11.2.0.2 (with

BP11) or later

22

Disabling Smart Flash Log

• To disable Smart Flash Log for all databases

• Use DROP FLASHLOG CellCLI command in the storage servers

• To disable Smart Flash Log for an individual database

• Use ALTER IORMPLAN dbplan=((name=test, flashLog=off))

23

CellCLI - CREATE FLASHLOG

Syntax:

CREATE FLASHLOG [ALL [FLASHDISK]] [attribute=value]

[,attribute=value] …

Examples:

CREATE FLASHLOG ALL

CREATE FLASHLOG ALL SIZE=1G

CREATE FLASHLOG CELLDISK='fd1,fd2'

CREATE FLASHLOG CELLDISK='fd1,fd2' SIZE=1G

Details:

Default size is 512MB and is automatically created for new cells, and

also during upgrades to 11.2.2.4.

24

CellCLI - DROP FLASHLOG

Syntax:

DROP FLASHLOG [FORCE]

Examples:

DROP FLASHLOG

DROP FLASHLOG FORCE

Details:

Note “DROP FLASHLOG” will fail if there is saved redo which has

not yet been written to size. The FORCE option will force the drop of

the flashlog even if there is saved redo and should be used with

caution

25

Exadata Delivers Extreme Consolidation Create a “Database-as-a-Service” platform

• Large Memory

– Many databases can be consolidated

• Extreme Performance

– OLTP, DW, data mining, batch, reporting, loading,

backups, files in the database

– Encryption, compression

• Workload Isolation

– Manage SLAs via Quality of Service (QoS)

– CPU and I/O resource management

– Instance caging

Shrink data center costs, increase system utilization and promote

application integration


26

Standardized and Simple to Deploy Eliminate systems integration trial-and-error

• No Unique Configurations

– Same as Oracle engineering

– Delivered tested and ready-to-run

– Highly optimized, top-to-bottom

– Highly supportable

• Existing Apps, Tools, Practices

– Oracle Database 11g

– Full 30 years of Oracle Database capabilities

– No Exadata certification required

– Skills, knowledge base, people, partners

Deploy in Days, Not Months


27

Faster Deployment with Lower Risk Build your own system vs. Exadata

Build From Scratch with Components

Reference Configurations

Take delivery of Oracle Database Machine

Weeks to Months

Pre-implementation

System sizing

Acquisition of

components

Installation and

configuration

Acquisition of

components

Installation and

configuration

Testing and

Validation

Testing and

Validation

Weeks to Months

Oracle Exadata Database Machine

Database pre-configured

Faster deployment

Lower Risk

< 1 Week after Delivery

Testing and Validation

Configuration



Exadata Product Capacity (Uncompressed)

X2-8

Full Rack

X2-2

Full Rack

X2-2

Half Rack

X2-2

Quarter Rack

Raw Disk1 High Perf Disk 100 TB 100 TB 50 TB 21 TB

High Cap Disk 336 TB 336 TB 168 TB 72 TB

Raw Flash1 5.3 TB 5.3 TB 2.6 TB 1.1 TB

Usable Capacity with ASM

normal redundancy2

High Perf Disk 45 TB 45 TB 22.5 TB 9.25 TB

High Cap Disk 150 TB 150TB 75 TB 31.5 TB

Usable Capacity with ASM

high redundancy3

High Perf Disk 30 TB 30 TB 15 TB 6.25 TB

High Cap Disk 100 TB 100TB 50 TB 21.5 TB

1 - Raw capacity calculated using standard disk drive raw space terminology of 1 GB = 1000 x 1000 x 1000 bytes and 1 TB = 1000 x 1000 x 1000 x 1000 bytes.

2 - Actual space available for a database after mirroring (ASM normal redundancy) and leaving one empty disk to handle disk failures. Capacity calculated using normal space terminology of 1 TB = 1024 * 1024 * 1024 * 1024 bytes.

3 - Actual space available for the database computed after triple mirroring (ASM high redundancy). Capacity calculated using normal space terminology of 1 TB = 1024 * 1024 * 1024 * 1024 bytes.


Exadata Product Performance

X2-8

Full Rack

X2-2

Full Rack

X2-2

Half Rack

X2-2

Quarter

Rack

Raw Disk Data

Bandwidth1,3

High Perf Disk 25 GB/s 25 GB/s 12.5 GB/s 5.4 GB/s

High Cap Disk 14 GB/s 14 GB/s 7 GB/s 3 GB/s

Raw Flash Data

Bandwidth1,3

High Perf Disk 75 GB/s 75 GB/s 37.5 GB/s 16 GB/s

High Cap Disk 64 GB/s 64 GB/s 32 GB/s 13.5 GB/s

Disk IOPS2,3 High Perf Disk 50,000 50,000 25,000 10,800

High Cap Disk 25,000 25,000 12,500 5,400

Flash IOPS2,3 1,500,000 1,500,000 750,000 375,000

Data Load Rate4 12 TB/hr 12 TB/hr 6 TB/hr 3 TB/hr

1 - Bandwidth is peak physical disk scan bandwidth achieved running SQL, assuming no compression.

2 - IOPs – Based on peak IO requests of size 8K running SQL. Note that other products quote IOPs based on 2K, 4K or smaller IO sizes that are not relevant for databases.

3 - Actual performance will vary by application.

4 - Load rates are typically limited by CPU, not IO. Rates vary based on load method, indexes, data types, compression, and partitioning

30

Complete Family Of Database Machines From quarter-rack to multi-rack configurations

Oracle Exadata X2-2 2 to 8 (12 core) database nodes

Oracle Exadata X2-8 2 (64 core) database nodes

Quarter Half

Full, Multi-Rack

Full-Rack

Multi-Rack Exadata models and configurations

span the full range of enterprise database deployments


31

Best OLTP Machine Runs all enterprise applications

• Oracle E-Business Suite

• Oracle Peoplesoft

• Oracle Siebel

• SAP applications

• 3rd party ISV applications

• In-house developed applications


32

For More Information

http://search.oracle.com

or

www.oracle.com/exadata

oracle exadata


World's Fastest Database Machine · City . 3 Oracle Exadata Database Machine ... disks to ASM...

Documents

Transcript of World's Fastest Database Machine · City . 3 Oracle Exadata Database Machine ... disks to ASM...