Exadata x3 workshop

1 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

Confidential - Oracle Restricted

Fran Navarro

Principal Sales Consultant

Oct - 2013

Oracle Software on Oracle Hardware: Exadata



ENGINEERED TO WORK TOGETHER



Transforming the Data CenterFrom Best in Class to Engineered Systems

Best-of-Breed Products Oracle Optimized Solutions Engineered Systems



BeforeBefore

A NEW ERA: ORACLE ENGINEERED SYSTEMS

HARDWARE AND SOFTWARE ENGINEERED TO WORK TOGETHER

NowNow



A FULLY INTEGRATED SYSTEM

Engineered

Certified

Deployed

Supported

Tested

Packaged

Upgraded

Managed

TOGETHER



100’s of Components 1 Machine 1000’s of Hours 1 Day

GROUNDBREAKING TIME TO MARKET

FEWER PIECES TO BUY, DEPLOY & MAINTAIN



Exadata Unified Workload Transformation

Single Machine for…• Data Warehousing

• OLTP

• Database Cloud

OLTP with Analytics and Parallelism of Warehousing

OLTP with Analytics and Parallelism of Warehousing

Warehousing with Interactivity, Availability, and Security of OLTPWarehousing with Interactivity,

Availability, and Security of OLTP



Exadata Database Machine

• Designed to be the best platform for Oracle Database

• Integrates and optimizes servers, storage, network– Using high-volume servers in a scale-out architecture– Flash-optimized

• Special software brings database intelligence to storage, flash, and networking – To deliver extreme performance and data compression

• Deployments are fast, reliable, and supportable

• Optimal for all database workloads– OLTP, Data Warehousing, and Database Clouds



Exadata Evolution

• Exadata V1 Introduced

• V2 Servers• 40 Gb InfiniBand• PCI Flash Cards

• X2-2 Servers• X2-8 64-core Servers

• Smart Flash Cache• Storage Index

• Columnar Compression• Smart Scan• InfiniBand Scaleout

• Hardware DB Encryption• Automatic Service Request

• Data Mining Offload

• Storage Expansion Rack• X2-8 CPU Refresh

• 2TB DRAM per node

• Smart Flash Logging

State-of-the-Art, Scale-out Hardware

State-of-the-Art, Scale-out Hardware

Unique Software Integration

Unique Software Integration

2008 2009 2010 2011 2012

• X3-2 8-core Servers

• X3-8 80-core Servers

• Write-back Flash cache



1000s of Deployments at Leading CompaniesHalf are Warehouses, Half are OLTP or Mixed Workloads

Petabyte Warehouses

Online Financial Trading

E-Commerce Sites Consolidation of 100s of

Databases



Exadata ArchitectureComplete Database platform using standard servers for Compute and Storage

Scale-Out Database Servers• 2-socket or 8-socket Xeon database servers• Oracle Database, ASM, RAC; Linux or Solaris• Standard Ethernet to data center

Scale-Out Intelligent Storage Servers• 2-socket storage servers, Exadata Storage Software• Up to 500 terabytes disk per rack• 56 PCI Flash memory cards per rack

InfiniBand Network• Unified internal connectivity ( 40 Gb/sec )



Exadata Storage Server Building Block• High-performance storage server built from

industry standard components

• 12 disks - 600 GB 15000 RPM High Performance SAS or 3TB 7200 RPM High Capacity SAS

• 2 Six-Core Intel Xeon Processors (E5-2630L)• Dual ported 40 Gb/sec InfiniBand• 4 x 400 GB Flash Cards• Intelligent Exadata Storage Server Software



Exadata Intelligent Storage Exadata storage servers also run more complex

operations in storage– Join filtering– Incremental backup filtering– I/O prioritization– Storage Indexing– Database level security– Offloaded scans on encrypted data– Data Mining Model Scoring

10x reduction in data sent to DB servers is common

Exadata Intelligent Storage Grid



Exadata Data Processing TransformationsExtreme Performance at Lowest Cost

+ ++

• Hybrid Columnar Compression– Faster Analytics– Huge Space Savings– 10x compression for warehouses– 15x compression for archives

Space Savings Cascade to

Database Copies

compress

primary DB

uncompressed

• Smart Scale-Out Storage– InfiniBand connected servers– Smart Scan query offload

• Smart Scale-Out PCI Flash Caching– Accelerates I/O up to 30x



Exadata Hybrid Columnar CompressionHighest Capacity, Lowest Cost

• Data is organized and compressed by column• Dramatically better compression

• Speed Optimized Query Mode for Data Warehousing• 10X compression typical • Runs faster because of Exadata offload!

• Space Optimized Archival Mode for infrequently accessed data• 15X to 50X compression typical

Qu

ery

Faster and SimplerBackup, DR, Caching, Reorg, Clone

Faster and SimplerBackup, DR, Caching, Reorg, Clone Benefits Multiply



Compression Ratio of Real-World Data• Compression Ratio varies by

customer and table

• Trials were run on largest table at 10 ultra large companies• Average revenue > $60 BB

• Average Query Compression ratio was 13x• On top of Oracle’s already

highly efficient format



Smart Scans

• Exadata cells implement smart scans to greatly reduce the data that needs to be processed by the database– Only return relevant rows and columns– Offload predicate evaluation

• Data reduction is usually large– Column and row reduction often decrease data

to be returned to the database by 10x

• Join filtering



Storage Index

• Exadata maintains summary information about table data in memory– Store min/max values of columns

– Typically one index entry for MB of disk

• Eliminates IO when MIN/MAX can never match the “where” clause of the query

• Completely automatic and transparent

• Example: select count(*) from table where B=1;

• Used in Joins with bloom filter sending min/max

• Useful for correlated columns like ship_date and order_date

Table Index

Min B=1Max B=5

Min B=3Max B=8



Exadata X3 Database In-Memory Machine

• X3 mass memory hierarchy delivers extreme performance– Automatically moves all active data from disk to memory

• DRAM memory expanded to 2 or 4 TB for hottest data– 4 to 40 TB of compressed user data

• Flash memory expanded 4X to 22 TB per rack– 40 to 200 TB of compressed user data – ALL active data– 1.5 Million SQL random read I/Os per second for OLTP

• Comparable to 15,000 disk drives in 150 array frames

– 100 GB/sec SQL data scan rate for reporting and warehouses• Comparable to 1,000 disk drives in 10 array frames

500 TBDISK

22 TB PCI FLASH

2 or 4 TB DRAM

Cold Data

Hottest Data

Active Data



Exadata Smart Flash Cache Write-Back

• Caches Write I/Os in PCI flash in addition to Read I/Os

• Transparently accelerates write intensive workloads– 20X more write IOPS than disk on X3– 10X more write IOPs than disk on V2 and X2

• Persistent write cache speeds database recovery

• Exadata Flash Cache is much more effective than flash tiering architectures used by others– Caches current hot data, not yesterday’s– Caches data in granules 8x to 16x smaller than tiering

• Greatly improves the effectiveness of flash

Writes I/Os

1 Million 8K Write IOPs from SQL



Writeback Flash Cache

Storage cell

Storage cell

Database Node




Storage cell

Storage cell

Hard disk Flash

Database Node




Storage cell

Storage cell

Database Node

Disks are not mirrored to each other




Storage cell

Storage cell

Database Node

Allocation units (4MB) are mirrored

Ignore variable extents for a little while

Blocks in picture are say 8k blocks




Storage cell

Storage cell

Database Node

Storage cell moves it into Flash

Block on disk is stale

New IO requests served from flash

Update blue and yellow

Green, blue, and yellow now in flash

Database backup reads green, blue, and yellow from flash and black from disk

Start Database Backup Update green

No need to have any new backup strategy




Storage cell

Storage cell

Database Node

Update green, read blue

Green is updated in flash on both storage cellsBlue is read from flash from primary storage cell

A block can stay for months or years in flash if it is active




Storage cell

Storage cell

Database Node

Read blue, read lots of other blocks but not yellow or green

Yellow and Green sent back to disk on both cells

Only primary copy in cache for smart usage of premium flash space

Blue written back only on secondary copy



Writeback Flash Cache – Reads with failure

Storage cell

Storage cell

Database Node

Read black from cell with failed flash

Disks are still online in v$asm_disk

Black read from hard disk on storage

Read yellow from cell with failed flashSpecial IO error redirects read to mirror copy on another storage cell

Transparent to application



Exadata Smart Flash Cache Compression

• Exadata automatically Compresses all data in Smart Flash Cache– Compression engine built into flash card– Zero performance overhead on reads and writes– Logical size of flash cache increases upto 2x– User gets large amount of data in flash for same

media size– Enabled via “cellcli –e alter cell flashCacheCompression=TRUE”

– Elasticity of flash cache is completely automatic and transparent



X3-2 Database Servers• 2 Eight-Core Intel® Xeon® 2.9 GHz E5-2690 CPUs• 256 GB (16 x 16GB)• On-board 4 x 1GbE/10GbE Base-T Ethernet• 2 x 10GbE SFP+ PCIe Ethernet card• Dual-port InfiniBand QDR (40 Gb/s) HCA• 4 x 2.5” 300GB Disk Drives• Disk Controller HBA with 512 MB BBWC• Redundant Power Supplies, Fans• ILOM

Installed Software:• Oracle Database 11.2, 12.1• Oracle UEK Linux or Solaris 11



InfiniBand Network• Unified InfiniBand Network

• Storage Network• RAC Interconnect• External Connectivity (optional)

• High Performance, Low Latency Network• 80 Gb/s bandwidth per link (40 Gb/s each direction)• Zero-copy Zero-loss Datagram Protocol (ZDP RDSv3)

• SAN-like Efficiency (Zero copy, buffer reservation)• Linux Open Source, Low CPU overhead (Transfer 3 GB/s with less

than 2% CPU usage)



Best-in-Class Technology: Transparent Storage Optimization

10:1

Hybrid Columnar Compression

HCC

HOTHOT

WARMWARM

COLDCOLD

Smart Flash CacheSmart Flash Log

Flash Disk

Smart Flash

Smart Scan

Compression expands Flash capacity by 10x

Smart Flash Caching boosts Flash capacity

CPU offload enables processing data at full

Flash bandwidth

Scale-out storage allows 56 Flash cards per rack



Comprehensive Resource Management• Unique Workload-based allocation of

1. CPU Resources

2. Network resources

3. I/O Resources

• Prioritize from the application to the database, O/S, network and storage – allocated to services, modules, actions or users

• Simplify, Standardize, OptimizeAll Workloads, All

Applications

SAP, Siebel, PeopleSoft, JDE,E-business Suite, Fusion

Applications

All Workloads, All Applications

SAP, Siebel, PeopleSoft, JDE,E-business Suite, Fusion

Applications

Lower CostsIncrease Utilization

Reduce Management

Lower CostsIncrease Utilization

Reduce Management



Exadata Hardware – Highly RedundantNo Single point of failure

Two Redundant Power Distribution Units (PDUs) for rack level power

Each database server, storage server, InfiniBand switch has redundant hot-swap power supplies

Disk drives, fans are hot-swap. RAC provides protection against database server failures ASM provides protections against storage server failures InfiniBand network highly redundant – can tolerate loss of

entire switch or connections without affecting performance



Start Small and GrowField Upgradeable

Unique Architecture Makes it Fastest at the Lowest Cost

Half Rack Full RackQuarter RackEighth Rack



Scale to 18 Racks by Just Adding CablesFull Bandwidth and Redundancy

Scale to more than 18 Racks by adding InfiniBand switches



X3-8 Full X3-2 Full X3-2 Half X3-2 Quarter X3-2 Eighth

Database ServersDatabase Servers 2 8 4 2 2

Database Grid CoresDatabase Grid Cores 160 128 64 32 16

Database Grid Memory (GB)Database Grid Memory (GB) 4096 2048 1024 512 512)

InfiniBand switchesInfiniBand switches 3 3 3 2 2

Ethernet switchEthernet switch 1 1 1 1 1

Exadata Storage ServersExadata Storage Servers 14 14 7 3 3

Storage Grid CPU CoresStorage Grid CPU Cores 168 168 84 36 18

Raw Flash CapacityRaw Flash Capacity 22.4 TB 22.4 TB 11.2 TB 4.8 TB 2.4 TB

Raw Storage CapacityRaw Storage CapacityHigh PerfHigh Perf 100 TB 100 TB 50 TB 21.6 TB 10.8 TB

High CapHigh Cap 504 TB 504 TB 252 TB 108 TB 54 TB

Usable mirrored capacityUsable mirrored capacityHigh PerfHigh Perf 45 TB 45 TB 22.5 TB 9.5 TB 4.5 TB


Usable Triple mirrored Usable Triple mirrored capacitycapacity

High PerfHigh Perf 30 TB 30 TB 15 TB 6.5 TB 3.25 TB


Exadata Database Machine Hardware Summary



Database Machine IO PerformanceX3-2 or X3-8

Full RackX3-2

Half RackX3-2

Quarter X3-2

Eighth

Disk Data Bandwidth1,3

High Perf Disk 25 GB/s 12.5 GB/s 5.4 GB/s 2.7 GB/s

High Cap Disk 18 GB/s 9 GB/s 4 GB/s 2 GB/s

Flash CacheData Bandwidth1,3

High Perf Disk 100 GB/s 50 GB/s 21.5 GB/s 10.7 GB/s

High Cap Disk 93 GB/s 46.5 GB/s 20 GB/s 10 GB/s

Disk IOPSHigh Perf Disk 50,000 25,000 10,800 5,400

High Cap Disk 28,000 14,000 6,000 3,000

Flash IOPS2,38K Reads 1,500,000 750,000 375,000 187,000

8K Writes 1,000,000 500,000 250,000 125,000

Data Load Rate4 16 TB/hr 8 TB/hr 4 TB/hr 2 TB/hr

1 - Bandwidth is peak physical scan bandwidth achieved running SQL, assuming no compression. Effective data bandwidth will be much higher when compression is factored in. 2 - IOPS – Based on read IO requests of size 8K running SQL. Note that the IO size greatly effects flash IOPS. Others quote IOPS based on 2K, 4K or smaller IOs that are not relevant for databases. Exadata Flash read IOPS are so high they are typically limited by database server CPU, not IO.3- Actual Performance varies by application.4 – Exadata load rates are typically limited by database server CPU, not IO. Rates vary based on load method, indexes, data types, compression, and partitioning



Database Machine Capacity (Uncompressed)X3-8 or X3-2

FullX3-2Half

X3-2Quarter

X3-2 Eighth

Raw Disk CapacityHigh Perf Disk 100 TB 50 TB 21.6 TB 10.8 TB

High Cap Disk 504 TB 252 TB 108 TB 54 TB

Raw Flash Capacity1 22.4 TB 11.2 TB 4.8 TB 2.4 TB

Usable Mirrored Capacity 1,2

High Perf Disk 45 TB 22.5 TB 9.5 TB 4.5 TB


Usable Triple Mirrored Capacity1,3

High Perf Disk 30 TB 15 TB 6.5 TB 3.25 TB


1- Raw Disk Capacity defined using standard disk drive terminology of 1 TB = 1000 * 1000 * 1000 * 1000 bytes.2- Capacity calculated using normal space terminology of 1 TB = 1024 * 1024 * 1024 * 1024 bytes.3 - Actual space available for a database after mirroring (ASM normal redundancy) and allowing one disk (Quarter and Half) or two disks (Full Rack) of free space to automatically remirror after disk failures. 4 - Actual space available for the database computed after triple mirroring (ASM high redundancy).



Exadata Database Machine X3-2 Eighth RackEntry Level Configuration

• 2 Xeon-based Dual-processor Database Servers– 16 cores (8 per server)– 512 GB memory (256 GB per server)– 10 Gig E-connectivity to Data Center

• 10 x 10Gb E-ports (5 per server)• 2.4 TB High Speed Flash • 3 Exadata Storage Servers X3-2

– All with High Performance 6 x 600GB SAS disks OR– All with High Capacity 6 x 3 TB SAS disks

• 2 Sun Datacenter InfiniBand Switch 36– 36-port Managed QDR (40Gb/s) switch

• 1 “Admin” Ethernet switch• Redundant Power Distributions Units (PDUs)

Upgradable via software to Quarter Rack



Exadata Database Machine X3-2 Quarter RackPre-Configured for Extreme Performance






Upgradable to Half Rack



Exadata Database Machine X3-2 Half RackPre-Configured for Extreme Performance






Upgradable to Full Rack



Exadata Management



Exadata Storage Management & Administration• Enterprise Manager

– Manage & administer Database and ASM– Monitor the Exadata Database Machine Hardware

• Auto Service Request (ASR)– File SRs automatically for common hardware faults

• Comprehensive CLI– Local Exadata Storage cell management – Distributed shell utility to execute CLI across multiple cells

• Embedded Integrated Lights Out Manager (ILOM)– Remote management and administration of hardware



Enterprise Manager 12c Integrated H/W + S/W management for Exadata

• Hardware view• Schematic of cells, compute nodes and

switches• Hardware components alerts

• Software/system view• Performance, availability, usage by

databases, services, clusters• Software alerts db, cluster, ASM• Topology view of DB systems/clusters

• Configuration view• Version summary of all components

along with patch recommendations



Automated Service Request (ASR)

ComprehensiveFault Coverage

•CPU•Disk controllers•Disks•Flash Cards•Flash modules•InfiniBand•Cards•Memory•System Board•Power supplies•Fans

!Fault occurs

Product’s auto-diagnosisfacility sends SNMP trap to ASR

Manager

Service Requestcreated

FRU dispatched by Support Engineer

FRU replaced by Field Engineer

ASRManager

ASRManager

SR creation email notification to customer

SR creation email notification to customer

Fault telemetry securely transmitted to Oracle

Fault telemetry securely transmitted to Oracle

SR routed to Support Engineer

SR routed to Support Engineer

Customer

Oracle Field Engineer

ASRServiceASR

Service



Oracle Support for Performance and Availability

• 24/7 support coverage

• Specialized Engineered Systems Support Team

• 2-hour onsite response to hardware issues1

• New updates and upgrades for Database, Server, Storage, and OS software

Complete. Integrated. Proactive. High Availability Services.No Additional Cost.

ORACLE PLATINUM SERVICES

Better support for the complete Oracle stack– Includes higher support levels for Database software

24/7 Oracle remote fault monitoring

Industry-leading response times:– 5 Minute Fault Notification

– 15 Minute Restoration or Escalation to Development

– 30 Minute Joint Debugging with Development

Patch deployment by Oracle engineers

Available now for certified configurations on Oracle SuperCluster

1 Covered system must be within an Oracle two-hour service area to receive two-hour response as a standard service.

Oracle engineers perform patching services up to four times per year



ORACLE INFRASTRUCTURE AS A SERVICE (IAAS)

• Engineered Systems hardware & hardware support for a monthly fee

No upfront capital expenditure, OPEX not CAPEX Usually lower total cost than purchasing system

• On Premise Deploys behind customer’s firewall Control and visibility over the system

• Elastic Compute Capacity on Demand1

For peak workloads and high availability Pay only when needed

• Oracle Platinum and PlatinumPlus Services2

Higher level of support including patching services Quarterly advisory services for system security,

performance, and availability

ON PREMISE WITH CAPACITY ON DEMAND

1. Eligible systems include Oracle Exadata, Exalogic, Exalytics and SPARC SuperCluster.2. Eligible systems include Oracle Exadata, Exalogic, and SPARC SuperCluster.



Benefits to IT | Business Benefits

2-Day Deployment Less Administration

1-800-SUPPORT Standard Configurations

Simplify IT

Deploy in Days

1-800-SUPPORT Consolidate|Standardize

Administer with Less

Global Scale OLTP

Work Faster & Smarter

Internet-Scale OLTP

Deeper Analytics

Real-Time BI Near Real-Time Batch

Real-Time BI

Deeper Analysis

Near Real-Time Batch

Exadata x3 workshop

Technology

Transcript of Exadata x3 workshop