danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing...
Transcript of danielaugusto.com/openworld2010/s316825-futuro-oracle-exadata-2… · •Data Intensive processing...
<Insert Picture Here>
Exadata Database Machine
Alexsander Siqueira - Solution Architect Manager
Exadata Database Machine
• Best Machine for Data Warehousing
• Best Machine for OLTP
• Best Machine for Database Consolidation
© 2010 Oracle Corporation 3
• Launched in Fall 2008
• Seeing rapid adoption in all geographies and industries
Exadata in the Marketplace
© 2010 Oracle Corporation 4
Exadata X2-2 Hardware Architecture
Database Grid
• 8 compute servers (1U)
• 2 Intel Sockets
Storage Grid
• 14 storage servers (2U)
• 2 Xeon CPUs per server
• 100 TB High Speed disk, or336 TB High Capacity disk
• 5 TB PCI Flash
• Data mirrored across storage servers
Scaleable Grid of industry standard servers for Compute and Storage
• Eliminates long-standing tradeoff between Scalability, Availability, Cost
InfiniBand Network
• Redundant 40Gb/s switches
• Unified server & storage net
© 2010 Oracle Corporation 5
Fully Redundant
Start Small and GrowField Upgradeable
Full Rack
Half Rack
Balanced Incremental Scaling for OLTP and DW
Quarter Rack
© 2010 Oracle Corporation 6
Scale to 8 Racks by Just Adding CablesFull Bandwidth and Redundancy
© 2010 Oracle Corporation 7
2368 Compute Cores
2.6 Petabytes Uncompressed Storage
© 2010 Oracle Corporation 8
Balanced and Optimized
• Custom systems do not achieve full performance
• Component imbalance, misconfiguration, bottlenecks
• Exadata is engineered and optimized end-to-end
• Double-digit GB/sec transfers from disk to database
• DB libraries optimized with firmware, drivers, OS, network
• Years of tuning
• Move I/T talent to higher value business needs
• Not designing, tuning, maintaining hardware configsOptimized
End-to-End
Keys to Speed and Cost Advantage
© 2010 Oracle Corporation 9
Exadata Hybrid Columnar Compression
Exadata Intelligent Storage Grid
Exadata Smart Flash Cache
• Data Intensive processing runs in Exadata Storage Grid
• Filter rows and columns as data streams from disks (112 Intel Cores)
• Example: How much product X sold last quarter
• Exadata Storage Reads 10TB from disk
• Exadata Storage Filters rows by Product & Date
• Sends 100GB of matching data to DB Servers
• Scale-out storage parallelizes execution and
removes bottlenecks
Exadata Intelligent Storage GridMost Scalable Data Processing
© 2010 Oracle Corporation 10
© 2010 Oracle Corporation 11
Exadata Intelligent Storage
• Exadata storage servers also run more complex operations in storage
• Join filtering
• Incremental backup filtering
• I/O prioritization
• Storage Indexing
• Database level security
• Offloaded scans on encrypted data
• Data Mining Model Scoring
• Smart File Creation
• 10x reduction in data sent to DB servers is common
Exadata Intelligent Storage Grid
Exadata Hybrid Columnar CompressionHighest Capacity, Lowest Cost
© 2010 Oracle Corporation 12
• Data is organized and compressed by column
• Dramatically better compression
• Speed Optimized Query Mode for Data Warehousing
• 10X compression typical
• Runs faster because of Exadata offload!
• Space Optimized Archival Mode for infrequently accessed data
• 15X to 50X compression typical
Qu
ery
Faster and Simpler
Backup, DR, Caching, Reorg, Clone Benefits Multiply
© 2010 Oracle Corporation 13
Exadata Smart Flash CacheExtreme Performance OLTP
• Exadata has 5 TB of flash
• 56 Flash PCI cards avoid disk
controller bottlenecks
• Intelligently manages flash
• Smart Flash Cache holds hot data
• Gives speed of flash, cost of disk
• Exadata flash cache achieves:
• Over 1 million IO/sec from SQL (8K)
• Sub-millisecond response times
• 50 GB/sec query throughput
Unified Hardware, Specialized Software
© 2010 Oracle Corporation 14
• Exadata enables a single hardware architecture for all database needs
• Massively parallel hardware, InfiniBand, & Flash are best for all DB applications and workloads
• Enables Strategic building block approach to IT
• Domain specialization is in software, not hardware
• Oracle offers the most sophisticated specializations
• Analytics.
• OLAP, Statistics, Spatial, Data Mining, etc.
• Warehousing
• Flexible Partitioning, Bitmap Indexing, Join indexing, Materialized Views, Result Cache
• Data
• Relational, XML, Objects, Secure Files
• OLTP, Security, HA
Data Mining
OLAP
ETL
Metrics
© 2010 Oracle Corporation 15
16
• Fastest Disk Throughput
• Much Faster with Flash
• 50 TB of data fits in Flash
• Using 10x Query Compression
• Effective Query Throughput on
compressed data is even higher
• Hundreds of GB/sec
© 2010 Oracle Corporation
Teradata2580
NetezzaTwinFin 12
ExadataV2
Query ThroughputGB/sec Uncompressed Data
Single Rack
Flash
Disk
Faster than DW Appliances 50 GB/sec!
17
• Exadata is fastest
• and scales with more racks
• Storage Arrays already can’t
deliver disk bandwidth
• No extra bandwidth from Flash
• No CPU offload
• No Columnar Compression
• No InfiniBand
© 2010 Oracle Corporation
Storage Data Bandwidth(Uncompressed GB/sec)
Fla
sh
More Bandwidth than High-End ArraysD
isk
ExadataV2
50 GB/sec!
1 RackMultiple Racks
© 2010 Oracle Corporation 18
Extreme Performance OLTP
5X More I/Os than
1000 Disk Enterprise
Storage Array
• Best random I/O performance
• Exadata has 5 TB of PCI flash
• Exadata flash cache achieves:
• Over 1 million IO/sec from SQL (8K)
• Sub-millisecond response times
More Data Capacity
© 2010 Oracle Corporation 19
Exadata V210x Compression
Teradata 25801.3x Compression
Netezza TwinFin2x to 4x Compression
EMC VMAX3x Oracle Compression
Systems with Equal User Data
All with Largest Disks, Best Compression
20
DBFS - Scalable Shared File System
© 2010 Oracle Corporation
• Database Machine comes with DBFS shared Linux file system
• Shared storage for ETL staging, scripts, reports and other application files
• Files stored as SecureFile LOBs in database tables stored in Exadata
• Protected like any DB data – mirroring, DataGuard, Flashback, etc.
• 7+ GB/sec file system I/O throughput
• 5 TB/hour data loading using DBFS and parallel load
ETL Files in DBFS
Load into database using External Tables
ETL
More File Throughput than High-End NAS Filer
New Top-of-the-Line
System
© 2010 Oracle Corporation 21
02468
101214161820
2005 2006 2007 2008 2010
Sun Fire x4800
• Most Compact Enterprise SMP
in Market
• 5 Rack Units
• 64 Intel Xeon 7500 EX Cores
• 8 Sockets
• 1 TB Memory
• 128 Dimms
• 8 40Gb/sec InfiniBand Ports
• 8 10Gb/sec 10g Ethernet Ports
7500
Relative Intel 4-socket chip performance
Top-of-the-Line Addition to Exadata Family: X2-8
Database Grid
• 2 64-core Intel EX Servers
• 2 TB Memory
• Choice of
• Oracle Linux Unbreakable Enterprise Kernel
• Solaris 11 Express
Storage Grid
• Same Storage Grid as Exadata X2-2
• CPUs updated to latest 6-core Xeon
Scale-Out Grid of Large SMP Servers – Best of Both Worlds
Network
• Redundant 40Gb/s Infiniband
• 10 Gb Ethernet to Data Center
Best Machine for Database Consolidation
© 2010 Oracle Corporation 25
• Exadata serves as farm/cloud for
databases
• Large memory enables many databases
to be consolidated
• Extreme performance for complex
workloads that mix OLTP, DW, batch,
reporting
• I/O and CPU resource management
isolates workloads
ERP
CRM
Warehouse
Data Mart
HR
Complete Family Of Database MachinesFor OLTP, Data Warehousing & Consolidated Workloads
• Quarter, Half, Full and Multi-Racks • Full and Multi-Racks
Oracle Exadata X2-8Oracle Exadata X2-2
New Software
Updates
Database 11.2.0.2
Exadata 11.2.2.1
© 2010 Oracle Corporation 27
Main Goal: Stability and Robustness
• Main focus over last year has been fixing and fine-tuning
• Working with dozens of customers deploying everything from
multi-hundred TB warehouses, to stock trading systems, to
business apps like E-business suite, Siebel, and PeopleSoft
• DB Machine bundle patches approximately every other month
• Full stack testing – Exadatda, DB, ASM, Clusterware, OS
• September release of DB patchset 11.2.0.2, Exadata 11.2.2.1
• No architectural changes, lots of fixes and point improvements for
performance, robustness, diagnostics, management, and security
Roadmap
• Hardware
• Exalogic
• Architecture is stable. Will track component updates
• Chips, memory, disks, flash, etc.
• We allow mixing of servers across generations
• Software
• Solaris 11 Express x86 on Database Nodes
• Exadata Smart Flash Log – lower latency log writes
• Write-back flash Cache
• Remote Syslog Auditing for Storage
• Snapshots on DB Server local disks
• Snapshot Oracle Home before making changes
Exadata Summary
• Best for OLTP
• Smart Flash Cache
• 1 Million I/Os per Second
• Best for Warehousing
• Intelligent Scale-Out storage
• 10x faster queries
• 10x Data Compression
• Best for Consolidation
• Terabytes of Memory
• Mix OLTP, DW, batch,
reporting in single machine
• Complete Ready-to-Run
System
• Full database encryption
with near zero overhead
• Runs all Oracle Applications
unchanged
SGA
Cenário Proposto – OracleProcessamento de Consultas em um Ambiente Convencional
Storage Array
Oracle Database
Grid1Cliente pede A
# * $ # & @ &
% * @ & @ ^ #
% @ * & A @ $
^ { ] $ # % A2
Cliente pede B
3
Cliente pede A
B
B
Memória Operacional
SGA
A A
A A
Cenário proposto – OracleArquitetura Exadata - Cache especializado para a área de trabalho
Exadata Storage Disks
Oracle Database
Grid1Cliente pede A
2Cliente pede B
3Cliente pede A
B B
B B
A A
A A
B B
B B
A A
A A
# * $ # & @ &
% * @ & @ ^ #
% @ * & A @ $
^ { ] $ # % AB
B