exadata | best exadata training | oracle exadata - oracle trainings
67612322 Exadata Technical PPT
Transcript of 67612322 Exadata Technical PPT
-
7/22/2019 67612322 Exadata Technical PPT
1/43
Oracle Exadata Database Machine Overview
Copyright 2010, Oracle Corporation and/or its affiliates
-
7/22/2019 67612322 Exadata Technical PPT
2/43
Copyright 2010, Oracle Corporation and/or its affiliates 2
Best Machine forData Warehousing
Best Machine forOLTP
Best Machine forDatabase Consolidation
UniqueArchitecture Makes it Fastest, Lowest Cost
Exadata Database MachineBest Platform to Run the Oracle Database
-
7/22/2019 67612322 Exadata Technical PPT
3/43
Exadata in the MarketplaceRapid adoption in all geographies and industries
Copyright 2010, Oracle Corporation and/or its affiliates 3
-
7/22/2019 67612322 Exadata Technical PPT
4/43
Exadata Hardware Architecture
Database Grid Intell igent Storage Grid
InfiniBand Network
Redundant 40Gb/s switches
Unified server & storage
network
14 High-performance low-coststorage servers
8 Dual-processor x64database servers
OR
2 Eight-processor x64database servers
Scaleable Grid of industry standard servers forCompute and Storage Eliminates long-standing tradeoff between Scalability, Availability, Cost
100 TB High Performance disk,or336 TB High Capacity disk
5.3 TB PCI Flash
Data mirrored across storageservers
Copyright 2010, Oracle Corporation and/or its affiliates 4
-
7/22/2019 67612322 Exadata Technical PPT
5/43
Standardized and Simple to Deploy
All Database Machines are the same
Delivered ready-to-run
Tested
Highly supportable
No unique configuration issues
Identical to config used by Oracle Engineering
Runs existing OLTP and DW applications
Full 30 years of Oracle DB capabilities
No Exadata certification required
Leverages Oracle ecosystem
Skills, knowledge base, people, partners
Deploy in Days,
Not Months
Copyright 2010, Oracle Corporation and/or its affiliates 5
-
7/22/2019 67612322 Exadata Technical PPT
6/43
Exadata Storage Server Building Block
High-performance storage server built fromindustry standard components
12 disks - 600 GB 15000 RPM High
Performance SAS or 2TB 7200 RPM HighCapacity SAS
2 Six-Core Intel Xeon Processors (L5640)
Dual ported 40 Gb/sec InfiniBand
4 x 96 GB Flash Cards
Intelligent Exadata Storage Server Software
Hardware by Sun
Software by Oracle
Copyright 2010, Oracle Corporation and/or its affiliates 6
-
7/22/2019 67612322 Exadata Technical PPT
7/43Copyright 2010 Oracle Corporation and/or its affiliates 7
New - Exadata Database Machine X2-8 Full RackExtreme Performance for Consolidation, Large OLTP and DW
2 x64 Eight-processor Database servers (Sun Fire 4800)
High Core, High Memory Database Servers
128 CPU cores (64 per server)
2 TB (1 TB per server)
10 GigE connectivity to Data Center
16 x 10GbE ports (8 per server)
14 Exadata Storage Servers X2-2
All with High Performance 600GB SAS disks
OR
All with High Capacity 2 TB SAS disks
3 Sun Datacenter InfiniBand Switch 36
36-port Managed QDR (40Gb/s) switch
1 Admin Cisco Ethernet switch Redundant Power Distributions Units (PDUs)
Add more racks for additional scalability
-
7/22/2019 67612322 Exadata Technical PPT
8/43Copyright 2010 Oracle Corporation and/or its affiliates 8
Exadata Database Machine X2-2 Full RackPre-Configured for Extreme Performance
8 x64 Dual-procesor Database Servers (Sun Fire X4170 M2)
96 cores (12 per server)
768 GB memory (96GB per server)
10 GigE connectivity to Data Center 16 x 10GbE ports (2 per server)
14 Exadata Storage Servers X2-2
All with High Performance 600GB SAS disks
OR
All with High Capacity 2 TB SAS disks
3 Sun Datacenter InfiniBand Switch 36
36-port Managed QDR (40Gb/s) switch
1 Admin Cisco Ethernet switch
Keyboard, Video, Mouse (KVM) hardware
Redundant Power Distributions Units (PDUs)
Add more racks for additional scalability
-
7/22/2019 67612322 Exadata Technical PPT
9/43Copyright 2010 Oracle Corporation and/or its affiliates 9
4 x64 Dual-procesor Database Servers (Sun Fire X4170M2)
48 cores (12 per server)
384 GB memory (96GB per server)
10 GigE connectivity to Data Center
8 x 10GbE ports (2 per server)
7 Exadata Storage Servers X2-2
All with High Performance 600GB SAS disks
OR
All with High Capacity 2 TB SAS disks
3 Sun Datacenter InfiniBand Switch 36
36-port Managed QDR (40Gb/s) switch
1 Admin Cisco Ethernet switch Keyboard, Video, Mouse (KVM) hardware
Redundant Power Distributions Units (PDUs)
Can Upgrade to a Full Rack
Exadata Database Machine X2-2 Half RackPre-Configured for Extreme Performance
-
7/22/2019 67612322 Exadata Technical PPT
10/43Copyright 2010 Oracle Corporation and/or its affiliates 10
Can Upgrade to an Half Rack
Exadata Database Machine X2-2 Quarter RackPre-Configured for Extreme Performance
2 x64 Dual-procesor Database Servers (Sun Fire X4170 M2)
24 cores (12 per server)
192 GB memory (96GB per server)
10 GigE connectivity to Data Center 4 x 10GbE ports (2 per server)
3 Exadata Storage Servers X2-2
All with High Performance 600GB SAS disks
OR
All with High Capacity 2 TB SAS disks
2 Sun Datacenter InfiniBand Switch 36
36-port Managed QDR (40Gb/s) switch
1 Admin Cisco Ethernet switch
Keyboard, Video, Mouse (KVM) hardware
Redundant Power Distributions Units (PDUs)
-
7/22/2019 67612322 Exadata Technical PPT
11/43
Start Small and GrowField Upgradeable
FullRack
HalfRack
Balanced Incremental Scaling for OLTP and DW
QuarterRack
Copyright 2010, Oracle Corporation and/or its affiliates 11
-
7/22/2019 67612322 Exadata Technical PPT
12/43
Scale to 8 Racks by Just Adding CablesFull Bandwidth and Redundancy
Copyright 2010, Oracle Corporation and/or its affiliates 12
-
7/22/2019 67612322 Exadata Technical PPT
13/43
Complete Family Of Database MachinesFor OLTP, Data Warehousing & Consolidated Workloads
Quarter, Half, Full and Multi-Racks Full and Multi-Racks
Oracle Exadata X2-8Oracle Exadata X2-2
Copyright 2010, Oracle Corporation and/or its affiliates 13
-
7/22/2019 67612322 Exadata Technical PPT
14/43
Database Server Operating System Choices
Two Operating System Choices on the database servers
Oracle Linux
Solaris 11 Express (x86) Coming Soon Customers will choose their preferred Database Server
OS at installation time
Exadata Storage Servers will continue to be Oracle Linux
Copyright 2010, Oracle Corporation and/or its affiliates 14
-
7/22/2019 67612322 Exadata Technical PPT
15/43
Copyright 2010, Oracle Corporation and/or its affiliates 15
Exadata Product Capacity (Uncompressed)
X2-8
Full Rack
X2-2
Full Rack
X2-2
Half Rack
X2-2
Quarter Rack
Raw Disk1High Perf Disk 100 TB 100 TB 50 TB 21 TB
High Cap Disk 336 TB 336 TB 168 TB 72 TBRaw Flash1 5.3 TB 5.3 TB 2.6 TB 1.1 TB
Usable Capacity with ASMnormal redundancy2
High Perf Disk 45 TB 45 TB 22.5 TB 9.25 TB
High Cap Disk 150 TB 150TB 75 TB 31.5 TB
Usable Capacity with ASMhigh redundancy3
High Perf Disk 30 TB 30 TB 15 TB 6.25 TB
High Cap Disk 100 TB 100TB 50 TB 21.5 TB
1 - Raw capacity calculated using standard disk drive raw space terminology of 1 GB = 1000 x 1000 x 1000 bytes and1 TB = 1000 x 1000 x 1000 x 1000 bytes.
2 - Actual space available for a database after mirroring (ASM normal redundancy) and leaving one empty disk tohandle disk failures. Capacity calculated using normal space terminology of 1 TB = 1024 * 1024 * 1024 * 1024 bytes.
3 - Actual space available for the database computed after triple mirroring (ASM high redundancy). Capacity
calculated using normal space terminology of 1 TB = 1024 * 1024 * 1024 * 1024 bytes.
-
7/22/2019 67612322 Exadata Technical PPT
16/43
Copyright 2010, Oracle Corporation and/or its affiliates 16
Exadata Product Performance
X2-8
Full Rack
X2-2
Full Rack
X2-2
Half Rack
X2-2
QuarterRack
Raw Disk DataBandwidth1,3
High Perf Disk 25 GB/s 25 GB/s 12.5 GB/s 5.4 GB/s
High Cap Disk 14 GB/s 14 GB/s 7 GB/s 3 GB/s
Raw Flash DataBandwidth1,3
High Perf Disk 75 GB/s 75 GB/s 37.5 GB/s 16 GB/s
High Cap Disk 64 GB/s 64 GB/s 32 GB/s 13.5 GB/s
Disk IOPS2,3High Perf Disk 50,000 50,000 25,000 10,800
High Cap Disk 25,000 25,000 12,500 5,400
Flash IOPS2,3 1,500,000 1,500,000 750,000 375,000
Data Load Rate4 12 TB/hr 12 TB/hr 6 TB/hr 3 TB/hr
1 - Bandwidth is peak physical disk scan bandwidth achieved running SQL, assuming no compression.
2 - IOPs Based on peak IO requests of size 8K running SQL. Note that other products quote IOPs based on 2K, 4Kor smaller IO sizes that are not relevant for databases.
3 - Actual performance will vary by application.
4 - Load rates are typically limited by CPU, not IO. Rates vary based on load method, indexes, data types,
compression, and partitioning
-
7/22/2019 67612322 Exadata Technical PPT
17/43
Exadata Storage Software Unique Features
Exadata Smart Scans 10X or greater reduction in data sent
to database servers
Exadata Storage Indexes Eliminate unnecessary I/Os
Hybrid Columnar Compression Efficient compression increaseseffective storage capacity andincreases user data scan bandwidthsby a factor of up to 10X
Exadata Smart Flash Cache Breaks random I/O bottleneck by
increasing IOPs by up to 20X
Doubles user data scan bandwidths
I/O Resource Manager (IORM) Enables storage grid by prioritizing
I/Os to ensure predictable
performance
Quality of Service (QoS) Actively meet and maintain SLAs
Memory Guard to protect existingcurrent transactions from memory-based failures
Copyright 2010, Oracle Corporation and/or its affiliates 17
-
7/22/2019 67612322 Exadata Technical PPT
18/43
Data Intensive processing runs in Exadata
Storage Grid Filter rows and columns as data streams from
disks (168 Intel Cores)
Example: How much product X sold last quarter Exadata Storage Reads 10TB from disk
Exadata Storage Filters rows by Product & Date
Sends 100GB of matching data to DB Servers
Scale-out storage parallelizes execution andremoves bottlenecks
Exadata Intell igent Storage Grid
Most Scalable Data Processing
Copyright 2010, Oracle Corporation and/or its affiliates 18
-
7/22/2019 67612322 Exadata Technical PPT
19/43
Simple Query Example
Exadata
Storage Grid
SUM
OptimizerChooses
Partit ions andIndexes toAccess
10 TB scanned
1 GB returned to servers
OracleDatabase Grid
What were mysales yesterday?
Select
sum(sales)where
Date=24-Sept
Scan compressedblocks in
partitions/indexes
Retrieve sales
amounts forSept 24
Copyright 2010, Oracle Corporation and/or its affiliates 19
-
7/22/2019 67612322 Exadata Technical PPT
20/43
Exadata Intelligent Storage
Exadata storage servers also run more complexoperations in storage Join filtering
Incremental backup fil tering
I/O prioritization
Storage Indexing
Database level security
Offloaded scans on encrypted data
Data Mining Model Scoring
10x reduction in data sent to DB serversis common
ExadataIntelligent Storage
Grid
Copyright 2010, Oracle Corporation and/or its affiliates 20
-
7/22/2019 67612322 Exadata Technical PPT
21/43
Exadata is Smart Storage
Storage Server is smart storage, not a DB node
Storage remains an independent tier
Database Servers
Perform complex database processing such as
joins, aggregation, etc.
Exadata Storage Servers
Search tables and indexes filtering out data that is
not relevant to a query Cells serve data to multiple databases enabling
OLTP and consolidation
Simplicity, and robustness of storage appliance
Compute and MemoryIntensive Processing
Data IntensiveProcessing
Copyright 2010, Oracle Corporation and/or its affiliates 21
-
7/22/2019 67612322 Exadata Technical PPT
22/43
Copyright 2010, Oracle Corporation and/or its affiliates 22
Exadata Storage IndexTransparent I/O Elimination with No Overhead
Exadata Storage Indexes maintain summaryinformation about table data in memory
Store MIN and MAX values of columns
Typically one index entry for every MB of disk
Eliminates disk I/Os if MIN and MAX can never
match where clause of a query
Completely automatic and transparent
A B C D1
3
5
5
8
3
Min B = 1
Max B =5
Table Index
Min B = 3
Max B =8
Select * from Table where B
-
7/22/2019 67612322 Exadata Technical PPT
23/43
Storage Index with Partitions Example
Queries on Ship_Date do not benefit from Order_Date partitioning
However Ship_date and Order# are highly correlated with Order_Date
e.g. Ship dates are usually near Order_Dates and are never less
Storage index provides partition pruning like performance for queries onShip_Date and Order#
Takes advantage of ordering created by partitioning or sorted loading
Order# Order_Date
Partitioning Column
Ship_Date Item
1 2007 20072 2008 2008
3 2009 2009
Orders Table
Copyright 2010, Oracle Corporation and/or its affiliates 23
-
7/22/2019 67612322 Exadata Technical PPT
24/43
Storage Index with Joins Example
A M C D
1
3
5
5
55
FactDimension
Name M
Accord 1
Camry 3
Civic 5
Prius 8
Bloom filterconstructed with
min/max for M
Skip IO
Due to Storage Index
Perform IO and
apply bloom fil ter
Select count(*) from fact, dim
where fact.m=dim.m and dim.name=Camry
Copyright 2010, Oracle Corporation and/or its affiliates 24
-
7/22/2019 67612322 Exadata Technical PPT
25/43
Exadata Smart Flash Cache
Extreme Performance OLTP & DW
5X More I/Os than1000 Disk Enterprise
Storage Array
Exadata has 5 TB of flash
56 Flash PCI cards avoid diskcontrol ler bottlenecks
Intelligently manages flash
Smart Flash Cache holds hot data
Avoids large scan wipe-outs of cache
Gives speed of flash, cost of disk
Exadata flash cache achieves:
Over1.5 mill ion IO/sec from SQL (8K)
Sub-millisecond response times
Copyright 2010, Oracle Corporation and/or its affiliates 25
-
7/22/2019 67612322 Exadata Technical PPT
26/43
Exadata Hybrid Columnar Compression
Highest Capacity, Lowest Cost
Data is organized and compressed by column Dramatically better compression
Speed Optimized Query Mode for DataWarehousing 10X compression typical
Runs faster because of Exadata offload!
Space OptimizedArchival Mode forinfrequently accessed data 15X to 50X compression typical
Q
uery
Faster and Simpler
Backup, DR, Caching,Reorg, Clone
Benefits Multiply
Copyright 2010, Oracle Corporation and/or its affiliates 26
C C
-
7/22/2019 67612322 Exadata Technical PPT
27/43
Exadata Hybrid Columnar Compression
How it works
Tables are organized into sets of a few thousand rows Compression Units (CUs)
Within CU, data is organized by column, then compressed Column organization brings similar values close together,enhancing compression
Useful for data that is bulk loaded and queried
Update activity is light
Compared to best conventional algorithms Gzip, Bzip2 Typically 2X the compression, 10X the performance
Exadata servers offload filtering, projection, etc. for scanson compressed data
Indexed accesses return compressed blocks to database sobuffer cache benefits from compression
Reduces
Table Size
4x to 40x
4x to 50xReduction
CompressionUnit
Copyright 2010, Oracle Corporation and/or its affiliates 27
-
7/22/2019 67612322 Exadata Technical PPT
28/43
Compression Ratio of Real-World Data
Compression Ratio varies bycustomer and table
Trials were run on largest tableat 10 ultra large companies
Average revenue > $60 BB
Average Query Compressionratio was 13x
On top of Oracles alreadyhighly efficient format
Copyright 2010, Oracle Corporation and/or its affiliates 28
-
7/22/2019 67612322 Exadata Technical PPT
29/43
Exadata I/O Resource ManagementMixed Workloads and Multi-Database Environment
Ensure different databases areallocated the correct relative amount ofI/O bandwidth
Database A: 33% I/O resources Database B: 67% I/O resources
Ensure different users and tasks withina database are allocated the correct
relative amount of I/O bandwidth Database A:
Reporting: 60% of I/O resources
ETL: 40% of I/O resources
Database B: Interactive: 30% of I/O resources
Batch: 70% of I/O resources
Exadata Cell
InfiniBand Switch/Network
Database A Database B
Exadata Cell Exadata Cell
Copyright 2010, Oracle Corporation and/or its affiliates 29
Q lit f S i M t
-
7/22/2019 67612322 Exadata Technical PPT
30/43
Quality of Service ManagementThe Oracle Approach in Action
Policy-DrivenArchitecture
Implement and Control
Define and Enable
Evaluate
and Report
Analyze and
Recommend
Classify and Measure
QoS Policy SetMaintenance Polic y
Weekend Policy
Af ter Hours Pol icy
Business Hours Policy
Server Pool Allocations
Performance Objectives
Server
Pools
Performance
ClassesBusiness Rankings
Copyright 2010, Oracle Corporation and/or its affiliates 30
-
7/22/2019 67612322 Exadata Technical PPT
31/43
Integrated, Task-Based ManagementNew EM Quality of Service Management Tool
Copyright 2010, Oracle Corporation and/or its affiliates 31
-
7/22/2019 67612322 Exadata Technical PPT
32/43
DBFS - Scalable Shared File System
Database Machine comes with DBFS shared Linux file system
Shared storage for ETL staging, scripts, reports and other application files
Files stored as SecureFile LOBs in database tables stored in Exadata Protected like any DB data mirroring, DataGuard, Flashback, etc.
5 to 7 GB/sec file system I/O throughput
ETL Files in DBFS
Load into databaseusing External Tables
ETL
More File Throughput than High-End NAS Filer
Copyright 2010, Oracle Corporation and/or its affiliates 32
-
7/22/2019 67612322 Exadata Technical PPT
33/43
Copyright 2010, Oracle Corporation and/or its affiliates 33
Exadata Storage Management & Administration
Enterprise Manager Manage & administer Database and ASM
Monitor the Exadata Database Machine Hardware
Plug-ins to monitor the Exadata Storage Cells and othercomponents in the Database Machine
Auto Service Request (ASR)
File SRs automatically for common hardware faults Comprehensive CLI
Local Exadata Storage cell management
Distributed shell utility to execute CLI across multiple cells Embedded Integrated Lights Out Manager (ILOM)
Remote management and administration of hardware
-
7/22/2019 67612322 Exadata Technical PPT
34/43
ASR for Exadata
Customer Datacenter
Customer
Oracle FieldEngineer
FRU replaced byField Engineer
Fault occurs
Oracle Support Services
OracleSupportEngineer
FRUdispatched by
SupportEngineer
ServiceRequestrouted toSupport
Engineer
Oracle CaseManagement
System
Service Request(SR) created
ASR Service
Product's auto-diagnosisfacility sends
SNMP trap to ASRManager
SR creationemail noti fication
to customer
Fault telemetrysecurely
transmitted toOracle
ASRManager
Copyright 2010, Oracle Corporation and/or its affiliates 34
-
7/22/2019 67612322 Exadata Technical PPT
35/43
First Secure Database Machine
Moves decryption from software
to hardware Over 5x faster
Near zero overhead for fullyencrypted database
Queries decrypt data at hundredsof Gigabytes/second
Copyright 2010, Oracle Corporation and/or its affiliates 35
-
7/22/2019 67612322 Exadata Technical PPT
36/43
Best Machine for Database Consolidation
Exadata serves as farm/cloud for
databases Large memory enables many
databases to be consolidated
Extreme performance for complexworkloads that mix OLTP, DW, batch,reporting
I/O and CPU resource managementisolates workloads
ERP
CRM
Warehouse
Data Mart
HR
Copyright 2010, Oracle Corporation and/or its affiliates 36
75 GB/sec!
-
7/22/2019 67612322 Exadata Technical PPT
37/43
37
Fastest Disk Throughput
Much Faster with Flash
50 TB of data fits in Flash Using 10x Query Compression
Effective Query Throughput on
compressed data is even higher Hundreds of GB/sec
2010 Oracle Corporation
10
20
25
TeradataNetezzaTwinFin 12
Exadata
Query ThroughputGB/sec Uncompressed Data
Single Rack
Flash
Disk
Faster than DW Appliances75 GB/sec!
F
lash
2650 4600
< 38
DiskDisk
-
7/22/2019 67612322 Exadata Technical PPT
38/43
2.5
9
< 6
11???
25
IBM
XIV
NetApp
6080
IBM
DS8700
Hitachi
USP V
EMC
VMAX
Exadata
V2
Exadata is fastest
and scales with more racks
Storage Arrays already cantdeliver disk bandwidth
No extra bandwidth from Flash
No CPU offload
No Columnar Compression
No InfiniBand
Storage Data Bandwidth(Uncompressed GB/sec)
Flash
Faster than High End Arrays
Dis
k
Exadata
V2
75 GB/sec!
1 RackMultiple Racks
Copyright 2010, Oracle Corporation and/or its affiliates 38
-
7/22/2019 67612322 Exadata Technical PPT
39/43
More Data Capacity
2010 Oracle Corporation 39
Exadata10x Compression
Teradata 26501.4x Compression
(block compression is archival)
Netezza TwinFin2x to 4x Compression
EMC VMAX3x Oracle Compression
Equivalent Capacity Systems
All with Largest Disks,Best Compression
4X
3X
7X
41X for 4600flash appliance
Exadata is Faster and 6X Lower Cost than
-
7/22/2019 67612322 Exadata Technical PPT
40/43
Exadata is Faster and 6X Lower Cost than
IBMs Best - Power 795
IBM P795 + 4 DS8700s with Flash
$18,860,000
2 Exadata X2-8
$3,000,000
Comparison of Hardware Prices
More CPU Cores
More I/O Performance
Same Storage Capacity Excluding Exadata compression!
HA Configuration
Copyright 2010, Oracle Corporation and/or its affiliates 40
E d t D t b M hi
-
7/22/2019 67612322 Exadata Technical PPT
41/43
Exadata Database MachineIdeal Database Platform
Best for Data Warehousing
Best for OLTP Best for Database Consolidation
Hybrid ColumnarCompression
IntelligentStorage Grid
Fastest, Lowest Cost
Smart FlashCache
Business answers in seconds, not hours
Hardware
Decryption
Copyright 2010, Oracle Corporation and/or its affiliates 41
-
7/22/2019 67612322 Exadata Technical PPT
42/43
Copyright 2010, Oracle Corporation and/or its affiliates 42
Resources
Oracle.com:http://www.oracle.com/exadata
Oracle Exadata Technology Portal on OTN:http://www.oracle.com/technology/products/bi/db/exadata
Oracle Exadata white papers:http://www.oracle.com/technetwork/middleware/bi-foundation/exadata-smart-flash-cache-twp-v5-1-128560.pdf
http://www.oracle.com/technetwork/database/features/availability/xmigration-11-133466.pdf
-
7/22/2019 67612322 Exadata Technical PPT
43/43