VoltaireVoltaireHigh Performance InfiniBand SolutionsHigh Performance InfiniBand Solutions
Enabling Enabling High PerformanceHigh PerformanceGrid ComputingGrid Computing
Yaron HavivYaron HavivCTOCTO
2© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
Building complete server grid solutions Building complete server grid solutions
Consolidating Network, Storage and Servers• Server, Fabric and Storage virtualization • Business continuity, fail-over and recovery on all levels • Management software abstraction, automation
FC Storage (SAN)
servers & Server Blades
Network
Administration��������������������������
����������������������� �����������������������
��������������
��
� !
IP Storage (SAN & NAS)
Remote Backup
3© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
Database Grids on Wall Street TodayDatabase Grids on Wall Street Today
Before:• Used a mainframe to run a
trading floor application• Monthly cost of $1M• Performance: 1.5M stock
transactions per hour
• Mainframe services were replaced with a 5 node InfiniBand Linux cluster
• Costs reduced to a fraction• Exceeded Mainframe Performance
Cost Saving of $Millions Per Year!!Cost Saving of $Millions Per Year!!
After:
4© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
What Does It Take to Build a Computing Grid?What Does It Take to Build a Computing Grid?
Physical Distribution• High Bandwidth for
Growing Data Requirements
• Low Latency, RDMA for Linear Scalability
Logical Consolidation• Virtualization• Built-in RAS Capabilities
High Performance Interconnect
IntelligentInterconnect
5© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
InfiniBand: HighInfiniBand: High--Speed Grid Interconnect Speed Grid Interconnect
• Standards Interconnect technology optimized for Server Grids
• Highest Bandwidth: 10Gbps links today• 30Gbps by year end, 60 Gb/s next year
• Low Message Latency: less than 6us • Support messaging and memory (RDMA) operations • Commodity Pricing• Optional GbE and FC shared I/O routers • Built in HA, QoS, Partitioning, etc’
The Best Clustering Technology Available TodayThe Best Clustering Technology Available Today
6© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
RDMA Enabling highRDMA Enabling high--end clusters end clusters
CPU
CPU
CPU
CPU
CPU
CPU
Memory
CPUCPU
CPU
Memory
HCACPU
CPU
Memory
HCACPU
CPU
Memory
HCACPU
CPU
Memory
HCACPU
InfiniBand Switch
Switch
Expensive SMP Serverwith Proprietary Interconnect InfiniBand Cluster
based on 2-way Servers
RDMA Operations allow fast access of
CPUs to remote memory
Similar shared memory model at much lower costs!Similar shared memory model at much lower costs!
I/O
I/O
7© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
VirtualizingVirtualizing Grids using Intelligent connectivity Grids using Intelligent connectivity
IP RouterServer & Network Resource Virtualization
Storage RouterStorage Virtualization & Partitioning
Virtual ConsolidationVirtual Consolidation
Fabric ManagementFabric Resource Provisioning
8© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
Fabric VirtualizationFabric Virtualization
Isolate congestion domains• one Virtual Fabric doesn’t impact the performance of another
Partitioning • Which node is a member in which virtual fabric/domain
Resource Allocation Policy, Prioritization • How to distribute and prioritize the real fabric resources
Fault detection and recovery • Automatically migrate to alternate paths, recover from failures
Integrated performance, health, and inventory monitoring
Emulation of Multiple Logically Independent
fabrics on a single fat pipe
9© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
Storage Virtualization Storage Virtualization
1. Generate Logical Volume from physical drives2. Use snapshots for backups and data migration 3. Use masking to control who see what 4. Enable high-availability using Mirroring, backup,
and Multi-Pathing
Physical Volumes
GroupsLogical Volumes
Snapshots
Mask
10© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
One Host card/driver, Many Storage optionsOne Host card/driver, Many Storage options
High-performance Low-cost Native
InfiniBand Storage
Fibre Channel SAN
IP SAN
FCGbE
IB HCA
iSCSI RDMA
Server
SCSIEmulate Virtual Local storage for hosts
Determine the right media option using software, on
the fly
11© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
Router/Gateway Virtualization Router/Gateway Virtualization
What it takes to Virtualize routers as one logical entity • Elect Master and Standby • Synchronize policy, configuration, and state using group
communication • Dynamically distribute traffic across routers • Automatically fail-over when needed
Enable simpler deployment, administration, and automatic fault recovery
Use multiple gateways and routers to aggregate performance
and provide high-availability
12© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
Managing GridsManaging Grids
Grid management interfaces• Provide status of physical resources• Provide consolidated status of logical entities• Enable to dictate group policies • Enable to dynamically assign/migrate physical
resources to logical groups/entities• Enable cloning and backup
Service/Application level management and policy enforcement can be conducted by an external management platforms or applications
13© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
Building Computing Grids with Voltaire’s InfiniBand SolutionsBuilding Computing Grids with Voltaire’s InfiniBand Solutions
HCA Adapters
Complete SW Stack
Low-Port Count Switch Router
High-Port Count Switch Router
InfiniBand to IP Router Blade
InfiniBand to FC Router Blade
Grid Management
14© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
Summary Summary
Grids provide Efficiency For High-Performance Grids InfiniBand fabric is most suitableSolutions should include • Server, Fabric and Storage virtualization • Redundancy and fail-over• Management abstraction and automation
Solutions should provide high-level of integration to be successful
BackupBackup
16© 2003 Voltaire, Inc. For discussion purposesNovember 26, 2003
Voltaire: Fast FactsVoltaire: Fast Facts
Locations• Business HQ: Boston• R&D: Herzeliya Israel
Headcount : 60Financing• Strategic Investors: Hitachi and Quantum• Well financed
Recent Partnerships• Oracle• IBM• Hitachi• HP
Top Related