System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN...
-
Upload
cameron-keay -
Category
Documents
-
view
217 -
download
0
Transcript of System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN...
![Page 1: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/1.jpg)
System Area Network
Abhiram Shandilya12/06/01
![Page 2: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/2.jpg)
Overview
Introduction to System Area Networks SAN Design and Examples SAN Applications
![Page 3: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/3.jpg)
Introduction
What is a SAN? Overview of Cluster Computing
Advent of Clusters Advantages of Clusters Communication in Clusters
SAN design goals
![Page 4: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/4.jpg)
What is a SAN?
Primarily designed for communication between nodes in a cluster.
Other SANs: Storage, Server and Small
A Cluster
![Page 5: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/5.jpg)
Cluster Computing: Advent of….
Early parallel computers: MPPs Custom-built Expensive
Intel Paragon, CM-1, nCube etc Changes in technology:
Faster processors Faster networking technologies Cheaper Commodity off-the-shelf (COTS) hardware
A cheaper option: clusters
![Page 6: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/6.jpg)
Cluster Computing: Advantages
Better price/performance ratios Better availability
Survive node failures with appropriate software support Impressive scaling
100s to 1000s of processors Easy and economical upgrading and technology
migration.
![Page 7: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/7.jpg)
Cluster Computing: Communication
Parallel computation is communication intensive Dominant contributors for message latency
Large messages: Bandwidth Small messages: Software Overhead
Cluster communication: small messages Software overhead on traditional networks due to:
Multiple data copies through protocol layers OS interrupts and context switching.
![Page 8: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/8.jpg)
Software overhead due to multiple copies
![Page 9: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/9.jpg)
SAN Design Goals
Minimize latency Avoid operating system by providing user application
direct access to the network interface Avoid multiple copies of data
High Bandwidth
![Page 10: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/10.jpg)
SAN Design and Examples
Key Issues General Architecture Example 1: Virtual Interface Architecture (VIA) Example 2: Memory Channel
![Page 11: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/11.jpg)
Key Issues
Design of direct user access to network interface Multiplexing between processes for access to
network interface Providing security: avoiding inter-process
interference Managing limited communication resources Efficient programming interface
![Page 12: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/12.jpg)
General Architecture
Communication model Virtual Interface Architecture (VIA) User-Level Network Interface (U-Net) Virtual Memory Mapped Communication (VMMC)
Network Interconnect (NI) Memory Channel 1 & 2 (DIGITAL) ServerNet-II (Compaq)
![Page 13: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/13.jpg)
Virtual Interface Architecture (VIA):An Overview
Promoted by Compaq, Intel and Microsoft Defines an industry-standard architecture for
communication within clusters Increase scalability
Allows a single parallel application to run efficiently over dozens of clustered nodes
Speeds up exchange of data between distributed application modules running on different servers
![Page 14: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/14.jpg)
VIA: Goals Protected communication Latencies like memory operation
Eliminate intermediate data copies Avoid traps into the OS Eliminate driver running in protected kernel mode Minimize number of instructions for send/receive Remove the reliance on interrupts for communication Keep architecture simple to allow software and hardware
implementations Three types of services provided:
Unreliable datagram service Reliable delivery service Reliable reception service
![Page 15: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/15.jpg)
A Virtual Interface (VI) Creates illusion that a process has its own network
interface.UserProcess
Send
Que
ue
Rec
eive
Que
ue
CN
TL
VI
Network Interface
UserProcess
Send
Que
ue
Rec
eive
Que
ue
CN
TL
VIKernelAgent
Controland interrupts
Per VI controland synchronization
![Page 16: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/16.jpg)
VIA: Architecture
Virtual Interface Represents a connection Linked list of descriptors
Send, remote-DMA/write and remote-DMA/read on send queue Receive on receive queue
Maintains data ordering for a connection using VI Asynchronous I/O between different VIs
Kernel agent Unless required by user, not involved in communication Initializes tables and structures for communication Provides memory protection Pins physical memory for each connection.
Necessary to avoid delay on receiver’s side due to address translation
![Page 17: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/17.jpg)
Memory Channel 1: An Overview
Developed at DIGITAL as a dedicated network interconnect
Designed to improve communication performance in a cluster of at most 8 nodes Can support clusters as large as 8 nodes by 12 processors
Implements Virtual Shared Memory Supports any computer using industry-standard
peripheral-component interconnect (PCI) bus
![Page 18: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/18.jpg)
Memory Channel 1: Goals
Minimize cluster communication latencies Maintain the ability to repair hardware while cluster is
running Strict message ordering Support full detection and recovery from communication
errors Connect to PCI bus for compatibility with all PCI-based
Alphas and Intel computers. Support broadcast, multicast and point-to-point
communication
![Page 19: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/19.jpg)
Memory Channel 1: Architecture (1)Address Space Mapping
Memory-mapped circuit Connection between
virtual-address space on sending node and a page of physical memory on receiver’s node.
Write-only connection
![Page 20: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/20.jpg)
Memory Channel 1: Architecture (2)Hardware Implementation
MCNetwork
I/O Bridge
Transmitpath
ReceivePath
Processor
Memory I/ODevice
I/O Bridge
Transmitpath
ReceivePath
Processor
Memory I/ODevice
PCIBus
SystemBus
SystemBus
PCIBus
Node 2
Node 1
MC Adaptor
MC Adaptor
![Page 21: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/21.jpg)
SAN Applications
File Server Clusters Database Server Clusters Storage Area Networks (SAN) Web Servers Clusters Scientific Applications
Beowulf clusters
![Page 22: System Area Network Abhiram Shandilya 12/06/01. Overview Introduction to System Area Networks SAN Design and Examples SAN Applications.](https://reader035.fdocuments.in/reader035/viewer/2022062511/551c5ae45503469d6a8b50d3/html5/thumbnails/22.jpg)
Conclusions
Introduction to SAN SAN Design and examples
VIA Memory Channel 1
SAN Applications