Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director...
-
Upload
jayson-williams -
Category
Documents
-
view
218 -
download
5
Transcript of Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director...
![Page 1: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/1.jpg)
Logistical Networking as an Advanced Engineering Testbed
Micah Beck, Assoc. Prof. & DirectorLogistical Computing & Internetworking (LoCI) Lab
Internet2 Spring Member Meeting April 10, 2003
![Page 2: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/2.jpg)
Panel Participants
• Gabriella Paolini, GARR (by phone)Topic: IPv6
• Geoff Hayward, Yotta YottaTopic: Wide Area Storage Networking
• Jim Ferguson, NCSATopic: Web 100 / TCP Tuning
![Page 3: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/3.jpg)
Funding• Dept. of Energy
SciDAC
• National Science Foundation ANIR
• UT Center for Info Technology Research
Logistical Networking Research at UTK
University of Tennessee
• Micah Beck• James S. Plank• Jack Dongarra
University of California, Santa Barbara
• Rich Wolski
![Page 4: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/4.jpg)
What is Logistical Networking
• A scalable mechanism for deploying shared storage resources throughout the network
• A general store-and-forward overlay networking infrastructure
• A way to break transfers into segments and employ heterogeneous network technologies on the pieces
![Page 5: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/5.jpg)
Why “Logistical Networking”
• Analogy to logistics in distribution of industrial and military personnel & materiel
• Fast highways alone are not enough Goods are also stored in warehouses for
transfer or local distribution
• Fast networks alone are not enough Data must be stored in buffers/files for
transfer or local distribution
![Page 6: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/6.jpg)
The Network Storage Stack
Applications
Logistical File System
Logistical Tools
L-Bone
IBP
Local Access
Physical
exNode
• Our adaption of the network stack architecture for storage• Like the IP Stack• Each level encapsulates details from the lower levels, while still exposing details to higher levels
![Page 7: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/7.jpg)
IBP: The Internet Backplane Protocol
• Storage provisioned on community “depots”• Very primitive service (similar to block service, but
more sharable)• Goal is to be a common platform (exposed)• Also part of end-to-end design
• Best effort service – no heroic measures• Availability, reliability, security, performance
• Allocations are time-limited!• Leases are respected, can be renewed• Permanent storage is to strong to share!
![Page 8: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/8.jpg)
Models of Sharing: Logistical Networking
Moderately valuable resources
• Storage, server cycles
Sharing enabled by relative plenty
Internet-like policies• Loose access control
• No per-use accounting
Primary design goal: scalability
• Application autonomy
• Resource transparency
Burdens of scalability• The End-to-End Principles
• Weak operation semantics
• Vulnerability to Denial of Service
![Page 9: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/9.jpg)
Data Movers
• Module implementing standard point-to-multipoint transfer between IBP allocations
• Uniform API allows independence from the underlying data transfer protocol
• Not every DM can apply to every transfer• Caller responsible for determining validity
• Current options: Multi-TCP, Multi-UDP (reliable), UDP Multicast (unreliable)
![Page 10: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/10.jpg)
The Network Storage Stack
The L-bone:Resource Discovery& Proximity queries
IBP: Allocating and managing networkstorage (like a network malloc)
The exNode:A data structurefor aggregation
LoRS: The Logistical Runtime System:Aggregation tools and methodologies
![Page 11: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/11.jpg)
The Logistical Backbone (L-Bone)
• LDAP-based storage resource discovery.
• Query by capacity, network proximity, geographical proximity, stability, etc.
• Periodic monitoring of depots.
• 10 Terabytes of shared storage. (with plans to scale to a petabyte...)
![Page 12: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/12.jpg)
L-Bone: January 2003
Current Storage Capacity: 10 TB
![Page 13: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/13.jpg)
The Network Storage Stack
The L-bone:Resource Discovery& Proximity queries
IBP: Allocating and managing networkstorage (like a network malloc)
The exNode:A data structurefor aggregation
LoRS: The Logistical Runtime System:Aggregation tools and methodologies
![Page 14: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/14.jpg)
The exNode
• The Network “File Descriptor
• XML-based data structure/serialization
• Map byte-extents to IBP buffers (or other allocations).
• Allows for replication, flexible decomposition of data.
• Also allows for error-correction/checksums
• Arbitrary metadata.
![Page 15: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/15.jpg)
ExNode vs inode
exNode
inode
IBP Allocations
the network
local system
disk blocks
kernel
capabilities
block addresses
user
![Page 16: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/16.jpg)
The Network Storage Stack
The L-bone:Resource Discovery& Proximity queries
IBP: Allocating and managing networkstorage (like a network malloc)
The exNode:A data structurefor aggregation
LoRS: The Logistical Runtime System:Aggregation tools and methodologies
![Page 17: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/17.jpg)
Logistical Runtime System
Basic Primitives:• Upload, Download, Augment, Refresh
End-to-end Services• Checksums, Encryption, Compression
![Page 18: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/18.jpg)
Download Movie
![Page 19: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/19.jpg)
Multithreaded Transfers
![Page 20: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/20.jpg)
Routed/Multipath
![Page 21: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/21.jpg)
Point-to-Multipoint
![Page 22: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/22.jpg)
Heterogeneous Multicast
![Page 23: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/23.jpg)
Caching/Staging
![Page 24: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/24.jpg)
Further Advanced Capabilities
• IBP over IPv6• Dual stack depot
• Specialized DataMovers• UDP (SABUL, Tsunami)• Fiber Channel over IP
• Non-standard TCP Stacks• Web 100• Future: FAST?
![Page 25: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/25.jpg)
Panel Participants
• Gabriella Paolini, GARR (by phone)Topic: IPv6
• Geoff Hayward, Yotta YottaTopic: Wide Area Storage Networking
• Jim Ferguson, NCSATopic: Web 100 / TCP Tuning
![Page 26: Logistical Networking as an Advanced Engineering Testbed Micah Beck, Assoc. Prof. & Director Logistical Computing & Internetworking (LoCI) Lab mbeck@cs.utk.edu.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649f015503460f94c16d17/html5/thumbnails/26.jpg)
Conclusions
• IBP is a global testbed for advanced network engineering
• Transfer rates routinely exceed 100Mbps
• New Data Movers under development can reach current applications
• Dedicated depots can support global testbed for kernel modificaitons