Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer...
-
Upload
benjamin-sheridan -
Category
Documents
-
view
213 -
download
0
Transcript of Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer...
![Page 1: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/1.jpg)
Shouldn’t High-Performance Shouldn’t High-Performance Networks Be As Easy To Use As the Networks Be As Easy To Use As the
Web?Web?
Basil IrwinBasil Irwin
Senior Network EngineerSenior Network Engineer
NETSNETS
July 13, 1999July 13, 1999
National Center for Atmospheric ResearchNational Center for Atmospheric Research
![Page 2: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/2.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 22NCARNCAR
Yes!Yes!
![Page 3: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/3.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 33NCARNCAR
How High-PerformanceHow High-PerformanceNetworks Work NowNetworks Work Now
![Page 4: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/4.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 44NCARNCAR
What Happens TodayWhat Happens Today
•Fire up FTP on a >100-Mbps national network between two supercomputers or other high-performance hosts and you get 10-Mbps if you’re lucky
•How many have seen such behavior?
•And then what?*Do you have tools that tell you where the problem is?
*Or is it all just a big mystery as to why it doesn’t go fast?
![Page 5: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/5.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 55NCARNCAR
And What About the Web?And What About the Web?
![Page 6: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/6.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 66NCARNCAR
It Just Works!It Just Works!
![Page 7: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/7.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 77NCARNCAR
Where Are The Problems?Where Are The Problems?
![Page 8: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/8.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 88NCARNCAR
It’s Not The NetworkIt’s Not The Network
•Networks aren’t usually the problem* vBNS and Abilene are very high-performance
networks at the national level
*Universities are now frequently connected at least at T3 (45-Mbps) or higher
*Campus LANs and host connections for researchers are often capable of 100-Mbps
•Problems are usually in the host-software
![Page 9: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/9.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 99NCARNCAR
So What’s Wrong WithSo What’s Wrong WithThe Host-Software?The Host-Software?
![Page 10: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/10.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 1010NCARNCAR
Lot’s Of Things Are WrongLot’s Of Things Are Wrong
•One of the biggest affects national-scale high-performance networks the worst * This is the so-called “bandwidth-delay-product”
issue
*Right now it takes network-engineer training to understand and deal with this issue
*A big part of many high-performance seminars for end-users is dealing with this issue
*Akin to having to be an auto mechanic to drive a car
![Page 11: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/11.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 1111NCARNCAR
The Problems (cont.)The Problems (cont.)
•Poor and inconsistent TCP implementations among operating system vendors
•Obscure programmatic interfaces (APIs) such as sockets that are difficult to use and lead to error/bad-performance prone user-codes
•And even worse, ALL problems have to be fixed to automatically obtain high-performance
![Page 12: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/12.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 1212NCARNCAR
Usability ProblemsUsability Problems
![Page 13: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/13.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 1313NCARNCAR
•Rotten FTP programs* Bad and inconsistent user-interfaces
•Lack of simple APIs optimized for common user needs
•No ubiquitous turnkey GUI-based diagnostic or performance monitoring tools* Still basically just have just “ping” and
“traceroute”, which have been around since the dawn of network computing
Usability ProblemsUsability Problems
![Page 14: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/14.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 1414NCARNCAR
Why Hasn’t The MarketWhy Hasn’t The MarketWorked?Worked?
•E-commerce development soaking up venture capital
•Vendors are focused on making money now, and often don’t take the long-term view
•Mass-market is often the major driver of high-technology and not vice-versa
•Solutions require uniformity to work well, and vendors tend to compete and not cooperate when strong standards don’t exist
![Page 15: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/15.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 1515NCARNCAR
How Do We FixHow Do We FixThese Problems?These Problems?
![Page 16: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/16.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 1616NCARNCAR
A Comprehensive SolutionA Comprehensive Solution
•Need an approach that fixes ALL host-software problems* Simply fixing this problem or that in isolation won’t
yield high-performance results
•Network researchers need to agree on what a comprehensive host-software solution is
•Operating system and other host-software vendors need to be induced to consistently install this comprehensive solution
![Page 17: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/17.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 1717NCARNCAR
A Comprehensive Solution A Comprehensive Solution (cont.)(cont.)
•Need a common vision that researchers, policy makers, and vendors can all relate to
•Need to demonstrate success with applications that everyone can relate to
![Page 18: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/18.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 1818NCARNCAR
How Can We Do This?How Can We Do This?
![Page 19: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/19.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 1919NCARNCAR
A ProposalA Proposal
•Frame a comprehensive approach in terms of a Web that runs 100 faster than it does today
•Develop solutions into a complete, turnkey high performance network-enabled system that includes an operating system, a Web Server, a Web Browser, and common application/plug-ins such as FTP and give the system away!
•The National Science Foundation leads this effort
![Page 20: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/20.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 2020NCARNCAR
A Proposal (cont.)A Proposal (cont.)
•This approach:*Offers a common vision for success
* Provides a demonstration of success
* Is designed to induce vendors to adopt the improvements
![Page 21: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/21.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 2121NCARNCAR
Why A 100xWeb?Why A 100xWeb?
•A supercharged Web is something that everyone can understand and rally around*Goal for policy-makers
*Goal for users
*Goal for developers
•Fixing the problems inhibiting Web performance fixes them for other high-performance applications
•Web itself is one of the most important networking tools used by researchers today
![Page 22: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/22.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 2222NCARNCAR
Why Free Software?Why Free Software?
•Shows the value of high-performance networking-enabled system
•Hopefully, provides an inducement for commercial vendors to adopt the solutions*Replicates the ARPA model with BSD Unix and
TCP/IP sockets
* Propagated distribution of TCP/IP via BSD Unix, enabling the success of TCP/IP, and thereby inducing adoption by commercial vendors wishing to remain in business
![Page 23: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/23.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 2323NCARNCAR
Why the NSF?Why the NSF?
•History of involvement of government in critical networking technologies*DARPA and TCP/IP development
*WWW protocols invented at CERN
•History of NSF involvement in critical networking developments*NSFnet
*MOSAIC at NCSA
•Directly related to the goals of the NSF as an NGI partner
![Page 24: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/24.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 2424NCARNCAR
Why the NSF? (cont.)Why the NSF? (cont.)
•NSF may be the only organization in a position to meld the numerous and diverse pieces to solve the host-software problems
![Page 25: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/25.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 2525NCARNCAR
Example Development PlatformExample Development Platform
![Page 26: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/26.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 2626NCARNCAR
Example Development PlatformExample Development Platform
•Development platform needs:*An operating system
*A hardware platform
*A Web Server
*A Web Browser
•Development component choices require* Source code freely available
* Source code freely distributable
* Source code already widely used and supported
* Source code suitable for performing desired functions
![Page 27: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/27.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 2727NCARNCAR
Example Development PlatformExample Development Platform(cont.)(cont.)
•Components that appear to meet the four criteria:* Linux OS
* Intel hardware platform
*Netscape Web Browser
*Apache Web Server
![Page 28: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/28.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 2828NCARNCAR
ConclusionConclusion
![Page 29: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/29.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 2929NCARNCAR
ConclusionConclusion
•We will continue to remain at the dawn of the high-performance networking era until these problems are solved
•Therefore a comprehensive effort should be made to solve the bulk of the host-software problems and provide a demonstration vehicle
•This won’t be easy and success isn’t guaranteed, but it’s vital that a bold attempt be made at a comprehensive solution
![Page 30: Shouldnt High-Performance Networks Be As Easy To Use As the Web? Basil Irwin Senior Network Engineer NETS July 13, 1999 National Center for Atmospheric.](https://reader036.fdocuments.in/reader036/viewer/2022070305/5514a6a1550346f06e8b5ce5/html5/thumbnails/30.jpg)
National Center for Atmospheric ResearchNational Center for Atmospheric Research 3030NCARNCAR
THE ENDTHE END