Computer Networks Simplified - Sushil Chandramani (NANDU Publications)
RAMCloud: System Performance Measurements (Jun ‘11) Nandu Jayakumar ([email protected])
-
Upload
phoebe-waters -
Category
Documents
-
view
224 -
download
0
Transcript of RAMCloud: System Performance Measurements (Jun ‘11) Nandu Jayakumar ([email protected])
![Page 2: RAMCloud: System Performance Measurements (Jun ‘11) Nandu Jayakumar (nandu@cs.stanford.edu)](https://reader036.fdocuments.in/reader036/viewer/2022082405/56649e9f5503460f94ba20cc/html5/thumbnails/2.jpg)
Goals
• Evaluate the performance and scalability of RAMCloud as a data-store.
• What are we measuring ?– Round-trip latency per operation– Overall system throughput– Performance under load
![Page 3: RAMCloud: System Performance Measurements (Jun ‘11) Nandu Jayakumar (nandu@cs.stanford.edu)](https://reader036.fdocuments.in/reader036/viewer/2022082405/56649e9f5503460f94ba20cc/html5/thumbnails/3.jpg)
RAMCloud Cluster
Master
Backup
Master
Backup
Master
Backup
Master
Backup…
Appl.
Library
Appl.
Library
Appl.
Library
Appl.
Library…
DatacenterNetwork Coordinator
1000 – 10,000 Storage Servers
1000 – 100,000 Application Servers
![Page 4: RAMCloud: System Performance Measurements (Jun ‘11) Nandu Jayakumar (nandu@cs.stanford.edu)](https://reader036.fdocuments.in/reader036/viewer/2022082405/56649e9f5503460f94ba20cc/html5/thumbnails/4.jpg)
Test Setup
• Cluster– 40 nodes, Mellanox NICs/switch– Single master/coordinator node– When used, 3 backups running on nodes different
from master.– Multiple clients
![Page 5: RAMCloud: System Performance Measurements (Jun ‘11) Nandu Jayakumar (nandu@cs.stanford.edu)](https://reader036.fdocuments.in/reader036/viewer/2022082405/56649e9f5503460f94ba20cc/html5/thumbnails/5.jpg)
Latency
• End-to-end round trip latency in microseconds at client.• Single client/single master.• Read operation on single object/single table – 100 Bytes• All transports are over 32 Gbps Infiniband network.
![Page 6: RAMCloud: System Performance Measurements (Jun ‘11) Nandu Jayakumar (nandu@cs.stanford.edu)](https://reader036.fdocuments.in/reader036/viewer/2022082405/56649e9f5503460f94ba20cc/html5/thumbnails/6.jpg)
Latency versus Object Size/Transport
![Page 7: RAMCloud: System Performance Measurements (Jun ‘11) Nandu Jayakumar (nandu@cs.stanford.edu)](https://reader036.fdocuments.in/reader036/viewer/2022082405/56649e9f5503460f94ba20cc/html5/thumbnails/7.jpg)
Latency – Under Load – InfRc
![Page 8: RAMCloud: System Performance Measurements (Jun ‘11) Nandu Jayakumar (nandu@cs.stanford.edu)](https://reader036.fdocuments.in/reader036/viewer/2022082405/56649e9f5503460f94ba20cc/html5/thumbnails/8.jpg)
Write Latency – Zoomed in
![Page 9: RAMCloud: System Performance Measurements (Jun ‘11) Nandu Jayakumar (nandu@cs.stanford.edu)](https://reader036.fdocuments.in/reader036/viewer/2022082405/56649e9f5503460f94ba20cc/html5/thumbnails/9.jpg)
Throughput – Under Load – InfRC
![Page 10: RAMCloud: System Performance Measurements (Jun ‘11) Nandu Jayakumar (nandu@cs.stanford.edu)](https://reader036.fdocuments.in/reader036/viewer/2022082405/56649e9f5503460f94ba20cc/html5/thumbnails/10.jpg)
Future Work
• Multiple masters – measure scalability• Compare against other key-value stores –
Open-source Yahoo! Cloud Serving Benchmark– More interesting workloads– elasticity
![Page 11: RAMCloud: System Performance Measurements (Jun ‘11) Nandu Jayakumar (nandu@cs.stanford.edu)](https://reader036.fdocuments.in/reader036/viewer/2022082405/56649e9f5503460f94ba20cc/html5/thumbnails/11.jpg)
Summary
• At a small scale– 5us RTT RPCs goal possible– 1 million reads/sec per server goal possible
• Goals ambitious enough ?• How will this scale to datacenters ?
![Page 12: RAMCloud: System Performance Measurements (Jun ‘11) Nandu Jayakumar (nandu@cs.stanford.edu)](https://reader036.fdocuments.in/reader036/viewer/2022082405/56649e9f5503460f94ba20cc/html5/thumbnails/12.jpg)
More detail
• http://fiz.stanford.edu:8081/display/ramcloud/RPC+Measurements+May+2011
• http://fiz.stanford.edu:8081/display/ramcloud/Inf+Under+Load
• http://fiz.stanford.edu:8081/display/ramcloud/Workload+Generator
• RAMCLOUD_SOURCE/src/Bench.cc• RAMCLOUD_SOURCE/scripts/*pl