Post on 17-Dec-2014
description
University of St Andrews
School of Computer Science
1
or can we charge for Energy?
Profiling Powerat Cloud scale
@jws7
James SmithAli Khajeh-HosseiniJonathan WardIan Sommerville
University of St Andrews
School of Computer Science
2
or can we charge for Energy?
Profiling Power
CloudMonitorat Cloud scale
@jws7
James SmithAli Khajeh-HosseiniJonathan WardIan Sommerville
University of St Andrews
School of Computer Science
3
Operational costs exceeding purchase costs
University of St Andrews
School of Computer Science
4
Even over a relatively short lifespan (3-5 years). Mainly driven by energy costs
Operational costs exceeding purchase costs
University of St Andrews
School of Computer Science
5
Even over a relatively short lifespan (3-5 years). Mainly driven by energy costs
Operational costs exceeding purchase costs
We need realistic Energy estimations
University of St Andrews
School of Computer Science
6
Even over a relatively short lifespan (3-5 years). Mainly driven by energy costs
Operational costs exceeding purchase costs
We need realistic Energy estimationsnot just included in “infrastructure”
University of St Andrews
School of Computer Science
Monitoring
7
“then you cannot improve it...”
If you cannot measure something
- Lord Kelvin
University of St Andrews
School of Computer Science
Monitoring
8
“then you cannot improve it...”
If you cannot measure something
- Lord Kelvin
13.4% of organisations monitor their energy consumption!
University of St Andrews
School of Computer Science
Datacentres
9
University of St Andrews
School of Computer Science
Datacentres
10
University of St Andrews
School of Computer Science
Datacentres
11
University of St Andrews
School of Computer Science
Datacentres
12
especially when you need additional hardware!
Monitoring at Scale is hard
University of St Andrews
School of Computer Science
CloudMonitor
13
University of St Andrews
School of Computer Science
CloudMonitor
14
Use SIGAR library to gather resource usage
University of St Andrews
School of Computer Science
CloudMonitor
15
Use SIGAR library to gather resource usage
Correlate with Power Meter
readings
University of St Andrews
School of Computer Science
CloudMonitor
16
Use SIGAR library to gather resource usage
Correlate with Power Meter
readings
Generate Power Model
University of St Andrews
School of Computer Science
17
So what?
University of St Andrews
School of Computer Science
18
Generate power model on one machine. Roll out to 1,000
So what?
University of St Andrews
School of Computer Science
19
Generate power model on one machine. Roll out to 1,000
So what?
of the same configuration
University of St Andrews
School of Computer Science
Previous work
• by Bohra, Ata & Chaundary - VMeter
• linear power model is workload-specific
• our work is workload-independent
• calculate once - valid for all machines of the same configuration
20*Husain Bohra, Ata E, and Vipin Chaudhary. “VMeter: power modelling for virtualized clouds.” 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW) (April 2010): 1-8.
University of St Andrews
School of Computer Science
21
University of St Andrews
School of Computer Science
22
University of St Andrews
School of Computer Science
23
Not perfect
University of St Andrews
School of Computer Science
24
Not perfect
but pretty close...
University of St Andrews
School of Computer Science
25
Experiments show 96% accuracy of Software Predictions against PDU Measurements
The lesson?
University of St Andrews
School of Computer Science
An Energy Tariff for Cloud
26
University of St Andrews
School of Computer Science
An Energy Tariff for Cloud
27
Energy rates are rising at 15% pa
University of St Andrews
School of Computer Science
An Energy Tariff for Cloud
28
36 month cost of test system:
Energy rates are rising at 15% pa
University of St Andrews
School of Computer Science
An Energy Tariff for Cloud
29
$2,76736 month cost of test system:
Energy rates are rising at 15% pa
University of St Andrews
School of Computer Science
Shop for Cloud
30
University of St Andrews
School of Computer Science
Amazon AWS EU Cloud
31
Category Cost
Data Transfer $58,084
VM hours $40,568
Storage $2,325
Storage I/O $2,293
Total $103, 270
University of St Andrews
School of Computer Science
Hypothetical Cloud thatcharges for Energy
32
Category Cost
Data Transfer $58,084
VM hours $40,568
Energy $2,767
Storage $2,325
Storage I/O $2,293
Total $106, 037
University of St Andrews
School of Computer Science
33
Energy would account for 2.6% of the total costs
The lesson?
University of St Andrews
School of Computer Science
34
Energy would account for 2.6% of the total costs
The lesson?
and is likely to rise in the future
University of St Andrews
School of Computer Science
Summary
35
CloudMonitorDistributed Monitoring Platform
Power Models
Resource Usage
University of St Andrews
School of Computer Science
36
University of St Andrews
School of Computer Science
37Everybody benefits!
University of St Andrews
School of Computer Science
Thanks for listening
38
@jws7
jws7.net/cloudmonitor