Download - CloudMonitor: Profiling Power Usage

University of St Andrews

School of Computer Science

1

or can we charge for Energy?

Profiling Powerat Cloud scale

@jws7

James SmithAli Khajeh-HosseiniJonathan WardIan Sommerville



2

or can we charge for Energy?

Profiling Power

CloudMonitorat Cloud scale

@jws7

James SmithAli Khajeh-HosseiniJonathan WardIan Sommerville



3

Operational costs exceeding purchase costs



4

Even over a relatively short lifespan (3-5 years). Mainly driven by energy costs




5



We need realistic Energy estimations



6



We need realistic Energy estimationsnot just included in “infrastructure”



Monitoring

7

“then you cannot improve it...”

If you cannot measure something

- Lord Kelvin



Monitoring

8

“then you cannot improve it...”

If you cannot measure something

- Lord Kelvin

13.4% of organisations monitor their energy consumption!



Datacentres

9



Datacentres

10



Datacentres

11



Datacentres

12

especially when you need additional hardware!

Monitoring at Scale is hard



CloudMonitor

13



CloudMonitor

14

Use SIGAR library to gather resource usage



CloudMonitor

15


Correlate with Power Meter

readings



CloudMonitor

16


Correlate with Power Meter

readings

Generate Power Model



17

So what?



18

Generate power model on one machine. Roll out to 1,000

So what?



19

Generate power model on one machine. Roll out to 1,000

So what?

of the same configuration



Previous work

• by Bohra, Ata & Chaundary - VMeter

• linear power model is workload-specific

• our work is workload-independent

• calculate once - valid for all machines of the same configuration

20*Husain Bohra, Ata E, and Vipin Chaudhary. “VMeter: power modelling for virtualized clouds.” 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW) (April 2010): 1-8.



21



22



23

Not perfect



24

Not perfect

but pretty close...



25

Experiments show 96% accuracy of Software Predictions against PDU Measurements

The lesson?



An Energy Tariff for Cloud

26




27

Energy rates are rising at 15% pa




28

36 month cost of test system:





29

$2,76736 month cost of test system:




Shop for Cloud

30



Amazon AWS EU Cloud

31

Category Cost

Data Transfer $58,084

VM hours $40,568

Storage $2,325

Storage I/O $2,293

Total $103, 270



Hypothetical Cloud thatcharges for Energy

32

Category Cost

Data Transfer $58,084

VM hours $40,568

Energy $2,767

Storage $2,325

Storage I/O $2,293

Total $106, 037



33

Energy would account for 2.6% of the total costs

The lesson?



34

Energy would account for 2.6% of the total costs

The lesson?

and is likely to rise in the future



Summary

35

CloudMonitorDistributed Monitoring Platform

Power Models

Resource Usage



36



37Everybody benefits!



Thanks for listening

38

@jws7

jws7.net/cloudmonitor