Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe...
-
Upload
madison-nash -
Category
Documents
-
view
216 -
download
0
Transcript of Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe...
![Page 1: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/1.jpg)
Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters
Gregor von Laszewski1, Lizhe Wang2, Andrew J. Younge2, Xi He2
1: Pervasive Technology InstituteIndiana UniversityBloomington, IN
2: Service Oriented Cyberinfrastructure LaboratoryRochester Institute of Technology
Rochester, NY 1
![Page 2: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/2.jpg)
Outline
2
• Introduction• Virtual Machines• Power-Aware Computing• System Model• Scheduling Algorithm
– Implementation– Simulation
• Conclusion
![Page 3: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/3.jpg)
Power Consumption in Data Centers
• Currently it is estimated that servers consume 0.5% of the world’s total electricity usage.– Approx. 1.2% when data center systems are factored
in• Server energy demand doubles every 4-6 years.• This results in large amounts of CO2 produced by
burning fossil fuels.• What if we could reduce the energy used with a
minimal performance impact?
3
![Page 4: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/4.jpg)
Virtualization
• A Virtual Machine (VM) is a software artifact that executes other software as if it was running on a physical resource directly.
• Typically uses a Hypervisor or VMM which abstracts the hardware from an Operating System
• Enables multiple OSs to run simultaneously on one physical machine.
4
![Page 5: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/5.jpg)
Virtualization in a Cluster
• A compute cluster provides various virtual machine templates.
• When a job arrives at the cluster, the cluster scheduler allocates the job with a pre-configured virtual machine then starts it on compute nodes.
• The job is executed in the virtual machine.• After the job is completed, the virtual machine is
shutdown.
5
![Page 6: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/6.jpg)
Advantages of Virtualization
• On-demand creation and customization• Enhanced system usage• Legacy support for specific software • Increased administrative control for users• Cluster site autonomy• Guaranteed quality of service
6
![Page 7: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/7.jpg)
Power-Aware Clusters
• A Power-aware cluster is a compute cluster where nodes support multiple power and performance modes.– Adjustable frequency, voltage, sleep state, etc– Lower the power consumption of the CPU when its
not needed• We can Dynamic Voltage and Frequency Scaling
(DVFS) methods to control processor power consumption– Intel SpeedStep Technology– AMD PowerNow
7
![Page 8: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/8.jpg)
Energy Model
Power consumption can be estimated as:
• WasWhere v is the processor voltage and s is the
operating frequency at time period t
8
![Page 9: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/9.jpg)
Cluster Model
A Processing Element is defined as:
Where op is the operating point, v is the voltage, and s is the processor speed.
Then we can define a cluster C as a collection of k PEs
9
![Page 10: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/10.jpg)
VM Model
A VM is defined as:
Where s is the speed with requirement r and t is the time, both as the execution time and the startup time required.
Then we can define a set of i VMs as:
10
![Page 11: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/11.jpg)
Research Issue
We need a function f
That schedules VMs to PEs at a certain operating point in such a way that minimizes the overall power consumption of the cluster C
11
![Page 12: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/12.jpg)
Main Idea
12
![Page 13: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/13.jpg)
Algorithm 1
• Set all PEs running to the lowest voltage and processor speed, smin
• Define pek.sa as the available processor speed if the processor does not change its operating point. Since no virtual machine are initially scheduled, pek .sa is initialized with smin
• pek. s∇ is the available PE speed when pek is operated to a highest level voltage from the current voltage level. pek. s ∇ is initialized with smax
• At a predefined interval, reduce power profiles with Algorithm 3 and schedule all incoming VMs with Algorithm 2 13
![Page 14: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/14.jpg)
Algorithm 2
• Sort the incoming virtual machine requests in decreasing order of required processing frequency, vmi .sr so the VMs with higher requirements are scheduled first
• Find a pen with the most available processor speed
• If this PE meets the needs of the VM, schedule it on pen
• Continue for all VMs to be scheduled.
14
![Page 15: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/15.jpg)
Algorithm 2 (cont)
• If vmi cannot be scheduled, take the pen with the maximum potential speed, we raise the speed the lowest possible level to satisfy the requirements of vmi
• Schedule vmi on pen
15
![Page 16: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/16.jpg)
Algorithm 3
• During the interval, a VM may finish execution
• If it does, try to lower the operating point of pen to the lowest possible point which meets the requirements of all currently running VMs on pen
16
![Page 17: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/17.jpg)
Validation
• Need to validate the potential of our algorithm– Implement the algorithm within a small VM
cluster– Simulate VMs scheduled on a cluster with the
algorithm
17
![Page 18: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/18.jpg)
OpenNebula
• OpenNebula is a virtual infrastructure manager for data centers
• The standard scheduler is independent of the other components
• We can replace this scheduler with our own Power-aware scheduling algorithm
• Then adjust the frequency at the Hypervisor level
18
![Page 19: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/19.jpg)
Xen Power Management
• Xen Hypervisor to change the power consumption – Use the Xen 3.3.4-unstable power management tools– Within Dom0, we can control each core’s operating
frequency using xenpm• Intel Nehalem Quad Core processors
– Can set frequency to 1.6Hz, 1.86Ghz, 2.13GHz, 2.53GHz, or 2.66Ghz
– Uses Hyperthreading which provides 8 virtual cores, each of which can run a VM instance
• Measure power consumption using a Watts-UP power meter
19
![Page 20: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/20.jpg)
Power Consumption Variations
20
![Page 21: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/21.jpg)
Performance Impact of VMs
21
![Page 22: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/22.jpg)
DVFS Simulation
• Simulate a test cluster with 10, 20, 30, 40, and 50 compute nodes– Each node was simulated as a Pentium M at
1.4ghz• Simulate 100, 200, 300, 400, and 500 virtual
machines deployed on the cluster– VMs randomly pick frequency requirements
in .100Mhz intervals• Use the DVFS scheduling algorithm to
schedule VMs on nodes22
![Page 23: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/23.jpg)
DVFS-enabled Cluster Scheduling
23
![Page 24: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/24.jpg)
Overall operating point distribution
24
• Simulate scheduling 200 VMs on 40 PEs
• In round 1, most PEs run at the lowest voltage
• Over subsequent rounds, the operating points scale up as the utilization rises
• The overall distribution varies widely, with the majority of the time running below the maximum operating frequency
![Page 25: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/25.jpg)
Conclusion
• Recent trend to consolidate resources into a virtualized data center.
• There is a need to address the power consumption in these data centers.
• We can use DVFS technologies when scheduling VMs to conserve power whenever possible.
• Both experimental and analytical results show our algorithm its possible to reduce power consumption within a cluster environment.
• Further research is needed to reduce the energy consumed in data centers
25
![Page 26: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/26.jpg)
Questions?
26
![Page 27: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/27.jpg)
Appendix
27
![Page 28: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/28.jpg)
Cloud Computing
• Distributed Systems encompasses a wide variety of technologies
• Grid computing spans most areas and is becoming more mature.
• Clouds are an emerging technology, providing many of the same features as Grids without many of the potential pitfalls.
From “Cloud Computing and Grid Computing 360-Degree Compared” 28
![Page 29: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/29.jpg)
29
Framework
![Page 30: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/30.jpg)
VM scheduling on Multi-core Systems
• There is a nonlinear relationship between the number of processes used and power consumption
• We can schedule VMs to take advantage of this relationship in order to conserve power Power consumption curve on an Intel
Core i7 920 Server (4 cores, 8 virtual cores with
Hyperthreading)Scheduling
0 1 2 3 4 5 6 7 890
100
110
120
130
140
150
160
170
180
Number of Processing Cores
Watt
s
30
![Page 31: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/31.jpg)
31
Node 1 @ 170W
VM
VM
VM
VM
VM
VM
VM
VM
Node 2 @ 105W
Node 3 @ 105W Node 4 @ 105W
Node 1 @ 138W
VM
VM
VM
VM
VM
VM
VM
VM
Node 2 @ 138W
Node 3 @ 138W Node 4 @ 138W
485 Watts vs. 552 Watts
VS.
![Page 32: Power-Aware Scheduling of Virtual Machines in DVFS-enabled Clusters Gregor von Laszewski 1, Lizhe Wang 2, Andrew J. Younge 2, Xi He 2 1: Pervasive Technology.](https://reader030.fdocuments.in/reader030/viewer/2022032806/56649efb5503460f94c0e453/html5/thumbnails/32.jpg)
Minimal VM Image
• Easier to slim down a fully functional distro than to create one from scratch
• Selected Ubuntu Linux– Jaunty 9.04– Minimal install site– Package management software
(aptitude)– Continuing support
Ubuntu Linux
Cloud Ubunt
u
Vs.
VM Image Design 32