Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1,...
-
Upload
paxton-foster -
Category
Documents
-
view
216 -
download
0
Transcript of Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1,...
![Page 1: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/1.jpg)
Increasing the Energy Efficiency of TLS Systems
Using Intermediate Checkpointing
Salman Khan1, Nikolas Ioannou2, Polychronis Xekalakis3 and Marcelo Cintra2
1 University of Manchester2 University of Edinburgh
3 Intel Labs Barcelona - UPC
![Page 2: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/2.jpg)
HiPC 2011 2
Introduction
Power efficiency, complexity and time-to-market reasons lead to CMPs
Problem:– No benefits for sequential applications– Even for mostly parallel applications Amdahl’s
Law limits performance gains with many cores Solution: Thread Level Speculation(TLS)
– But performance through TLS costs in energy
Can we reduce the wastefulness of re-execution due to misspeculation
without losing performance?
![Page 3: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/3.jpg)
3
Key Contributions
Propose checkpointing to improve efficiency of speculative execution
Evaluate dependence prediction techniques to guide checkpoint placement
Our approach results in an energy saving of up to 14%, with 7% on average over normal TLS execution, with no significant effect on speedup.
HiPC 2011
![Page 4: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/4.jpg)
4
Outline
Introduction Checkpointing Dependence Predictors Checkpointing Policy Experimental Setup and Results Conclusions
HiPC 2011
![Page 5: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/5.jpg)
Thread Level Speculation
5HiPC 2011
![Page 6: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/6.jpg)
Thread Level Speculation with Checkpointing
6HiPC 2011
![Page 7: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/7.jpg)
7
Outline
Introduction Checkpointing Dependence Predictors Checkpointing Policy Experimental Setup and Results Conclusions
HiPC 2011
![Page 8: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/8.jpg)
Placing Checkpoints
Stride Dependence Prediction
– Address based– Program Counter Based– Hybrid
HiPC 2011 8
![Page 9: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/9.jpg)
Dependence Prediction
HiPC 2011 9
![Page 10: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/10.jpg)
Hybrid Dependence Predictor
HiPC 2011 10
![Page 11: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/11.jpg)
11
Outline
Introduction Checkpointing Dependence Predictors Checkpointing Policy Experimental Setup and Results Conclusions
HiPC 2011
![Page 12: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/12.jpg)
Placing Checkpoints
Limited number of checkpoints Placing a checkpoint has a cost Checkpointing on every positive
prediction results in too many checkpoints
HiPC 2011 12
![Page 13: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/13.jpg)
13
Outline
Introduction Checkpointing Dependence Predictors Checkpointing Policy Experimental Setup and Results Conclusions
HPCA 2010
![Page 14: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/14.jpg)
Setup Simulator, Compiler and Benchmarks:
– SESC (http://sesc.sourceforge.net/)– POSH (Liu et al. PPoPP ‘06)– Spec 2000 Int.
Architecture:– Four way CMP, 4-Issue cores– 16KB L1 Data (multi-versioned) and
Instruction Caches– 1MB unified L2 Caches– Cycles from Violation to Kill/Restart: 12– Cycles to Spawn: 12
HiPC 2011 14
![Page 15: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/15.jpg)
Measuring Dependence Prediction
HiPC 2011 15
![Page 16: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/16.jpg)
ICS 2009 16
![Page 17: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/17.jpg)
HiPC 2011 17
Wasted Instructions: Unnecessarily squashed instructions.
![Page 18: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/18.jpg)
HiPC 2011 18
![Page 19: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/19.jpg)
HiPC 2011 19
![Page 20: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/20.jpg)
20
Outline
Introduction Checkpointing Dependence Predictors Checkpointing Policy Experimental Setup and Results Conclusions
HPCA 2010
![Page 21: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/21.jpg)
Conclusions
Effective checkpointing improves the efficiency of TLS
Placing checkpoints by stride is not sufficient to reduce waste significantly
Checkpointing using dependence predication obtains energy saving of up to 14%, with 7% on average over normal TLS execution, with no significant effect on speedup.HiPC 2011 21
![Page 22: Increasing the Energy Efficiency of TLS Systems Using Intermediate Checkpointing Salman Khan 1, Nikolas Ioannou 2, Polychronis Xekalakis 3 and Marcelo.](https://reader035.fdocuments.in/reader035/viewer/2022062417/551ae90555034606048b5d13/html5/thumbnails/22.jpg)
Read the paper for…
Complete results Microarchitectural issues that
arise from checkpointing running tasks
Modified squash/restart mechanism that is needed to avoid performance degradation from checkpointing
HiPC 2011 22