Boddu Satyavathi vs Boddu Ramakrishna Rao on 7 November, 2006
Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu...
-
Upload
leo-parker -
Category
Documents
-
view
218 -
download
0
Transcript of Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu...
![Page 1: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/1.jpg)
Concentration Zone/ Delta correlation based
data prefetcher aided by stream buffer
Kowshick Boddu04/09/2015
![Page 2: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/2.jpg)
PREFETCH
Hardware driven; hardware decides which
memory addresses to prefetch based on past
accesses or future instructions
problems with lateness, inaccurate addresses,
lengthening the critical path)
Software driven; compiler issues prefetch
instructions
problems with extra instruction overhead
![Page 3: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/3.jpg)
CZONE/DELTA CORRELATION PREFETCHING
Divides the memory space into equal-sized
concentration zones(Czones)
Global history buffer to detect patterns in
miss address “deltas” within each Czone
A tuning algorithm dynamically configures
Czone sizes and prefetch degree - Adaptivity
![Page 4: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/4.jpg)
IMPLEMENTATION
Global history buffer pre-fetching
Configuration
![Page 5: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/5.jpg)
SMALL STREAM BUFFER AIDING PREFETCH
ReferenceN. P. Jouppi. 1990“Improving direct-mapped cache performance by the addition of a small fully-associative cache and prefetch buffers”
Screen clipping taken: 09-12-2014, 02:09
![Page 6: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/6.jpg)
PREFETCH HARDWARE ON CACHE MISS
![Page 7: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/7.jpg)
![Page 8: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/8.jpg)
MEMORY BUS INTERFACE
Miss status handling register for demand fetches Keeps track of the demand fetch FIFO
If MSHR reaches high, prefetch is stalled untill Demand fetch is empty
![Page 9: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/9.jpg)
VISUAL REPRESENTION OF CACHE ACCESS
![Page 10: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/10.jpg)
ADAPTIVE PREFETCHING
Different programs use different data
structure and access patterns
Optimal Czone size and prefetch degree vary
across programs and within single program
Adopted Algorithms
Oracle Tuning
Phased-Based Tuning
![Page 11: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/11.jpg)
ORACLE TUNING ALGORITHM
Divides program execution into fixed intervals of one million instruction
Performance evaluation for varying Czone size and varying prefetch degree
Choose the best configuration at the end Performance improvement with oracle tuning
![Page 12: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/12.jpg)
PHASED-BASED TUNING ALGORITHM
Control dynamically configutrable hardware structures
Tuning is performed on phase change
Tuning algorithm for dynamic adaption
![Page 13: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/13.jpg)
BENCHMARKS
Three groups of benchmarks Amiable – Atleast one prefetching method
stuided improves performance by more than 5% Indifferent – None of the prefetching methods
hurt performance, and no method improves by 5%
Hostile - Prefetching tends to degrade performance
Benchmark Groups
![Page 14: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/14.jpg)
EVALUATION/RESULTS(1/3)SPEC FP IPC Improvement and Memory utilization
![Page 15: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/15.jpg)
EVALUATION/RESULTS(2/3)
![Page 16: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/16.jpg)
PERFOMANCE VARIATION
![Page 17: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/17.jpg)
CONCLUSIONS
C/DC requires very small prefetch table (few kilobytes) when compared to other methods
Czone prefetch is sensitive to Czone size, Optimal Czone size
Not as accurate as constant stride prefetch method leading to higher memory utilization
LIMITATIONS OF THE PAPER
No clear explanation of what the execution phases of the program
![Page 18: Concentration Zone/ Delta correlation based data prefetcher aided by stream buffer Kowshick Boddu 04/09/2015.](https://reader035.fdocuments.in/reader035/viewer/2022062314/56649ec65503460f94bd1092/html5/thumbnails/18.jpg)
THANK YOU
QUESTIONS?