Parallel Processing Mechanisms - Asha...
Transcript of Parallel Processing Mechanisms - Asha...
![Page 1: Parallel Processing Mechanisms - Asha Dasashadas.uccollege.edu.in/wp-content/uploads/sites/99/2016/02/... · 1 Parallel Processing Mechanisms 1. Multiplicity of functional units 2.](https://reader031.fdocuments.in/reader031/viewer/2022022409/5aaedd5f7f8b9a07498ca41e/html5/thumbnails/1.jpg)
1
Parallel Processing Mechanisms
1. Multiplicity of functional units2. Parallelism and pipelining within the CPU3. Overlapped CPU and I/O operations4. Use of a hierarchical memory system5. Balancing of subsystem bandwidths6. Multiprogramming and time sharing
![Page 2: Parallel Processing Mechanisms - Asha Dasashadas.uccollege.edu.in/wp-content/uploads/sites/99/2016/02/... · 1 Parallel Processing Mechanisms 1. Multiplicity of functional units 2.](https://reader031.fdocuments.in/reader031/viewer/2022022409/5aaedd5f7f8b9a07498ca41e/html5/thumbnails/2.jpg)
2
1. Multiplicity of functional unitsn Early computers
q one ALU that perform one operation at a time.q Slow process
n Multiple and specialized functional units.q operate in parallel.
n IBM 360/91 →q two parallel execution units (fixed and floating point
arithmetic)n CDC-6600 →
q 10 functional units
![Page 3: Parallel Processing Mechanisms - Asha Dasashadas.uccollege.edu.in/wp-content/uploads/sites/99/2016/02/... · 1 Parallel Processing Mechanisms 1. Multiplicity of functional units 2.](https://reader031.fdocuments.in/reader031/viewer/2022022409/5aaedd5f7f8b9a07498ca41e/html5/thumbnails/3.jpg)
3
System Architecture of CDC-6600
![Page 4: Parallel Processing Mechanisms - Asha Dasashadas.uccollege.edu.in/wp-content/uploads/sites/99/2016/02/... · 1 Parallel Processing Mechanisms 1. Multiplicity of functional units 2.](https://reader031.fdocuments.in/reader031/viewer/2022022409/5aaedd5f7f8b9a07498ca41e/html5/thumbnails/4.jpg)
4
2. Parallelism and pipelining within CPU
n Parallel Adders q bit serial adders.q carry-lookahead and carry save adders.
n Multiplier recoding and convergence division.n Phases of instruction execution are pipelined
q Instruction fetch, decode, operand fetch, arithmetic logic execution, store result.
n Instruction Prefetch and data buffering.
![Page 5: Parallel Processing Mechanisms - Asha Dasashadas.uccollege.edu.in/wp-content/uploads/sites/99/2016/02/... · 1 Parallel Processing Mechanisms 1. Multiplicity of functional units 2.](https://reader031.fdocuments.in/reader031/viewer/2022022409/5aaedd5f7f8b9a07498ca41e/html5/thumbnails/5.jpg)
5
3. Overlapped CPU and I/O operations
n I/O operations performed simultaneously with CPU computations q separate I/O controllers, channels or I/O
processors.n DMA channels – cycle stealing.
![Page 6: Parallel Processing Mechanisms - Asha Dasashadas.uccollege.edu.in/wp-content/uploads/sites/99/2016/02/... · 1 Parallel Processing Mechanisms 1. Multiplicity of functional units 2.](https://reader031.fdocuments.in/reader031/viewer/2022022409/5aaedd5f7f8b9a07498ca41e/html5/thumbnails/6.jpg)
6
4. Use of a hierarchical memory system
![Page 7: Parallel Processing Mechanisms - Asha Dasashadas.uccollege.edu.in/wp-content/uploads/sites/99/2016/02/... · 1 Parallel Processing Mechanisms 1. Multiplicity of functional units 2.](https://reader031.fdocuments.in/reader031/viewer/2022022409/5aaedd5f7f8b9a07498ca41e/html5/thumbnails/7.jpg)
7
5. Balancing of subsystem bandwidthsn .
n Bandwidth of a system q no: of operations performed per unit time.
n Memory bandwidth q no: of words that can be accessed per unit time.
n Processor bandwidth q max: CPU computation rate. q Ex: Cray-1 → 160 MFLOPS
tBm
m
W
Bm
B p
ttt pmd
![Page 8: Parallel Processing Mechanisms - Asha Dasashadas.uccollege.edu.in/wp-content/uploads/sites/99/2016/02/... · 1 Parallel Processing Mechanisms 1. Multiplicity of functional units 2.](https://reader031.fdocuments.in/reader031/viewer/2022022409/5aaedd5f7f8b9a07498ca41e/html5/thumbnails/8.jpg)
8
n I/O bandwidth q Average data transfer rate. q Ex: Modern drives has Bd = 1 megabyte/sec
n Utilization bandwidth of memory andn Utilization bandwidth of CPU
n Utilization bandwidth of I/O q lower than the actual bandwidth.
n Relationship b/w BWs
MBB mu
m B
u
m Bm
Bu
m
TRB
p
wu
p
Bu
d
BBBBB d
u
ppmum
Bd
![Page 9: Parallel Processing Mechanisms - Asha Dasashadas.uccollege.edu.in/wp-content/uploads/sites/99/2016/02/... · 1 Parallel Processing Mechanisms 1. Multiplicity of functional units 2.](https://reader031.fdocuments.in/reader031/viewer/2022022409/5aaedd5f7f8b9a07498ca41e/html5/thumbnails/9.jpg)
n Bandwidth balancing between CPU and memory.
§ Cache memory§
n Bandwidth balancing between memory and I/O§ Buffer§ Multiplexing
n Totally balanced system where and
tt pc
BBBu
md
u
p BB p
u
p BB m
u
m
![Page 10: Parallel Processing Mechanisms - Asha Dasashadas.uccollege.edu.in/wp-content/uploads/sites/99/2016/02/... · 1 Parallel Processing Mechanisms 1. Multiplicity of functional units 2.](https://reader031.fdocuments.in/reader031/viewer/2022022409/5aaedd5f7f8b9a07498ca41e/html5/thumbnails/10.jpg)
10
n Batch processingq Sequential execution
n Multiprogrammingq Interleaving of CPU and I/O operations
among several programs n Time sharing
q Assign fixed or variable time slices to multiple programs
6. Multiprogramming and time sharing
![Page 11: Parallel Processing Mechanisms - Asha Dasashadas.uccollege.edu.in/wp-content/uploads/sites/99/2016/02/... · 1 Parallel Processing Mechanisms 1. Multiplicity of functional units 2.](https://reader031.fdocuments.in/reader031/viewer/2022022409/5aaedd5f7f8b9a07498ca41e/html5/thumbnails/11.jpg)
11
![Page 12: Parallel Processing Mechanisms - Asha Dasashadas.uccollege.edu.in/wp-content/uploads/sites/99/2016/02/... · 1 Parallel Processing Mechanisms 1. Multiplicity of functional units 2.](https://reader031.fdocuments.in/reader031/viewer/2022022409/5aaedd5f7f8b9a07498ca41e/html5/thumbnails/12.jpg)
12