Understanding Parallel Computers
-
Upload
vaughan-england -
Category
Documents
-
view
24 -
download
0
description
Transcript of Understanding Parallel Computers
![Page 1: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/1.jpg)
Understanding Parallel Computers
Parallel ProcessingEE 613
![Page 2: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/2.jpg)
Balancing Machine Specifics With Portability
• How much do we need to know about the machine architecture– Performance goal
• Game developers, embedded systems, and hardware vendors
• Coding specific to machine
– Lifetime goal• Portability• Generalized code
![Page 3: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/3.jpg)
A Look At Six Parallel Computers
• Chip Multiprocessors– Intel Core Duo– AMD Dual Core Opteron
• Heterogeneous Chip Designs– GPU, FPGA, Cell– Vector
• Clusters– Node – processors, RAM, disk, memory not shared– Typical - eight nodes, control processor, switch– Blade server – includes com ports and cooling fans
• Supercomputers – BlueGene/L (440 PowerPC’s)
![Page 4: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/4.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 5: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/5.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 6: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/6.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 7: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/7.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 8: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/8.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
Now we can put multiple cores on a single chip.
![Page 9: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/9.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
MESI – Modified, Exclusive, Shared, Invalid
![Page 10: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/10.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 11: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/11.jpg)
![Page 12: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/12.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
MOESI – Modified, Owned, Exclusive, Shared, Invalid
![Page 13: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/13.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
Both designs implement a coherent shared memory.
![Page 14: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/14.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 15: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/15.jpg)
Symmetric Multiprocessor (SMP)• Each processor makes memory requests over the common memory bus
• All cache controllers snoop the memory bus and adjust the tags on their cached values to ensure coherent cache usage.
![Page 16: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/16.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
Example – po & p1 have copies of Block X, but p2 writes to Block X.
![Page 17: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/17.jpg)
![Page 18: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/18.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 19: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/19.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 20: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/20.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 21: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/21.jpg)
![Page 22: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/22.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 23: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/23.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 24: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/24.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 25: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/25.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 26: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/26.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 27: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/27.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 28: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/28.jpg)
![Page 29: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/29.jpg)
![Page 30: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/30.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 31: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/31.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 32: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/32.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 33: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/33.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 34: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/34.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 35: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/35.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 36: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/36.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 37: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/37.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 38: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/38.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 39: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/39.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 40: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/40.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 41: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/41.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 42: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/42.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 43: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/43.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 44: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/44.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 45: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/45.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 46: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/46.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 47: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/47.jpg)
CSE524 Parallel Algorithms Lawrence Snyder
![Page 48: Understanding Parallel Computers](https://reader034.fdocuments.in/reader034/viewer/2022042718/56812c77550346895d911a23/html5/thumbnails/48.jpg)
CSE524 Parallel Algorithms Lawrence Snyder