Lecture 9: Group Communication Operations Shantanu Dutt ECE Dept. UIC.
NUMA overview
Chap4 slides
AU733v01
Www.cineca.it The basic of parallel programming Carlo Cavazzoni, HPC department, CINECA.
Definitions A Synchronous application is one where all processes must reach certain points before execution continues. Local synchronization is a requirement.
Lecture 9: Group Communication Operations
Basic Communication Operations Ananth Grama, Anshul Gupta, George Karypis, and Vipin Kumar To accompany the text ``Introduction to Parallel Computing'',
Definitions
Topic Overview One-to-All Broadcast and All-to-One Reduction All-to-All Broadcast and Reduction All-Reduce and Prefix-Sum Operations Scatter and Gather.
Basic Communication Operations
