Introduction to Parallel Processing
description
Transcript of Introduction to Parallel Processing
![Page 1: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/1.jpg)
Introduction to Parallel Processing
Dr. Guy Tel-ZurLecture 6
![Page 2: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/2.jpg)
Exe #3
The Course RoadmapIntroduction
Message Passing
HTCHPC
Shared MemoryCondor
The Grid (EGEE)
Cloud Computing
MPI OpenMP
Next week
Today
![Page 3: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/3.jpg)
Agenda• A remark about Collective commands in MPI• More MPI Demonstrations• Introduction to Condor (next week - lab)
– Users perspective– Admin. Perspective– Demo:
• How to install a Personal Condor• A test program
• Discussion about the Final presentations• Home assignment #2
![Page 4: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/4.jpg)
http://eesgi2.ee.bgu.ac.il/
![Page 5: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/5.jpg)
MPI• More MPI examples
– Dead lock example with collective commands.
![Page 6: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/6.jpg)
פקודות קולקטיביות חייבות להינתן באותו הסדר לכל התהליכים בקומוניקטור
// Process A:MPI_Bcast(buf1, count, type, 0, comm);MPI_Bcast(buf2, count, type, 1, comm);break;// Process B (reverse broadcast):MPI_Bcast(buf2, count, type, 1, comm);MPI_Bcast(buf1, count, type, 0, comm);
From: “Grid Computing for Developers” book, by VLADIMIR SILVA
![Page 8: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/8.jpg)
Condor• Online manual:
http://www.cs.wisc.edu/condor/manual/v7.4• Next presentation:
– 2010 Condor Week– Nick LeRoy presentation: Condor User Tutorial– URL:
http://www.cs.wisc.edu/condor/CondorWeek2010/condor_presentations.html
![Page 9: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/9.jpg)
Installing Condor (7.4.2 – current)“Personal” Condor on Windows (Vista)
Version 7.4.2. Released on April 6, 2010
![Page 10: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/10.jpg)
Cont’
![Page 11: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/11.jpg)
Cont’
![Page 12: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/12.jpg)
Cont’
![Page 13: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/13.jpg)
Cont’
![Page 14: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/14.jpg)
Cont’
Click on Install
![Page 15: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/15.jpg)
Cont’
Give Administrator rights to the installer
![Page 16: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/16.jpg)
Cont’
restart
![Page 17: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/17.jpg)
The Condor service should be startedIf needed restart the service here
![Page 18: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/18.jpg)
At least the five Condor daemons should be running
![Page 19: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/19.jpg)
Condor config
![Page 20: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/20.jpg)
Condor config_local
You will find both configuration files under the install dir c:\condor
![Page 21: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/21.jpg)
condor_status
Good! So now we have a Personal Condor running on my laptop
![Page 22: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/22.jpg)
Demo: cpu_burn.c#include <math.h>#include <stdio.h>
int main() { int iMAX = 60000; int i,j; float fNORM, fMAX; float x,y; fMAX = iMAX; // convert to float fNORM = fMAX * fMAX; for (j=0;j<iMAX;j++) for (i=0;i<iMAX;i++) { y = i; // convert to float x = y*y/fNORM; } return 0;}
![Page 23: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/23.jpg)
Submit file:universe = vanilla
executable = cpu_burn.exeError = err.$(Cluster).$(Process) Output = out.$(Cluster).$(Process) Log = log.$(Cluster).$(Process)
Queue 5
![Page 24: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/24.jpg)
Watch the Task Manager
![Page 25: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/25.jpg)
Check the logfile000 (088.001.000) 04/26 10:23:10 Job submitted from host: <127.0.0.1:50486>...001 (088.001.000) 04/26 10:23:19 Job executing on host: <127.0.0.1:50487>...005 (088.001.000) 04/26 10:24:20 Job terminated.
(1) Normal termination (return value 0)Usr 0 00:00:27, Sys 0 00:00:00 - Run Remote UsageUsr 0 00:00:00, Sys 0 00:00:00 - Run Local UsageUsr 0 00:00:27, Sys 0 00:00:00 - Total Remote
UsageUsr 0 00:00:00, Sys 0 00:00:00 - Total Local Usage
0 - Run Bytes Sent By Job15686 - Run Bytes Received By Job0 - Total Bytes Sent By Job15686 - Total Bytes Received By Job
...
![Page 26: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/26.jpg)
![Page 27: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/27.jpg)
Condor daemons while executing cpu_burn
![Page 28: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/28.jpg)
![Page 29: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/29.jpg)
Same job at the vdwarf
Show demo under: /users/agnon/misc/tel-zur/condor/cpuburn
![Page 30: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/30.jpg)
Condor and Matlab/Octave demo
![Page 31: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/31.jpg)
The submit file
![Page 32: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/32.jpg)
The wrapper file
![Page 33: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/33.jpg)
![Page 34: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/34.jpg)
Final Presentationsעבור למצגת הרצאות גמר•
כל קבוצת תלמידים מתבקשת לבחור נושא להרצאת •גמר ואז לפעול כדלקמן:
את הדברים הבאים:[email protected]לשלוח אלי ל- –נושא ההרצאה )כותרת(•(PP-xxמספר הקבוצה )•שמות חברי הקבוצה•
אני אשיב לקבוצה באם הנושא אושר או לא! בטרם תקבלו –אישור ממני, אין להתחיל לעבוד על ההצעה שהגשתם!
![Page 35: Introduction to Parallel Processing](https://reader036.fdocuments.in/reader036/viewer/2022062812/5681634a550346895dd3da46/html5/thumbnails/35.jpg)
זהו להפעם, תירגול 21.8שבוע הבא,
CONDOR34 בבניין 310במעבדה
18:00-21:00נוכחות חובה