SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and...
Transcript of SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and...
![Page 1: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/1.jpg)
DISTRIBUTED RESEARCH ON EMERGING APPLICATIONS & MACHINESdream-lab.in | Indian Institute of Science, BangaloreDISTRIBUTED RESEARCH ON EMERGING APPLICATIONS & MACHINESdream-lab.in | Indian Institute of Science, Bangalore
DREAM:LabDREAM:Lab
©DREAM:Lab, 2014This work is licensed under a Creative Commons Attribution 4.0 International License
DISTRIBUTED RESEARCH ON EMERGING APPLICATIONS & MACHINESdream-lab.in | Indian Institute of Science, Bangalore
DREAM:Lab
SE252:Lecture 8+9, Jan 30/Feb 3ILO1:Parallel and Distributed Systems
Context
DREAM:Lab
![Page 2: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/2.jpg)
DREAM:LabDREAM:LabDREAM:Lab
ILO 1
•
•
![Page 3: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/3.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Lecture 8+9
![Page 4: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/4.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Computer Organization
•
![Page 5: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/5.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Flynn’s Taxonomy
•
•
•
•
![Page 6: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/6.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Single Instruction, Single Data
![Page 7: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/7.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Single Instruction, Multiple Data
•
![Page 8: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/8.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Multiple Instruction, Single Data
•
![Page 9: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/9.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Multiple Instruction, Multiple Data
••
![Page 10: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/10.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Shared vs Distributed Memory MIMD
•
•
•
•
•
![Page 11: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/11.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Shared vs Distributed Memory MIMD
•••••
IBM Blue Gene (MMP)
![Page 12: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/12.jpg)
DREAM:LabDREAM:LabDREAM:Lab
0
100
200
300
400
500
600
700
800
1 3 5 7 9 11 13 15 17 19 20 22 24 26 27 29
TFlo
ps
Rank
TopSC.in Dec, 2014
Rpeak (TFlops)
Rmax (TFlops)
TFlop Distribution for Dec/2014
![Page 13: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/13.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Cumulative Perf over Time
0.1
1
10
100
1000
10000
12 6 12 6 12 6 12 6 12 6 12 6 12
2008 2009 2010 2011 2012 2013 2014
TFlo
ps
TopSC.in Performance Trends over Time
Sum Max Min Avg
![Page 14: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/14.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Performance in Top500
![Page 15: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/15.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Computing Paradigms
•••
••
•
•
![Page 16: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/16.jpg)
DREAM:LabDREAM:LabDREAM:Lab
HPC, HTC, OLTP, Big Data
••
••
•
••
![Page 17: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/17.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Distributed Computing Sys Models
•
•
•
•
•
•
![Page 18: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/18.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Grid Computing for Science
Scalable, Data-driven Science on Emerging Distributed Platforms ... Y. Simmhan
Grid
Portal Server
Execution
Management
Information
Services
Self
Management
Resource
Management
Security
Services
Data
Services
Compute Resources Data Resources Instruments & Sensors
Proxy Certificate
Server (Vault)
Events & Messaging
Resource Broker
Community & User
Metadata Catalog
Workflow engine Resource
Registry
Application
Deployment
User’s Grid Desktop Portal
![Page 19: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/19.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Distributed Computing Sys Models
•
•
•
•
•
![Page 20: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/20.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Torrent P2P Protocol
![Page 21: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/21.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Internet of Things (IoT)
•
•
••
![Page 22: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/22.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Forecast Demand
Ingest Data
Store & Share Data
Visuali-zation
Decide D2R
Strategy
Generation Capacity DataEngineers
Analysts
Researchers
Customers
Monitor
Curtailment Notification – Voluntary and Direct Load Control
Customers, Facilities
Equipment, Sensors
Environment, Events
Smart Power Grids: Demand Response OptimizationReduce consumer demand for electricity during periods
of peak usage to relieve stress on power gridWhen → By How Much → How/Whom … Predict, Adapt, Evolve
![Page 23: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/23.jpg)
DREAM:LabDREAM:LabDREAM:Lab
IoT: Edge+Cloud
•
![Page 24: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/24.jpg)
DREAM:LabDREAM:LabDREAM:Lab
5 min peer discussion
→
![Page 25: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/25.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Utility vs Exclusive Computing
••
••••
![Page 26: SE252:Lecture 8+9, Jan 30/Feb 3 ILO1:Parallel and ...cds.iisc.ac.in/faculty/simmhan/SE252/lectures/SE... · DREAM:Lab 0 100 200 300 400 500 600 700 800 1 3 5 7 9 11 13 15 17 19 20](https://reader033.fdocuments.in/reader033/viewer/2022060423/5f196ed7b52e9408b2013c3b/html5/thumbnails/26.jpg)
DREAM:LabDREAM:LabDREAM:Lab
Assignments
•
•
•
Reading Assignment