Download - Condor and Distributed Computing

Transcript
Page 1: Condor and Distributed Computing

Condor and Distributed Computing

David Ríos

CSCI 6175Fall 2011

Page 2: Condor and Distributed Computing

Why are we going to spend 25 minutes on Condor?

Page 3: Condor and Distributed Computing

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 4: Condor and Distributed Computing

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 5: Condor and Distributed Computing

What is Condor?

Page 6: Condor and Distributed Computing

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 7: Condor and Distributed Computing

Who can benefit from Condor?

• Movie and Film Industry• Software Industry• Investment Brokerage Firms• Genome Research Firms• Engineering Firms• Electronics Design and Manufacturing• Anyone!

Page 8: Condor and Distributed Computing

US Air Force

• March 2011• Cluster of 1,716

PS3s

Page 9: Condor and Distributed Computing

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 10: Condor and Distributed Computing

High Throughput (Condor Strength)

Page 11: Condor and Distributed Computing

Opportunistic Computing (Condor Strength)

Page 12: Condor and Distributed Computing

Speed of Job Completion

Page 13: Condor and Distributed Computing

Performance

Page 14: Condor and Distributed Computing

Planning vs. Scheduling

Page 15: Condor and Distributed Computing

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 16: Condor and Distributed Computing

Flexibility

Page 17: Condor and Distributed Computing

Let Communities Grow Naturally

Page 18: Condor and Distributed Computing

Leave the owner in control, no matter what the cost

Page 19: Condor and Distributed Computing

Plan Without Being Picky

Page 20: Condor and Distributed Computing

Lend and Borrow

Page 21: Condor and Distributed Computing

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 22: Condor and Distributed Computing

Condor at Work

Page 23: Condor and Distributed Computing

Basic Condor Pool

Page 24: Condor and Distributed Computing

Condor Cluster Environment

Page 25: Condor and Distributed Computing

Physical Condor Cluster

Page 26: Condor and Distributed Computing

Agenda

• What is Condor?• Who can benefit from Condor?• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor

Page 27: Condor and Distributed Computing

Evolution of Condor

Page 28: Condor and Distributed Computing

Condor-G

• The Globus Project• Interface for batch execution• GRAM protocol (Grid Resource Access

Management)

Page 29: Condor and Distributed Computing

Archer

• Virtual Machine

• Condor is installed on VM

• Fast deployment

• Expertise not required

Page 30: Condor and Distributed Computing

What we discussed today…

• Why Condor is important to you• What is Condor• Who can benefit from Condor• Distributed Computer Concepts• Condor Design Philosophy• How Condor Works• Evolution of Condor