CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management...

16
1 Andreas Doerr – Sun Grid Engine Amir Halfon – CTO, Financial Services Sun Microsystems, Inc. CLOUD COMPUTING ARCHITECTURES

Transcript of CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management...

Page 1: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

1

Andreas Doerr – Sun Grid Engine

Amir Halfon – CTO, Financial ServicesSun Microsystems, Inc.

CLOUD COMPUTINGARCHITECTURES

Page 2: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

Why Cloud Computing Fascinates IT

Developers Deployers

• Why won’t IT support this?• Why can’t I use the versions

I want?

• Why do we have so many versions of everything?

• Where can I cut costs?

2Sun Confidential

I want?• Why can’t I get better

availability?• How can I pay for what

I need?• How quickly can I get

more servers?

• Where can I cut costs?• How can I do finer grain

provisioning?• Where do we enforce

security, regulation andaudit?

Page 3: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

Two Perspectives

Massively scalable,

highly parallelPay as you go,

virtual data center

3Sun Confidential

highly parallel

computingvirtual data center

Explosion of unstructured data Changing economics: opex vs. capex

Page 4: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

Defining Concepts

Virtualization

Real-time, user-controlled

provisioning and

4Sun Confidential

Virtualization +

Multi-tenancy

provisioning anddeprovisioning

+Pay-per-use

Page 5: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO GridServer)

Dynamically Scaling Platform

Distributed Resource Management

From Grids to Clouds

5Sun Confidential

Self-service RM and scheduling (could be delegated to a framework). Workloads encapsulated within VMIs (e.g. Amazon EC2, Joyent, Rackspace Mosso)

S/W infrastructure platform controls resource and thread management. Workloads written for platform (e.g. Gigaspaces XAP, Paremus, Terracotta)

Virtualized Resource Management

Dynamically Scaling Platform

Page 6: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

Applications offered on-demand over the network

(Oracle CRM On Demand, salesforce.com)

Platform as a Service

Software as a Service

Cloud Service Models

6Sun Confidential

Basic storage and compute capabilities offered as a service (AWS, Rackspace Mosso)

Developer platform with built-in services (Google App Engine, Azure, Force.com)

Infrastructure as a Service

Platform as a Service

Page 7: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

Public

Cloud Ownership Models

PrivateHybrid

7Sun Confidential

You don’t know who else is on the same servers,

networks and disks that you are

You own the server, network and disk,and decide whogets to run on it

e.g.: A private cloud operated out of the resource pool of a public

cloud

Page 8: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

Sample Use Case: „Cloud Bursting“

� Sun Grid Engine: Maximize resource utilization and horizontal scalability for a wide range of workloads

– Batch, parallel, parametric, interactive and distributed services

Bundled components:

8Sun Confidential

� Bundled components:– SGE “Core” – workload and resource management

– SGE Inspect – Monitoring & management console

– ARCo – Accounting and Reporting console

– SDM – Service Domain Manager

• Power Saving

• Multi-Clustering and more

• Cloud connectivity

Page 9: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

Sample Use Case: „Cloud Bursting“Grid

Engine AGrid

Engine BGrid

Engine C

9Sun Confidential

Service Domain Manager

Zzzzz Zzzzz

Spare Pool Cloud ServicePower Saving Spare Pool

Page 10: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

All Clouds Share Key Traits

One Service Fits All

Virtualized Physical Resources

Self Provisioning

1

0Sun Confidential

Self Provisioning

Elasticity

Pay Per Use

Programmatic Control

Page 11: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

Sun’s View

Many Clouds

1

1Sun Confidential

Public and Private

Open and Compatible

Page 12: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

Consolidation

Abstraction

Building an Enterprise Cloud

1

2Sun Confidential

Automation

Utility

Interoperability

Page 13: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

Cloud Building Blocks

Platforms and Services

OpsCenter DCRM (aka CMDB)

1

3Sun Confidential

Infrastructure (Networks, Servers, Storage, Appliances)

Management & Orchestration

Virtualization

OpsCenter DCRM (aka CMDB)

7000 Series

IB

Page 14: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

Summary

� Many clouds: usage will drive redundancy models

� Rich ecosystem evolving

� Architectures are changing

Developers are impacted

1

4Sun Confidential

� Developers are impacted

� Forget 9s, think parallel distribution

Page 15: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

More Bits

•sun.com/cloud

•Sun Grid Engine

http://www.sun.com/software/sge/

1

5Sun Confidential

http://www.sun.com/software/sge/

•Security projects:

•Cloud Safety Boxhttp://kenai.com/projects/s3-crypto/pages/Home

•Hardened VMIshttp://blogs.sun.com/ec2/entry/hardened_opensolaris_2008_11_on

Page 16: CLOUD COMPUTING ARCHITECTURES - ETSI · Typical HPC grid: Grid engine controls resource management and scheduling. Workloads are DRM-aware (e.g. Sun Grid Engine, Platform LSF, TIBCO

1

6

SUBTITLE WITH TWO LINES OF TEXTIF NECESSARY

[email protected]

[email protected]

Questions/Comments?