HPC in the CloudImpact on Future Enterprise Architectures

Dr. Tirumale K (TK ) RameshThe Boeing Company

NCOIC Cloud Computing Working Grouptirumale.k.ramesh@boeing.com

NCOIC PanelNAVAIR Military Aviation Architecture Conference

September 22, 2010

Approved for Public ReleaseDistribution Unlimited

NCOIC-DefDaily-TKR20100917

Cloud Computing & High Performance ComputingDefinitions and Synergies

Cloud Computing A paid-for service model for delivery and consumption of computing allowing

organizations to access to applications, deployment and infrastructure platforms as a service provided on-demand

Infrastructure services which is more of a la carte with control for infrastructure provisioning is not what Cloud offers at least for now

What Cloud provides is an on-demand infrastructure as a whole (Infrastructure as a Service-IaaS) via set of pre-packaged menu options to choose the infrastructure from the providers

High Performance Computing (HPC) A computational model in which high performance is delivered to support

highly compute-intensive calculations mainly by using parallel algorithms with tightly-coupled, data-intensive inter-process communication, running on hundreds or even thousands of processors or cores.

HPC in the Cloud- Setting up a configuration of distributed cloud resources as a tightly coupled HPC engine to meet requirements of locality of reference, communication bandwidth and latency from node to node

2

Cloud Computing Impact on Future Enterprise Architectures (EA) It is predicted that in next 10+ years as Cloud Computing(CC) grows and matures, it

impacts and may redefine and advance the EA of an organization There is even more interest of EA to global organizations to sustain global

competition and support for interoperability in a global ecosystem environment Users would be able to buy cost-effective mission-critical processes as cloud services

and general buying habits of organizations may change from “buy all once” mindset to “buy breed of needed services”

3

Adaptable and scalable architecture to support changing buying habits and support for ecosystem of cloud computing

EvolvableArchitectures

Organizations to re-examine organizational security policies

Organizations to re-examine organizational security policies

Organizations to have high level control over data & network

Organizations to have high level control over data & network

Organizations to periodically evaluate vendor technologies and risk management including COTS technologies risks

Organizations to periodically evaluate vendor technologies and risk management including COTS technologies risks

Organizations to engage pro-actively in architecture implementations in cloud-For example designs that support integrating multiple CC interfaces

Cloud Services

Future Enterprise Architecturesdemands

demands

Cloud Service & Delivery Model Trade-offs

4

IaaS

PaaS

SaaS

Private

Public

Hybrid

User Responsible for Security

Vendor Responsible for Security

Ada

ptat

ion

toFu

ture

Arc

hite

ctur

es

Rel

iabi

lity

Inte

rope

rabi

lity

secu

rity

Rel

iabi

lity

Inte

rope

rabi

lity

Ada

ptat

ion

to

Futu

re A

rchi

tect

uresOpen Standard

Specifications

Proprietary Specifications

better

concerns better

better better

better better

PaaS(IaaShigh cost)

With balanced options, Security is still an issue for global operations

Basis Criteria's: Future Architectures, Security, Interoperability and Reliability

Trade-off from EA CentricTrade-off from EA Centric

Trade-off from Secured & global ops Centric

Trade-off from Secured & global ops Centric

PaaS

Trade-off from EA CentricTrade-off from EA Centric

Hybrid(Open arch)

Trade-off from Secured & global ops centric

Trade-off from Secured & global ops centric

Hybrid

Trade-offs

Cloud in Open Architecture Global Environment

Most of cloud providers expose APIs but have specific implementations that do not permit interoperability

– Ope

Some Open Standards under development including OGF’s Open Cloud Computing Interface- OCC (Open Cloud Consortium) is working on obtaining consensus on open standards and best practices

The Cloud Security Alliance is a non-profit organization that is working on promoting the use of best practices for providing security assurance 5

RoutingRouting

SwitchingSwitching FirewallsFirewalls

Application DeliveryApplication Delivery

Cloud Providers Cloud ProvidersVirtualizationVirtualization

Service-Oriented ArchService-Oriented Arch

PublicCloud PublicCloud

PrivateCloud PrivateCloud

HybridCloud HybridCloud

Open Standards

Enables open architecture

Provides global interoperability and portability

High Performance Computing (HPC) in the Cloud- Are there Cost Savings?

HPC in the Cloud offers the possibility of creating applications that would otherwise be prohibitive in HPC infrastructure costs to many HPC application developers Transforming HPC to Cloud via virtualization of cloud infrastructure and adapting

to HPC usage patterns of cloud resources Primary determinants of HPC performance are data locality and locality of

reference, and communications latency and bandwidthCurrently most of the HPC providers cannot guarantee these but possible in the

near future Today, nobody would build an HPC cloud for great grand challenge scientific

applications as the business is not profitable HPC users are far too small and does not take full advantage of cloud scaling

As HPC usage moves more from scientific users to main stream enterprise users, HPC cloud will become more economical

6

High Performance Computing (HPC) in the Cloud for Future EA

HPC benefits in future enterprise global operations As organizations in future become smarter in global collaborative work using 3D web

technologies and other collaborative computing technologies , it creates an opportunity for HPC to tap into much broader main stream enterprise user base and instantiate an architecture view in future enterprise architectures

HPC in the Cloud migration path for future EA First migrate via SaaS by tapping some acceleration HPC applications as a Cloud

Service to use with traditional HPC data centers (some FPGA vendors are interested in this)

Better Security in SaaSBetter Adaptation to Future Enterprise Architectures to support HPC for main

stream usersSlowly migrate to IaaS (full provisioning of HPC resources in Cloud)

So, is it all good news to migrate HPC to Cloud to save cost? No, not yet.More learning curve and initial efforts needed Initial high cost leading to lot of wait and watch now

7

High Performance Computing (HPC) in the Cloud- What are the Gaps?

8

HPC (Traditional P & D computing with high throughput HW and optimized SW stack)

HPC (Traditional P & D computing with high throughput HW and optimized SW stack)

Dynamic and adaptive workload management to fully utilize cloud resources

Gaps for Migration of HPC to Cloud

Cloud Fabric Scalability: Intelligent management of resources from network all the way up to processor/multi-core level( to gain fine-grain multi-threading parallelism)

Need virtualization of accelerators on the cloud to migrate any Hybrid HPC to cloud

CloudComputing

More compute intensiveapplications today demands HPC acceleration via CPU/GPU, CPU/FPGA

Some HPC in Cloud offerings todayPenguin’s HPC-as-a ServiceTM

Open Question: Is the Cloud robust enough to handle the massive computing cycles and very high system throughput needed for an

effective HPC environment?

Cloud Computing Open Architecture to leverage COTS HPC solutions and dramatically decrease the cost for doing HPC – a clear lift off opportunity for HPC to enter main stream

Cloud in Open Architecture EnvironmentImpact to HPC in the Cloud

Security and Legal/Legislation Issues Impact Potential exposure of sensitive and valuable information processed in HPC in the

Cloud HPC have well developed security layers in a single HPC data center

environment Security providers are looking to enhance the security of cloud offerings such as

cloud-based intrusion prevention which allows users to monitor network activity for malicious behavior

This requires integrating traditional HPC security layers with higher level cloud security layer for HPC offerings in cloud

There is no doubt that Cloud Computing is still in its infancy and many offerings remain insecure or poorly documented

Need to put more trust in security suppliers Private cloud architectures may be holding well at a good level in the enterprise, but

open standards to facilitate managing across global competing platforms is still far away for global operations

Currently opportunities are opening up for HPC in private Clouds

9

Secured Cloud Computing for GlobalOperations- Are We There Yet?

I say it is a Mixed BagSecurity is a major concern

Some cloud opponents argue that customer data is more secure when managed internally and not throw it on cloud

Some cloud supporters argue that Cloud Providers have a strong incentive to maintain trust so that they can provide a higher level of security in the near future

Expectations going forwardMost organizations experimenting with small implementations as Private

and Hybrid Cloud architecturesPrivate Cloud may move into the mainstream well before truly global

standards may even come into play Eventually there will be one standard that some experts argue may even

take longer for standardization (10+ years)

10

Final Thoughts

Delivering Secured Cloud Computing for Global Operations is not the responsibility of one single organization We need a well established framework for collaborations of all stakeholders

(Industries, Consumers, Government and Academia) Fundamentally Cloud needs to be a “Virtual Connector” to achieve “Net centricity”

Future Enterprise divides into community of people, processes, information, knowledge and services interconnected by a smarter network to achieve maximum benefit of its resources with reduced cost

11

Cloud (Virtual Connector

Cloud (Virtual Connector

People(Stakeholders) People(Stakeholders)

Information/ Knowledge/

Information/ Knowledge/

ProcessesProcesses

Org

aniz

atio

nal

inte

rope

rabi

lity

Semantic

interoperability

Smart Network(technology enabler)

Smart Network(technology enabler)

EA View as a Cloud Fabric

Technical

interoperability

Final Thoughts

Commercial and Military Aviation Architecture need to align with the global enterprise architecture in order to support today’s global business using key technology pointers Recommended migration plan is to first apply SoA in Aviation Architectures and transform

them to cloud offerings Take the architectural principle of SOA and applying it to an infrastructure offered by

cloudFinally integrate into HPC usage in the long run within a comprehensive enterprise

architectural framework to support global interoperability Network Technology is only an enabler for future aviation architectures implemented on

Cloud but network itself is not a major problem

NCOIC can help in providing the necessary guidance in the proliferation of Cloud Computing in support of future enterprise open architectures that evolves and uses emerging technologies rendered on the cloud that can be accessed via cloud services

Cloud computing can provide highly cost effective implementations of the architecture but Security is still the main issue

12

13

Thank You!