Community Clouds from Scratch

Community Community Clouds from Scratch Clouds from Scratch A Real World Introduction

[email protected] – Berlin 2013 OpenNebula Conf 2013

Jordi Guijarro - [email protected]@cloudadms

mailto:[email protected]

What Cloud What Cloud Computing really Computing really means for R&E means for R&E A strategy, a tactical solution...


A Research and Education Network is a non-profit Internet service provider dedicated to supporting the needs of the research and education communities.

It has a high-speed backbone network.

Research and Education Networks are usually the places where new Internet protocols and architectures are introduced before their public deployment:

R&E Networks

Protocols: IPv6 and multicast.

Architecture: Client/Server and Cloud Computing


R&E Networks


JUST A BUZZWORD?What Cloud Computing really means for R&E Community ?


What Cloud Computing really means

SELFSERVICE(s)?

jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC [email protected] – Berlin 2013 OpenNebula Conf 2013

mailto:jguijarro@cesca

What Cloud Computing really mean for R&E Community?

RESPONSIBILITIES...



MEGHA Working MEGHA Working

GroupGroup Let's pull all together...



MISSIONMEGHA Working Group

the development of innovation in Cloud Computing technologies within the scope of the institutions affiliated to RedIRIS

for the application of open and interoperable Cloud technologies in other areas in which it can influence, such as business in government.

TO PROMOTE

TO ACT AS A CATALYST

INTEROPERABLE

OPEN

PROMOTION

USE CASES

TESTBED

IDENTITY

http://wiki.rediris.es/megha


Deploy a federated Cloud infrastructure as a platform for innovation and evaluation.

Explore the possibilities for the application of Cloud computing has in research, academic and management environments.Facilitate the creation of an ecosystem of open-source middleware components to deploy interoperable Clouds and coordinate training and education activities for its deployment.

MAIN OBJECTIVESMEGHA Working Group


MEGHA IntercloudMEGHA Intercloud

projectproject From myth to reality...


INITIAL STAGEMEGHA Intercloud Project


CESCA Cloud InfrastructureCESCA Cloud Infrastructure

CESGA Cloud InfrastructureCESGA Cloud Infrastructure

INTEROPERABILITYMEGHA Intercloud Project

A “Virtual Poka Yoke” ?A “Virtual Poka Yoke” ?


OPEN PLEASE! MEGHA Intercloud Project

Director,...


INTEROPERABLEMEGHA Intercloud Project


FEDERATED MEGHA Intercloud Project


FEDERATED MEGHA Intercloud Project

PKIRISGRIDX.509 Cert

UI

OpenN

ebula

3.8

r


Public high speed connectivity.

Images, instances and networks management.

SSH access (root).User manual & Service Provider Howtos (ONE 3.x)“Terms of Service”.

MATURING TOGETHER


MAIN PLAYERS MEGHA Intercloud Project


Some Real World Some Real World

User CasesUser Cases Cloudified...


UOC: Learning Apps

REAL WORLD USER CASES

A store on the internet inspired by Apple's App Store which focuses on educational applications

The provision of the educational environments is automated (OCCI 0.8) and the amount of infr. depends on parameters such as a preconfigured concurrency.

RESTFUL API

http://www.learningappsstore.org/

ON DEMAND

ACADEMICACADEMIC

EDUCATION

AUTOMATION

CONTEXTUALIZATION


PIC: Grid & CloudREAL WORLD USER CASES

DIRAC (Interware) allows homogeneous access to heterogeneous computing resources.

Providing transparent access and interoperability between Grids and Clouds OCCI 1.1 interface.

SCIENTIFICINTEGRATION

CONTEXTUALIZATION

DIRACINTERWARE

Víctor Méndez (www.pic.es)


PIC: Grid & Cloud


DIRAC WMS

TaskQueue

VM Scheduler

VM Director

MeghaCloudInfrastructure

Command-line

DIRAC API

Web Portal

VirtualMachine

UserAdmin

Image Repo

Cloud Manager

DIRAC CS

Cloud Driver

Integration Design: VM Job Running

Víctor Méndez (www.pic.es)[email protected] – Berlin 2013 OpenNebula Conf 2013

PIC: Grid & CloudREAL WORLD USER CASES


DIRAC WMS

TaskQueue

VM Scheduler

OCCI Director(VM Director)

MeghaCloudInfrastructure

VirtualMachine

Image Repo

OCCI / OpenNebula

?

OCCI Image

OCCI RESTful Client

Integration Design: Occi VM Submission


PIC: Grid & Cloud


jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC 2012

Virtual Machine

VM Monitor

Job Agent

DIRAC WMS

TaskQueue

VM Manager

Job

Cloud Manager

VirtualMachine

MeghaCloud Infrastructure

VMVM

VM

Job Run

CPU statistics

Job State Update

Job Matcher


Integration Design: VM Job Running



Next Steps... Next Steps... This is only the tip of the iceberg


DETECTED PROBLEMSNEXT STEPS...


Small and medium Scientific Research centersdon ́t have the manpower or know-how tobuild a 24/365 data center

Server deployment takes a long time

Can t́ solve peak problems

Usually can ́t have more than one data center

TEST PLATFORMNEXT STEPS FOR...

VO's ? SUNSTONE FEDERATION ?

COMPATIBILITY AND FEATURES

TO BUILD A MARKETPLACE ?


REAL SCENARIONEXT STEPS...


Some Some

conclusions... conclusions... Options to cater to all tastes!


NEW CHALLENGESNEXT STEPS...


Federated user authentication and authorization mechanisms and user management between different cloud managers.

Secure VM image distribution and validation.among heterogeneous cloud managers.

Federated Cloud accounting system integrating the accounting records of multiple cloud managers and supporting the Federated Cloud governance.

Monitoring and notification of unpredictable change of availability.

Distributed scenario

FUTURE COMMUNITY FEDERATED CLOUD MODELFUTURE COMMUNITY FEDERATED CLOUD MODEL

Scalability (Commercial prov. included)

Resource sharingHigh Availability

Efficient use of infrastructure


Strategy, strategy, strategy, ...

Dedicated to those who made MEGHA possible.

Gràcies! Gràcies! Gracias! Gracias! ThanksThanks! !

Jordi Guijarro [email protected]

@cloudadms

mailto:[email protected]

Community Clouds from Scratch

Technology

Transcript of Community Clouds from Scratch