Post on 12-May-2015
description
Community Community Clouds from Scratch Clouds from Scratch A Real World Introduction
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Jordi Guijarro - jguijarro@cesca.cat@cloudadms
About
What Cloud What Cloud Computing really Computing really means for R&E means for R&E A strategy, a tactical solution...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
A Research and Education Network is a non-profit Internet service provider dedicated to supporting the needs of the research and education communities.
It has a high-speed backbone network.
Research and Education Networks are usually the places where new Internet protocols and architectures are introduced before their public deployment:
R&E Networks
Protocols: IPv6 and multicast.
Architecture: Client/Server and Cloud Computing
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
R&E Networks
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
JUST A BUZZWORD?What Cloud Computing really means for R&E Community ?
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
What Cloud Computing really means
SELFSERVICE(s)?
jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC 2012jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
What Cloud Computing really mean for R&E Community?
RESPONSIBILITIES...
jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC 2012jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
MEGHA Working MEGHA Working
GroupGroup Let's pull all together...
jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC 2012jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
MISSIONMEGHA Working Group
the development of innovation in Cloud Computing technologies within the scope of the institutions affiliated to RedIRIS
for the application of open and interoperable Cloud technologies in other areas in which it can influence, such as business in government.
TO PROMOTE
TO ACT AS A CATALYST
INTEROPERABLE
OPEN
PROMOTION
USE CASES
TESTBED
IDENTITY
http://wiki.rediris.es/megha
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Deploy a federated Cloud infrastructure as a platform for innovation and evaluation.
Explore the possibilities for the application of Cloud computing has in research, academic and management environments.Facilitate the creation of an ecosystem of open-source middleware components to deploy interoperable Clouds and coordinate training and education activities for its deployment.
MAIN OBJECTIVESMEGHA Working Group
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
MEGHA IntercloudMEGHA Intercloud
projectproject From myth to reality...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
INITIAL STAGEMEGHA Intercloud Project
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
CESCA Cloud InfrastructureCESCA Cloud Infrastructure
CESGA Cloud InfrastructureCESGA Cloud Infrastructure
INTEROPERABILITYMEGHA Intercloud Project
A “Virtual Poka Yoke” ?A “Virtual Poka Yoke” ?
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
OPEN PLEASE! MEGHA Intercloud Project
Director,...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
INTEROPERABLEMEGHA Intercloud Project
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
FEDERATED MEGHA Intercloud Project
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
FEDERATED MEGHA Intercloud Project
PKIRISGRIDX.509 Cert
UI
OpenN
ebula
3.8
r
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Public high speed connectivity.
Images, instances and networks management.
SSH access (root).User manual & Service Provider Howtos (ONE 3.x)“Terms of Service”.
MATURING TOGETHER
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
MAIN PLAYERS MEGHA Intercloud Project
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Some Real World Some Real World
User CasesUser Cases Cloudified...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
UOC: Learning Apps
REAL WORLD USER CASES
A store on the internet inspired by Apple's App Store which focuses on educational applications
The provision of the educational environments is automated (OCCI 0.8) and the amount of infr. depends on parameters such as a preconfigured concurrency.
RESTFUL API
http://www.learningappsstore.org/
ON DEMAND
ACADEMICACADEMIC
EDUCATION
AUTOMATION
CONTEXTUALIZATION
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
PIC: Grid & CloudREAL WORLD USER CASES
DIRAC (Interware) allows homogeneous access to heterogeneous computing resources.
Providing transparent access and interoperability between Grids and Clouds OCCI 1.1 interface.
SCIENTIFICINTEGRATION
CONTEXTUALIZATION
DIRACINTERWARE
Víctor Méndez (www.pic.es)
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
PIC: Grid & Cloud
REAL WORLD USER CASES
DIRAC WMS
TaskQueue
VM Scheduler
VM Director
MeghaCloudInfrastructure
Command-line
DIRAC API
Web Portal
VirtualMachine
UserAdmin
Image Repo
Cloud Manager
DIRAC CS
Cloud Driver
Integration Design: VM Job Running
Víctor Méndez (www.pic.es)jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
PIC: Grid & CloudREAL WORLD USER CASES
Víctor Méndez (www.pic.es)
DIRAC WMS
TaskQueue
VM Scheduler
OCCI Director(VM Director)
MeghaCloudInfrastructure
VirtualMachine
Image Repo
OCCI / OpenNebula
?
OCCI Image
OCCI RESTful Client
Integration Design: Occi VM Submission
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
PIC: Grid & Cloud
REAL WORLD USER CASES
jguijarro@cescajguijarro@cesca,.cat – Reykjavik 2012,.cat – Reykjavik 2012 TNC 2012TNC 2012
Virtual Machine
VM Monitor
Job Agent
DIRAC WMS
TaskQueue
VM Manager
Job
Cloud Manager
VirtualMachine
MeghaCloud Infrastructure
VMVM
VM
Job Run
CPU statistics
Job State Update
Job Matcher
Víctor Méndez (www.pic.es)
Integration Design: VM Job Running
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Next Steps... Next Steps... This is only the tip of the iceberg
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
DETECTED PROBLEMSNEXT STEPS...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Small and medium Scientific Research centersdon ́t have the manpower or know-how tobuild a 24/365 data center
Server deployment takes a long time
Can t́ solve peak problems
Usually can ́t have more than one data center
TEST PLATFORMNEXT STEPS FOR...
VO's ? SUNSTONE FEDERATION ?
COMPATIBILITY AND FEATURES
TO BUILD A MARKETPLACE ?
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
REAL SCENARIONEXT STEPS...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Some Some
conclusions... conclusions... Options to cater to all tastes!
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
NEW CHALLENGESNEXT STEPS...
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Federated user authentication and authorization mechanisms and user management between different cloud managers.
Secure VM image distribution and validation.among heterogeneous cloud managers.
Federated Cloud accounting system integrating the accounting records of multiple cloud managers and supporting the Federated Cloud governance.
Monitoring and notification of unpredictable change of availability.
Distributed scenario
FUTURE COMMUNITY FEDERATED CLOUD MODELFUTURE COMMUNITY FEDERATED CLOUD MODEL
Scalability (Commercial prov. included)
Resource sharingHigh Availability
Efficient use of infrastructure
jguijarro@cesca..cat – Berlin 2013 OpenNebula Conf 2013
Strategy, strategy, strategy, ...
Dedicated to those who made MEGHA possible.
Gràcies! Gràcies! Gracias! Gracias! ThanksThanks! !
Jordi Guijarro jguijarro@cesca.cat
@cloudadms