SuperVessel: The Open Cloud Service for...

12
SuperVessel: The Open Cloud Service for OpenPOWER Yonghua Lin, Ling Shao IBM www.ptopenlab.com SuperVessel WeChat group Facebook group: SuperVessel OpenPOWER QQ group: SuperVessel

Transcript of SuperVessel: The Open Cloud Service for...

Page 1: SuperVessel: The Open Cloud Service for OpenPOWERon-demand.gputechconf.com/gtc/2015/presentation/S5702... · 2015-03-27 · Architecture of SuperVesselCloud 4 Nova Neutron Cinder

SuperVessel: The Open Cloud Service

for OpenPOWERYonghua Lin, Ling Shao

IBM

www.ptopenlab.com

SuperVessel

WeChat groupFacebook group: SuperVessel OpenPOWER

QQ group: SuperVessel

Page 2: SuperVessel: The Open Cloud Service for OpenPOWERon-demand.gputechconf.com/gtc/2015/presentation/S5702... · 2015-03-27 · Architecture of SuperVesselCloud 4 Nova Neutron Cinder

Motivation: To grow the number of developers on OpenPOWER

in the world

� Freely opened to all the students in universities, individual

developers and ecosystem partners for OpenPOWER.

� Built on the POWER7/POWER8 resource pool

� Built with open technologies, such as OpenStack

� Support advanced technology services, e.g. Docker service,

big data service, cognitive computing service

Why SuperVessel Cloud

2

Page 3: SuperVessel: The Open Cloud Service for OpenPOWERon-demand.gputechconf.com/gtc/2015/presentation/S5702... · 2015-03-27 · Architecture of SuperVesselCloud 4 Nova Neutron Cinder

Service Roadmap of SuperVessel

3

SuperVessel Cloud Infrastructure

SuperVessel

Cloud

Service

SuperVessel

Big Data and HPC

Service

Super

Class

Service

OpenPOWER

Enablement

Service

Super Project

Team

Service

Super Marketplace

1.VM and

container service

2.Storage service

3.Network service

4.Accelerator as

service5. Image service

1.Big Data

service: MapReduce

(Symphony), SPARK

2.Performance

tuning service

1.X-to-P migration

2.OpenPOWER

new system test

service

1.On-line video

courses

2.Teacher course

management

3.User

contribution

management

1.Project

management

service

2.DevOps

automation

Storage IBM POWER servers OpenPOWER server FPGA/GPU

Docker

(Online)(Online) (Preparing)

(Online)

Page 4: SuperVessel: The Open Cloud Service for OpenPOWERon-demand.gputechconf.com/gtc/2015/presentation/S5702... · 2015-03-27 · Architecture of SuperVesselCloud 4 Nova Neutron Cinder

Architecture of SuperVessel Cloud

4

Nova Neutron Cinder

KVM

Nova Neutron Cinder

KVM

Nova Neutron Cinder

LxC/ Docker

Nova Neutron Cinder

LxC/ Docker

Nova Neutron Cinder

KVM

KVM pool for POWER8 LE KVM pool for POWER8 BE Container pool for POWER8 LE

KVM pool for x86Container pool for POWER8 BE

System

maintenanceSystem monitoring

Resource usage

meteringSystem analysis

Services for cloud admin

User account & authentication managementUser interfaceHorizon

OpenStack

controller Nova

NeutronGlance Cinder

HEAT

Admin interface Virtual point management Statistic and analysisOpenPOWER-SuperVessel Unified Management Platform

Baremetal

management

Image

management

Cloud Infrastructure Service Big Data Service OpenPOWERenablement service Super Classservice Super Project Service

FPGA/GPUOpenPOWER

server

(IBM Cloud Management)

GPFS

Page 5: SuperVessel: The Open Cloud Service for OpenPOWERon-demand.gputechconf.com/gtc/2015/presentation/S5702... · 2015-03-27 · Architecture of SuperVesselCloud 4 Nova Neutron Cinder

To expand the SuperVessel via

collaboration with OpenPOWER partners� Multi-site design : Using the multi-region in OpenStack to support multi-site

management of SuperVessel cloud.

� We are designing the first multi-site for Jiangsu Development and Test cloud on POWER

• Shared dashboard, Shared keystone, Shared object store (in future)

• Enhance the cache design for performance optimization

• Enable the regional administration

5

Unified Management of SuperVesselDashboard for cloud Dashboard for Big data …Beijing Site Jiangsu Site

OpenStack controller OpenStack controller

V

M

V

M

V

M

V

MV

M

V

M

V

M

V

M

Users Users

Page 6: SuperVessel: The Open Cloud Service for OpenPOWERon-demand.gputechconf.com/gtc/2015/presentation/S5702... · 2015-03-27 · Architecture of SuperVesselCloud 4 Nova Neutron Cinder

SuperVessel Cloud Services

6

• Virtual machine and Docker services

• VPN management

• Pre-installed image service

• Multi-site support will be provided in next stepWe use virtual points for

resource management

Page 7: SuperVessel: The Open Cloud Service for OpenPOWERon-demand.gputechconf.com/gtc/2015/presentation/S5702... · 2015-03-27 · Architecture of SuperVesselCloud 4 Nova Neutron Cinder

• Pre-installed image service: It could very much make user easier to start

development on POWER

• Docker is used to provide the pre-installed environment.

SuperVessel Cloud Services

7

Page 8: SuperVessel: The Open Cloud Service for OpenPOWERon-demand.gputechconf.com/gtc/2015/presentation/S5702... · 2015-03-27 · Architecture of SuperVesselCloud 4 Nova Neutron Cinder

SuperVessel Big Data Services

8

• Support MapReduce and SPARK services

• Allow user to request different size of cluster

Page 9: SuperVessel: The Open Cloud Service for OpenPOWERon-demand.gputechconf.com/gtc/2015/presentation/S5702... · 2015-03-27 · Architecture of SuperVesselCloud 4 Nova Neutron Cinder

Shared file system for Cloud and Big Data service

9

Docker

(Symphony)

Horizon

OpenStack controller

HEAT

NeutronGlance Manila

Nova

Cloud Infrastructure Service Big Data Service • Select Big data computing

framework (Mapreduce,

SPARK

• Select cluster size

• Select data folder sizeHEAT template for big data cluster

Docker

(Symphony)

Docker

(Symphony)

Docker

(Symphony)

Docker

(Symphony)

Docker

(SPARK)

POWER7/POWER8

KVM/Docker

(Web app)

Folder A

User BUser A

Folder B

User A

• HEAT will orchestrate docker instances, subnet and data folder based on user’s request

• Manila provides the NFS service using GPFS as backend, and the folder will be mounted via nova-docker (with –

v support)

• Folder created by Manila could be accessed by the KVM/docker instances created for big data and other

purpose

GPFS FPOPOWER7/POWER8

Servers

GPFS FPOServers

GPFS FPO

KeyStone

Cinder

Page 10: SuperVessel: The Open Cloud Service for OpenPOWERon-demand.gputechconf.com/gtc/2015/presentation/S5702... · 2015-03-27 · Architecture of SuperVesselCloud 4 Nova Neutron Cinder

SuperVessel Accelerator as Service

10

• Accelerator MarketPlace for developers to

upload and compile the accelerators for

SuperVessel POWER cloud

• Allow user to request different size of cluster

Fig.1 Accelerator MarketPlace for SuperVessel Cloud

Fig.2 Cloud users could apply

accelerator when creating VM

Page 11: SuperVessel: The Open Cloud Service for OpenPOWERon-demand.gputechconf.com/gtc/2015/presentation/S5702... · 2015-03-27 · Architecture of SuperVesselCloud 4 Nova Neutron Cinder

Developer quickly grew in the past 100 days

11

• Users from 30 universities (including

3 from US)

• 6 university joint research projects

� Supported several courses from

universities, e.g.

� The Big Data course of Beijing

Institute of Technology: 100

students with 38 big data

clusters

� The virtualization technology

course from University of

Delaware (US)

11

Our target is 100,000 users and 100 universities in 2015/2016.

Page 12: SuperVessel: The Open Cloud Service for OpenPOWERon-demand.gputechconf.com/gtc/2015/presentation/S5702... · 2015-03-27 · Architecture of SuperVesselCloud 4 Nova Neutron Cinder

Thank You !!

12

Call for your collaboration to build this CLOUD together

www.ptopenlab.com