Innovations in Virtualization

VISIT 2010 – Fujitsu Forum Europe 1

Innovation Forum – Room 12

Shapingtomorrowwith you.

Innovations in Virtualizationwith you.

Masanobu Yuhara Research FellowFujitsu Laboratories

14:00 h14:00 h

VISIT 2010 – Fujitsu Forum Europe

VISIT 2010 – Fujitsu Forum Europe 3

Innovations in Virtualization

November 24, 2010Masanobu YuharaMasanobu Yuhara

Fujitsu Laboratories Limited

VISIT 2010 – Fujitsu Forum Europe 4 Copyright 2010 FUJITSU

R&D of Fujitsu Laboratories Ltd.

VIRTUALIZATION


VirtualizationVirtualization in ICT is a concept to abstract the underlying ICT resources (lower layer) in order to hide the details of the lower layer and provide better experience to the upper layerlayer and provide better experience to the upper layer.

Upper Layer (green) Provide betterexperienceUpper Layer

Virtualization Layer (pink)

experience

Lower LayerLower Layer (blue) Hide details

VISIT 2010 – Fujitsu Forum Europe Copyright 2010 FUJITSU6

Why use virtualization?

Merits ExamplesPartitioning (1 N) Virtual MachinePartitioning (1 N) Virtual MachineLarger capacity Virtual MemoryB tt ilit Vi t l M hi (d l ti )Better agility Virtual Machine (deploy time)Higher performance RAID0 (striping)Higher availability RAID1 (mirroring)Better portability Virtual Appliance (VM)Better mobility Live Migration (VM)Better security Access Control, EncryptionLess energy Migrate VMs and Power down

physical servers


Virtualization TechnologyVirtualization is one of the core concepts of Cloud Computing.

Any virtualization technology has its merits and demerits.

Fujitsu Laboratories Ltd. has been conducting researches to bring new merits and to reduce demerits.g


Today’s topicsToday s topics

Cloud

(4) System Virtualization (VSYS)

(1) MachineVirtualization (VM)

(2) StorageVirtualization

(3) NetworkVirtualization

VISIT 2010 – Fujitsu Forum Europe Copyright 2010 FUJITSUCopyright 2010 FUJITSU

Virtualization (VM) Virtualization Virtualization

9

(1) Machine Virtualization (VM)E l f M hi Vi t li tiExamples of Machine Virtualization

ServerOS

ServerOS

ServerOS

VM VM VM

ClientOS

ClientOS

ClientOS

Ph i l S

HypervisorVM VM VMOS

Hypervisor

OS OSVM VM VM

Physical Server Physical PC

S Vi t li tiS Vi t li tiCli t PC Vi t li tiCli t PC Vi t li ti

Client Client Client

Server VirtualizationServer VirtualizationClient PC VirtualizationClient PC Virtualization

Hypervisor

OS OS OSVM VM VM

Physical Server

Hypervisor


VM: Virtual (Virtualized) MachineHypervisor: Machine virtualization software Desktop VirtualizationDesktop Virtualization

Virtualization of USBAdd USB Virtualization Support

Client PCBankGeneral

Appl.Audio/Video

Appl.Super Secure

Appl.

(VA)

Client PCVirtualization Client

OS

pp

ClientOS

pp

Super SecureOS

pp

HypervisorVM VM VM

Physical PC

USB devices


USB devices

Authentication DevicesAudio/Video devices

Virtualization of USB devices

Client OSClient OSMng OS

Rule-based automatic/manual plug-in

Client OSClient OSMng OS

Virtualroothubroothub

Virtualroothub

device USBHub

device device device device

device device

Status: Fujitsu Labs. developed the first practical version of USB virtualization for Xen (Xen 3 4 0 and later releases)

VISIT 2010 – Fujitsu Forum Europe Copyright 2010 FUJITSU

Xen (Xen 3.4.0 and later releases).

12

Virtualization of VGAMPEG-4 3D Video HPCProvide direct and secure access to

VGA hardware (VGA path-through) ClientOS

ClientOS

ClientOS

MPEG-4 3D Video HPC

Hypervisor

OS OS OSVM VM VM

Hypervisor

Physical Server

•Direct I/O (VT-d) supportDesktopVirtualization

VGA VGA VGA VGA

•VGA BIOS handling•PCI MMIO BAR handling•Hot plug for secondary VGAStatus:


Fujitsu Labs. has contributed to the development of VGA path-through for Xen and its codes are adopted in Xen 4.0.

Fujitsu’s contribution to the open source community (Xen)

Number of enhancements/fixes officially adopted by the Xen community From Sep. 2007 to Mar. 2010.

Counted by Fujitsu

aurel32.net (2.2%) Others (12.4%)

Counted by Fujitsu.

Oracle/Sun (2.5%)

IBM (2.5%)

( )free.fr (1.9%)

Citrix(36.6%)

AMD (4 1%)

Red Hat (3.2%)

Oracle/Sun (2.5%)

Fujitsu Group(13.8%)

Intel(12.5%)

Novell (8.5%)

AMD (4.1%)

( )( )


(2) Storage VirtualizationExample of Storage Virtualization:

RAID (Redundant Array of Inexpensive Disks)

Logical Disk (LUN)• Redundancy

RAID layer• Combined capacity• Partitioned capacity• Higher performanceg p

Physical Disk Drives


Online Data Migration

Bi A li ti

About 80% CPU is left to applicationsVery small CPU% is left to applications

Biz. Application Biz. Application

Fujitsu Labs’ OTDMF

Vendor’sDevice Driver EMC’s Driver

Fujitsu Labs OTDMF

FJ’s Driver

SAN

Device Driver

SANSame vendor only Multi vendor

FujitsuEMCold

y Multi vendor

newDataMigration

DataMigration

FujitsuETERNUS®

EMCSymmetrix®old

new/fast/ Status:

new


large Finished R&D of Fujitsu Labs’ OTDMF(Online Transparent Data Migration Facility)

Deduplication

OS/Application OS/Application

Physical Machine Physical Machine

Fujitsu Labs’ Dedup

Physical Machine Physical Machine

dedup dedup

Save capacity and energy by deduplication

shared

•Storage capacity grows 50% every year. Save capacity and energy by deduplication• Applicable to primary storage

(not limited to backup storage)• Inline (real time) dedup

g y g y y•Storage is projected to consume 20% of Data Center energy.

•In the desktop virtualization scenario, the same file is stored multiple times by


Inline (real time) dedup. Status: Developing a prototype in FY 2010.

same file is stored multiple times by different persons.

This research is partially funded by NEDO (New Energy and industrial technology Development Organization).

Overview of Fujitsu Labs’ Dedup

data

data

already writtenHash Value

Dedup

data

new write

Hash Valuesearch

Data compressionHigh speed dup detection

Hash Tableupdate

pHigh speed dup detection

1write addresses

Serialize

Block Mapupdate

update

Sequential

243210518394333

Serialize

update…Normal write write

HashValue

Writeaddress

HashV alue

RealAddressaddress Valueaddress V alue Addressaddress

Block Map Hash Table Disk

１１


Block Map Hash Table Disk

(3) Network VirtualizationExamples of Network Virtualization

• L2 overlay network: VLANL3 l t k I t t VPN

Used to separate networks between customers in the cloud• L3 overlay network: Internet VPN

Private LAN Private LAN Private IP Network Private IP Network

customers in the cloud

VLAN Internet VPN

Physical LAN

L2 SWL2 SW InternetL2 SW

L2 SWL2 SW L2 SW

Internet

VISIT 2010 – Fujitsu Forum Europe Copyright 2010 FUJITSU

VPN: Virtual Private Network19

Virtual Switch for Virtual MachinesCurrent

VM VM VMPh M Ph M Ph M

Physical Machine EnvironmentCurrentVirtual Machine Environment

VM VM VMPhyM PhyM PhyM

Server ManagementW ld

Virtual SwitchWorld

Physical SwitchPhysical Switch Network Management Physical SwitchPhysical Switch Network ManagementWorld


Virtual Switch for Virtual MachinesCurrent

VM VM VMPh M Ph M Ph M

Physical Machine EnvironmentCurrentVirtual Machine Environment

VM VM VMPhyM PhyM PhyM

Server ManagementW ld

Virtual SwitchWorld

Physical SwitchPhysical Switch Network Management Physical SwitchPhysical Switch Network ManagementWorld


Visible =Manageable & Offloadable

Invisible =Un-manageable & Un-offloadable

Network Path-throughVEPA (Virtual Ethernet Port Aggregator):

Draft standard of IEEE 802.1QbgNew Technology

VM VM VMVirtual port

P th Th hVEPA

Virtual Switch

Path-Through(Port Aggregator）

Offload to hardwareVEPA-aware

Physical SwitchHairpin function

• Filtering (ACL)• QoS• Mirroring


Port Profile Migration

VM 1 VM 2 VM X VM X VM VM b

Current Live Migration of VM

VM-1 VM-2 VM-X VM-X VM-a VM-b

virtual port

Virtual Switch Virtual Switch

p-port setup for VM-1/2/Xp-port setup for VM-1/2

p-port setup for VM-a/bp-port setup for VM-a/b/Xphysical port

Physical Switch Physical Switch

No standard interface


for setting up virtual ports

Automatic Port Profile MigrationLive Migration of VM with automatic port profile migration


Live Migration of VM with automatic port profile migration

VEPAVirtual Switch

VEPAVirtual Switch

port profile for port profile for

VEPA-aware VEPA-aware


Physical Switch Physical Switch

Vendor-independent standard i t f f tti i t l

Status: • World’s first integration of VEPA (draft) based Path-through VEPA-aware

interface for setting up virtual ports


• World s first integration of VEPA (draft) based Path-through, VEPA-aware 10Gbps Ethernet SW, and Automatic Port Profile Migration.

• Demonstrated at INTEROP Tokyo 2010 (June 9-11,2010).

(4) System Virtualization (VSYS)

Business Application

Virtual System (VSYS)

IaaS Cloud Service(System Virtualization)Business Application


(System Virtualization)

firewalls

loadbalancers

serversstorages

pp

firewallsnetworks

Physical System (resources)Physical System


IaaS: Infrastructure as a Service

Virtual System Templates

Pre-designed, ready-to-run system configuration of servers, storages and networks as well as software stackstorages, and networks as well as software stackEnables fast and easy provisioning of infrastructureC t t th i t l t t id d li t dCustomers can create their own templates to avoid duplicated system developmentsVSYS t l t i f t f f ft kVSYS template is a future form of software package


Virtual System Templates

Virtual System

(1) Select (3) Deploytemplates

p yp yTemplate LibraryTemplate Library Virtual System (VSYS)

WEBMZ

MZ ur

eur

e

Optional ResourcesFirewall

DBWEB

ServerWEB

S

DM

DM

Sec

uS

ecu

WindowsServer

CentOSServer

CentOSS

DBServer

Server Server


(2) Customize

Virtual System

StatusDesign and Development for IaaS Cloud• Laboratory prototype (2007-2009)• Commercial service started in Japan (Oct. 2010-).• Global deployment to Australia, Singapore, US, UK and Continental

Europe (Germany) is underway.

Standardization• Proposed a set of cloud APIs based on our VSYS concept to DMTFoposed a set o c oud s based o ou S S co cept to

(Distributed Management Task Force) (Nov. 2009, July. 2010).• Joint effort by Fujitsu Labs. (Japan), Fujitsu Labs. of America, Fujitsu Labs.

of Europe and Fujitsuof Europe, and Fujitsu.

• VSYS use case was adopted as one of the cloud use cases by DMTF Cloud Management Workgroup.


Fujitsu’s Global IaaS Cloud

Administrative User

Private/Public IaaS for Enterprise

Deploy

Portal(GUI & API)

Deploy

Resource Pool(GUI & API) Resource Pool


Users

Data Center


Data Center

VSYS in Fujitsu IaaS Cloud

FirewallDMZ

VSYSSelect from Pre-configured VSYS

templates

VSYSnetwork

configurationtemplates

Secure Zone

VSYS informationincl. pre-installed

software



Connect VSYS to InternetFirewall

VSYS

(not) Connect VSYS to Intranet



D &D t ddDrag&Drop to add a server

Option List

Modify a VSYS based on the selected template if necessary



Drag&Drop to add an optional disk

Specify the disk size


.... then, deploy

Conclusions

Virtualization is a key concept of cloud computingFujitsu Laboratories Ltd. has been and will beFujitsu Laboratories Ltd. has been and will beworking on advanced virtualization technologies in various fieldscontributing to open source communities for virtualizationparticipating in the standardization of virtualization

Don’t forget to visit the live demonstration ofFujitsu’s global IaaS cloud

at P2.


VISIT 2010 – Fujitsu Forum Europe

Innovations in Virtualization

Technology

Transcript of Innovations in Virtualization