Fun with “nested ESXi”- How to build “cloud” in your home -Fun with “nested ESXi”- How to build “cloud” in your home -

March 24,2013Kenzo.Nagahisa@gmail.com

March 24,2013Kenzo.Nagahisa@gmail.com

学习会学习会＠＠上海上海

0.Introduction(1)0.Introduction(1)

•Self introduction

•name: Kenzo Nagahisa( 永久健三 )

•job: SoftBank Telecom China( 软银通信科技 )•work for: Cloud Service Provider(云计算 )•e-mail: kenzo.nagahisa@gmail.com

•Self introduction

•name: Kenzo Nagahisa( 永久健三 )

•job: SoftBank Telecom China( 软银通信科技 )•work for: Cloud Service Provider(云计算 )•e-mail: kenzo.nagahisa@gmail.com

0.Introduction(2)0.Introduction(2)•Terminology(Not accurate :p)•Terminology(Not accurate :p)

HV Hyper Visor

VM Virtual Machine

VMwareFamous “Virtualization” American company.Consumer Products: VMware Player/Fusion

ESXi

HV provided by VMware.(1) Free version -stand alone- (2) Paid version - can be controlled by vCenter

vCenter Server to control multiple ESXis

ClusterSet of ESXis controlled by vCenterHA function is configured on each Cluster.

vMotionTo move VM from one ESXi to another ESXi.i.e. use for ESXi hardware maintenance

HAHigh Availability. Automatic VM restart on the other ESXi in case of ESXi failure.

1.Today’s topic1.Today’s topic•Let’s have fun with creating “home

cloud”.

• AWS/VMware Player is very cheap and useful but let's try & feel “physical cloud” at home.

•But we have NO MONEY... have only one server;)

• Keep in your mind we live in “Virtualization” IT world.

•Can we use virtual ESXi ? YES, WE CAN!

• “nested ESXi” means “ESXi(VM) on ESXi(HV)”.

• We can use vCenter to control “ESXi”s on ESXi.

•Let’s have fun with creating “home cloud”.

• AWS/VMware Player is very cheap and useful but let's try & feel “physical cloud” at home.

•But we have NO MONEY... have only one server;)

• Keep in your mind we live in “Virtualization” IT world.

•Can we use virtual ESXi ? YES, WE CAN!

• “nested ESXi” means “ESXi(VM) on ESXi(HV)”.

• We can use vCenter to control “ESXi”s on ESXi.

2.Requirements(1)2.Requirements(1)•Hardware

•At least one x86 server.

•CPU is key(VT-x:mandatory. EPT:optional).

•Sufficient Memory

•My case: Dell PowerEdge1950(2nd hand)

•Storage for HA

•NFS or iSCSI

•My case: QNAP TS-119P II + Sata disk

•Hardware

•At least one x86 server.

•CPU is key(VT-x:mandatory. EPT:optional).

•Sufficient Memory

•My case: Dell PowerEdge1950(2nd hand)

•Storage for HA

•NFS or iSCSI

•My case: QNAP TS-119P II + Sata disk

2.Requirements(2)2.Requirements(2)•Software

•Get VMware account(free) and download:

•Standalone ESXi HV(free)

•vSphere 5.1 Evaluation(60 days)

•vCenter Evaluation Appliance(60 days)

•Client OS media for test

•Linux, Windows

•Software

•Get VMware account(free) and download:

•Standalone ESXi HV(free)

•vSphere 5.1 Evaluation(60 days)

•vCenter Evaluation Appliance(60 days)

•Client OS media for test

•Linux, Windows

3.Design(1)3.Design(1)•Image•Image

vCentervCenter

ESXiESXi ESXiESXi

StorageStorage

RDP,sshRDP,ssh

Physical ServerPhysical Server

3.Design(2)3.Design(2)•Goal: to execute VMotion & HA•Goal: to execute VMotion & HA

vCentervCenter

ESXiESXi ESXiESXi

StorageStorage

RDP,sshRDP,ssh

Physical ServerPhysical Server

3.Design(3)3.Design(3)•Diagram•Diagram

vCenter-1vCenter-1esxi510-esxi510-

22

X86 ServerX86 ServerStorageStorage

Mgmt Network SWMgmt Network SW

esxi510-esxi510-11

StorageNetwork StorageNetwork SWSW

RDP/ssh ClientRDP/ssh Client

192.168.1.202192.168.1.202

192.168.1.252192.168.1.252

192.168.1.201192.168.1.201192.168.1.210192.168.1.210

192.168.2.251192.168.2.251

192.168.2.252192.168.2.252

192.168.1.100192.168.1.100

192.168.2.201192.168.2.201 192.168.2.202192.168.2.202

4.Installation(1)4.Installation(1)•Points

•ESXi(VM)’s Machine Type: 9 (vmx-09)

•vhv.enable = TRUE (in case of EPT enabled)

•NWs on ESXi(HV) set to “promiscuous” mode

•Dedicated NW for vMotion

•Multiple management NWs for HA

•vCenter Appliance: vmware/vmware

•Points

•ESXi(VM)’s Machine Type: 9 (vmx-09)

•vhv.enable = TRUE (in case of EPT enabled)

•NWs on ESXi(HV) set to “promiscuous” mode

•Dedicated NW for vMotion

•Multiple management NWs for HA

•vCenter Appliance: vmware/vmware

4.Installation(2)4.Installation(2)

Only 32bit VMOnly 32bit VM

4.Installation(3)4.Installation(3)•HV Installation•HV Installation

4.Installation(4)4.Installation(4)•Storage(iSCSI)•Storage(iSCSI)

4.Installation(5)4.Installation(5)•NWs on HV•NWs on HV

4.Installation(6)4.Installation(6)•3VMs=2ESXis & vCenter•3VMs=2ESXis & vCenter

4.Installation(7)4.Installation(7)•vCenter Appliance•vCenter Appliance

4.Installation(8)4.Installation(8)•Datacenter=Shanghai, Cluster=Pudong•Datacenter=Shanghai, Cluster=Pudong

5.Home cloud?5.Home cloud?

6.At the end6.At the end•Cheap server is very noisy. not recommended

:(

•CPU w/ EPT allows “VHV”(Virtualized HV)

Hyper-V on ESXi ?

•Mac mini maybe work as “nested ESXi”

•Cheap server is very noisy. not recommended :(

•CPU w/ EPT allows “VHV”(Virtualized HV)

Hyper-V on ESXi ?

•Mac mini maybe work as “nested ESXi”

EnjoyEnjoy!!