ADC0063 – How KMD Designed its Virtual Infrastructure for...

38
ADC0063 – How KMD Designed its Virtual Infrastructure for a High-Availability Environment Alan Madsen KMD, System Engineer

Transcript of ADC0063 – How KMD Designed its Virtual Infrastructure for...

Page 1: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

ADC0063 – How KMD Designedits Virtual Infrastructure for a High-Availability Environment

Alan Madsen

KMD, System Engineer

Page 2: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Agenda

A little historyThe problem!

3 1 datacenterIn sourcing of costumers

The solution!VMware Assessment• Storage• Network• VirtualCenterITIL in a virtual environmentWho will pay?

Page 3: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

A Little History

Started in 1972!3,000 employees2,8+ billions revenue Core Business

Local authorityCentral governmentPrivate sector• Outsourcing

Page 4: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

The Problem!

Strategic decision to consolidating 3 1 datacenter

Page 5: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

The Problem!

Denmark in Europe

Page 6: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

The Problem!

In-sourced customers How to administer the customers• Individual needs• Individual SLA

• Auto failover, between datacenters• Start working on issue within 15 minutes• Low priority servers

• Individual configurations

How do we administer that?

Page 7: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

The Solution!

The solution!VMware (surprise) - looked at Microsoft VirtualServerAssessmentDesign• Storage• Network• VirtualCenterITIL in a virtual environmentWho will pay?

Page 8: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

VMware

Created a cookbook for virtualization in KMDBest practice for KMDVirtualizations standards for KMDScoreboard - ESX vs. MS Virtual Server (No match!)P2V tool

Page 9: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

The Solution!

The solution!VMwareAssessmentDesign• Storage• Network• VirtualCenterITIL in a virtual environmentWho will pay?

Page 10: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Assessment

Page 11: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Assessment

Page 12: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Assessment

Page 13: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Assessment

Send me a [email protected]

Page 14: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Assessment

Page 15: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Design

The solution!VMwareAssessmentDesign• Storage• Network• VirtualCenterITIL in a virtual environmentWho will pay?

Page 16: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Design

Design requirements:SecureScalableMinimum administrationManageable NetworkManageable StorageMonitor the environmentBackup

Deploy a server within 20 minutesSMS agentAntivirusSystem Surveillance Backup AgentCM Registered

Page 17: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Design

Hardware Department/HP8 - HP BL25P blades• 4 in each datacenterAMD Opteron dual core CPU10 GB ram (16GB PC3200 DDR )4 NIC

32 servers required (planned)

Storage Department:100 GB Templates3 x 300 GB VMFS

Network Department:Admin netProductionVMotion

Page 18: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

The Solution!

The solution!VMware (surprise)AssessmentDesign• Storage• Network• VirtualCenterITIL in a virtual environmentWho will pay?

Page 19: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Design - Storage

EMC Symmetrix DMX3000

The coolest filesystem!

DC1 DC2

ESX 3

Hardware

VM VM VM

ESX 3

Hardware

VM VM VM

EMC2EMC1

ESX 3

Hardware

VM VM VM

ESX 3

Hardware

VM VM VM

ISL ISLDirector

Page 20: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Design - Storage

Page 21: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Design - Storage

How big should my VMFS partitions be?300 Gb?• Database servers• Test/Pilot servers• SCSI reservations (Metadata)

• After the implementation we chanced that!

Page 22: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

The Solution!

The solution!VMware (surprise)AssessmentDesign• Storage• Network• VirtualCenterITIL in a virtual environmentWho will pay?

Page 23: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Design - Network

ProblemsDelegate responsibility from Network Admins to Server AdminsLearning the anatomy of an ESX server!Dedicated gigabit connection between datacenters for VMotion99,99 vs 99,9% uptimeNetwork load, an issue?Will broadcast traffic be a problem?HA/WLBS

Page 24: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Design - Network

ProblemDelegate responsibility from Network Admins to Server AdminsLearning the anatomy of an ESX server!• Virtual Switch Tagging

ESX 3

Hardware

VM VM VM

Destination Address

Source Address

802.1QVLAN Data

Page 25: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Design - Network

ProblemsDedicated gigabit for VMotion between datacenters

Page 26: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Design - Network

ProblemsNetwork load, an issue?Will broadcast traffic be a problem?

VMware ESX HOST - BLR14C-VH

VMware GUESTNavn: ETS01WMNET: KMD LAN

VirtualCenterManagement Console

Virtual Center

VMware GUESTNavn: WSS01WM1Q2003

NET: KMD LAN

VMware GUESTNavn: AFD01WM4Q2001

NET: KMD LAN

VMOTION KMDNET – 1 Gb

VLAN5 VLAN15 VLAN156 VLAN57 VLAN158 VLAN159

KMD NET – 1 Gb

ESX ADM – 1 Gb

Page 27: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Design - NetworkProblem

99,99 vs 99,9% uptimeHigh Availability/• WLBS• Cluster across boxes• Cluster between physical

and virtual machines

Page 28: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

The Solution!

The solution!VMware (surprise)AssessmentDesign• Storage• Network• VirtualCenterITIL in a virtual environmentWho will pay?

Page 29: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

VirtualCenter

VirtualCenterRunning in a Virtual Guest• Pros and consHA and DRS• Reflects KMDs Network infrastructure• Original design reflected storage configuration!Datacenter/folder creation• Access ControlResource Management• Why we “almost” don’t use it• Transparent page sharing! (a small hint)

Page 30: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

VirtualCenter

Super admins VS. Admins vs. UsersProcess for keeping the servers up and running in a HA environment

Super admins (technology group)• Configuration and installing new ESX• Managing LUNs

Admins (department admins)• Creating new VMs

Users• Accessing VM´s (KVM access)

Page 31: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

VirtualCenter

Installation and customization using a templateSMS agentAntivirusSystem Surveillance Backup Agent

ITIL Registered

SharedServicesIdeal for Hosting Costumers• Secure• High Available (May be running as a VM)

Page 32: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

The Solution!

The solution!VMware (surprise)AssessmentDesign• Storage• Network• VirtualCenterITIL in a virtual environmentWho will pay?

Page 33: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

ITIL in a Virtual Environment

IT Services Support (A brief description of our ITIL Problems)Configuration Management• Dynamic update using DRS• HA• Storage Issues – Multiple VMFS access from one VM guest• SLA – The highest level of uptime!Incident Management• Always the “new product” that fails!!!Problem ManagementChange Management• What affect does a change have to the VM infrastructure in a HA environment

IT Services deliveryService Level ManagementCapacity ManagementContinuity ManagementAvailability Management

Page 34: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

The Solution!

The solution!VMware (surprise)AssessmentDesign• Storage• Network• VirtualCenterITIL in a virtual environmentWho will pay?

Page 35: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Who Will Pay?

Hosting CustomersMaximum use of LUNs• CPUs• MemoryDuring peak hours or monthly useInternal payment within our company or customers• SAP!

Page 36: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Questions?

Questions?

Page 37: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates

Presentation Download

Please remember to complete yoursession evaluation form

and return it to the room monitorsas you exit the session

The presentation for this session can be downloaded at http://www.vmware.com/vmtn/vmworld/sessions/

Enter the following to download (case-sensitive):

Username: cbv_repPassword: cbvfor9v9r

Page 38: ADC0063 – How KMD Designed its Virtual Infrastructure for ...download3.vmware.com/vmworld/2006/adc0063.pdf · 4 NIC 32 servers required (planned) Storage Department: 100 GB Templates