Virtual I/O Server - Shared Storage Pools (Phase 2)€¦ · PowerHA System Mirror TSA HMC IBM...

© 2012 IBM Corporation

Common Tagung VIOS, 9. Mai 2012

Virtual I/O Server -Shared Storage Pools (Phase 2)

René AkeretIBM Switzerland

Common Tagung VIOS, 9. Mai 2012 | © 2012 IBM Corporation

Agenda

2 Cluster Aware AIX (CAA)

3 Shared Storage Pools (SSP)

Summary4

1 PowerVM Editions


PowerVM Editions

Network Balancing

10 per core(up to 1000)

Enterprise

Shared Storage Pools (Phase 2)Active Memory De-duplication**

Active Memory Sharing

Live Partition Mobility Performance Improvements

10 per core(up to 1000)

Standard

Suspend/Resume

Live Partition Mobility

2 per server

Express

NPIV

Shared Processor Pools

Virtual I/O Server

Concurrent VMs

PowerVM Editions

Q4 2011 Features** Requires POWER7 System with eFW7.4


New PowerVM Features 4Q 2011

Improvements in network components and this doubles the number of data movers from 8 to 16.

Network traffic is balanced across multiple shared Ethernet adapters in HA environments

Detects and removes duplicate memory pages in Active Memory Sharing configurations.

Creates pools of storage that can be used by virtualized workloads. This facility enables key functions like linked clones, snapshot / rollback and storage mobility.

Function

Optimizes physical memory usage for LPARs in Active Memory Sharing configurations. Allows more partitions to fit on a system if memory is constrained.

Active Memory De-duplication

BenefitFeature

Allows Live Partition Mobility to operate faster which enables quicker system evacuation for maintenance activities.

Live Partition Mobility Performance Improvements

Improved utilization of shared Ethernet adapters in HA environments and better performance.

Network Balancing

Improves storage utilization, reduces storage infrastructure costs, decreases time to provision new VMs and reduces administration costs.

Shared Storage Pools


New features requiring FW 7.4

Firmware 7.4 Is required for new selected Power enhancements

Is available only new on MTM…710 / 730: E1C & E2C720 / 740: E4C & E6C770 / 780: MMC & MHC

No FW 7.4 support for older Power Systems

Product Feature Express Standard Enterprise RequiresEFW 7.4

PowerVM:Active Memory De-duplication

PowerSC:Trusted Boot --


PowerSC Editions

PowerSC ExpressBasic compliance for AIX

PowerSC Standard Security and compliance for virtual & cloud environments

PowerSC Editions Express Standard

Security and Compliance Automation

Trusted Logging

Trusted Boot**

Trusted Network Connect and Patch Management

** Requires POWER7 System with eFW7.4


Agenda



Summary4

1 PowerVM Editions


Cluster Aware AIX (CAA) Exploiters

Legacy AIX

PowerHASystem MirrorTSA HMC IBM

Storage HPC

DB2 IBMDirector

Monitoring API

ClusterMonitoring

Group Services

Cluster Admin UI

Cluster CFGRepository

Resource Mgr Services

Bundled Resource Managers

ClusterMessaging

Messaging API

Legacy RSCT

RSCT Consumers

Monitoring API

ClusterMonitoring

Group Services

Cluster Admin UI

Cluster CFGRepository

Resource Mgr Services

Bundled Resource Managers

ClusterMessaging

Messaging API

RSCT With Cluster Aware AIX

Cluster Aware AIX

ClusterRepository

ClusterMessaging

ClusterMonitoring

ClusterEvents

CAA APIs and UIs

Redesigned Layers Integrated to CAA Capabilities

RSCT and Cluster Aware AIX together provide the foundation of strategic Power Systems SW

RSCT integration with CAA extends simplified cluster management along with optimized and robust cluster monitoring, failure detection, and recovery to RSCT exploiters on Power / AIX

VIOS


Agenda



Summary4

1 PowerVM Editions


VIOS Storage Options

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR

Whole local Disk & SAN LUN

Logical Volume from VG Pool

File backed from a file system

NPIV LUN

SAN LUN

Shared Storage Pool

NPIV over vFCvSCSI


Extending Integrated Storage Virtualization Beyond a Single System

PowerVM PowerVM with Shared Storage Pools

High value extension of today’s modelPredominant PowerVM usage model today

SAN

Shared Storage Pool

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

VIO

S

SAN

Storage PoolStorage PoolStorage Pool

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR

VIO

S


VIOS Shared Storage Pool Clustering Model

VIOS nodes are joined together to form a cluster

All VIOS nodes see all disks for storage pools they access

All VIOS nodes are eligible to read and write user data via the SAN

One or more VIOS nodes are meta-data managers for sub-units of each storage pool

Non managers communicate meta-data access and update via the ethernet

Cluster-wide concurrent access to namespace and data available from any node

Based on Cluster Aware AIX (CAA), SF-Store and RSCT functions

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR

LUN LUNLUN

Shared Storage Pool

Ethernet

SAN

VIO

S


VIOS Shared Storage Pool

MotivationSimplify the aggregation of large numbers of disks Better utilize on a percentage basis the available storage Simplify administration

A set of one or more disks managed as a block of storage that multiple file systems can reside within

Managed as one entity with disks entering, leaving, and being managed thru a simplified set of commandsFile systems share this common storage pool unit

Better storage utilization than the traditional dedicated storage that a (perhaps improperly sized) file system would necessitate

Notion of a “file system quota” (follow-on)

Addressable on the VIOS thru a directory namespace rooted at /<poolname>

Shared Storage Pool

/pool1/vdev1: /pool1/vdev2:


Thin or Thick Provisioning

MotivationStorage utilization

A Client vSCSI device can be presented as a thinly or thickly partitioned device

Thin provisioned device May present a much larger image than the current actual physical useNot fully backed by physical storage if the blocks are not in actual use

Thick provisioned device Fully backed by physical storage no matter what the actual usage

Storage Pool

Thin Thick

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR


Snapshots on VM disks and Cloning

Persistently saved snapshot of a point in time, rollback to prior snapshot

Consistency group snapshots

Sub-second creation

No practical limit on the number of snapshots that can be persisted

Basis for: Capture / deploy

Disaster Recovery

Consolidated Backup / Restore VIOS

LPAR #1 LPAR #2

/pool1/vdev1.1/pool1/vdev1.0 /pool1/vdev1.2

Block virtualization


Live Storage Mobility

Storage Mobility is a new function that allows data to be moved to newstorage devices within Shared Storage Pools.

Virtual machines remain completely active and available.

This ability to move data to new devices can improve performance and allow for the retirement of old storage devices without incurring anyapplication outages.

Examples:Move I/O to newly acquired disk subsystemMore evenly spread I/O load across devicesMove the data to a different location (remote site)Remove data from retiring subsystem


Live Storage Mobility (Replace Disk)

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR

vSCSI vSCSI vSCSI

Fibre Channel

Neat IBMUgly “other”vendor


Live Storage Mobility (Disk Space Move)*

*Not on Phase 2

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR

Power HyperVisor

VIO

S

LPAR

LPAR

LPAR

LPAR

vSCSI vSCSI vSCSI

Fibre Channel

Storage Pool A Storage Pool B

Move Blocks

Mirror Blocks


Shared Storage Pool Requirements

Platforms: POWER6 & POWER7 only (includes Power Blades)VIOS Storage Pool (minimums):

Direct fibre-channel attached LUNs: 1 for repository ~10 GB1 or more for data, 10 GB in practice lots more [like 1TB+]

Pool Storage Redundancy: Repository & pool storage must be RAIDed

VIOS name resolution to resolve hostnames

Virtual I/O Server(s):Minimum CPU: 1 (shared, uncapped is good)Minimum Memory: 4 GB

Read the Release Noteshttp://www-01.ibm.com/support/docview.wss?rs=0&uid=isg400000876


Shared Storage Pool Limits (Phase 2)

Max nodes: 4 VIOS nodes

Max physical disks in a pool: 256

Max virtual disks (LUs) in a cluster: 1024

Number of Client LPARs per VIOS 1 to 40(that is, 40 clients per VIOS, or 40 clients per VIOS pair)

Capacity of Physical Disks in Pool (each) 5GB to 4TB

Storage Capacity of Storage Pool (total) 10GB to 128TB

Capacity of each Virtual Disk (LU) in Pool 1GB to 4TB

Number of Repository Disks 1 to 1 (CAA limit)

40

Storage Pool

VIO

S

LPAR

40

VIO

S

LPAR

40

VIO

S

LPAR

40

VIO

S

LPAR

Storage PoolV

IOS

LPAR

VIO

S

40

VIO

S

LPAR

VIO

S

40


Shared Storage Pools

**Not currently supported

Power HyperVisorPower HyperVisor

/foo/f3: /bar/f4: /bar/l2:

Dedicated LUN **

block virtualization

/foo/f1: /bar/f2:

Store Shared Pool

/bar/l1:

block virtualization

Store Storage Pool

Dedicated LUN **

SFStore Meta-Data

VIOS VIOS

Shared Pool Virtual Devices Dedicated Virtual DeviceDedicated Virtual Device


User Interface

Command lineSome feature will remain command line only like: cluster –create

cfgassistThis is the VIOS version of smitty

Menu driven interface for CLI

Fully covers SSP functions

Graphical User InterfaceHMC (V7 R7.4)

System Director - Future releaseAlready has Storage Pools concept and features

Shared Storage Pool is just another storage pool type

Then may adds new unique items – like VMControl appliance deploy to SSP disk space or cloning


Agenda



Summary4

1 PowerVM Editions


Shared Storage Pools transforming the datacenter

Dynamic FlexibilityAll operations online

Improved utilizationThin ProvisioningGreater utilization percentage

LifeCycle Management (first time power is applied to the server’s retirement)Image Management: capture, deployAgility (linked-clones)

Provisioning time

Location transparency

Availability

Backup / Restore & Disaster Recovery


Technical Information

Announcement letterhttp://www-01.ibm.com/common/ssi/cgi-bin/ssialias?infotype=AN&subtype=CA&htmlfid=897/ENUS211-354&appname=USN

Release noteshttp://www-01.ibm.com/support/docview.wss?rs=0&uid=isg400000876

VIOS 2.2 User Guidehttp://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/p7hb1/p7hb1.pdf

Technical Hands-On Movieshttp://tinyurl.com/AIXmovies


René AkeretIBM Switzerland

[email protected]


Cluster Aware AIX (CAA) – What is it?

A set of services/tools embedded in AIX to help manage a cluster of AIX nodes and/or help run cluster software on AIX

IBM cluster products (including RSCT, PowerHA, and the VIOS) will use and/or call CAA services/tools.

CAA services can assist in the management and monitoring of an arbitrary set of nodes and/or running a third-party cluster.

CAA does not form a cluster by itself. It is a tool set.There is no notion of quorum. (If 20 nodes of a 21 node cluster are down, CAA still runs on the remaining node).

CAA does not eject nodes from a cluster. CAA provides tools to fence a node but never fences a node and will continue to run on a fenced node.


Cluster Aware AIX (CAA) and RSCT


Shared Storage Pools (SSP)

SSP is a server based storage virtualizer that is clustered across multiple Power servers

It’s an extension of PowerVM’s existing storage virtualization (VIOS vSCSI)

Combines existing SCSI emulation with clustering technology and a distributed data object repository

Distributed data object repository is an advanced filesystem-like function developed specifically for storage virtualization

SSP provides the same standard vSCSI Target interface to client hostVIOS 2.2.1.0


Why Shared Storage Pools?

Fibre-Channel LUN & NPIV is complexSAN switch, SAN disk subsystem = hard work & weird GUI !!

Typical LUN lead time: 4 minutes, 4 hours, 4 days, 4 weeks?

With rapidly changing needs with mandatory responsiveness it is simply not good enough!

Many smaller computer rooms have no dedicated SAN guy

LPM hard work as most people don’t pre-Zone the target so have to Zone before the move = complexity, slow, error prone

LPM = zero outage for Hardware & Firmware upgrades

Shared Storage PoolAllocate LUNs to the Virtual I/O Servers once

One VIOS command to allocate space to a VMOr use: cfgassist (VIOS’s smitty)Or use: HMC Virtual Storage Management GUI

LPM any time you like


Shared Storage Pool Configuration (Phase 2)

11Number of Repository Disks

4TB1GBCapacity of a Virtual Disk (LU) in Pool

128TB10GB Storage Capacity of Storage Pool

4TB5GB Capacity of Physical Disks in Pool

401Number of Client LPARs per VIOS node

12041Number of Virtual Disks (LUs) Mappings in Pool

2561Number of Physical Disks in Pool

41Number of VIOS Nodes in Cluster

MaxMinFeature


Shared Storage Pool Software Stack


IBM Systems Director offers end-to-end platform management

Hardware

Other Systems Management Software

Automation

Status

Configuration

Discovery

Update

Remote Access

Virtualization Core Director Services

Configuration

System x & Blade Center

System z

Power Systems

Storage Configuration

WPA

R M

anag

er

Add

ition

al P

lug-

Ins

Managed virtual and physical environments

Resource Management

Base Systems Director Managers

& Hardware

Platform Managers

IBM and non-IBM hardware

IBM® Systems Director Editions

Advanced Managers

&Priced Plug-Ins

Enterprise ServiceManagement

Integrated Service Management

Stor

age

Con

trol

VMC

ontr

ol

Net

wor

k C

ontr

ol

$$

VMC

ontr

ol Im

age

Man

ager

Tran

sitio

n M

gr fo

r HP

SIM

BO

FM

Serv

ice

& Su

ppor

t M

anag

er

Act

ive

Ener

gy M

anag

er

Virtual I/O Server - Shared Storage Pools (Phase 2)€¦ · PowerHA System Mirror TSA HMC IBM...

Documents

Transcript of Virtual I/O Server - Shared Storage Pools (Phase 2)€¦ · PowerHA System Mirror TSA HMC IBM...