IBM® Edge2013 - IBM Flex System V7000 Technical Overview

7/27/2019 IBM Edge2013 - IBM Flex System V7000 Technical Overview

1/48

2013 IBM Corporation

IBM Flex System V7000Technical Overview

Bill Wiegand Consulting I/T Specialist

June 2013


2/48


Flex System Hardware Overview

SAS Networking

Clustering and Network Integration

Management

Virtualization Overview

Array Configuration

Advanced Functions

2

Agenda


3/48


The IBM Flex System Platform

The Flex System V7000

Storage node fits within the

Flex Enterprise chassis toprovide integrated storage

and servers in a single

package

Runs the exact same software

as the Storwize V7000 and

SAN Volume Controller (SVC)

3


4/48


The IBM Flex System Platform

The Flex Enterprise Chassis

provides the following services to

the Flex System V7000 StorageNode:

1 Gb/s Management network

4 host attachment networks

10 Gb/s Ethernet using FCoE or iSCSI

8 Gb/s or 16 Gb/s Fibre Channel

The host attachment networks must

always be configured in 2 pairs when

used with the Flex System V7000

A reliable power supply source andcooling

4


5/48

2013 IBM Corporation5

Flex System V7000 Enclosures - Front View

Control Enclosure

Expansion Enclosure


6/48 2013 IBM Corporation

Full Wide

24, 2.5 HDD Bays

Full Wide

24, 2.5 HDD Bays

Node Canisters

ControlEnclosure

Drive Caddy

HIC card 2FC or 10gigE

HIC card 110gigE only

Internal Components

6


7/48 2013 IBM Corporation7

The following drives are supported in the Flex System V7000:

2.5" 10k SAS HDD, 300GB (Seagate / Hitachi)



2.5" NL SAS, 500GB (Seagate)

2.5" NL SAS, 1TB (Seagate)

2.5" 15k SAS, 146GB (Seagate)

2.5" 15k SAS, 300GB (Seagate)

2.5" SSD SAS, 200GB (Hitachi) 2.5" SSD SAS, 400GB (Hitachi)

LFF 3.5 NL_SAS drives in 2/3/4TB capacities are available by using

Storwize V7000 expansion enclosures

Drive Options


8/48 2013 IBM Corporation

Control Enclosure Node Canister

Intel Jasper Forest quad core 64-bit CPU running at 2.1 GHz

8GB Memory per node canister 16GB per control enclosure

32GB internal flash drive for Linux and virtualization software

One or two Host Interface Cards (HIC) Slot 1 HIC must always be:

Two port 10 Gb/s Ethernet Adapter supporting FCoE and/or iSCSI

Slot 2 HIC can be either:

Four 2/4/8 Gb/s Fibre Channel ports

Two port 10 Gb/s Ethernet Adapter supporting FCoE and/or iSCSI

One internal 10/100/1000 Mb/s Ethernet for management (no iSCSI)

One external 6 Gb/s SAS wide port (24Gb aggregate) and usage optional

Two external USB Ports (not used for normal operation)

One Battery

8



Two 6 Gb/s SAS ports with usage of port 1 is mandatory and use of port 2is optional

The SAS port on the Flex System V7000 expansion canisters are HD Mini

SAS ports, and the Storwize V7000 canister SAS ports are Mini SAS Both are functionally the same, but have different sized connectors

Expansion Enclosure Canister



SAS NetworkingIBM Flex System V7000 Technical Overview



SAS Network Cabling


12/48


SAS Network Cabling

12


13/48


The SAS chain can contain up to 10

enclosures in any one of the following

configurations:

Flex System V7000 Control Enclosure only

Flex System V7000 Control Enclosure+ 1 Flex System V7000 Expansion

Enclosure in the same Enterprise chassis

+ 0 - 8 Storwize V7000 Expansion

Enclosures

Flex System V7000 Control Enclosure

+ 2 Flex System V7000 ExpansionEnclosure in the same Enterprise chassis

+ 0 - 7 Storwize V7000 Expansion

Enclosures

The control enclosure MUST be cabled

with Flex System V7000 expansionenclosures before the Storwize V7000

expansion enclosures

All Flex System V7000 expansion

enclosures must be in the same Flex

Enterprise chassis as control enclosure

13

SAS Network Cabling


14/48


Scalable within a FlexEnterprise chassis

Storage ITE Dual Controller

Storage ITE JBOD

Storage ITE JBOD

Storage ITE JBOD

Scalable to externalJBODS

Integrated into the FlexEnterprise chassis

Flex

Chassis

Flex

Ch

assis

Standard

Rack

Enclosure

Flex System V7000 Storage Node

Flexible Configuration

14


15/48


Clustering and

Network Integration

IBM Flex System V7000 Technical Overview


16/48


Scale Multiple WaysAn I/O Group is a control

enclosure and its associatedSAS attached expansionenclosures

Clustered system can consist of2-4 I/O Groups

Scale capacity/throughput 4x

Up 960 internal drives in 40enclosures within two 42U racks

Non-disruptive upgrades

From smallest to largestconfigurations

Purchase hardware only whenyou need it

No extra feature to order andno extra charge for a clusteredsystem

Virtualize external storagearrays behind Flex SystemV7000 for even greater capacityand throughput

Expand

Cluster

ClusterControl Enclosure Control Enclosure Control Enclosure

ExpansionEnclosures

ExpansionEnclosures

ExpansionEnclosures

Flex SystemV7000

One I/O GroupSystem

Flex System V70002-4 I/O Groups

Clustered System

An I/O Group is acontrol enclosureand its associatedSAS connected

expansionenclosures

Expan

d

No interconnection of SAS chains betweencontrol enclosures as control enclosures

communicate via FC

16


17/48


All four control enclosures must be

interconnected using a minimum of

two FC ports per node canister

FCoE is not currently supported forclustering, only FC is today

Flex chassis must have FC switch

modules and control enclosures must

have FC HICs

Recommended FC connectivity is via

a FC top of rack switch or via an

existing Brocade/Cisco FC SAN Can interconnect FC switch modules in

Flex Enterprise chassis via ISls if

desired in lieu of using a TOR switch

17

Cluster Control Enclosures


18/48


Flex System V7000 Storage Node with Fiber Channel

Fiber Channel

Adapter

Brocade or QLogic

FC switches

Red line is Fibre Channel

Cisco or Brocade

SAN

Virtualized

ExternalStorage

Switch Configurations (per switch) 8GB QLogic 14 internal ports 1 to each Node Canister

Means max of 2 FC ports used per node canister

16GB Brocade 12 Ports active with Ports On DemandAll internal 10 Compute Nodes + 1 to each Node Canister

10 internal 6 Compute Nodes + 2 to each Node Canister+ 2 uplink ports

16GB Brocade 24 Ports active with Ports On Demand 10 Compute nodes (1 port each) + 2 ports to each node canister

+ 10 uplink ports

FC enabled Storage Node to

integrated FC switches

Connect to externally

virtualized FC storage

18

Flex System V7000


19/48


Flex System V7000 Storage Node with Integrated FCoE

LOM or CN4054

(pNIC, vNIC mode)

CN4093 Flex System

Fabric Converged

Switch

First truly FCoE optimized storage

No cost wasted on non-FCoE ports

All FCoE traffic via mid-plane to integrated switch

Easily integrated into customer FC SAN

Virtualize other FC storage via FCoE connection

Black line is FCOE

Red line is Fibre Channel

Green line is Ethernet

Ethernet NetworkG8264/G8316

VirtualizedExternal

Storage

Cisco or BrocadeSAN

19

Flex System V7000

StorwizeV7000

FCoE


20/48


ManagementIBM Flex System V7000 Technical Overview


21/48


Auto-Discovering a New Storage Node

21

Storage Node 01


22/48


Auto-Discovering a New Storage Node

Insert Flex System V7000 Node

Wait 5 minutes for power up

Use chassis map task to launch

browser to Easy Setup Wizard

22


23/48


System Manager Chassis Map Operations

Chassis map location

Flyover status

Rapid access to details

V7000 GUI a click away

23


24/48


Native GUI Launched from Remote Access Task

Deeper devicespecific functions

24


25/48


Update Management Capability for Flex System V7000 Storage Node

Centrally manage the

device firmware

25


26/48


Virtualization

Overview

IBM Flex System V7000 Technical Overview


27/48


Flex System V7000 Built on Virtualization

Internal

Increases disk utilizationand reduces hot spots

Improves administrativeproductivity by up to 2X

External

External arrays inherit allStorwize V7000 functions

Extends life of existingstorage arrays

Optional feature

Migrate

Migrate data from externalLUNs to Flex SystemV7000

Thin or fully provisionedtarget volumes

Included at no cost for 45days from migration start

Flex System V7000VirtualizedStorage Pools

Servers


Servers


Servers

External Array

27


28/48


Storage AreaNetwork

Managed Disks a Cluster Resource

VolumesVolumesVolumesVolumes

NC NC NC NC NC

Designed to be redundant, modular and scalable solution

NC NCNC

System consists of one

to four I/O Groups

managed as a single

entity

Control enclosure with 2

node canisters (NC) makes

up an I/O Group and owns

given volumes

Control Enclosure Control Enclosure Control Enclosure Control Enclosure

28

Virtualization The Big Picture


29/48


MDG1

Pool 2

MDG3

Cluster:

Max 4 I/O Groups built from4 control enclosures

Flex System V7000 System

Managed Disks (MDisks):

Internally or externally provided Max 4096 MDisks per System

I/O Group 0 I/O Group 1

Volumes:

Max 8192 Volumes, 2048 per I/O

Group, with each up to 256TB in size

and each assigned to:A specific I/O Group

Built from a specific Storage Pool

Pool 1 Pool 3 Storage Pools:

Max 128 Storage Pools

Max 128 MDisks per Pool

Control Enclosure Control Enclosure

Virtualization The Big Picture

29


30/48


The Flex System V7000 uses basic storage units called managed disks and

collects them into one or more storage pools

These storage pools then provide the physical capacity to create volumes for

use by hosts

Volumes

Storage Pool

Managed Disks (MDisks)

Logical Building Blocks

30


31/48


The basic unit of storage in the Flex System V7000 is the managed disk or MDisk for short

A managed disk must be protected by RAID to prevent loss of the entire storage pool In Flex System V7000 we can have two different types:

Internal Array MDisk

The internal RAID implementation inside the system takes drives and builds a RAID

array with protection against drive failures

External SAN attached MDisk

An external storage system provides the RAID function and presents a Logical Unit

(LU) to the Flex System V7000

Managed Disks

31


32/48


Storage Pools

A storage pool is a collection of managed disks

The primary property of a storage pool is the extent size which bydefault using the GUI is 256MB

This extent size is the smallest unit of allocation from the pool When you add managed disks to a pool they should have similar

performance characteristics:

Same RAID level

Roughly the same number of drives per array Same drive type (SAS, NL SAS, SSD except if using Easy Tier)

Similar performance characteristics for external storage system MDisks

This is because data from each volume will be spread across all

MDisks in the pool, so the volume will perform approximately at thespeed of the slowest MDisk in the pool

The exception to this rule is that if using Easy Tier you can have 2 different tiers ofstorage in the same pool but the MDisks within the tiers should still have thesame performance characteristics

32


33/48


When the managed disks are added

into storage pools, the managed disks

are split into chunks of storage known

as extents

The size of these extents is a propertyof the storage pool

Default is 256MB

Whenever you create a new volume

you must pick a single storage pool to

provide the physical capacity

By default the created volume will stripe

all of its data across all the managed

disks in the storage pool as shown on

the left diagram Thin provisioned volumes consume

extents only as actual data is written to

disk

A2

A6

B1

B5

A3

A7

B2

B6

A4

A8

B3

B7

A1

A5

A9

B4

B8

A1 A2 A3 A4 A5 A6 A7 A8

B1 B2 B3 B4 B5 B6 B7 B8

A9 Volume A

Volume B

Volumes

Managed Disks

Thin ProvisionedVolume CC1 C2 C3 C4 C5 C6 C7 C8

C1

Storage Pool

33

Volumes


34/48


Array ConfigurationIBM Flex System V7000 Technical Overview


35/48


Internal Storage RAID

The Flex System V7000 system will contain a number of drive objects, but these

drives cannot be directly added to storage pools The drives need to be included in a Redundant Array of Independent Disks (RAID)

to provide protection against the failure of individual drives

3535


36/48


Supported RAID levels

Flex System V7000 will support the following RAID levels:

RAID 0 (striping, no redundancy) RAID 1 (mirroring between 2 drives)

RAID 5 (striping, can survive one drive fault)

RAID 6 (striping, can survive two drive faults)

RAID 10 (RAID 0 on top of RAID 1)

More details about the what the RAID levels actually mean is available at URL

below:

http://en.wikipedia.org/wiki/RAID

3636


37/48


Creating a RAID Array

In Flex System V7000 a RAID Array is created at the point that you add the array

into the storage pool When the array is created a managed disk also called a MDisk is created the full

useable capacity of the array

Wizards and Presets are available to suggest configurations to users based on

the hardware attached to the system If the MDisk built on internal storage is ever removed from the pool, then the array

and the associated managed disk is unconfigured

Drives go back to candidate status to be used to create another array

3737


38/48


One Click RAID Setup

A one click GUI setup exists to configure all drives into RAID arrays

Solid state drives will be configured as RAID 1 with 2 members and 1 spare

SAS drives will be configured as RAID 5 with 8 members and 1 spare

Near line SAS drives will be configured as RAID 6 with 12 members and 1 spare

All members of an array will have the same drive classAll SAS or all SSD or all NL SAS

Same RPM

Same capacity

One storage pool will be created for each drive class

3838


39/48


Manual RAID Array Creation (1): Drive Class

Internal Storage configuration

Fully automatic configuration of

the whole system

Semi-automatic configuration of

a subset of drives

Same type, RPM and capacity

3939


40/48


Array Creation (2): Preset

All RAID configuration in the GUI

is done via presets

Collection of RAID properties which

have been preselected based on best

practice guidelines

Wizard shows what it will create at the

bottom of the panel

40

40


41/48


Array Creation (3): Width, Optimization, Spares

Decide whether to configure spares

Choose the optimization policy

Modify the number of drives to configure

into array(s)

4141


42/48


Spare Drive Design

Spare drives are global spares

This means that any spare which is at least as big as the drive which is being replacedcan be used in an array

Thus a SSD array with no SSD spare available would use a HDD spare

The spare system will prefer best possible match based on the following

parameters:

Technology type

SAS vs SSD vs. NL-SAS

Speed/RPM

Capacity

Each array has a spare goal property

Indicates how many spares must be available to protect this array

If the number of spares drops below the goal then alert sent to notify admin

4242


43/48


Advanced FunctionIBM Flex System V7000 Technical Overview


44/48


Data Migration Included

Move data between storage pools an/or storage tiers non-disruptively

Migrate to new disk hardware when old hardware comes off lease

Thin Provisioning Included

Allows for storage optimization by consuming real capacity only when data iswritten

Volume Mirroring Included

Mirror data between storage pools built from internal or external disk enclosures

Add mirror to existing volume as thin-provisioned to reclaim capacity and/or migrateto another storage pool

Easy Tier Included

Allows for management of hotspots automatically by migrating extents fromspinning drives to solid state drives as needed for higher performance

FlashCopy IncludedAllows use of FlashCopy function with internal Flex System V7000 volumes as well

as external storage under Flex System V7000 management

FlashCopy Manager optionally available to help automate function

44

Flex System V7000 Advanced Functions


45/48


Metro and/or Global Mirror OptionalAllows you to replicate data synchronously or asynchronously between up to four

Flex System V7000 systems and/or Storwize V7000/SVC clusters

Compression OptionalAllows for in-band compression of data to minimize use of physical capacity

External Virtualization OptionalAllows you to bring external fibre channel disk systems under Flex System V7000

control providing access to all the functions of the above features

45

Flex System V7000 Advanced Functions

Questions?


46/48

2013 IBM Corporation IBM Flex V7000 Storage System L&L

Automated deployment

When placed into the Flex System

Enterprise Chassis, Flex System V7000

is immediately recognized and added toIBM Flex System Manager and Chassis

Map

Integrated event monitoring

Seamless visibility to events and status

Intelligent storage provisioning

Integrated storage provisioning for

virtual machine creation, deploymentand cloning

Automated firmware update

Update Manager provides firmware level

compliance monitoring andmanagement

Advanced Storage Management Time to Value with IBM PureSystems

Flex System V7000: Simplified Experience

46


47/48



48/48

IBM® Edge2013 - IBM Flex System V7000 Technical Overview

Documents

Transcript of IBM® Edge2013 - IBM Flex System V7000 Technical Overview