Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ......

18
Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved. Storage Area Network Management Modeling Simulation Ramani Routray IBM Almaden Research Center

Transcript of Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ......

Page 1: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Storage Area Network Management Modeling Simulation

Ramani Routray

IBM Almaden Research Center

Page 2: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Outline

BackgroundSAN SimulatorModes of Operation

Snapshot ModeConfiguration ModeWhat-if Analysis

ArchitectureTest InfrastructureLessons Learnt

2

Page 3: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Background

The bottom line? Enterprises report that IT operational overhead is reaching up to 70 percent of the overall IT budget. And that number is growing—leaving precious few resources for new initiatives.

Worldwide storage management software market revenue totaled $10.6 billion in 2007, a 12.2 percent increase from 2006 revenue of $ 9.4 billion

3

Page 4: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Background

4

ManagementServer

CIM AgentCIMOM

CIM Providers

EmbeddedOR

External

Managed Environment

Page 5: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

SAN Simulation

5

Simulate Servers

Simulate FC Fabric

Simulate Storage

Correlate

CPU Profile

System Memory Profile

FC HBA Profile

Fabric Profile

Switch Profile

Array Profile

Disk Drive SubProfile

LUN Masking MappingSubProfile

Enhanced ZoningSubProfile

Page 6: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Modes of Operation

6

Snapshot ModeConfiguration ModeWhat-if Analysis

Page 7: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Snapshot Mode

7

SIMDB

SAN Simulator

CIM Agent

CIM Namespace

CIM ClassCIM Data

Page 8: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Snapshot Mode

8

Point to live CIM AgentUses standard CIM Client

Read CIM class definitions, construct MOF fileTraverse namespaces

For all CIM classes, enumerate InstancesCopy CIM Instances. Construct indexes

Point-in-time copy (Freeze CIM Agent or Subscribe Indications)

Record-Replay for Performance Data

Page 9: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Snapshot Mode

9

1. Create CIMClient (CIM Agent Credentials)2. Traverse Server Profile. Collect Namespaces3. For each Namespace

{snapshotClasses(Namespace)

}4. Build Association Indexes(GlobalAssociationClassList)

3.snapshotClasses(Namespace){

enumerateClasses();for each CIMClass{

enumerateInstances();record CIMData();if (AssociationClass)

Add to globalAssociationClassList}

}

Page 10: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Configuration Mode

10

High level user device specificationProgressive specificationNaming conventions pre-cannedGenerate Data . Store in DB. Serve through ProviderIncremental update of specification

Page 11: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Configuration Mode

11

#Type of storage systemSTORAGE_SYSTEM=DS8000

#Number of storage systemNUMBER_OF_STORAGE_SYSTEM=1

# Number of portsNUMBER_OF_PORTS=8

# Total number of volumesNUMBER_OF_VOLUMES=15

# Total number of PoolsNUMBER_OF_POOLS=5

# Total number of Array SitesNUMBER_OF_ARRAY_SITE_EXTENT = 10

# Mapping of Pool to VolumeMAPPING_POOL_TO_VOLUME=4 2 2 4 5

#Mapping from Arraysite to Pool (Disk to Pool)MAPPING_ARRAYSITE_TO_POOL=2 2 2 2 3

Page 12: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Configuration Mode

12

<SanConfigGenerator><workloads>

<workloadprofile name="wpd1“ IODemand="" XferSize="4“ReadPercentage="100" WritePercentage="0" SequentialRead="100“equentialWrite="100" ReadHitPercentage="50“Utilization="Volume"><trendprofile>

<range RangeLowerBound=“60" RangeUpperBound=“80" /><pattern Type="Random" Change=“5" Cyclic="Yes"/><time Length=“60" Unit="minute" />

</trendprofile><attachement><volume name="volume1" ></volume><fcport name="port1" /></attachement></workloadprofile>……………

</workloads></SanConfigGenerator>

Page 13: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Architecture

13

CIMOM(Pegassus/Sun WBEM/SNIA/..)

Provider(Server Profile/Array Profile/Switch Profile/BSP Profile/..

Device(s) Configuration Repository

Simulation Framework iSAN

CIMOM(Pegassus/Sun WBEM/SNIA/..)

Provider(Server Profile/Array Profile/Switch Profile/BSP Profile/..

CIM Agent(Server/Storage Subsystem/Tape Library/FC Switch/..)

CIMOM(Pegasus/Sun WBEM/SNIA/..)

CIM Provider(Server Profile/Array Profile/Switch Profile/BSP Profile/..

Device(s) Configuration Repository

VisualWorkbench

MOFScanner

TemplateGenerator

DataGenerator

SnapshotMaker

Knowledge Repository

Real Live CIM agent

Page 14: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

What-if Analysis

14Real Live Managed Environment

Simulated CIM Agent(s)

Declarative Configuration of Managed Environment

SimulatedCIM Agent(s)

Snapshot

Generate Configuration

What-ifAnalysis

SimulatedCIM Agent(s)

Page 15: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Test Infrastructure

15

Control Functions (invokeMethod)SNIA Lab. MirrorConformance TestingAutomated Management Server Testing

Page 16: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Lessons Learnt

16

Large Scale Clustered File System SimulationManagement Server

ManagementRepository

ServerServer ServerSwitch Switch

Switch Switch

Storage Storage

Storage Storage

Storage

Storage

Server Server Server

CIM-XML Proprietary SNMP

Server ResourceDatabase Resource

Network

Agent to DeviceMappingProviders Instances

Recipes

Failover/Load Balance

1. Query2. Statistics

ICAC 2009 ParaDisE: Parallel Discovery Engine for Enterprise Datacenters

Page 17: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Questions ?

17

Page 18: Storage Area Network Management Modeling Simulation Area Network Management Modeling Simulation. ... Storage Developer Conference 2009 ... Network. Agent to Device.

Storage Developer Conference 2009 © 2009 IBM Corporation. All rights reserved.

Thank You!

18