Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS
PRIMERGY
DuplexDataManager ®
Configuration Examples for
FibreCAT CXx-xx iSCSI
Windows Server 2003 / 2008
June 5, 2009
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS1
MultiPath
I/O Fault Tolerance by Redundant Fibre Channel Paths
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS2
MultiPath handles Path Redundancy
MultiPath
PRIMERGY
standby
active
FC CXxxx
Storage Array
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS3
Load Balancing Option
MultiPath
LUN 0,2,...
Channel = 1
Channel = 0
LUN 1,3,...
Load Balancing Algorithms:
a) AutoBalance load balancing algorithm
b) Per LUN selectable path
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS4
standard configuration
MultiPath
Subnet B
Subnet A
PRIMERGY XXX
internal disks
for
SYSTEM,...
NIC #1
Ethernet
LAN
NIC #2
MultiPath
LAN
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
Subnet B Subnet A
LAN #2
LAN #1
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS5
one switch configuration
MultiPath
Subnet B
Subnet A
PRIMERGY XXX
internal disks
for
SYSTEM,...
NIC #1
Ethernet
LAN
NIC #2
MultiPath
LAN
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
Subnet B Subnet A
! not recommended !
Switch is single point of failure
LAN
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS6
direct attached
MultiPath
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
LAN
Subnet B
Subnet A
PRIMERGY XXX
internal disks
for
SYSTEM,...
NIC #1
Ethernet
LAN
MultiPath
NIC #2
Subnet B Subnet A
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS7
Tips and Tricks
General Recommendations for MultiPath
IPv4 should be selected (IPv6 not supported)
Do not establish multiple connections to one target before MultiPath installation
For iSCSI boot "spanning tree" must be disabled at the boot NIC's switch port
Check presence and status of all MultiPath Groups
MultiPath status must show Active / Standby
Check Acknowledge Configuration to enable the monitoring of missing paths
MultiPath
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS9
DuplexWrite mirrors Data
DuplexWrite
original
mirror
FC CXxxx
Storage Array
PRIMERGY
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS10
Diskload Balancing Option
DuplexWrite
block# > boundary
block# < boundary
Diskload Balancing Algorithm:
read channel depends on block number
boundary dynamically adjusted
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS11
direct attached
DuplexWrite
P0 P1
1st RAID
Disk Array
Controller
Cntrl A
FibreCAT CXxxx iSCSI
P0 P1
1st RAID
Disk Array
Controller
Cntrl A
FibreCAT CXxxx iSCSI
LAN
PRIMERGY XXX
internal disks
for
SYSTEM,...
NIC #1
Ethernet
LAN
MultiPath
NIC #2
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS12
one switch configuration
DuplexWrite
P0 P1
1st RAID
Disk Array
Controller
Cntrl A
FibreCAT CXxxx iSCSI
P0 P1
1st RAID
Disk Array
Controller
Cntrl A
FibreCAT CXxxx iSCSI
LAN
PRIMERGY XXX
internal disks
for
SYSTEM,...
NIC #1
Ethernet
LAN
MultiPath
LAN
! not recommended !
Switch is single point of failure
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS13
Tips and Tricks
General Recommendations for DuplexWrite
IPv4 should be selected (IPv6 not supported)
For iSCSI boot "spanning tree" must be disabled at the boot NIC's switch port
Configure DuplexWrite first
Install DDM
Build all DuplexWrite groups and start recovery
...configure your system and applications
Check presence and status of all DuplexWrite groups
DuplexWrite status must show Online for all (partner) disks
Be careful using Disk Administrator
Never delete a COD partition, delete DuplexWrite group first
DuplexWrite
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS14
DuplexDataManager
Highest Storage Availability by DuplexWrite & MultiPath
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS15
DuplexWrite & MultiPath
DuplexDataManager
Location1 Location2
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS16
standard configuration
DuplexWrite & MultiPath
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
LAN
PRIMERGY XXX
internal disks
for
SYSTEM,...
NIC #1
Ethernet
LAN
MultiPath
NIC #2Subnet B
Subnet A
LAN #2
LAN #1
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS17
reduced connection costs (partial MultiPath)
DuplexWrite & MultiPath
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
LAN
PRIMERGY XXX
internal disks
for
SYSTEM,...
NIC #1
Ethernet
LAN
MultiPath
NIC #2Subnet B
Subnet A
LAN #2
LAN #1
! not recommended !
No failover when host attached
LAN connection breaks
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS19
MS Cluster & DuplexWrite & MultiPath
Disaster Resilient Solution
Location1 Location2
Cluster Interconnect
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS20
MS Cluster handles Server Redundancy
Disaster Resilient Solution
Location1 Location2
Cluster Interconnect
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS21
MultiPath handles Path Redundancy
Disaster Resilient Solution
Location1 Location2
Cluster Interconnect
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS22
DuplexWrite mirrors Data
Disaster Resilient Solution
Location1 Location2
Cluster Interconnect
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS23
standard configuration
MS Cluster & MultiPath
Subnet B
Subnet A
PRIMERGY XXX
internal disks
for
SYSTEM,...
NIC #1
Ethernet
LAN
NIC #2
MultiPath
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
Subnet A
LAN
PRIMERGY XXX
internal disks
for
SYSTEM,...
Ethernet
LAN
ScsiPort2NIC #1
NIC #2
MultiPath
Subnet B
LAN #2
LAN #1
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS24
standard configuration
MS Cluster & DuplexWrite & MultiPath
Subnet B
Subnet A
PRIMERGY XXX
internal disks
for
SYSTEM,...
NIC #1
Ethernet
LAN
NIC #2
MultiPath
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
Subnet A
LAN
PRIMERGY XXX
internal disks
for
SYSTEM,...
Ethernet
LAN
ScsiPort2NIC #1
NIC #2
MultiPath
Subnet B
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
LAN #2
LAN #1
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS25
using switch interconnects
MS Cluster & DuplexWrite & MultiPath
Subnet B
Subnet A
PRIMERGY XXX
internal disks
for
SYSTEM,...
NIC #1
Ethernet
LAN
NIC #2
MultiPath
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
Subnet B
LAN
PRIMERGY XXX
internal disks
for
SYSTEM,...
Ethernet
LAN
ScsiPort2NIC #1
NIC #2
MultiPath
Subnet A
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
LAN #2.1
LAN #1.1
LAN #2.2
LAN #1.2
switch
interconn.
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS26
2 switch solution
MS Cluster & DuplexWrite & MultiPath
Subnet B
Subnet A
PRIMERGY XXX
internal disks
for
SYSTEM,...
NIC #1
Ethernet
LAN
NIC #2
MultiPath
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
Subnet A
LAN
PRIMERGY XXX
internal disks
for
SYSTEM,...
Ethernet
LAN
ScsiPort2NIC #1
NIC #2
MultiPath
Subnet B
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
switch
interconn.
! configuration not recommended !
switch failure would cause outage of
the dedicated storage
Subnet A/B Subnet A/B
LAN #1/2 LAN #1/2
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS27
! Avoid Split Brain Situations !
DuplexDataManager
Subnet B
Subnet A
PRIMERGY XXX
internal disks
for
SYSTEM,...
NIC #1
Ethernet
LAN
NIC #2
MultiPath
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
Subnet B
LAN
PRIMERGY XXX
internal disks
for
SYSTEM,...
Ethernet
LAN
ScsiPort2NIC #1
NIC #2
MultiPath
Subnet A
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
LAN #2.1
LAN #1.1
LAN #2.2
LAN #1.2
single point of failure
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS28
Bringup nodeA, and nodeB separately (use ServerStart) Install Windows Server 2003 including latest update & hotfixes
Install DuplexDataManager on all nodes
Install and configure all LAN connections Configure NICs and switches
Configure the iSCSI SW target
Configure the Storages Shut down all but nodeA
Configure LUNs pairwise on both storages (DuplexWrite groups)
Register all nodes for each path
Create DuplexWrite groups Shut down all but nodeA
Create all DuplexWrite groups on storageA (no mirror disks)
Add second disks at storageB and start recover
Reboot this node (nodeA)
Install Microsoft Cluster Services Install MSCS on nodeA (nodeB off)
Install MSCS on nodeB (cluster installation - join)
Check DDM and cluster functionality
Setting up MS Cluster & DDM (WS 2003)
Prim Prim
Prim Prim
Prim Prim
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS29
Bringup all nodes separately (use ServerStart) Install Windows Server 2008 including latest update & hotfixes
Install DuplexDataManager on all nodes
Install and configure all LAN connections Configure NICs and switches
Configure the iSCSI SW target
Configure the Storages Configure LUNs pairwise on both storages (DuplexWrite groups)
Register all nodes for each path
Create DuplexWrite groups Shut down all but one node
Create all DuplexWrite groups
Add second disks (do not start recover, status is Online - Error)
Reboot this node, start all other nodes
Add the feature Failover Clustering Start the Failover Cluster Management, select Validate a Configuration
Evaluate the cluster validation log (do not proceed until it is error free)
Create the Failover Cluster Recover all DuplexWrite groups on the node which owns the disk resource
Create all partitions on the cluster disk resources (DuplexWrite groups)
Acknowledge the MultiPath configuration on all nodes
If all DuplexWrite groups are Online test the functionality(e.g. Path failover, moving resources to other nodes, ... )
Install the Failover Clustering applications.
Setting up MS Cluster & DDM (WS 2008)
Prim Prim
Prim Prim
Prim Prim
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS30
Documentation General hint: read the related documents !
Contained on DDM-CD:
Readme
Online help ( newest / best reference ! )
Configuration slides
DDM related links:
DDM's home (Intranet)http://synergy.pdb.fsc.net/> DuplexDataManager
Partners (Corporate Extranet)https://partners.ts.fujitsu.com/com/products/servers/primergy/haproducts/> Product catalog > Server products > Industry standard > High availabiliy products
Online Manuals (Internet)http://manuals.ts.fujitsu.com/> Industry Standard Servers > Software > Select High Availability > Select PRIMERGY DuplexDataManager
PRIMERGY clustering and disaster tolerance (Internet)http://ts.fujitsu.com/products/software/cluster_technology/primergycluster.html> Business > Products > Software > High Availability > PRIMERGY cluster
DuplexDataManager updates (Internet)http://support.ts.fujitsu.com/com/support/index.html> SUPPORT > Driver & Downloads > Full text search Software; Search: DuplexDataManager, MultiPath or MPIO
PRIMERGY servers (Internet)http://ts.fujitsu.com/products/standard_servers/
Disk storage systems (Internet)http://ts.fujitsu.com/products/storage/disk/
MS Cluster documentation
DuplexDataManager
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS31
FibreCAT CX3-x0
Appendix
B Po
rt 0
Po
rt 1
A Po
rt 0
Po
rt 1
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
Copyright 2009 FUJITSU TECHNOLOGY SOLUTIONS32
FibreCAT CX4-120/240
Appendix
B
Port 0
Port 1
A
Port 0
Port 1
P0 P1 P0 P1
1st RAID
Disk Array
Controller
Cntrl A
2nd RAID
Disk Array
Controller
Cntrl B
FibreCAT CXxxx iSCSI
Top Related