Dell EMC Integrated Offerings Connectrix Business Unit€¢ Oversubscription – Bandwidth mismatch...
Transcript of Dell EMC Integrated Offerings Connectrix Business Unit€¢ Oversubscription – Bandwidth mismatch...
© Copyright 2017 Dell Inc. 3
Agenda • What’s new with storage connectivity
– Protocol adoption – Connectrix Product Updates
• Congestion Spreading and its impact – Congestion Spreading terminology – Congestion Spreading & Innocent flows
• SAN Best practices for All Flash Arrays (AFAs) • Introduction to NVMe
– FC-NVMe
© Copyright 2017 Dell Inc. 4
How Customers Invest in Storage • FC and IP continue as primary options
2017
2021
Source: IDC WW Quarterly Disk Storage Systems Forecast, 03/17
WW External Storage Systems Market Revenue
$0
$2,000
$4,000
$6,000
$8,000
$10,000
$12,000
Fibre Channel &HCI
EthernetFile/Object
Ethernet Block DAS FICON Other
$s M
illio
ns
© Copyright 2017 Dell Inc. 5
How Customers Invest in Storage • FC and IP continue as primary options
2017
2021
Source: IDC WW Quarterly Disk Storage Systems Forecast, 03/17
WW External Storage Systems Market Revenue
$0
$2,000
$4,000
$6,000
$8,000
$10,000
$12,000
Fibre Channel &HCI
EthernetFile/Object
Ethernet Block DAS FICON Other
$s M
illio
ns
© Copyright 2017 Dell Inc. 6
Agenda • What’s new with storage connectivity
– Protocol adoption – Connectrix Product Updates
• Congestion Spreading and its impact – Congestion Spreading terminology – Congestion Spreading & Innocent flows
• SAN Best practices for All Flash Arrays (AFAs)
• Introduction to NVMe – FC-NVMe
© Copyright 2017 Dell Inc. 7
Connectrix B-Series Updates
Mgmt
FW
HW
Q1 2017
Q2 2017
Q2 2016
FOS 7.4.1e FOS 8.0.0
Connectrix Manager
v14.2
FOS 8.1.0a
FOS 8.0.1b
FOS 7.4.1d (T)
Connectrix Manager v14.0.1
Connectrix Manager
v14.0
48 SFP+ Port Blades (4,8,16,32G) 32- 128Gb/s ICL ports
FCIP Blade (32Gb/s FC, two 40GiE
NOS 6.02c
ED-DCX6-8/4B DS-6610B
24 SFP+ Ports (4,8,16,32G)
FOS 8.0.2b FOS 8.0.1a
Q3 2016
© Copyright 2017 Dell Inc. 8
Connectrix B-Series Updates
Mgmt
FW
HW
Q1 2017
Q2 2017
Q3 2016
Q2 2016
FOS 7.4.1e FOS 8.0.0
Connectrix Manager
v14.2
FOS 8.1.0a
FOS 8.0.1b
FOS 7.4.1d (T)
Connectrix Manager v14.0.1
Connectrix Manager
v14.0
48 SFP+ Port Blades (4,8,16,32G) 32- 128Gb/s ICL ports
FCIP Blade (32Gb/s FC, two 40GiE
NOS 6.02c
ED-DCX6-8/4B DS-6610B
24 SFP+ Ports (4,8,16,32G)
FOS 8.0.2b FOS 8.0.1a
© Copyright 2017 Dell Inc. 9
Connectrix B-Series Updates
Mgmt
FW
HW
Q1 2017
Q2 2017
Q3 2016
Q2 2016
FOS 7.4.1e FOS 8.0.0
Connectrix Manager
v14.2
FOS 8.1.0a
FOS 8.0.1b
FOS 7.4.1d (T)
Connectrix Manager v14.0.1
Connectrix Manager
v14.0
48 SFP+ Port Blades (4,8,16,32G) 32- 128Gb/s ICL ports
FCIP Blade (32Gb/s FC, two 40GiE
NOS 6.02c
ED-DCX6-8/4B DS-6610B
24 SFP+ Ports (4,8,16,32G)
FOS 8.0.2b FOS 8.0.1a
© Copyright 2017 Dell Inc. 10
Connectrix MDS-Series Updates
Mgmt
FW
HW
Q1 2017
Q2 2017
Q3 2016
Q2 2016
NX-OS 6.2.11e (FICON) NX-OS 6.2.(15)
DCNM V10.1.2
NX-OS 7.3(1)DY(1) NX-OS 7.3(0)DY(1)
DCNM V10.0.1
DCNM v7.2.3
NX-OS 7.3(0)D1(1)
DCNM V10.1.1
Q4 2016
DS-9648-1536k9
48 SFP+ Ports (4,8,16,32G)
© Copyright 2017 Dell Inc. 11
Connectrix MDS-Series Updates
Mgmt
FW
HW
Q1 2017
Q2 2017
Q3 2016
Q2 2016
NX-OS 6.2.11e (FICON) NX-OS 6.2.(15)
DCNM V10.1.2
NX-OS 7.3(1)DY(1) NX-OS 7.3(0)DY(1)
DCNM V10.0.1
DCNM v7.2.3
NX-OS 7.3(0)D1(1)
DCNM V10.1.1
Q4 2016
DS-9648-1536k9
48 SFP+ Ports (4,8,16,32G)
© Copyright 2017 Dell Inc. 13
Agenda • What’s new with storage connectivity
– Protocol adoption – Connectrix Product Updates
• Congestion Spreading and its impact – Congestion Spreading terminology – Congestion Spreading & Innocent flows
• SAN Best practices for All Flash Arrays (AFAs)
• Introduction to NVMe – FC-NVMe
© Copyright 2017 Dell Inc. 15
Congestion • Oversubscription
– Bandwidth mismatch › Speed mismatch (e.g. 16G to 4G) › Fan-in mismatch (e.g. 8-port to 1-port)
Source: Brocade Communications Systems Source: Cisco Systems
© Copyright 2017 Dell Inc. 16
Congestion • Oversubscription
– Bandwidth mismatch › Speed mismatch (e.g. 16G to 4G) › Fan-in mismatch (e.g. 8-port to 1-port)
• Misbehaving Devices (Slow Drain) – Brocade: Misbehaving Devices
› Credit stall (i.e. device induced credit latency) – Cisco: B2B credit starvation
› Slow Port › Stuck Port
Source: Brocade Communications Systems Source: Cisco Systems
© Copyright 2017 Dell Inc. 17
Congestion • Oversubscription
– Bandwidth mismatch › Speed mismatch (e.g. 16G to 4G) › Fan-in mismatch (e.g. 8-port to 1-port)
• Misbehaving Devices (Slow Drain) – Brocade: Misbehaving Devices
› Credit stall (i.e. device induced credit latency) – Cisco: B2B credit starvation
› Slow Port › Stuck Port
• Lost Credit – Physical errors
Source: Brocade Communications Systems Source: Cisco Systems
© Copyright 2017 Dell Inc. 18
Physical Errors
• 98% of network installation professionals reported connector/cable contamination was the greatest cause of network failure (Source: NTT-Advanced Technology)
• 83% of replaced optics were not actually faulty (Source: Dell EMC)
© Copyright 2017 Dell Inc. 19
John Ford [email protected]
Tuesday at 4:10pm and Wednesday at
12:50pm@ Brocade Booth
Wednesday at 4-5pm @ Customer Service Booth
© Copyright 2017 Dell Inc. 20
Metrics • Credit Latency
– Time at zero credit – Amount of time frames are waiting to be
transmitted › Credit Latency counters track the cumulative time
frames wait for credit when ready for transmission › Credit Latency monitors typically look for average
delay times over varying periods to capture delay spikes, repetitive delays, or sustained delays
Source: Brocade Communications Systems Source: Cisco Systems
© Copyright 2017 Dell Inc. 21
Metrics • Credit Latency
– Time at zero credit – Amount of time frames are waiting to be
transmitted › Credit Latency counters track the cumulative time
frames wait for credit when ready for transmission › Credit Latency monitors typically look for average
delay times over varying periods to capture delay spikes, repetitive delays, or sustained delays
• Brocade: Queue Latency – Transmit queue latency – Amount of time a frame is queued for
transmission until it is transmitted › i.e. the time a frames takes to move from the bottom
to the top of the transmit queue plus transmission time
Source: Brocade Communications Systems Source: Cisco Systems
© Copyright 2017 Dell Inc. 22
Metrics • Credit Latency
– Time at zero credit – Amount of time frames are waiting to be
transmitted › Credit Latency counters track the cumulative time
frames wait for credit when ready for transmission › Credit Latency monitors typically look for average
delay times over varying periods to capture delay spikes, repetitive delays, or sustained delays
• Brocade: Queue Latency – Transmit queue latency – Amount of time a frame is queued for
transmission until it is transmitted › i.e. the time a frames takes to move from the bottom
to the top of the transmit queue plus transmission time
• Bandwidth Utilization – Percent utilization – Average amount of link capacity used
Source: Brocade Communications Systems Source: Cisco Systems
© Copyright 2017 Dell Inc. 23
Metrics • Credit Latency
– Time at zero credit – Amount of time frames are waiting to be
transmitted › Credit Latency counters track the cumulative time
frames wait for credit when ready for transmission › Credit Latency monitors typically look for average
delay times over varying periods to capture delay spikes, repetitive delays, or sustained delays
• Brocade: Queue Latency – Transmit queue latency – Amount of time a frame is queued for
transmission until it is transmitted › i.e. the time a frames takes to move from the bottom
to the top of the transmit queue plus transmission time
• Bandwidth Utilization – Percent utilization – Average amount of link capacity used
• Frame Loss – Discarded frame count – Brocade: Count of frame discarded due to
transmission hold time timeout (220ms to 500ms)
– Cisco: Frames discard due to congestion drop (500ms) or no-credit drop timeout
Source: Brocade Communications Systems Source: Cisco Systems
© Copyright 2017 Dell Inc. 24
Metrics • Credit Latency
– Time at zero credit – Amount of time frames are waiting to be
transmitted › Credit Latency counters track the cumulative time
frames wait for credit when ready for transmission › Credit Latency monitors typically look for average
delay times over varying periods to capture delay spikes, repetitive delays, or sustained delays
• Brocade: Queue Latency – Transmit queue latency – Amount of time a frame is queued for
transmission until it is transmitted › i.e. the time a frames takes to move from the bottom
to the top of the transmit queue plus transmission time
• Bandwidth Utilization – Percent utilization – Average amount of link capacity used
• Frame Loss – Discarded frame count – Brocade: Count of frame discarded due to
transmission hold time timeout (220ms to 500ms)
– Cisco: Frames discard due to congestion drop (500ms) or no-credit drop timeout
• Link Reset – Link reset count – Brocade: Number of times credit has not been
returned for 2-seconds – Cisco: Number of times when credits were zero
for 1 second on F_port and 1.5 seconds on E_port
Source: Brocade Communications Systems Source: Cisco Systems
© Copyright 2017 Dell Inc. 25
Brocade Severity • Mild
– Small credit delay – Brocade only Small queue latency (less than 10ms) – No frame loss (discards) or link resets
Source: Brocade Communications Systems
© Copyright 2017 Dell Inc. 26
Brocade Severity • Mild
– Small credit delay – Brocade only Small queue latency (less than 10ms) – No frame loss (discards) or link resets
• Moderate – Medium credit delay – Brocade only Medium queue latency (10ms – 80ms) – No frame loss (discards), but no link resets
Source: Brocade Communications Systems
© Copyright 2017 Dell Inc. 27
Brocade Severity • Mild
– Small credit delay – Brocade only Small queue latency (less than 10ms) – No frame loss (discards) or link resets
• Moderate – Medium credit delay – Brocade only Medium queue latency (10ms – 80ms) – No frame loss (discards), but no link resets
• Severe – Large credit delay – Brocade only Large queue latency (greater than 80ms) – Frame loss (discards) and some link resets
Source: Brocade Communications Systems
© Copyright 2017 Dell Inc. 28
Cisco Severity • Level – 1 : Latency
• Reduced number of remaining credits or small duration of credit unavailability • No discards, retransmission or link resets
Source: Cisco Systems
* Default configuration: congestion-drop timeout – 500ms, no-credit-drop timeout – off Configurable option: congestion-drop timeout – 100 - 500ms, no-credit-drop timeout – 1 – 500 ms Recommended configuration: congestion-drop timeout – 200ms, no-credit-drop timeout – 50 ms
© Copyright 2017 Dell Inc. 29
Cisco Severity • Level – 1 : Latency
• Reduced number of remaining credits or small duration of credit unavailability • No discards, retransmission or link resets
• Level – 2 : Retransmission • Longer duration of credit unavailability • Frames are discarded (but no link reset) due to congestion-drop timeout or no-
credit-drop timeout* leading to retransmission.
Source: Cisco Systems
* Default configuration: congestion-drop timeout – 500ms, no-credit-drop timeout – off Configurable option: congestion-drop timeout – 100 - 500ms, no-credit-drop timeout – 1 – 500 ms Recommended configuration: congestion-drop timeout – 200ms, no-credit-drop timeout – 50 ms
© Copyright 2017 Dell Inc. 30
Cisco Severity • Level – 1 : Latency
• Reduced number of remaining credits or small duration of credit unavailability • No discards, retransmission or link resets
• Level – 2 : Retransmission • Longer duration of credit unavailability • Frames are discarded (but no link reset) due to congestion-drop timeout or no-
credit-drop timeout* leading to retransmission.
• Level – 3 : Extreme delay • Prolonged duration of credit unavailability (1 sec for F-port, 1.5 sec for E-port) • Link resets or port flaps
Source: Cisco Systems
* Default configuration: congestion-drop timeout – 500ms, no-credit-drop timeout – off Configurable option: congestion-drop timeout – 100 - 500ms, no-credit-drop timeout – 1 – 500 ms Recommended configuration: congestion-drop timeout – 200ms, no-credit-drop timeout – 50 ms
© Copyright 2017 Dell Inc. 31
Brocade Terminology Cross Reference
Source: Brocade Communications Systems
Cause Mild Moderate Severe Oversubscription1 1. High Bandwidth at the device port.
2. Small Credit Latency at the ISL port. 3. Less than 10ms Queue Latency at
the ISL port. 4. No Frame Loss or Link Resets.
1. High Bandwidth at the device port. 2. Medium Credit Latency at the ISL port. 3. Between 10m to 80ms Queue Latency at
the ISL port. 4. No Frame Loss or Link Resets.
1. High Bandwidth at the device port. 2. Large Credit Latency at the ISL port. 3. Greater than 80ms Queue Latency at the ISL port. 4. Frame Loss at an upstream (ISL) port (indicates
Queue Latency of 220ms-500ms). 5. No Link Resets.
Misbehaving Device
1. Small Credit Latency at the device port and upstream ISL port.
2. Less than 10ms Queue Latency at the device port and upstream ISL port.
3. No Frame Loss or Link Resets.
1. Medium Credit Latency at the device port and upstream ISL port.
2. Between 10ms to 80ms Queue Latency at the device port and upstream ISL port.
3. No Frame Loss or Link Resets.
1. Large Credit Latency at the device port and upstream ISL port.
2. Greater than 80ms Queue Latency at the device port and upstream ISL port.
3. Frame Loss at device or upstream (ISL) port (indicates Queue Latency of 220ms-500ms).
4. Link Reset at an ISL port (indicates credit stall for more than 2s).
Lost Credit2 1. Small Credit Latency at the port. 2. Less than 10ms Queue Latency at
the port or upstream from the port. 3. No Frame Loss or Link Resets.
1. Medium Credit Latency at the port. 2. Between 10ms to 80ms Queue Latency
at the port or upstream from the port. 3. No Frame Loss or Link Resets.
1. Large Credit Latency at the port. 2. Greater than 80ms Queue Latency at the port or
upstream from the port. 3. Frame Loss at the port or upstream from the port
(indicates credit stall for 220ms-500ms). 4. Link Reset at the port or upstream from the port
(indicates credit stall for more than 2s).
1 Severe congestion due to oversubscription is a rare to extremely rare occurrence. 2 Causes for Lost Credit are typically transmission errors such as ITW, CRC, or other signal related problems.
© Copyright 2017 Dell Inc. 32
Cisco Terminology Cross Reference
Source: Cisco Systems
Congestion type Level – 1 : Latency Level – 2 : Retransmission Level – 3 : Extreme delay
Oversubscription 1. High link utilization at the end-device port.
2. No B2B credit starvation at the end-device port
3. Congestion spreading towards the ISLs
4. No Frame Loss or Link Resets.
Retransmission or Extreme delay due to oversubscription is a rare to extremely rare occurrence.
Credit Starvation 1. Low link utilization at the end-device port
2. Reduced number of remaining credits or small duration of credit unavailability
3. Congestion spreading towards ISLs 4. No discards, retransmission or link
resets
1. Low link utilization at the end-device port
2. Longer duration of credit unavailability
3. Congestion spreading towards ISLs. 4. Frames are discarded (but no link
reset) due to congestion-drop timeout or no-credit-drop timeout* leading to retransmission.
1. No frames are transmitted to the end-device.
2. Prolonged duration of credit unavailability (1 sec for F-port, 1.5 sec for E-port)
3. Severe congestion towards ISLs 4. Link resets or port flaps
* Default configuration: congestion-drop timeout – 500ms, no-credit-drop timeout – off Configurable option: congestion-drop timeout – 100 - 500ms, no-credit-drop timeout – 1 – 500 ms Recommended configuration: congestion-drop timeout – 200ms, no-credit-drop timeout – 50 ms
© Copyright 2017 Dell Inc. 33
Agenda • What’s new with storage connectivity
– Protocol adoption – Connectrix Product Updates
• Congestion Spreading and its impact – Congestion Spreading terminology – Congestion Spreading & Innocent flows
• SAN Best practices for All Flash Arrays (AFAs)
• Introduction to NVMe – FC-NVMe
© Copyright 2017 Dell Inc. 37
Host 1
Switch 1 Switch 24G
32G16G
Storage Group 1
Congestion Spreading
© Copyright 2017 Dell Inc. 38
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16GStorage Group 1
Congestion Spreading
© Copyright 2017 Dell Inc. 39
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
© Copyright 2017 Dell Inc. 40
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
© Copyright 2017 Dell Inc. 41
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
© Copyright 2017 Dell Inc. 42
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
32G16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
© Copyright 2017 Dell Inc. 43
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G
16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
Large Block Read Request
© Copyright 2017 Dell Inc. 44
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16GStorage Group 1
Storage Group 2
Congestion Spreading
© Copyright 2017 Dell Inc. 45
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16GStorage Group 1
Storage Group 2
Congestion Spreading
16Gb/s of Data
© Copyright 2017 Dell Inc. 46
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G
16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
Read Response
16Gb/s of Data
© Copyright 2017 Dell Inc. 47
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
32G16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
16Gb/s of data
© Copyright 2017 Dell Inc. 48
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
Host @ Full Line Rate Of 16Gb/s
© Copyright 2017 Dell Inc. 49
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 216G
32G16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
Host @ Full Line Rate Of 16Gb/s
© Copyright 2017 Dell Inc. 50
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G
16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
Host @ Full Line Rate Of 16Gb/s
Large Block Read
Request
© Copyright 2017 Dell Inc. 51
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
Host @ Full Line Rate Of 16Gb/s
© Copyright 2017 Dell Inc. 52
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
Host @ Full Line Rate Of 16Gb/s
16Gb/s of Data
© Copyright 2017 Dell Inc. 53
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G
16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
Host @ Full Line Rate Of 16Gb/s
Read Response
16Gb/s of Data
© Copyright 2017 Dell Inc. 54
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 216G
32G16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
Host @ Full Line Rate Of 16Gb/s
© Copyright 2017 Dell Inc. 55
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 216G
32G16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
Host @ Full Line Rate Of 16Gb/s
Host can only handle 4Gb/s of data
© Copyright 2017 Dell Inc. 56
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G
16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
Host @ Full Line Rate Of 16Gb/s
Outstanding I/Os for host 1 start to queue
Read Response
© Copyright 2017 Dell Inc. 57
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G
16G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
Outstanding I/Os for host 1 start to queue
Read Response
Less BW for host 2
Read Response
© Copyright 2017 Dell Inc. 58
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
Storage Group 1
Storage Group 2
Congestion Spreading
BW drops to 4Gb/s of Data
© Copyright 2017 Dell Inc. 59
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
Storage Group 1
Storage Group 2
Congestion Spreading
BW drops to 4Gb/s of Data
BW drops to 4Gb/s of Data
© Copyright 2017 Dell Inc. 60
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
Storage Group 1
Storage Group 2
Congestion Spreading
BW drops to 4Gb/s of Data
BW drops to 4Gb/s of Data
Congested ISL Ratio >~0.5
© Copyright 2017 Dell Inc. 61
Lost Credit Slow Drain
Thanks to Dell EMC E-lab for testing and results!
© Copyright 2017 Dell Inc. 62
Lost Credit Slow Drain
Thanks to Dell EMC E-lab for testing and results!
© Copyright 2017 Dell Inc. 63
Lost Credit Slow Drain
Thanks to Dell EMC E-lab for testing and results!
© Copyright 2017 Dell Inc. 64
Lost Credit Slow Drain
Thanks to Dell EMC E-lab for testing and results!
© Copyright 2017 Dell Inc. 65
Lost Credit Slow Drain
Thanks to Dell EMC E-lab for testing and results!
Performance impact when BB_Credit is 5 or
less.
© Copyright 2017 Dell Inc. 66
Lost Credit Slow Drain
Thanks to Dell EMC E-lab for testing and Results!
C Ratio = Time at zero BB_Credit
Frames transmitted
© Copyright 2017 Dell Inc. 67
Lost Credit Slow Drain
Thanks to Dell EMC E-lab for testing and Results!
Time at zero BB_Credit Frames transmitted
Less than .01
C Ratio =
© Copyright 2017 Dell Inc. 68
Lost Credit Slow Drain
Thanks to Dell EMC E-lab for testing and Results!
Time at zero BB_Credit Frames transmitted
Less than .01
.01 - .2 C Ratio =
© Copyright 2017 Dell Inc. 69
Lost Credit Slow Drain
Thanks to Dell EMC E-lab for testing and Results!
Time at zero BB_Credit Frames transmitted
Less than .01
Greater Than .2
.01 - .2 C Ratio =
© Copyright 2017 Dell Inc. 70
Lost Credit Slow Drain
Thanks to Dell EMC E-lab for testing and Results!
Time at zero BB_Credit Frames transmitted
Less than .01
Greater Than .2
.01 - .2 C Ratio =
© Copyright 2017 Dell Inc. 71
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
Storage Group 1
Storage Group 2
Congestion Spreading
Host @ ¼ of Line Rate 4Gb/s
BW drops to 4Gb/s of Data
BW drops to 4Gb/s of Data
Congested ISL Ratio >~0.5
© Copyright 2017 Dell Inc. 72
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
Storage Group 1
Storage Group 2
Congestion Spreading
Host @ ¼ of Line Rate 4Gb/s
BW drops to 4Gb/s of Data
BW drops to 4Gb/s of Data
Congested ISL Ratio >~0.5
© Copyright 2017 Dell Inc. 73
Agenda • What’s new with storage connectivity
– Protocol adoption – Connectrix Product Updates
• Congestion Spreading and its impact – Congestion Spreading terminology – Congestion Spreading & Innocent flows
• SAN Best practices for All Flash Arrays (AFAs)
• Introduction to NVMe – FC-NVMe
© Copyright 2017 Dell Inc. 78
Congestion Spreading Avoidance
Short Term
(today)
Medium term
Long term
© Copyright 2017 Dell Inc. 79
Congestion Spreading Avoidance
Prevention
Short Term
(today)
Medium term
Long term
© Copyright 2017 Dell Inc. 80
Congestion Spreading Avoidance
Prevention Detection
Short Term
(today)
Medium term
Long term
© Copyright 2017 Dell Inc. 81
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
Medium term
Long term
© Copyright 2017 Dell Inc. 82
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio
Medium term
Long term
© Copyright 2017 Dell Inc. 83
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
16G
Storage Group 1
Storage Group 2
BW Ratio (example 1)
© Copyright 2017 Dell Inc. 84
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
16G
Storage Group 1
Storage Group 2
BW Ratio (example 1)
© Copyright 2017 Dell Inc. 85
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
16G
Storage Group 1
Storage Group 2
BW Ratio (example 1)
© Copyright 2017 Dell Inc. 86
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
16G
Storage Group 1
Storage Group 2
1:1 (Good)
BW Ratio (example 1)
© Copyright 2017 Dell Inc. 87
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
16G
Storage Group 1
Storage Group 2
1:1 (Good)
1:4 (Warning)
BW Ratio (example 1)
© Copyright 2017 Dell Inc. 88
Zone 1
Host Switch 1 Switch 216G 32G8G
8G
Storage Group 18G
BW Ratio (example 2)
© Copyright 2017 Dell Inc. 89
Zone 1
2:3 (Warning)
Host Switch 1 Switch 216G 32G8G
8G
Storage Group 18G
BW Ratio (example 2)
© Copyright 2017 Dell Inc. 90
Zone 1
Host Switch 1 Switch 232G 16G8G
8G
Storage Group 18G
BW Ratio (example 3)
© Copyright 2017 Dell Inc. 91
Zone 1
Host Switch 1 Switch 232G 16G8G
8G
Storage Group 18G
2:3 (Warning)
BW Ratio (example 3)
© Copyright 2017 Dell Inc. 92
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN
Medium term
Long term
© Copyright 2017 Dell Inc. 93
Zone 1
Host Switch 1 Switch 232G 32G16G
16G
Storage Group 1
Modernize
• Zero oversubscription (from end-to-end) is impractical in larger environments • Focus on upgrading specific host, switch and storage connectivity
© Copyright 2017 Dell Inc. 94
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio
Medium term
Long term
© Copyright 2017 Dell Inc. 95
Zone 1
2:3 (Warning)
Host Switch 1 Switch 216G 32G8G
8G
Storage Group 18G
BW Ratio (example 2)
© Copyright 2017 Dell Inc. 96
Zone 1 Host Switch 1 Switch 216G 32G
8G
8G
Storage Group 18G
BW Ratio (example 2)
1:1 (Good)
© Copyright 2017 Dell Inc. 97
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits
Medium term
Long term
© Copyright 2017 Dell Inc. 98
• Apply a BW Limit to a Storage Group or LUN • This approach works well when you need to limit BW to a single host.
Host 14Gbps
4
4
Host 28Gbps
8
8
Switch 1A
4
81616
Switch 2A
161616
16
16
Storage Pool 1800 MB/s BW limit
Storage Pool 21600 MB/s
BW limit
Switch 1B
4
81616
Switch 2B
161616
400
800
400
800
SAN A
SAN B
BW Limit (example 1)
© Copyright 2017 Dell Inc. 99
Host 14Gbps
4
4
Host 24Gbps
4
4
Switch 1A
4
41616
Switch 2A
161616
16
16
Storage Pool 11600 MB/s
BW limit
Switch 1B
4
41616
Switch 2B
161616
800
800
SAN A
SAN B
BW Limit (example 2)
• But since the limit is applied to the SG or LUN, this becomes a problem when you have more than one host accessing it.
• The problem is, nothing prevents a single HBA from consuming all 800 MB/s
© Copyright 2017 Dell Inc. 100
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits • Isolation
Medium term
Long term
© Copyright 2017 Dell Inc. 101
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
16G
Storage Group 1
Storage Group 2
1:1 (Good)
1:4 (Warning)
BW Ratio (example 1)
© Copyright 2017 Dell Inc. 102
VSAN (VF) 200
VSAN (VF) 100
Host 1
Host 2
Switch Switch4G
16G
32G 16G
16G
Storage Group 1
Storage Group 2
32G
1:1 (Good)
1:4 (Warning)
Isolation
© Copyright 2017 Dell Inc. 103
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits • Isolation
• Ratio: bb_credit Zero(or TxWait) /tx frames
Medium term
Long term
© Copyright 2017 Dell Inc. 104
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits • Isolation
• Ratio: bb_credit Zero(or TxWait) /tx frames
• Brocade FPI/MAPS
Medium term
Long term
© Copyright 2017 Dell Inc. 105
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
16G
Storage Group 1
Storage Group 2
Brocade MAPS
>90% TX util BB credit zero
© Copyright 2017 Dell Inc. 107
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits • Isolation
• Ratio: bb_credit Zero(or TxWait) /tx frames
• Brocade FPI/MAPS
• Cisco Port Monitor
Medium term
Long term
© Copyright 2017 Dell Inc. 108
Zone 2
Zone 1
Host 1
Host 2
Switch 1 Switch 24G
16G32G
16G
16G
Storage Group 1
Storage Group 2
Cisco Port Monitoring
TX Datarate TxWait
© Copyright 2017 Dell Inc. 110
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits • Isolation
• Ratio: bb_credit Zero(or TxWait) /tx frames
• Brocade MAPS • Cisco Port
Monitor
• Congestion Spreading KB
Medium term
Long term
© Copyright 2017 Dell Inc. 111
SAN Performance issues KB 464206
Brocade?
Cisco?
Known issue?
BrocadeKB 334849
CiscoKB 334854
N Slow Drain?
Y
Y
Y
Congestion Spreading
known issues KB 464232
Bit Errors and their impact
KB 464245
Perform Known issue remediation
stepsY
Cable hygiene KB 472306
Oversubscription KB 464241
Perform cable maintenance / swap
optic.
Problem fixed?
Link Appropriate KB and Close Case
Was issue preventable?
Prevention KB 464214
Not a SAN issue move case to
appropriate team
Y
N
• Recommend a temporary workaround if possible
• Refer case to the Customers Account team perhaps this is an opportunity?
Bit Errors?
Oversub or design issue?
Y
Y
Y
N
N
Switch Issue?
Create/Link KB, Escalate to vendor and notify [email protected]
Y
Data CollectionKB 464210
N
Any SAN anomalies?N
Y N
EMC end device
problem?N
Create/Link KB, Escalate to product Eng, notify [email protected]
Y
N
Create/link KB and notify [email protected]
Notify customer to work with
appropriate vendor
The Congestion Spreading Knowledge Map KB 464027
© Copyright 2017 Dell Inc. 112
Congestion Spreading Knowledge Map • Knowledge Map – KB 464027
– Summary of KB’s and how they’re related • Congestion Spreading overview – KB 464206
– Congestion Spreading types and how to detect them • Known Issues – KB 464232
– Emulex FW issue KB 464737: › LPe11000/11002 (4Gb FC HBA): firmware version 2.82x14 or above › LPe12000/12002 (8Gb FC HBA): firmware version 2.02a1 or above › Not an issue with 16G+ HBAs
– RecoverPoint FW issue: KB 453338 – Congestion Spreading due to lost credit: KB 464246
© Copyright 2017 Dell Inc. 113
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits • Isolation
• Ratio: bb_credit Zero(or TxWait) /tx frames
• Brocade FPI/MAPS
• Cisco Port Monitor
• Congestion Spreading KB
• Brocade SDDQ • Cisco Slow Drain
Virtual Link Isolation
Medium term
Long term
© Copyright 2017 Dell Inc. 114
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits • Isolation
• Ratio: bb_credit Zero(or TxWait) /tx frames
• Brocade FPI/MAPS
• Cisco Port Monitor
• Congestion Spreading KB
• Brocade SDDQ • Cisco Slow Drain
Virtual Link Isolation • Cisco no-credit-drop
Medium term
Long term
© Copyright 2017 Dell Inc. 115
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits • Isolation
• Ratio: bb_credit Zero(or TxWait) /tx frames
• Brocade FPI/MAPS
• Cisco Port Monitor
• Congestion Spreading KB
• Brocade SDDQ • Cisco Slow Drain
Virtual Link Isolation • Cisco no-credit-drop • Port fencing
Medium term
Long term
© Copyright 2017 Dell Inc. 116
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits • Isolation
• Ratio: bb_credit Zero(or TxWait) /tx frames
• Brocade FPI/MAPS
• Cisco Port Monitor
• Congestion Spreading KB
• Brocade SDDQ • Cisco Slow Drain
Virtual Link Isolation • Cisco no-credit-drop • Port fencing
Medium term
• BW Limit Enhancements
Long term
© Copyright 2017 Dell Inc. 117
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits • Isolation
• Ratio: bb_credit Zero(or TxWait) /tx frames
• Brocade FPI/MAPS
• Cisco Port Monitor
• Congestion Spreading KB
• Brocade SDDQ • Cisco Slow Drain
Virtual Link Isolation • Cisco no-credit-drop • Port fencing
Medium term
• BW Limit Enhancements
• ViPR-C
Long term
© Copyright 2017 Dell Inc. 118
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits • Isolation
• Ratio: bb_credit Zero(or TxWait) /tx frames
• Brocade FPI/MAPS
• Cisco Port Monitor
• Congestion Spreading KB
• Brocade SDDQ • Cisco Slow Drain
Virtual Link Isolation • Cisco no-credit-drop • Port fencing
Medium term
• BW Limit Enhancements
• ViPR-C
• ViPR-SRM
Long term
© Copyright 2017 Dell Inc. 119
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits • Isolation
• Ratio: bb_credit Zero(or TxWait) /tx frames
• Brocade FPI/MAPS
• Cisco Port Monitor
• Congestion Spreading KB
• Brocade SDDQ • Cisco Slow Drain
Virtual Link Isolation • Cisco no-credit-drop • Port fencing
Medium term
• BW Limit Enhancements
• ViPR-C
• ViPR-SRM • ViPR-SRM & ViPR-C
Long term
© Copyright 2017 Dell Inc. 120
Congestion Spreading Avoidance
Prevention Detection Remediation
Short Term
(today)
• BW Ratio • Modernize SAN • Fan-In/Out Ratio • BW Limits • Isolation
• Ratio: bb_credit Zero(or TxWait) /tx frames
• Brocade FPI/MAPS
• Cisco Port Monitor
• Congestion Spreading KB
• Brocade SDDQ • Cisco Slow Drain
Virtual Link Isolation • Cisco no-credit-drop • Port fencing
Medium term
• BW Limit Enhancements
• ViPR-C
• ViPR-SRM • ViPR-SRM & ViPR-C
Long term
Future Fibre Channel Enhancements (TBD)
© Copyright 2017 Dell Inc. 121
AGENDA • What’s new with storage connectivity
– Protocol adoption – Connectrix Product Updates
• Congestion Spreading and its impact – Congestion Spreading terminology – Congestion Spreading & Innocent flows
• SAN Best practices for All Flash Arrays (AFAs)
• Introduction to NVMe – FC-NVMe
© Copyright 2017 Dell Inc. 123
0 2 4 6 8 10 12
HDD
ms
HDD vs SDD
Read Time Transfer Time Misc SSD Link Transfer Platform & Adapter SoftwareSource: Intel Measurements Source: Jim Handy, SDC 2015 https://www.snia.org/sites/default/files/SDC15_presentations/gen_sessions/JimHandy_The_Long-Term_Future_PrintVersion.pdf
Time scale in milliseconds
© Copyright 2017 Dell Inc. 124
0 2 4 6 8 10 12
HDD
ms
HDD vs SDD
Read Time Transfer Time Misc SSD Link Transfer Platform & Adapter Software
Read Access time Tiny
Rainbow
Source: Intel Measurements Source: Jim Handy, SDC 2015 https://www.snia.org/sites/default/files/SDC15_presentations/gen_sessions/JimHandy_The_Long-Term_Future_PrintVersion.pdf
Time scale in milliseconds
© Copyright 2017 Dell Inc. 125
0 2 4 6 8 10 12
HDD
SSD
ms
HDD vs SDD
Read Time Transfer Time Misc SSD Link Transfer Platform & Adapter SoftwareSource: Intel Measurements Source: Jim Handy, SDC 2015 https://www.snia.org/sites/default/files/SDC15_presentations/gen_sessions/JimHandy_The_Long-Term_Future_PrintVersion.pdf
Time scale in milliseconds
© Copyright 2017 Dell Inc. 126
0 20 40 60 80 100 120
HDD
SSD
us
HDD vs SDD
Read Time Transfer Time Misc SSD Link Transfer Platform & Adapter SoftwareSource: Intel Measurements Source: Jim Handy, SDC 2015 https://www.snia.org/sites/default/files/SDC15_presentations/gen_sessions/JimHandy_The_Long-Term_Future_PrintVersion.pdf
Time scale in microseconds
© Copyright 2017 Dell Inc. 127
0 20 40 60 80 100 120
HDD
SSD
us
HDD vs SDD
Read Time Transfer Time Misc SSD Link Transfer Platform & Adapter Software
Transfer Time
Misc. SSD
Media Access Time
Platform & Adapter
Software
Source: Intel Measurements Source: Jim Handy, SDC 2015 https://www.snia.org/sites/default/files/SDC15_presentations/gen_sessions/JimHandy_The_Long-Term_Future_PrintVersion.pdf
Link Transfer
© Copyright 2017 Dell Inc. 128
0 20 40 60 80 100 120
MLC NAND SATA 3 ONFi 2
us
SSD Access times
Read Time Transfer Time Misc SSD Link Transfer Platform & Adapter SoftwareSource: Intel Measurements Source: Jim Handy, SDC 2015 https://www.snia.org/sites/default/files/SDC15_presentations/gen_sessions/JimHandy_The_Long-Term_Future_PrintVersion.pdf
© Copyright 2017 Dell Inc. 129
0 20 40 60 80 100 120
MLC NAND SATA 3 ONFi 2
MLC NAND SATA 3 ONFi 3
us
SSD Access times
Read Time Transfer Time Misc SSD Link Transfer Platform & Adapter Software
ONFi 3 reduces transfer time
Source: Intel Measurements Source: Jim Handy, SDC 2015 https://www.snia.org/sites/default/files/SDC15_presentations/gen_sessions/JimHandy_The_Long-Term_Future_PrintVersion.pdf
© Copyright 2017 Dell Inc. 130
0 20 40 60 80 100 120
MLC NAND SATA 3 ONFi 2
MLC NAND SATA 3 ONFi 3
MLC NAND PCIe x4 G3 ONFi 3
us
SSD Access times
Read Time Transfer Time Misc SSD Link Transfer Platform & Adapter Software
ONFi 3 reduces transfer time
PCIe reduces Link Transfer & Platform & Adapter time
Source: Intel Measurements Source: Jim Handy, SDC 2015 https://www.snia.org/sites/default/files/SDC15_presentations/gen_sessions/JimHandy_The_Long-Term_Future_PrintVersion.pdf
© Copyright 2017 Dell Inc. 131
0 20 40 60 80 100 120
MLC NAND SATA 3 ONFi 2
MLC NAND SATA 3 ONFi 3
MLC NAND PCIe x4 G3 ONFi 3
Future NVM PCIe x4 G3
us
SSD Access times
Read Time Transfer Time Misc SSD Link Transfer Platform & Adapter Software
ONFi 3 reduces transfer time
PCIe reduces Link Transfer & Platform & Adapter time
NVM Shrinks Read, Transfer & Misc SSD Times
Source: Intel Measurements Source: Jim Handy, SDC 2015 https://www.snia.org/sites/default/files/SDC15_presentations/gen_sessions/JimHandy_The_Long-Term_Future_PrintVersion.pdf
© Copyright 2017 Dell Inc. 132
0 20 40 60 80 100 120
MLC NAND SATA 3 ONFi 2
MLC NAND SATA 3 ONFi 3
MLC NAND PCIe x4 G3 ONFi 3
Future NVM PCIe x4 G3
us
SSD Access times
Read Time Transfer Time Misc SSD Link Transfer Platform & Adapter Software
ONFi 3 reduces transfer time
PCIe reduces Link Transfer & Platform & Adapter time
NVMe to replace the SCSI SW Reduce latency down to
~<10us
Source: Intel Measurements Source: Jim Handy, SDC 2015 https://www.snia.org/sites/default/files/SDC15_presentations/gen_sessions/JimHandy_The_Long-Term_Future_PrintVersion.pdf
© Copyright 2017 Dell Inc. 133
Agenda • What’s new with storage connectivity
– Protocol adoption – Connectrix Product Updates
• Congestion Spreading and its impact – Congestion Spreading terminology – Congestion Spreading & Innocent flows
• SAN Best practices for All Flash Arrays (AFAs)
• Introduction to NVMe – FC-NVMe
© Copyright 2017 Dell Inc. 134
SATA-SSDBACK
END
CACHE
FRONT
END
SCSI FCP
Storage Array
SATA-SSD
SATA-SSDFibre ChannelSCSI FCP
iSCSI
Host
Application iSCSI
IP/Ethernet
SCSI
SCSI
© Copyright 2017 Dell Inc. 135
SATA-SSDBACK
END
CACHE
FRONT
END
SCSI FCP
Storage Array
SATA-SSD
SATA-SSDFibre ChannelSCSI FCP
iSCSI
HostNVMe-SSDNVMe-SSD
NVMe-SSD
Application iSCSI
IP/Ethernet
SCSI
SCSI
© Copyright 2017 Dell Inc. 136
SATA-SSDBACK
END
CACHE
FRONT
END
SCSI FCP
Storage Array
SATA-SSD
SATA-SSDNVMe-SSDNVMe-SSD
NVMe-SSD
Fibre ChannelSCSI FCP
iSCSI
HostNVMe-SSDNVMe-SSD
NVMe-SSD
Application iSCSI
IP/Ethernet
SCSI
SCSI
© Copyright 2017 Dell Inc. 137
SATA-SSDBACK
END
CACHE
FRONT
END
SCSI FCP
Storage Array
NVME-oF
SATA-SSD
SATA-SSDNVMe-SSDNVMe-SSD
NVMe-SSD
Fibre ChannelSCSI FCP
iSCSI
Host
NVME-oF
NVMe-SSDNVMe-SSD
NVMe-SSD
Application
NVMe
iSCSI
IP/EthernetNVMe
SCSI
SCSI
© Copyright 2017 Dell Inc. 139
Want to win a Levitating Death Star Speaker?
• Follow @DellEMCStorage while at Dell EMC World
• 2 Winners will be chosen daily from
Monday May 8 through Thursday May 11 • All winners will be notified through
Twitter Direct Message
NO PURCHASE NECESSARY. Ends 05/11/2017. To enter and for Official Rules, visit http://thecoreblog.emc.com/dell-emc-world-follow-win-sweepstakes-2017/
© Copyright 2017 Dell Inc. 140
JOIN US! • Birds of a feather (BOF)
– Tuesday @ 1:30pm
• Second Session – Thursday @ 8:30am
• Drop by the Connectrix Booth • Schedule your 1x1 personal sessions
today!
© Copyright 2017 Dell Inc. 141
THANK YOU! Q & A
Erik Smith
[email protected] @provandal
www.brasstacksblog.typepad.com
Alan Rajapa [email protected]
© Copyright 2017 Dell Inc. 143
Sources/References • Erik Smith: Slow Drains are impacting your SAN
– http://brasstacksblog.typepad.com/brass-tacks/2016/02/slow-drains-are-impacting-your-san.html – https://www.brighttalk.com/webcast/13935/213779/slow-drains-are-impacting-your-san
• Erik Smith: EMC World 2016 Presentation: – https://www.emcworldonline.com/2016/connect/sessionDetail.ww?SESSION_ID=2539
• Dell EMC Congestion Spreading knowledge Map – https://emcservice--c.na55.visual.force.com/apex/KB_BreakFix_clone?id=kA2j0000000R59Q
• Brocade MAPS Configuration Guide – http://www.brocade.com/content/html/en/configuration-guide/fos-80x-maps/GUID-426E1CD4-3763-419D-9D54-91F824F463EB-homepage.html
• Cisco Slow Drain Device Detection white paper – http://www.cisco.com/c/dam/en/us/products/collateral/storage-networking/mds-9700-series-multilayer-directors/whitepaper-c11-737315.pdf
• Dell EMC VMAX 3 and VMAX AFA I/O Limits – https://www.emc.com/collateral/white-papers/h15498-dell-emc-vmax3-and-vmax-all-flash-quality-of-service-controls-for-
multi-tenant-environments.pdf
• Jim Handy- SDC 2015 – https://www.snia.org/sites/default/files/SDC15_presentations/gen_sessions/JimHandy_The_Long-
Term_Future_PrintVersion.pdf
© Copyright 2017 Dell Inc. 144
• Title: Connectrix Optic Cable Cleaning Made Easy (2:31)
Description: In this video, you will learn how easy it is to clean your fiber optic cables to prevent connectivity issues in your Connectrix products https://www.youtube.com/watch?v=u1rgjzUQlDU&index=2&list=PL0CFE7365EB8D1577
Connectrix Video Resources
• Title: Connectrix SFP Optic Replacement Made Easy (1:51)
Description: In this video, you will learn how easy it is to replace your failed SFP optic in your Connectrix products https://www.youtube.com/watch?v=4kd6O0S7Fsg&index=1&list=PL0CFE7365EB8D1577