Cisco Catalyst Instant...

47
Cisco Confidential © 2010 Cisco and/or its affiliates. All rights reserved. 1 Cisco Catalyst Instant Access Jaromír Pilař, Consulting Systems Engineer CCIE #2910

Transcript of Cisco Catalyst Instant...

Cisco Confidential © 2010 Cisco and/or its affiliates. All rights reserved. 1

Cisco Catalyst Instant Access

Jaromír Pilař, Consulting Systems Engineer CCIE #2910

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2

Catalyst 3850

Catalyst 2960-X

Catalyst 3650

Catalyst 4500

Sup8-E

Catalyst 6800 &

Catalyst Instant Access

Cisco Prime Infrastructure

Cisco Identity Services Engine

Cisco Confidential 3 © 2011 Cisco and/or its affiliates. All rights reserved.

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4

•  Focus on reducing complexity in the Campus LAN Simplified Ordering Simplified Configuration Simplified Management

•  Reduced number of touch points (reduced OPEX!) Treated as one device for the distribution and access layer One device for configuration and image upgrade Consistent CLI across the distribution and access layer

•  Investment Protection – Can leverage existing 6500 distribution deployment

For more details see whitepaper at http://www.cisco.com/en/US/prod/collateral/switches/ps10902/ps715/ps13198/white_paper_c11-728265.html

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5

•  Distribution Pair of 6500/6807 with Sup2T or 6880 in VSS Mode •  Requires 6904 Line card with 4X Adapter and SFP+ •  Requires IP Services License or greater •  Minimal Parent configuration single 6500 in VSS mode

•  10G Fabric Links •  Can be SR, LR, LRM, ER, Twinax •  Up to 60G MEC between Client stack and Parent •  1G mode supported as well but not recommended

•  Catalyst 6848ia Client Switches •  6848ia supports Stacking up to 3 clients in Phase 1 •  144 ports per stack in Phase 1

•  Can Support Switches off of the Client Ports •  These would be treated as standalone switches, not managed by 6500 •  No support for cascaded IA Clients

Instant Access Parent

Instant Access Clients

6848ia

6848ia

6848ia

Fabric Links

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6

•  Two available SKUs: 48p of 10/100/1000 Ethernet with PoE+ and 2 x 10GbE SFP+ Uplink Ports 48p of 10/100/1000 Ethernet (non-PoE) and 2 x 10GbE SFP+ Uplink Ports

•  Stackable up to 3 clients in Phase 1

•  80G Bidirectional Stack Bandwidth

•  Includes Stack Module, no licensing required

•  Single Fixed Power Supply and Fixed Fans

•  All ports 802.3at capable. PSU capable of 30W on 24 ports/15.4W on all 48 Ports

•  Operates in Client Mode ONLY (no local switching – traffic between local ports goes through parent switch), not convertible to standalone switch

Shipping

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7

IA client dual homed to VSS Pair

SiSi SiSi

IA client dual homed to VSS Pair across stack members

SiSi SiSi

Up to 6 uplinks (60G) MEC from client to parent

SiSi SiSi

Recommended Design

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8

SiSi SiSi

IA client single homed with up to 6 links in MEC across stack members

SiSi SiSi

IA client single homed to VSS pair

Possible but “Not Recommended”

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9

SiSi

IA client single homed to single switch in VSS mode

SiSi

IA client dual homed to single switch in VSS mode

SiSi

Up to 6 links in MEC single homed to single switch in VSS mode

Possible but “Not Recommended”

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10

Maximum Client Switch User Ports

1008

Maximum Client Switch ID’s 12 Maximum Client Switches 21 Maximum Clients in Stack 3 Maximum User Ports in Stack 144

Client Switch ID is a single client or a stack. If using individual clients max of

12 clients supported.

In order to reach this number, you must use stacks

# of IDFs

# of Ports/IDF

# of Clients in a Stack

# of Access Ports

7 144 3 1008 10 96 2 960 12 48 0 576

Most cost effective where IDF has 96 ports or greater

Single Client IDF’s (no stacking) support fewer overall ports

Sample Configurations

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11

12 Individual Clients – No Stacks

Client Node IDs: 12 Total Clients: 12 User Ports: 576

VSS

VSS

Client Node IDs: 7 Total Clients: 21 User Ports: 1008

7 Stacks of 3 Clients

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 12

DA[6] SA[6] VNTAG[6] 802.1Q[4] Frame Payload …. CRC[4]

VNTAG ETHER TYPE (0X8926) D[1] P[1] DVIF [12] L[1] R[1] R[1] R[1] SVIF[12]

Destination bit

Pointer bit (multicast)

Destination VIF Source VIF

Loopback bit Reserved

Unicast D=1 Unicast to FEX Host Port

Multicast P=1 Pointer to Multicast Table on FEX Client

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 13

IF1 IF2

F102/2 F102/1

SiSiSiSi

(VIF1) (VIF2)

<Interface-type>/<fex-id>/<module>/<submode>/<port>

interface GigabitEthernet 102/1/0/1

FEX ID 101-199 Stack Sub Module FEX Port

Controller

IA

Hosts Host-1 Host-2

VSS

FEX 102

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 14

CFEX1#conf t Enter configuration commands, one per line. End with CNTL/Z. CFEX1(config)#int GigabitEthernet 102/1/0/1 CFEX1(config-if)#switchport CFEX1(config-if)#switchport mode access CFEX1(config-if)#switchport access vlan 2

L2, L3 Features of Cat6k at Access.

CFEX1(config-if)#int gig 102/1/0/2 CFEX1(config-if)#ip address 1.1.1.1 255.255.255.0 CFEX1(config-if)#mpls ip

MPLS IP at Campus FEX

CFEX1(config-if)#int gig 102/1/0/3 CFEX1(config-if)#xconnect 10.10.10.2 100 encapsulation mpls

EoMPLS/VPLS/AVPLS from Campus FEX Port

•  All configuration tasks performed at parent switch •  Functionality inherited at IA client ports

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 15

Core

Building 1 Building 2 Building 3 Building 4

NO Routing Protocols or Spanning-Tree configuration between Access and Distribution

NO Configuration or Image Management at Access Switches

5 Total Devices for Image and Configuration Management Automated Trunk Configuration 4032 User Ports Considerations: STP Loop Prevention FHRP Tuning CAM/ARP Tunings PIM Tuning/DR priority Routing Protocol Tuning Dual Active Detection Method 5 Separate Configurations of SNMP, NTP, TACACS, Banner, vty, VLAN DB, Mgmt IP/GW, Hostname,

VSS

VSS VSS VSS VSS

NO Trunks to Configure from Access to Distribution

Combines the benefits of Collapsed Control Plane and Reduction of Devices to Manage

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 16

Common Access Features IA FCS Support Notes

NAC/802.1x/SGT/SGACL *See whitepaper for 802.1x/SGT details

Downloadable ACLs

VRF assignment

QoS (ingress classifier, and egress queuing policy) Ingress classification happens at parent, CoS trusted on fabric link. Static egress Queue policy at client

Netflow/Flexible Netflow

Data/voice VLANs for IP Phone deployments

Private VLANs

BPDUGuard

Bridge Assurance Edge or Portfast

DHCP relay

Security features: IP Source Guard, DHCP snooping, DAI etc

For more information look into whitepaper at http://www.cisco.com/en/US/prod/collateral/switches/ps10902/ps715/ps13198/white_paper_c11-728265.html

Cisco Confidential 17 © 2011 Cisco and/or its affiliates. All rights reserved.

1.  Switch Discovery Protocol (SDP) •  Fabric Link Discovery

switchport mode fex-fabric •  Switch Discovery

fex associate <FEX-ID> •  EtherChannel Link Aggregation

2.  Switch Registration Protocol (SRP) •  Exchange Compatibility information •  IA Client Registration

IA Client image management IA Client OIR

•  Stack Member Identification & mgmt 3.  Switch Configuration Protocol

•  Configuration •  Status •  Statistics

4.  Inter Card Communication (ICC) for Syslog, QoS, Remote login.

Instant Access Parent

2

Client ID Image Check

VIF ID

2

1

1 1

3

Configuration Interface Stats

3

Remote Login Syslog QoS

4

4

“No User Configuration” All Happens in background Instantly

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 19

•  SDP : Switch Discovery Protocol ü  The first protocol to send Hello’s (keep alive) and establish communication between Parent Switch and Client Switch ü  Is a link based protocol, runs on every link between Controller and FEX. ü  Communicates all attributes to/from each IA Client (Client ID, VIFs, SKU…)

•  SRP : Switch Registration Protocol ü  Completes the OIR and registration of IA Client on a Parent Switch.

•  SCP : Switch Configuration Protocol ü  Configuration and management protocol established between Parent and IA Client Switch. ü  Lightweight L2 based protocol.

•  ICC : Inter Card Communication ü  Protocol for heavyweight features running over Cisco IPC.

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 20

Instant Access Parent

•  IA Control Plane •  IA Client VIF association •  VNTAG Assignment

•  IA Data Plane •  MAC Learning and Switching •  L2 & L3 Features

IA Client Switch

•  VNTAG Encapsulation •  QoS

Instant Access Parent

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 21

TAG FEX Interface VIF1 IF1

VIF2 IF2

Ingress Mapping IA Parent

IA client

Hosts

Host-1 Host-2

Switch-3

VSS

IF1 IF2

F101

TAG: Virtual NIC Tag VIF – Virtual Interface

(VIF1) (VIF2)

•  Automatically assigned •  One VIF to each host port •  One VIF to each Etherchannel •  One VIF to FEX CPU for Control Channel •  FEX Controller VIF = 0 •  Multicast: Pointer to Replication Table in FEX

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 22

IA Parent

IA Client

Hosts

Host-1 Host-2

Switch-3

VSS

IF1 IF2

F101

VNTAG: Virtual NIC Tag VIF – Virtual Interface

(VIF1) (VIF2)

MAC + Payload

VNTAG SVIF = VIF1 DVIF = 0

MAC + Payload

MAC + Payload

VNTAG SVIF = VIF1 DVIF = 0

MAC + Payload

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 23

IA Parent

IA Client

Hosts

Host-1 Host-2

Switch-3

VSS

IF1 IF2

F101

VNTAG: Virtual NIC Tag VIF – Virtual Interface

(VIF1) (VIF2)

MAC + Payload

VNTAG SVIF = 0, DVIF = VIF1

MAC + Payload

MAC + Payload

VNTAG SVIF = 0, DVIF = VIF1

MAC + Payload

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 24

Host-1 MAC1

Host-2 MAC2

Switch-3

VSS

IF2

F101

VNTAG: Virtual NIC Tag

(VIF2)

SA=MAC1, DA=MAC2+ Payload

IF1 (VIF1)

SA=MAC1, DA=MAC2+ Payload

VNTAG SVIF = 0, DVIF = VIF2

SA=MAC1, DA=MAC2+ Payload

VNTAG SVIF = 0, DVIF = VIF2

SA=MAC1, DA=MAC2+ Payload

SA=MAC1, DA=MAC2+ Payload

SA=MAC1, DA=MAC2+ Payload

SA=MAC1, DA=MAC2+ Payload

VNTAG SVIF = VIF1 DVIF = 0

VNTAG SVIF = VIF1 DVIF = 0

SA=MAC1, DA=MAC2+ Payload

SA=MAC1, DA=MAC2+ Payload

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 25

IA Parent

IA Client

Hosts

Host-1 Host-2

Switch-3

VSS

IF1 IF2

F101

VNTAG: Virtual NIC Tag VIF – Virtual Interface

(VIF1) (VIF2)

MAC + Payload

VNTAG, P=1 SVIF =0, DVIF = Group VIF

MAC + Payload

Outgoing Interface

IF1, IF2

192.168.1.100,  224.0.255.1  Incoming  Interface:  FortyGig  5/1  RPF  Neighbor  210.20.37.33    Outgoing  interface  list:          Gigabitethernet  101/1/0/1,  Forward/Dense,  0:57:31/0:02:52          Gigabitethernet  101/1/0/2,  Forward/Dense,  0:56:55/0:01:28  

MAC + Payload

Group VIF

MAC + Payload

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 26

Host-1 IA Client

Host

Switch-3

VSL

Switch-1 Switch-2

IF1 (VIF1)

IA Parent

Fabric Link

access-­‐list  100  permit  ip  any  10.0.0.0  0.255.255.255    Interface  Gig  103/1/0/24  ip  access-­‐group  100  in  

To -10.1.1.1 VNTAG

ACL TCAM

0X0001 X X X X X X X

0X0002 Y Y Y Y Y Y Y

0XNNNN Z Z Z Z Z Z Z

To -172.16.0.1 VNTAG

To -10.1.1.1

To -172.16.0.1 To -10.1.1.1

To -172.16.0.1

When an Ingress ACL is applied on the IA Client host port, the packet entering that IA Client port will get to the IA Parent via the fabric link. Once the packet reaches the IA Parent, the relevant ACLs will get applied.

SiSi SiSi

#

#

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 27

Host-1 IA Client

Host

Switch-3

VSL

Switch-1 Switch-2

IF1 (VIF1)

IA Parent Fabric Link

access-­‐list  101  deny  ip  192.168.1.0  0.255.255.255  any  Access-­‐list  101  permit  ip  any  any    interface  Gig  103/1/0/24  ip  access-­‐group  101  out  

Src -10.1.1.1 VNTAG

ACL TCAM

0X0001 X X X X X X X

0X0002 Y Y Y Y Y Y Y

0XNNNN Z Z Z Z Z Z Z

Src -10.1.1.1 Src -10.1.1.1

Src -192.168.1.1

Egress ACLs are applied on the IA Parent and If the packet is to be permitted, the packet will be sent down the fabric link to the IA Client. If the packet is to be dropped, the packet will not be sent to the IA Host Port

SiSi SiSi

#

#

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 28

Traffic from IA Client to Parent Traffic from IA Parent to Client

1

•  Trust  DSCP  at  A  Client  host  ports  

1

•  Default  DSCP/COS  to  Queue  map  –  4    (1P3QT3)  Queues  

•  shared  weights:  1  30  35  5  •  IA  Control  traffic  on  to    2  addiUonal  Queues   2

2

•  No  Policing/Marking/Shaping  on  Fabric  links  (Phase  1)  

•  DSCP  or  COS    to  Queue  Map  •  Queues  –  1P7Q4T  •  6  Queues  on  Fabric  link  for  IA  Client  data,    •  2    Queues  for  IA  control  Traffic  

4

•  4  Egress  queues  (1P3QT3)  •  shared  weights:  1  30  35  5    •  Control  Traffic  to  IA  Queues  

4

•  ClassificaUon,  ReMarking,  Poiicing    on  IA  host  Virtual  Interface  

3

3

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 29

Priority Q (1)

Standard Q (2)

Standard Q (3)

Standard Q (4)

Queues (1P3Q3T)

BPDU IA Control Traffic

COS 5 Data

COS 3 Data

•  Trust DSCP at IA Host Port •  DSCP/COS to Output Q Map •  1 Priority Queue •  3 Standard Queue •  Shared Queue 1 30 35 5 •  Marking/Re-Marking at IA Parent •  Policing at IA Parent

IA Client IA Parent

Fabric Link

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 30

Priority (1)

Standard Q (2)

Standard Q (3)

Standard Q (4)

Standard Q (5)

Standard Q (6)

Standard Q (7)

Queues 1P7Q4T

DSCP 40 Data

DSCP 16 Data

BPDU IA Control Traffic

IA Client IA Parent

Fabric Link

Dscp-outputq-threshold map: DSCP = d1d2! d1: 0 1 2 3 4 5 6 7 8 9 ! -------------------------------------------------------------------------------------------! 0 : 08-03 08-03 07-03 07-03 06-03 06-03 06-03 06-03 05-01 05-02 ! 1 : 05-02 05-02 04-02 04-02 04-02 04-02 03-03 03-03 03-03 03-03 ! 2 : 03-03 03-03 03-03 03-03 02-03 02-03 02-03 02-03 02-03 02-03 ! 3 : 02-03 02-03 03-03 03-03 03-03 03-03 03-03 03-03 03-03 03-03 ! 4 : 01-03 01-03 01-03 01-03 01-03 01-03 01-03 01-03 02-03 02-03 ! 5: 02-03 02-03 02-03 02-03 02-03 02-03 02-03 02-03 02-03 02-03 ! 6 : 02-03 02-03 02-03 02-03 !!!

DSCP 40: d1 = 4, d2 = 0 DSCP 16: d1 = 1, d2 = 6

Trust DSCP/COS Map Table at IA Parent

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 31

Priority (1)

Standard Q (2)

Standard Q (3)

Standard Q (4)

Standard Q (5)

Standard Q (6)

Standard Q (7)

Queues 1P7Q4T

IA Client IA Parent

Fabric Link

Priority (1)

Standard Q (2)

Standard Q (3)

Standard Q (4)

Queues 1P3Q3T

DSCP 40 Data

DSCP 16 Data

Trust DSCP/COS 1P3QT3 Egress Host Port Shared 1 30 35 5

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 32

SDP – Satellite Discover Protocol

Enhanced PAgP

Hot Standby Active

Switch 1 Switch 2

•  Requires ePagP capable neighbor: •  3750: 12.2(46)SE •  4500: 12.2(44)SE •  6500: 12.2(33)SXH1

•  Sub-second convergence

Enhanced SDP (Fabric Link Discovery Protocol)

•  Sub-second convergence

•  Requires eSDP Neighbor: •  Catalyst 6800ia: 15.1(2)SY

Hot Standby Active

Switch 1 Switch 2

Cat6500-VSS#show fex dual-active !FEX dual-active detection enabled: Yes!!Channel Group 16 (FEX 132)! Dual Active detection capable: Yes! switch 1 member port state:! Te1/2/5 - Interface Up. state: bound ! Te1/2/13 - Interface Up. state: bound ! switch 2 member port state:! Te2/2/5 - Interface Up. state: bound ! Te2/2/13 - Interface Up. state: bound !

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 33

redundancy!

mode sso!

!!

switch virtual domain 100 !

switch 1!

!!interface Port-channel1!switch virtual link 1!interface ten 1/5/4 !channel-group 1 mode on!interface ten 1/1/1 !channel-group 1 mode on!!!switch convert mode virtual!

VSS Configurations Guide http://www.cisco.com/en/US/docs/switches/lan/catalyst6500/ios/12.2SX/configuration/guide/vss.html

SiSi SiSi

Switch 1 Switch 2

Switch 1 Configuration Switch 2 Configuration redundancy!

mode sso!

!!

switch virtual domain 100 !

switch 2!

!!interface Port-channel2!switch virtual link 2!interface ten 2/5/4 !Channel-group 2 mode on! interface ten 2/1/1 !channel-group 2 mode on!!!switch convert mode virtual!

Cat6500-VSS#show switch virtual !

Switch mode : Virtual Switch!

Virtual switch domain number : 100!

Local switch number : 1!

Local switch operational role: Virtual Switch Active!

Peer switch number : 2!

Peer switch operational role : Virtual Switch Standby!

VSS Verification

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 34

Step 1 interface Port-channel20!

switchport!

switchport mode fex-fabric!

fex associate 118!

!

Step 2 interface range TenGig1/2/5, TenGig2/2/5! switchport! channel-group 20 mode on!

SiSi SiSi

No Console Access Required to Instant Access Client Provisioning

The Discovery process starts automatically once the FEX-Fabric is configured on downlinks to IA Client

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 35

SiSi SiSi

Cat6500-VSS#show fex 118 detail !FEX: 118 Description: FEX0118 state: online! FEX version: 15.0(2.0.51)UCP! Extender Model: WS-C2960X-48FPD-L, Extender Serial: FHH1707P00S! FCP ready: yes! Image Version Check: overridden! Fabric Portchannel Ports: 2! Fabric port for control traffic: Te1/2/5 ! Fabric interface state:! Po20 - Interface Up. ! Te1/2/5 - Interface Up. state: bound ! Te2/2/5 - Interface Up. state: bound !!Cat6500-VSS#show run fex 118 Current configuration : 11123 bytes ! interface GigabitEthernet118/1/0/1 …

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 36

SiSi SiSi

Cat6500-VSS#mod provision create fex 121 type WS-XC6800IA-48FPD!FEX 121 slot 1 module provisioning entry added.!

Pre-Provisioning of IA Client

Cat6500-VSS#mod provision create fex 121 type WS-XC6800IA-48FPD slot 2!FEX 121 slot 2 module provisioning entry added.!

Pre-Provisioning a Stack Member to Existing FEX-ID

Pre-Provisioning Switch and host port configuration before the IA Switch is physically connected can be done very similar to a line card Pre Provisioning

Cat6500-VSS#show switch virtual slot-map !Virtual Slot to Remote Switch/Physical Slot Mapping Table:!!Virtual Remote Physical Module!Slot No Switch No Slot No Uptime!---------+-----------+----------+----------! 68 121 1 ! 69 121 2 !

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 37

SiSi SiSiCat6500-VSS# show run fex 121!Building configuration...!!Current configuration : 5564 bytes!!!interface GigabitEthernet121/1/0/1! switchport mode access!.....!

FEX 121

Once the FEX-ID is provisioned, the Host Port Interface can be configured like any regular interface in Cat6500

Cat6500-VSS# conf t!Enter configuration commands, one per line. End with CNTL/Z.!Cat6500-VSS(config)# int Gig 121/1/0/24!Cat6500-VSS(config-if)# description To Printer Bldg3,4th Floor.!Cat6500-VSS(config-if)# switchport access vlan 110!

Pre Provision any IA Client Host Port like a regular port ahead.

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 38

SiSi SiSi

Cat6500-VSS#show mod fex 118! Switch Number: 118 Role: FEX!---------------------- -----------------------------!Mod Ports Card Type Model Serial No.!------ ----- -------------------------------------- ------------------ -----------! 1 48 C6800IA 48GFPwr 2SFP Fullers_48FullPwr FHH1707P00S!!Cat6500-VSS# !*Apr 3 19:37:58.026: %SATMGR-SW1-5-FEX_MODULE_ONLINE: FEX 118, module 2 online!Cat6500-VSS#!*Apr 3 19:37:58.030: %OIR-SW1-6-INSREM: Switch 118 Physical Slot 2 - Module Type LINE_CARD inserted ! Fex 118 Module 2: Passed Online Diagnostics!*Apr 3 19:38:12.178: %OIR-SW1-6-SP_INSCARD: Card inserted in Switch_number = 118, physical slot 2, interfaces are now online!Cat6500-VSS#show mod fex 118! Switch Number: 118 Role: FEX!---------------------- -----------------------------!Mod Ports Card Type Model Serial No.! --- ----- -------------------------------------- ------------------ -----------! 1 48 C6800IA 48GFPwr 2SFP Fullers_48FullPwr FHH1707P00S! 2 48 C6800IA 48GFPwr 2SFP Fullers_48FullPwr FHH1707P010!

Stack Member automatically Discovered and associated to

FEX like a Line Card

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 39

SiSi SiSi

Cat6500-VSS# show fex 118 detail !FEX: 118 Description: FEX0118 state: online!<Snip>…! Fabric Portchannel Ports: 2! Fabric port for control traffic: Te1/2/5 ! Fabric interface state:! Po20 - Interface Up. ! Te1/2/5 - Interface Up. state: bound ! Te2/2/5 - Interface Up. state: bound !Cat6500-VSS(config)#int range TenGig1/2/13, TenGig2/2/13!Cat6500-VSS(config-if-range)#channel-group 20 mode on!

Cat6500-VSS#show fex 118 detail !FEX: 118 Description: FEX0118 state: online! <Snip>…! Fabric Portchannel Ports: 4! Fabric port for control traffic: Te1/2/5 ! Fabric interface state:! Po20 - Interface Up. ! Te1/2/5 - Interface Up. state: bound ! Te1/2/13 - Interface Up. state: bound ! Te2/2/5 - Interface Up. state: bound ! Te2/2/13 - Interface Up. state: bound!

Just Bundling to “fex-fabric” Port Channel on Parent,

No Configuration at IA Client

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 40

Interface range command Cat6500-VSS(config)# int range Gig 132/1/0/1-48, Gig132/2/0/1-48!Cat6500-VSS(config-if-range)#!

Show run for IA Client Cat6500-VSS# show run fex 132!

Building configuration...!

!

Current configuration : 11103 bytes!

!!

interface GigabitEthernet132/1/0/1!

switchport access vlan 10!

!!

interface GigabitEthernet132/1/0/2!

switchport access vlan 10!

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 41

Cat6500-VSS#show module fex ! Switch Number: 132 Role: FEX!---------------------- -----------------------------!Mod Ports Card Type Model Serial No.!--- ----- -------------------------------------- ------------------ -----------! 1 48 C6800IA 48GFPwr 2SFP Fullers_48FullPwr FHH1707P00S! 2 48 C6800IA 48GFPwr 2SFP Fullers_48FullPwr FHH1707P010!

Cat6500-VSS# show environment status fex all!Fex 132 Fan 1! FEX 132 Fan 1 type: 33-0752-01 ! FEX 132 Fan 1 mode: Auto !Fex 132 fan-tray 1 fan-fail: OK!Fex 132 Fan 2! FEX 132 Fan 2 type: 33-0752-01 ! FEX 132 Fan 2 mode: Auto !Fex 132 fan-tray 2 fan-fail: OK! FEX 132 module 1 cooling requirement: 84 cfm! FEX 132 module 2 cooling requirement: 84 cfm!Fex 132 module 1 outlet temperature: 45C!Fex 132 module 2 outlet temperature: 52C!

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 42

Cat6500-VSS#attach fex 132!Open!FEX-132#!FEX-132#show int tenGigabitEthernet 1/0/1!TenGigabitEthernet1/0/1 is up, line protocol is up (connected) ! Hardware is Ten Gigabit Ethernet, address is 0022.bdf4.6633 (bia 0022.bdf4.6633)! MTU 9198 bytes, BW 10000000 Kbit/sec, DLY 10 usec, ! reliability 255/255, txload 1/255, rxload 1/255! Encapsulation ARPA, loopback not set! Keepalive not set! Full-duplex, 10Gb/s, link type is auto, media type is SFP-10GBase-SR! input flow-control is off, output flow-control is unsupported ! ARP type: ARPA, ARP Timeout 04:00:00! Last input never, output never, output hang never! Last clearing of "show interface" counters never! Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 0! Queueing strategy: fifo! Output queue: 0/40 (size/max)! 5 minute input rate 4000 bits/sec, 3 packets/sec! 5 minute output rate 0 bits/sec, 0 packets/sec! 13031 packets input, 2591153 bytes, 0 no buffer!

To troubleshoot on IA Client Uplink - interface stats, transceiver details - Attach to IA Client “attach <fex-id>”

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 43

FEX-132#show int ten 1/0/2 transceiver !ITU Channel not available (Wavelength not available),!Transceiver is internally calibrated.!If device is externally calibrated, only calibrated values are printed.!++ : high alarm, + : high warning, - : low warning, -- : low alarm.!NA or N/A: not applicable, Tx: transmit, Rx: receive.!mA: milliamperes, dBm: decibels (milliwatts).!! Optical Optical! Temperature Voltage Tx Power Rx Power!Port (Celsius) (Volts) (dBm) (dBm)!---------- --------------- --------- ------------ --------------!Te1/0/2 40.7 3.32 -2.0 -1.1 !!

S LC1 LC2 LC3

F 102 101 F 103

A LC1 LC2 LC3

S LC1 LC2 LC3

F 102 F 101 F 103

A LC1 LC2 LC3

A LC1 LC2 LC3

F 102 F 101 F 103

S LC1

LC2 LC3

A LC1 LC2 LC3

F 102 F 101 F 103

S LC1 LC2 LC3

A LC1 LC2 LC3

F 102 F 101 F 103

S LC1 LC2 LC3

A LC1 LC2 LC3

F 102 F 101 F 103

S LC1 LC2 LC3

issu load

version

issu run

version

issu accept version

issu commit version

S LC1 LC2 LC3

A LC1 LC2 LC3

F 102 F 101 F 103

S LC1

LC2 LC3

issu run version fex 103

issu run version fex 102, 101

Rolling upgrade across FEX-ID’s

A = Active S=Standby LC=Line Card

Old Code

Newer Code

Cisco Confidential 45 © 2011 Cisco and/or its affiliates. All rights reserved.

© 2011 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 46

•  Single point of management & simplified configuration and deployment and operations reducing TCO

•  Consistent features across distribution and access •  Unified application visibility and control for complete

distribution block •  Simplified network virtualization with EVN/MPLS-VRF at

access •  Simplified network security with complete support of SGT/

SGACL/NDAC/802.1x across distribution block •  Maintain existing L2//L3 Designs, Smooth Migration

Simplifying Networks Reducing TCO

Thank you.