Catalyst 9400 Architecture - clnv.s3.amazonaws.com · Catalyst 9400 Architecture Kenny Lei...

113

Transcript of Catalyst 9400 Architecture - clnv.s3.amazonaws.com · Catalyst 9400 Architecture Kenny Lei...

Catalyst 9400 Architecture

Kenny Lei

Technical Marketing Engineer

BRKARC-3873

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Cisco Spark

Questions? Use Cisco Spark to communicate with the speaker after the session

1. Find this session in the Cisco Live Mobile App

2. Click “Join the Discussion”

3. Install Spark or go directly to the space

4. Enter messages/questions in the space

How

cs.co/ciscolivebot#BRKARC-3873

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Session Goal

• To provide a thorough understanding of the Catalyst 9400 hardware architecture, packet flows and key forwarding components

• This session will also examine Catalyst 9400 software architecture, ACL and QoS

• No discussion on other Catalyst platforms

4

BRKARC-3873 4

• Overview

• Architecture

• Forwarding

• ACL

• QoS

• High Availability

• Conclusion

Agenda

Overview

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 7BRKARC-3873

A New Era in Networking

Voice

Video

Data

Previous Era

Mobility

Security

Cloud

IOT

New Era

Software Defined Access

(SD-Access)

(Catalyst 9K Series)

- Policy Based Automation from Edge to CloudSD-Access

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

7-Slot 10-Slot

Redundancy

is now

Table-stakes

Ready for

100W PoE

480G BW

per slot

Catalyst 9400

Modular Access Platform

BRKARC-3873 8

Hardware

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

7 - Slot 10 - Slot

Supervisor 2 (Redundant)

Line Cards 5 8

Ports 240x 10/100/1000120 mGig; 128 SFP/SFP+

2x QSFP+

384x 10/100/1000192 mGig; 200 SFP/SFP+

2x QSFP+

Dimension W:17.5”; D:16.25”; H:10RU W: 17.5”; D:16.25”; H: 13RU

BW per LC Slot 480G 480G

BW between Sup Slots 720G

Power Supply 8 PS (N+1 and N+N)

PoE per slot 4,800W

Cooling Side to Side (Front-to-Back for PS)

Chassis

High Density 10G Ports, 100G Uplinks

Ready for future higher power PoE devices

BRKARC-3873 10

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Blue Beacon

• Chassis/Fan tray, Supervisor, Line cards, and PS have the beacon

• Identify the hardware during configuration and trouble shooting

• Turn on and off by using software control (No button except FanTray)

Supervisor Line Card PSChassis/FanTray

BRKARC-3873 11

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Built-in Passive RFID

RFID on

Every FRUable

Components of

Catalyst 9400

RFID

BRKARC-3873 12

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Sample RFID Tag DataSN = 'FOC2109Q023’

PID = 'C9410R'

VID = 'V00'

TAN = '68-100900-02'

TAN Rev = '10'

CLEI = 'UNDEFINED'

Index = '900'

Encode = 'SGTIN-198‘

Filter = '0‘

Partition = '5'

Company = '0746320' Built-in Passive RFID

Inventory Management (Tracking) has never been Easier

RFID

BRKARC-3873 13

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Sup-1 - Overview

Uplinks:

8x 10G / 2x 40G

Line Card Slot BW:

7 Slot: 80G

10 Slot: 80G (> 150Byte)720G LCs/Uplinks

MACSec256

2.4Ghz Quad Core x86 CPU

UADP 2.0 XL ASICs

USB 2.0/3.0

16G DRAM and 16G Flash

M.2 SATA SSD

(Optional: Upto 1TB)

BRKARC-3873 14

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Sup-1XL - Overview

15BRKARC-3873

Uplinks:

8x 10G / 2x 40G

Line Card Slot BW:

7 Slot: 120G (>150Byte)

10 Slot: 80G (> 150Byte)720G LCs/Uplinks

MACSec256

2.4Ghz Quad Core x86 CPU

UADP 2.0 XL ASICs

USB 2.0/3.0

16G DRAM and 16G FlashM.2 SATA SSD

(Optional: Upto 1TB)

Optimized for Core deployment

Templates: Distribution,

Core, SD Boarder, NAT

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

RJ45 (UPoE)48x 10/100/1000

PoE/PoE+; PoE/PoE+/UPoE

TrustSec and MACSec(256)

Line Cards - Copper

16BRKARC-3873

RJ45 (Data)48x 10/100/1000

TrustSec and MACSec(256)

48x 10/100/1000 Data

48x 10/100/1000 PoE/PoE+

24x 1G + 24x mGig UPoE

48x 10/100/1000 PoE/Poe+/UPoE

RJ45 (mGig)24x 10/100/1000 + 24x 100/1G/2.5G/5G/10G

PoE/PoE+/UPoE

TrustSec and MACSec(256)

Mar ‘18

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Fiber (1G/10G)24x 1G/10G

TrustSec and MACsec(256)

Line Cards - Fiber

SFP (1G)48x 100/1000

TrustSec and MACSec(256)

24x SFP/SFP+

24x SFP 48x SFP

Mar `18 Mar `18

BRKARC-3873 17

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Power Supplies

• Modular Design: 8 PS for 7 and 10 slot chassis

• Shared: Power for both Data and Inline Power

• Redundancy Mode : N+N , N+1

• Platinum PS: 90%+ efficiency

• Output: 3200W AC PS With 240V input. (1570W with 120V input)

BRKARC-3873 18

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Fan Tray

• Redundant - N+1 fan

• Flexible Service - fan tray can be replaced from the portside or the back

• Efficient - Variable speed per fan depends on the load, temperature and altitudes (=>lower noise).

• Air flow - Side to side air flow

BRKARC-3873 19

Architecture

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Supervisor

Architecture

Forwarding

Features

Embedded Controllers

Centralized Architecture

Control Plane

Container

HA communication

Passive BackPlaneUpto 480G BW per slot

Line CardSTUB

ASIC

Line CardSTUB

ASIC

Line CardSTUB

ASIC…

Open

IOS-XE

BRKARC-3873 21

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Common Infrastructure / HA

Management Interface

Module Drivers

Kernel

22

Open IOS-XE

Same Look & Feel, Enhanced & Modern Architecture

IOS

IOS

Common Infrastructure / HA

Management Interface

Module Drivers

Kernel

IOS XE 3.7.x(SE)

Features Components

Hosted AppsIOSd

Features

Components

WCM

Wireshark

Open IOS XE 16.6.x

Hosted AppsIOSd

LXC

LXC

IOS-XE

DB

Common

Infrastructure / HA

Management

Interface

Module Drivers

Kernel

LXC

Wireshark

IOSd Blob

IOS Sub

SystemsIOS Sub

SystemsIOS Sub

Systems

BRKARC-3873

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Open IOS XE – IOS Sub Systems

IOSd Blob

IOS Sub Systems

IOS Sub Systems

IOS Sub Systems

IOS Sub Systems Enhances IOS Resiliency

IOS-XE DB

BGP

OSPF

MPLS, etcFailure of one of

the Sub Systems

Keeps Rest of

the System intact

BRKARC-3873 23

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Open IOS XE – DB

Decoupling Code & Data protects the

Operational & Configurational States

IOS-XE DBIOSd Sub

Systems

Config & Operational

States

Higher Application UP Time

Quicker Recovery

Better Convergence

BRKARC-3873 24

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

IOS-XE – An Application Platform

Configuration

Management

Network

Monitoring

Network

Analytics

Kernel Support for Multiple Containers exist in current

versions of IOS-XE Denali

Depending on the Platform Capabilities, Apps can run

in Containers

netconf/restconf/yang/rest-api Interfaces

Life Cycle Management

IOS

OS/Linux

IOS

NW Devices

OS/Linux

NW Devices

ContainerContainer

Cisco Signed apps “Open Packages”

Cisco + 3rd-party packages

BRKARC-3873 25

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Up to 32MB

Packet BufferUp to 64K x2

Netflow Records

Embedded Microcontrollers

Shared

Lookup Up to 240GE

Bandwidth

384K Flex Counters

Up to 2X to 4X

forwarding + TCAM

Universal DeploymentsAdaptable Tables

Enhanced Scale/BufferingMulticore resource share

Investment ProtectionFlexible Pipeline

26BRKARC-3873

UADP 2.0 - Next Generation of ASIC Innovation

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

28BRKARC-3873

UADP 2.0 – 2 Cores

Egress Forwarding

Controller

(EFC)

Stack Interface

PBC – Packet Buffers Complex

IQS

Q

EQS

Q Q

SQS AQM

Ingress Forwarding

Controller

(IFC)

Egress Forwarding

Controller

(EFC)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

MACSEC MACSECMACSEC MACSEC

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 29BRKARC-3873

Shared Lookup Tables

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stag

e

#8

Flex Parser

EGR

Stag

e

#..

Stag

e

#..

Stag

e

#2

Stag

e

#1

Stag

e

#15

Flex Parser

IGR

Stag

e

#..

Stag

e

#..

Stag

e

#2

Stag

e

#1

Core 1

Ingress Pipeline

Network Interfaces (Core 1)

Core 1

Egress Pipeline

X

F

C

X

F

C

FIFO FIFO

Ingress

Forwarding

Controller

(IFC)

Core 1

Egress

Forwarding

Controller

(EFC)

Core 1

Flexible

Look up

Tables

(Shared

Across

Cores)

Rewrite

Block

PBC – Buffers Complex (Core 1)

Egress

Forwarding

Controller

(EFC)

Core 0

Network Interfaces (Core 0)

FIFO FIFO

Ingress

Forwarding

Controller

(IFC)

Core 0

Rewrite

Block

Stack Interface

PBC – Buffers Complex (Core 0)

Lookup Tables

shared across the

cores

Scales better at High Performance

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

30BRKARC-3873

UADP 2.0 – Forwarding Pipelines

Egress Forwarding

Controller

(EFC)

MACSEC MACSEC

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

31BRKARC-3873

UADP 2.0 – Forwarding Pipelines

Egress Forwarding

Controller

(EFC)

MACSEC MACSEC

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

32BRKARC-3873

UADP 2.0 – Forwarding Pipelines

Egress Forwarding

Controller

(EFC)

MACSEC MACSEC

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

33BRKARC-3873

UADP 2.0 – Forwarding Pipelines

MACSEC MACSEC

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Stage

#15

Flex Parser

IGR

Stage

#..

Stage

#..

Stage

#2

Stage

#1

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Stage

#8

Flex Parser

EGR

Stage

#..

Stage

#..

Stage

#2

Stage

#1

TCAM/ SRAM

Forwarding - Under the covers

15 Ingress

Programmable

Stages

Flex Parser

256 B

Flex Parser

256 B

Final Decision on

Packet’s Future

Final Decision on

Packet’s Future

Flexible

Look up Tables

(Shared

Across Cores)

8 Egress

Programmable

Stages

BRKARC-3873 34

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Ingress Programmable

Pipeline

Punt

Flex Parser

IGR

NF

SPAN

MC

L3/L2

FIB

Lookup

Table

Lookup

Table

Lookup

Table

ACL

MCast

Lookup

Table

Lookup

Table

Lookup

Table

QOS

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

Lookup

Table

SPAN

Flex Parser

EGR

Stage

#..

Sec

NF

Policy

Egress Programmable

Pipeline

TCAM/ SRAM

At each stage, 2

simultaneous lookups

Programmed to

understand

VXLAN

Programmed to

understand

MPLS

Microcode programs UADP 2.0

ASIC

Micro Code

Software Features

VXLAN MPLSNG

Protocol

BRKARC-3873 35

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

UADP 2.0 – Look up Tables

Egress Forwarding

Controller

(EFC)

MACSEC MACSEC

BRKARC-3873 36

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

UADP 2.0 – Look up Tables

Egress Forwarding

Controller

(EFC)

MACSEC MACSEC

BRKARC-3873 37

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

UADP 2.0 – Look up Tables

Egress Forwarding

Controller

(EFC)

MACSEC MACSEC

BRKARC-3873 38

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

SRAM TCAM

Flex Tables

Lookup

TableLookup

Table

Lookup

Table

Lookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

Table

Lookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

Table

Lookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

Table

Lookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

BRKARC-3873 39

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Collapsed Core-

WAN Template

Aggregation

Template

Core-Border

Template

L3 & NATMix of L2/L3

CapabilitiesL3 & Cross Domain

Policy

Flexible ASIC Templates

SRAM/TCAM

MAC

IPv4/IPv6

VACL

PACL

RACL

SGACL

QoS

NAT

SPAN

CoPP

Customize table size for each function based on the place in the network

Client Scale

Access-Edge Template

SRAM

FIB

(48K)

SGT

(16K)

IGMP

(32K)

Host

(32K)

MCAST

(16K)

MAC

(80K)

Internal Resources

TCAM

SEC ACL

(18K)

Tunnels

(1K)

NAT

(2K)

QoS ACL

(18K)

Others

Internal Resources

LISP

(1K)

SRAM TCAM

FIB

(64K)

SGT

(32K)

IGMP

(16K)

Host

(32K)

MCAST

(48K)

MAC

(32K)

Internal Resources

SEC ACL

(18K)

Tunnels

(1K)

NAT

(16K)

QoS ACL

(3K)

Others

Internal Resources

LISP

(1K)

Core-Border Template

64K

16K

32K

32K

48K

8K

64K

Access-Edge

Template

Custom ASIC Templates for Universal Deployment

40BRKARC-3873

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 41BRKARC-3873

Sup-1/Sup-1XL Block Diagram

Switch Backplane

4x10G /

40G

UADP2.0 XL

#1

720 Gbps

4x10G /

40G

PCIeSupIO

(I2C)Ethernet

24x

SLI

24x

SLI

16x

SLI8x

SLI

UADP2.0 XL

#1

UADP2.0 XL

#2

ASIC # 7-Slot 10-Slot

UADP #1 Slot 2 and 7 Slot1, 9, and 10

UADP #2 Slot 1 and 5 Slot 2, 3 and 4

UADP #3 Slot 6 and Uplinks Slot 7, 8, and Uplinks

Quad Core CPU(Control Traffic, Containers

for APPs)

Console/

Mgmt

SDRAM

USB

M.2 SATA

(optional)

240G 40G

SLI – Switch Link Interfaces

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 42BRKARC-3873

Port to ASIC Mapping

switch#show platform software fed active ifm mappings lpn

Mappings Table

LPN ASIC Port Interface IF_ID Active

------------------------------------------------------------------------------

1 1 0 GigabitEthernet1/0/1 0x000000c6 Y

<SNIP>

48 1 47 GigabitEthernet1/0/48 0x00000036 Y

1 0 0 GigabitEthernet2/0/1 0x00000037 Y

<SNIP>

48 0 47 GigabitEthernet2/0/48 0x000000c5 Y

1 2 17 TenGigabitEthernet3/0/1 0x00000067 Y

<SNIP>

8 2 10 TenGigabitEthernet3/0/8 0x0000006e Y

9 2 18 FortyGigabitEthernet3/0/9 0x0000006f Y

10 2 19 FortyGigabitEthernet3/0/10 0x00000070 Y

1 2 3 TenGigabitEthernet4/0/1 0x00000071 Y

<SNIP>

8 2 4 TenGigabitEthernet4/0/8 0x00000078 Y

9 2 8 FortyGigabitEthernet4/0/9 0x00000079 Y

10 2 9 FortyGigabitEthernet4/0/10 0x0000007a Y

1 1 0 TenGigabitEthernet5/0/1 0x0000007b Y

<SNIP>

24 1 23 TenGigabitEthernet5/0/24 0x00000092 Y

1 2 24 GigabitEthernet6/0/1 0x00000093 Y

<SNIP>

24 2 69 GigabitEthernet6/0/24 0x000000aa Y

25 2 30 TenGigabitEthernet6/0/25 0x000000ab Y

<SNIP>

48 2 63 TenGigabitEthernet6/0/48 0x000000c2 Y

switch#

Catalyst 9407R

Mod Card Type

--- ------------------------------

1 48-Port UPOE 10/100/1000 (RJ-45)

2 48-Port 10/100/1000 (RJ-45)

3 Supervisor 1 Module

4 Supervisor 1 Module

5 24-Port 10 Gigabit Ethernet (SFP+)

6 48-Port UPOE w/ 24p mGig 24p RJ-45

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 43BRKARC-3873

Sup-1/Sup-1XL Uplink - Single Sup

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 44BRKARC-3873

Sup-1/Sup-1XL Uplink - Single Sup

Default Mode (8x 10GE)

Active Disabled

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 45BRKARC-3873

Sup-1/Sup-1XL Uplink - Single Sup

Default Mode (8x 10GE)

Active Disabled

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 46BRKARC-3873

Sup-1/Sup-1XL Uplink - Single Sup

Default Mode (8x 10GE)

2x 40Ginterface FortyGigabitEthernet<slot>/0/[9-10]

enable

Active Disabled

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 47BRKARC-3873

Sup-1/Sup-1XL Uplink - Single Sup

Default Mode (8x 10GE)

2x 40Ginterface FortyGigabitEthernet<slot>/0/[9-10]

enable

Active Disabled

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 48BRKARC-3873

Sup-1/Sup-1XL Uplink - Single Sup

Default Mode (8x 10GE)

2x 40Ginterface FortyGigabitEthernet<slot>/0/[9-10]

enable

Mix Mode (4x 10GE + 1x 40G) interface FortyGigabitEthernet<slot>/0/10

enable

Mix Mode (4x 10GE + 1x 40G) interface FortyGigabitEthernet<slot>/0/9

enable

Active Disabled

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 49BRKARC-3873

Sup-1/Sup-1XL Dual Sups - Uplink Redundancy

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 50BRKARC-3873

Sup-1/Sup-1XL Dual Sups - Uplink Redundancy

Default Mode (8x 10GE)

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 51BRKARC-3873

Sup-1/Sup-1XL Dual Sups - Uplink Redundancy

Default Mode (8x 10GE)

40G Uplink Modeinterface FortyGigabitEthernet<slot>/0/9

enable

Active Disabled

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 53BRKARC-3873

48x1G RJ45 Line Card (UPoE)

6x

SLI

Stub ASIC

Switch Backplane

RJ4541-48

Octal PHY

10G

(USGMII)

Management

Sub-System

Power

Sub-system

PoE

Sub-System

IEEE

1588

Speed10/100/1000

RJ4533-40

Octal PHY

RJ4525-32

Octal PHY

RJ4517-24

Octal PHY

RJ459-16

Octal PHY

RJ451-8

Octal PHY

Line Rate on all Ports; UPoE on all Ports

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 54BRKARC-3873

48x1G Line Card (RJ45 Data or SFP)

Switch Backplane

Speed10/100/1000

6x

SLI

Stub ASIC

RJ4541-48

Octal PHY

Speed10/100/1000

RJ4533-40

Octal PHY

RJ4525-32

Octal PHY

RJ4517-24

Octal PHY

RJ459-16

Octal PHY

RJ451-8

Octal PHY

Management

Sub-System

IEEE

1588

10G

(USGMII)

Line Rate on all Ports

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 55BRKARC-3873

24x 1/10G SFP/SFP+ Line Card

Switch Backplane

SFP/SFP+19-24

PHY

6x

SLI

Stub ASIC

6x 10G

Management

Sub-System

IEEE

1588

SFP/SFP+13-18

PHY

6x

SLI

Stub ASIC

6x 10G

SFP/SFP+7-12

PHY

6x

SLI

Stub ASIC

6x 10G

SFP/SFP+1-6

PHY

6x

SLI

Stub ASIC

6x 10G

(USXGMII)

Sup-1: 80G with C9410R and C9407R

Sup-1XL: 80G with C9410R; 120G with C9407R

Release 16.6.2

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

C9400-LC-24XS Port-Group

7 Slot Chassis: 12 Port-Group

10 Slot Chassis: 8 Port-Group

1 2 3 4 5 6 7 8 9 10 11 12

1 2 3 4 5 6 7 8

Release 16.6.2

BRKARC-3873 56

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

C9400-LC-24XS Port-Group – 7 Slot ChassisR4-C94-2041#show platform hardware iomd 5/0 portgroups

Port Interface Status Interface Group

Max

Group Bandwith Bandwidth

1 TenGigabitEthernet5/0/1 up 10G

1 TenGigabitEthernet5/0/2 down 10G 10G

2 TenGigabitEthernet5/0/3 up 10G

2 TenGigabitEthernet5/0/4 down 10G 10G

3 TenGigabitEthernet5/0/5 up 10G

3 TenGigabitEthernet5/0/6 down 10G 10G

4 TenGigabitEthernet5/0/7 up 10G

4 TenGigabitEthernet5/0/8 down 10G 10G

<SNIP>

11 TenGigabitEthernet5/0/21 up 10G

11 TenGigabitEthernet5/0/22 down 10G 10G

12 TenGigabitEthernet5/0/23 up 10G

12 TenGigabitEthernet5/0/24 down 10G 10G

R4-C94-2041#show

• Bandwidth shared within port-group

• 12 port-group in the 7 slot chassis

• For 10G line rate performance:• Configure: “hw-module

subslot <slot#/0> mode

dynamic”

• 8 Port with C9400-Sup-1

• 12 port with C9400-Sup-1XL

BRKARC-3873 57

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 59BRKARC-3873

mGig RJ45 Line Card

Switch Backplane

RJ451-24

RJ4525-32

RJ4533-40

RJ4540-48

4x Octal PHY

(use 6 out of 8)2x Quad mGig PHY

6x

SLI

Stub ASIC

6x2x

Speed10/100/1000 Speed100/1G/2.5G/5G/10G

Management

Sub-System

PoE

Sub-System

IEEE

1588

Power

Sub-system

2x Quad mGig PHY2x Quad mGig PHY

6x

SLI

Stub ASIC

6x2x

6x

SLI

Stub ASIC

6x2x

6x

SLI

Stub ASIC

6x2x

Sup-1: 80G with C9410R and C9407R

Sup-1XL: 80G with C9410R; 120G with C9407R

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

C9400-LC-48UX Port-Group

7 Slot Chassis: 12 Port-Group

10 Slot Chassis: 8 Port-Group

1 2 3 4 5 6 7 8 91

0

1

1

1

22 3 1 5 6 4 8 9 7

1

1

1

2

1

0

11

2 32

3

44 5

56 7

6

7

88 1

12 3

2

3

44 5

56 7

6

7

88

Release 16.6.2

BRKARC-3873 60

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Power

Combined

(Default)

Normal PS failure

Redundant

ACTIVE STANDBY

Load sharing on all PSs Load sharing on functional PSs

Failed PS

Load sharing on active PSs

Standby PS in output disabledStandby PS becomes active

System enters alarm state

BRKARC-3873 63

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Power Redundancy: N+N and N+1

• Default active is PS1-4 and standby is PS5-8

• Standby power slots are configurable

ACTIVE STANDBY

SW(config)#power redundancy-mode redundant ?

N+N Redundant N+N (N is active, N is standby)

N+1 Redundant N+N (N is active, 1 is standby)

SW(config)#power redundancy-mode redundant N+1 ?

<1-8> standby slot in N+N mode

SWR(config)#

• Default active is PS1-7 and standby is PS8

• Standby power slot is configurable

SW(config)#power redundancy-mode redundant ?

N+N Redundant N+N (N is active, N is standby)

N+1 Redundant N+N (N is active, 1 is standby)

SW(config)#power redundancy-mode redundant N+1 ?

<1-8> standby slot in N+1 mode

SWR(config)#

BRKARC-3873 64

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Power Priority

• All components in the system are assigned with power priority level

• Supervisors and Fan Tray has the same highest priority level

• Lower slot# has the higher power priority level by default if “power supply autoLC shutdown” is configured

• Configurable power priority for line card slotsC94(config)#power supply autoLC priority ?

<1-7> Physical slot number

<cr>

C94(config)

Highest

Priority

BRKARC-3873 65

Configurable

Priority

Forwarding

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Netflow

Forwarding Resources

67BRKARC-3873

Flex Tables

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Feature Resources

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Netflow

Forwarding Resources

68BRKARC-3873

Flex Tables

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Feature Resources

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

• MAC

• Host Route

• IGMP Groups

• LPM Route

• Multicast Route

• SGT

• Security ACL

• QoS ACL

• Service ACL• PBR/NAT

• Netflow ACL

• SPAN

• MACsec

• CoPP

• Tunnel

• LISP

Netflow Entries

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Netflow

Forwarding Resources

69BRKARC-3873

Flex Tables

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Feature Resources

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

Table

Lookup

TableLookup

TableNetflow Entries: 128K per ASIC

• MAC: 64K

• Host Route: 48K – 112K

• IGMP Groups: 16K

• LPM Route: 64K

• Multicast Route: 16K

• SGT: 16K

• Security ACL: 18K

• QoS ACL: 18K

• Service ACL: 18K• PBR/NAT

• Netflow ACL

• SPAN

• MACsec

• CoPP

• Tunnel

• LISP

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

70BRKARC-3873

Unicast – within ASIC

Egress Forwarding

Controller

(EFC)

MACSEC MACSEC

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

71BRKARC-3873

Unicast – within ASIC

Egress Forwarding

Controller

(EFC)

1. Received, processed by

MACSec and into FIFO

MACSEC MACSEC1

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

72BRKARC-3873

Unicast – within ASIC

Egress Forwarding

Controller

(EFC)

1. Received, processed by

MACSec and into FIFO

2. A copy to buffer and a copy

to IFC

2

MACSEC MACSEC1

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

73BRKARC-3873

Unicast – within ASIC

Egress Forwarding

Controller

(EFC)

1. Received, processed by

MACSec and into FIFO

2. A copy to buffer and a copy

to IFC

2

3

3. Goes through IFC, result

descriptor send to PBC

MACSEC MACSEC1

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

74BRKARC-3873

Unicast – within ASIC

Egress Forwarding

Controller

(EFC)

1. Received, processed by

MACSec and into FIFO

2. A copy to buffer and a copy

to IFC

2

3

3. Goes through IFC, result

descriptor send to PBC

4

4. Descriptor has local

destination, PBC sends the info

to EQS

MACSEC MACSEC1

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

75BRKARC-3873

Unicast – within ASIC

Egress Forwarding

Controller

(EFC)

1. Received, processed by

MACSec and into FIFO

2. A copy to buffer and a copy

to IFC

2

3

3. Goes through IFC, result

descriptor send to PBC

4

4. Descriptor has local

destination, PBC sends the info

to EQS

5. EQS schedule PBC to send

a copy to EFC and a copy to

ReWrite (includes descriptor)

5

MACSEC MACSEC1

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

76BRKARC-3873

Unicast – within ASIC

Egress Forwarding

Controller

(EFC)

1. Received, processed by

MACSec and into FIFO

2. A copy to buffer and a copy

to IFC

2

3

3. Goes through IFC, result

descriptor send to PBC

4

4. Descriptor has local

destination, PBC sends the info

to EQS

5. EQS schedule PBC to send

a copy to EFC and a copy to

ReWrite (includes descriptor)

6

5

6. EFC sends results to

ReWrite

MACSEC MACSEC1

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

77BRKARC-3873

Unicast – within ASIC

Egress Forwarding

Controller

(EFC)

1. Received, processed by

MACSec and into FIFO

2. A copy to buffer and a copy

to IFC

2

3

3. Goes through IFC, result

descriptor send to PBC

4

4. Descriptor has local

destination, PBC sends the info

to EQS

5. EQS schedule PBC to send

a copy to EFC and a copy to

ReWrite (includes descriptor)

6

5

6. EFC sends results to

ReWrite

7. Rewrite the packet and send

though the egress FIFO

7

MACSEC MACSEC1

Multicast

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Catalyst 9400 Multicast

• Performance

• High L2 and L3 multicast throughput

• Low latency

• Flexible Scalability

• Future templates will provide different IGMP snooping group and mroutes

• Optimized Replication

• Replication are done at the egress

• Single copy in the buffer memory during replication

• Enhanced Features

• IP-Based forwarding for IGMP snooping

• IGMP snooping explicit tracking (For IGMP v3).

81BRKARC-3873

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Multicast Features

Features Catalyst 9K

IGMP (Internet Group Management Protocol)v1, v2, v3 Yes

IGMP snooping (v1, v2, v3) Yes

MLD (Multicast Listener Discovery) v1, v2 Yes

MLD snooping (v1, v2) Yes

PIM (Protocol Independent Multicast) SM (Sparse Mode) Yes

PIM Dense Mode Yes

PIM SSM (Source Specific Mode) Yes

PIM Bi-Dir No (HW capable)

BRKARC-3873 82

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

84BRKARC-3873

Multicast Key Components

Egress Forwarding

Controller

(EFC)

MACSEC MACSEC

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

85BRKARC-3873

Multicast Key Components

Egress Forwarding

Controller

(EFC)

MACSEC MACSEC

• Schedule the packet for

Stack Interface (Remote).

• Notify PBC when it no longer

needs the packet

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

86BRKARC-3873

Multicast Key Components

Egress Forwarding

Controller

(EFC)

MACSEC MACSEC

• Receive result descriptor from

IFC.

• Notify IQS and/or EQS

• Remove the packet after

notification from IQS and/or EQS

• Schedule the packet for

Stack Interface (Remote).

• Notify PBC when it no longer

needs the packet

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

87BRKARC-3873

Multicast Key Components

Egress Forwarding

Controller

(EFC)

MACSEC MACSEC

• Receive result descriptor from

IFC.

• Notify IQS and/or EQS

• Remove the packet after

notification from IQS and/or EQS

• Schedule the packet for

Stack Interface (Remote).

• Notify PBC when it no longer

needs the packet

• Generate a list of egress ports

• Schedule the packet for each egress

port

• Notify PBC when it no longer needs

the packet.

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

88BRKARC-3873

Multicast – Egress Local

Egress Forwarding

Controller

(EFC)

MACSEC MACSEC

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

89BRKARC-3873

Multicast – Egress Local

Egress Forwarding

Controller

(EFC)

1. Received, processed by

MACSec and into FIFO

2. A copy to buffer and a copy

to IFC

2

3

3. Goes through IFC, result

descriptor send to PBC

4

4. Descriptor has local

destination, PBC sends the info

to EQS

MACSEC MACSEC1

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

90BRKARC-3873

Multicast – Egress Local

Egress Forwarding

Controller

(EFC)

1. Received, processed by

MACSec and into FIFO

2. A copy to buffer and a copy

to IFC

2

3

3. Goes through IFC, result

descriptor send to PBC

4

4. Descriptor has local

destination, PBC sends the info

to EQS

5. AQM within EQS generate

the list of egress port based on

descriptor, schedule for each

egress port

5

MACSEC MACSEC1

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

91BRKARC-3873

Multicast – Egress Local

Egress Forwarding

Controller

(EFC)

1. Received, processed by

MACSec and into FIFO

2. A copy to buffer and a copy

to IFC

2

3

3. Goes through IFC, result

descriptor send to PBC

4

4. Descriptor has local

destination, PBC sends the info

to EQS

5. AQM within EQS generate

the list of egress port based on

descriptor, schedule for each

egress port

6

5

6. For each egress port, frame

goes though the EFC, ReWrite

and Egress FIFO

MACSEC MACSEC1

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding

Controller

(IFC)

Flexible

Look up

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

92BRKARC-3873

Multicast – Egress Local

Egress Forwarding

Controller

(EFC)

1. Received, processed by

MACSec and into FIFO

2. A copy to buffer and a copy

to IFC

2

3

3. Goes through IFC, result

descriptor send to PBC

4

4. Descriptor has local

destination, PBC sends the info

to EQS

5. AQM within EQS generate

the list of egress port based on

descriptor, schedule for each

egress port

6

5

6. For each egress port, frame

goes though the EFC, ReWrite

and Egress FIFO

Only a single copy of packet in

buffer memory during replication

MACSEC MACSEC1

ACL

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

ACL Types and Features• Security ACL (MAC, IPv4, and IPv6)

− PACL: ACL enabled under L2 interface

− VACL: ACL enabled for L2 VLAN traffic

− RACL: ACL enabled for routed traffic

− GACL: ACL for Clients group

− SGACL: ACL for CTS/SGT

− WCCP-Egress

• ACL for QoS classification and Policing (including CoPP)

• Service ACLPolicy

− PBR/NAT/WCCP-Ingress

− Netflow ACL

− SPAN

− MACSec

− User ACL to redirect traffic (CoPP)

− Tunnel

− LISP

96BRKARC-3873

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Security ACLs

ACL Type Attach Point Direction

PACL L2 interface IN OUT

VACL VLAN Always IN & OUT

RACL L3 interface, L3 PortChannel, sub-interface SVI IN OUT

interface gigabitethernet1/1

ip access-group PACL-1 in

ip access-group PACL-2 out

switchport access vlan 100

vlan access-map VACL-map

match ip address VACL-1

action forward

vlan filter VACL-map vlan-list 100

interface Vlan100

no shutdown

ip access-group RACL-1 in

ip access-group RACL-2 out

ip address 100.1.1.1/24

PACL: Direction indicated in CLI

VACL: VLAN ACL for Both

Ingress and Egress; Apply to

Pre- and Postrouted Traffic

RACL: Routed ACL; Apply Only

to Traffic That Requires Routing;

Direction Indicated in the CLI

BRKARC-3873 97

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Security ACL Processing Order and Priority

• The following is a conceptual illustration. In the ASIC the lookup for different

types of ACL takes place concurrently.

• A packet is dropped if it hits the deny rule in any of these types of ACLs.

• RACL is applied only to traffic that is L3 forwarded.

98BRKARC-3873

Ingress Processing

Ingress

Egress Process

PACL

Out

RACL

Out

VACL

Out

Within

ASIC

Or

STACK

RACL

In

PACL

In

VACL

In

GACL

InGACL

Out

SGACL

Out

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Sharing ACE

• Each ACL policy is reference by a label.

• Same ACL policy (Security ACL like GACL, PACL, VACL, RACL and QoS ACL) is applied to multiple interfaces or VLAN, it

uses the same label.

• Label sharing is within the core

• Ingress and egress use different label

99BRKARC-3873

ip access-list extended ip-list-1

deny ip 100.1.1.0 0.0.0.255 200.1.1.0 0.0.0.255

deny ip 100.1.2.0 0.0.0.255 200.1.2.0 0.0.0.255

deny ip 100.1.3.0 0.0.0.255 200.1.3.0 0.0.0.255

permit ip any any

interface GigabitEthernet1/0/1

ip access-group ip-lists-1 in

interface GigabitEthernet1/0/2

ip access-group ip-lists-1 in

interface GigabitEthernet1/0/3

ip access-group ip-lists-1 in

Label

101 Gi1/0/1

101 Gi1/0/2

101 Gi1/0/3

101 IPv4 ACL ip-list-1 in

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Resource UtilizationC9400#show platform hardware fed active fwd-asic resource tcam utilization

CAM Utilization for ASIC Instance [0] Table Max Values Used Values

--------------------------------------------------------------------------------

Unicast MAC addresses 65536/512 17/21

IGMP and Multicast groups 8192/512 0/0

L2 Multicast groups 8192/512 0/0

Directly or indirectly connected routes 16384/65024 0/14

NAT/PAT SA address and Port 0 0

QoS Access Control Entries 18432 0

Security Access Control Entries 18432 114

Ingress Netflow ACEs 1024 8

Policy Based Routing ACEs 2048 0

Egress Netflow ACEs 2048 0

Input Microflow policer ACEs 512 0

Output Microflow policer ACEs 1024 7

Flow SPAN ACEs 1024 0

Control Plane Entries 1024 200

Tunnels 1024 17

Lisp Instance Mapping Entries 1024 3

Input Security Associations 512 0

Output Security Associations and Policies 512 5

SGT_DGT 8192/512 0/0

CLIENT_LE 4096/256 0/0

INPUT_GROUP_LE 1024 0

OUTPUT_GROUP_LE 1024 0

Macsec SPD 256 2

BRKARC-3873 100

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Hitless ACL update

ACL-Test

-> Label 101

TCAM

Label 101

ACL-Test

-> Label 101

TCAM

Label 101

Label 102

ACL-Test

-> Label 102

TCAM

Label 101

Label 102

ACL-Test

-> Label 102

TCAM

Label 102

Modified ACL-Test

SW(config)#ip access-list extended ACL-Test

SW(config-ext-nacl)#105 permit ip host 10.1.1.1 host 20.1.1.1

SW(config-ext-nacl)# Requirement:

TCAM has enough

space

Result:

No outage during

ACL update

BRKARC-3873 102

Release 16.8.1

QoS

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

QoS Fundamental

Policing

Trust Classification

Unconditional

Marking

Conditional

Marking

Scheduler

8q3t

1p7q3t

2p6q3t

PolicingConditional

Marking

Unconditional

Marking

PQ1

PQ2

Q3

Q4

Q5

Q6

Q7

Q8

WTD

WTD rest

of non

WRED

queues

WRED

on any 4

queues

PQ or QClassification

BRKARC-3873 104

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Egress Pipeline

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

L

o

o

k

u

p

T

a

b

l

e

Stage #8

Flex Parser

EGR

Stage #..

Stage #..

Stage #2

Stage #1Stage #15

Flex Parser

IGR

Stage #..

Stage #..

Stage #2

Stage #1

Ingress Pipeline

X

F

C

X

F

C

Ingress Forwarding Controller

* Classify based on Original

Packet

* Ingress Policer

* Conditional marking

* Unconditional marking

TCAM

Tables

(Shared

Across

Cores)

Network Interfaces - Front Panel Ports + CPU + Network Redundant Uplinks (NRU)

Recirculation

Engine

Encryption

EngineIngress

FIFOEgress

FIFO

Stack Interface

PBC – Packet Buffers Complex

EQS

Q Q

SQS AQM

IQS

Q

ReWrite

Engine

105BRKARC-3873

UADP 2.0 – Qos Packet Processing

Egress Forwarding Controller

* Classify based on Ingress

QoS Result and Original

packet

* Egress Policer

* Conditional marking

* Unconditional marking

MACSEC

Scheduler

to Split Data

and CPU

Queues

Scheduler

from stack

Scheduler

to Egress

Port

MACSEC

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 106BRKARC-3873

Policing

Action

B<Tc

Conform Exceed

CBS

CIR

Yes

No

Action

Packet ofSize B

Action

B>Tp

Violate

PBS

PIR

Yes

No

Packet ofSize B

Action

B>Tc

Exceed

CBS

Yes

No

Conform

Action

CIR

police cir 100000000 bc 3125000 conform-

action set-dscp-transmit af41 exceed-action

drop

police cir percent 10 pir percent 50

conform-action transmit exceed-action set-

dscp-transmit af11 violate-action drop

1 Rate 2 Color 2 Rate 3 Color

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Types:

• Ingress Buffers: For ingress queues and scheduler (IQS) (dedicated and shared)

• Egress Stack Buffers: For Egress Stack Queues and Scheduler (SQS) (dedicated and shared)

• Egress Port Buffers: For Egress port queues (AQM)

• Temporary Buffers: For packet from the Stack or CPU.

Allocation:

• Use dedicated first then shared.

Packet Buffer

10 MB Egress

1.5MB – 3.5 MB Stack

1.5 MBFIFO

0.4MB-1.5 MB Ingress

16MB per Core32MB per ASIC

BRKARC-3873 107

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

2-Level HQoS

Child Parent

BW, Policing Shape

Marking Policing

Policing Marking

police

Parent

Action

Queues

police

CHILD PARENT

BRKARC-3873 108

High Availability

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 110BRKARC-3873

SSO – Stateful Switch Over

IP Phone

LED Lights

PC/LaptopAP

Switchover

Default Redundancy

Mode

Continue

Synchronization from

Active to Standby

Links Stay up

Continue Communication

Lights Stay on

Sup Uplinks stay up

Less than 200ms traffic interruption

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Sup-1 Uplink Redundancy – Dual Sups

Default Mode (8x 10GE)

40G Uplink Modeinterface FortyGigabitEthernet<slot>/0/9

enable

BRKARC-3873 111

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 112BRKARC-3873

Redundant Uplinks

Switch Backplane

4x10G /

40G

UADP2.0 XL

#1

720 Gbps

4x10G /

40G

PCIeSupIO

(I2C)Ethernet

24x

SLI

24x

SLI

16x

SLI8x

SLI

UADP2.0 XL

#2

7-Slot 10-Slot

UADP #1 Slot 2 and 7 Slot1, 9, and 10

UADP #2 Slot 1 and 5 Slot 2, 3 and 4

UADP #3 Slot 6 and Uplinks Slot 7, 8, and

Uplinks

Quad Core CPU(Control Traffic, Containers

for APPs)

Console/

Mgmt

SDRAM

USB

M.2 SATA

(optional)

240G 40G

UADP2.0 XL

#3

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Redundant Uplinks

Backplane

Network

Redundant

Unlink

UADP #3

Active Sup

Cores

Uplinks

UADP #3

Standby Sup

Cores

Network

Redundant

Unlink

Standby Uplinks stays

up when standby Sup

reboots

Uplinks

These components stay

operational when Sup

reboots

BRKARC-3873 113

Conclusion

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

7-Slot 10-Slot

Power Supply3200W AC

Core Linecards24x 10G SFP+*

24x1G SFP*

Access Linecards24xmGig + 24xUPOE*

48xUPoE

48xData

SupervisorSup-1: 80G/Slot Access Optimized

High

Availability/

Redundancy

100W PoE

Ready

480G

Slot BW

*not available at FCS

Catalyst 9400

BRKARC-3873 115

Open

IOS-XE

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Catalyst 9K enables the New Era of Networking

IOS XE16.5.1

Hosted AppsIOSdLXC

*LXC

*

IOS-XE

DB

Common Infrastructure /

HA

Management Interface

Module Drivers

Kernel

LXC

*Wire

shar

k

IOSd

Blob

IOS

Sub

Syst

ems

IOS

Sub

Syst

ems

IOS

Sub

Syst

ems

UADP 2.0 IOS XE 16.6

Catalyst 9K Family

Foundational Components

Catalyst 9K – Built to see you through Next Decade

Encrypted

Traffic

Analytics

(ETA)

Resiliency with

Patching &

GIR

Programmability

& Automation

Standards

Leadership

.3bt, .3bz, etc

Real time

Streaming

TelemetrySD Access

Trustworthy

Systems

3rd Party

App

Hosting

Fabric

Enabled

Wireless

X86 Based CPU Larger Storage

Usa

bili

ty &

Op

era

tion

al E

ffic

iency

BRKARC-3873 116

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Continue Your Education

• Cisco Live Sessions:

• BRKARC-3438: Cisco Catalyst 3850 and 3650 Series Switching Architecture (Tue 8 am; Wed 8 am)

• BRKARC-3445: Cisco Catalyst 4500E Switch Architecture (Thur 8:30 am)

• BRKARC-3465: Cisco Catalyst 6800 Switch Architecture (Tue 4 pm; Thur 8:30 am)

• BRKARC-3863: Catalyst 9300 Switching Architecture (Thur 10:30 am)

• BRKCRS-2410: Cisco Network Data Platform for Campus Networks (Tue 1:30pm; Wed 8am)

• Labs

• LTRCRS-2007: Catalyst Access Layer Innovations: Hands On Lab (Tue 1 p.m.)

• Lunch & Learn

• TTGEN-1002 (Tue 12 pm)

117BRKARC-3873

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Cisco Spark

Questions? Use Cisco Spark to communicate with the speaker after the session

1. Find this session in the Cisco Live Mobile App

2. Click “Join the Discussion”

3. Install Spark or go directly to the space

4. Enter messages/questions in the space

How

cs.co/ciscolivebot#BRKARC-3873

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

• Please complete your Online Session Evaluations after each session

• Complete 4 Session Evaluations & the Overall Conference Evaluation (available from Thursday) to receive your Cisco Live T-shirt

• All surveys can be completed via the Cisco Live Mobile App or the Communication Stations

Don’t forget: Cisco Live sessions will be available for viewing on-demand after the event at www.ciscolive.com/global/on-demand-library/.

Complete Your Online Session Evaluation

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Continue Your Education

• Demos in the Cisco campus

• Walk-in Self-Paced Labs

• Tech Circle

• Meet the Engineer 1:1 meetings

• Related sessions

120BRKARC-3873

Thank you

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

R&S Related Cisco Education Offerings

Course Description Cisco Certification

CCIE R&S Advanced Workshops (CIERS-1 &

CIERS-2) plus

Self Assessments, Workbooks & Labs

Expert level trainings including: instructor led workshops, self

assessments, practice labs and CCIE Lab Builder to prepare candidates

for the CCIE R&S practical exam.

CCIE® Routing & Switching

• Implementing Cisco IP Routing v2.0

• Implementing Cisco IP Switched

Networks V2.0

• Troubleshooting and Maintaining

Cisco IP Networks v2.0

Professional level instructor led trainings to prepare candidates for the

CCNP R&S exams (ROUTE, SWITCH and TSHOOT). Also available in

self study eLearning formats with Cisco Learning Labs.

CCNP® Routing & Switching

Interconnecting Cisco Networking Devices:

Part 2 (or combined)

Configure, implement and troubleshoot local and wide-area IPv4 and IPv6

networks. Also available in self study eLearning format with Cisco Learning

Lab.

CCNA® Routing & Switching

Interconnecting Cisco Networking Devices:

Part 1

Installation, configuration, and basic support of a branch network. Also

available in self study eLearning format with Cisco Learning Lab.

CCENT® Routing & Switching

For more details, please visit: http://learningnetwork.cisco.com

Questions? Visit the Learning@Cisco Booth

BRKARC-3873 123

© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public

Design Cisco Education Offerings

Course Description Cisco Certification

Designing Cisco Network Service Architectures

(ARCH) Version 3.0

Provides learner with the ability to perform conceptual, intermediate, and

detailed design of a network infrastructure that supports desired capacity,

performance, availability required for converged Enterprise network

services and applications.

CCDP® (Design Professional)

(Available Now)

Designing for Cisco Internetwork Solutions

(DESGN) Version 3.0

Instructor led training focused on fundamental design methodologies used

to determine requirements for network performance, security, voice, and

wireless solutions. Prepares candidates for the CCDA certification exam.

CCDA® (Design Associate)

(Available Now)

For more details, please visit: http://learningnetwork.cisco.com

Questions? Visit the Learning@Cisco Booth

BRKARC-3873 124