BRKOPT-2114 Ethernet Operations,Administration and Maintenance (E-OAM)Technical Overview

© 2006, Cisco Systems, Inc. All rights reserved.Presentation_ID.scr

1

© 2008 Cisco Systems, Inc. All rights reserved. Cisco PublicBRKOPT-211414366_04_2008_c1 2

Ethernet Operations, Administration and Maintenance (E-OAM): Technical Overview

BRKOPT-2114


2

© 2008 Cisco Systems, Inc. All rights reserved. Cisco Public 3BRKOPT-211414366_04_2008_c1

Agenda

Ethernet OAM Protocol OverviewIEEE 802.3ah (clause 57)

IEEE 802.1ag

ITU Y.1731

MEF E-LMI

Ethernet OAM Inter-Working

Ethernet OAM Fault Management “In Action”

Ethernet Performance Management—Cisco IP SLA

Summary


Ethernet OAM Protocol Overview


3


Drivers for Ethernet OAM

OAM BenchmarksSet by TDM and existing WAN technologies

Operational EfficiencyReduce OPEX, avoid truck-rolls

Downtime cost

Management ComplexityLarge Span Networks

Multiple constituent networks belong to disparate organizations/companies


Problem TaxonomyFault Management

Fault DetectionFault Verification Fault IsolationFault RecoveryFault Notification

Configuration ManagementService Provisioning

Performance ManagementFrame Loss Measurement Delay Measurement Delay Variation Measurement Availability Measurement

CarrierEthernetServices


4


Ethernet OAMBuilding Blocks

FaultManagementFault

Management

PerformanceManagementPerformance

Management

ConfigurationManagementConfiguration

Management

FaultManagement

FaultManagement


Management


Management


Management

PerformanceManagementPerformanceManagement


Management


Management


Management

ConfigurationManagement

ConfigurationManagement

802.3ah

E-LMI Cisco

IP SLAsService Layer

Network LayerTransport Layer

802.1ag/Y.1731

E-LMI


Ethernet OAMDecoder Ring

IEEE 802.1agConnectivity Fault Management (CFM)

Also referred as Service OAM

IEEE 802.3ah (Clause 57)Ethernet Link OAM

Also referred as 802.3 OAM, Link OAM or Ethernet in the First Mile (EFM) OAM

ITU-T Y.1731OAM functions and mechanisms for Ethernet-based networks

MEF E-LMIEthernet Local Management Interface


5


Cisco Carrier Ethernet OAMProtocol Positioning

E-LMI—User to Network Interface (UNI)

Link OAM—Any point-point 802.3 link

CFM—End-to-End UNI to UNI

MPLS OAM—Within MPLS cloud

Core Customer

ProviderBridges

ProviderBridges

IP/MPLS

Business

Residential

Business

Residential

UNI UNINNINNINNI

BackboneBridges

BackboneBridges

Customer

EthernetLink OAM

AccessConnectivity

Fault ManagementAccessE-LMI

MPLSOAM


IEEE 802.3ah (Clause 57) Link OAM


6


Link OAM (IEEE 802.3ah, Clause 57)

Provides mechanisms useful for “monitoring link operation,”such as:

Link Monitoring

Remote Failure Indication

Remote Loopback Control

Defines an optional OAM sub-layer

Intended for single point-to-point IEEE 802.3 links

Uses “Slow Protocol”* frames called OAMPDUs which are never forwarded by MAC clients

Standardized: IEEE 802.3ah, Clause 57 (now in IEEE 802.3-2005)

MAC

OAM (Optional)

LLC

Higher Layers

Physical Layer

LAN CSMA/CD Layers

Transport

Session

Presentation

Application

Network

Physical

Data Link

OSI Model

*No more than 10 frames transmitted in any one-second period


IEEE 802.3ahKey Functions

OAM DiscoveryDiscover OAM support and capabilities per device

Link MonitoringBasic error definitions for Ethernet so entities can detect failed and degraded connections

Fault SignalingMechanisms for one entity to signal another that it has detectedan error

Remote LoopbackUsed to troubleshoot networks, allows one station to put the other station into a state whereby all inbound traffic is immediately reflected back onto the link


7


IEEE 802.3ahOAM Events

Set of events that may impact link operation

Critical Link eventsLink Fault—Fault in the Rx direction of local DTE

Dying Gasp—Unrecoverable local failure condition

Critical Event—Unspecified critical event

Link eventsErrored Symbol Period Event

Errored Frame Event

Errored Frame Period Event

Errored Frame Seconds Summary Event


IEEE 802.3ahRemote Loopback

Fault localization and link performance testing

Loopback Control OAMPDU is used to control a remote OAM client

Traffic sent from master loopback port is loopback by slave port, except Pause and OAMPDU

OAM

MAC

PHY

OAM

MAC

PHY

XX

Master OAM Slave OAM


8


CE CEOperator A Operator B

Access SwitchCEinterface GigabitEthernet0/0description To uPE11 gig2/7ethernet oam remote-loopback supportedethernet oam

interface GigabitEthernet2/7description To CE11 gig0/0ethernet oam max-rate 5ethernet oam remote-loopback supportedethernet oam timeout 30ethernet oam remote-failure link-fault action error-disable-interfaceethernet oam remote-failure dying-gasp action error-disable-interfaceethernet oam remote-failure critical-event action error-disable-interfaceethernet oam

Cisco E-OAM Implementation802.3ah Provisioning

GE2/7GE0/0

CEuPE


IEEE 802.1agConnectivity Fault Management (CFM)


9


CFM Overview

Family of protocols that provides capabilities to detect, verify, isolate and report end-to-end ethernet connectivity faults

Employs regular Ethernet frames that travel in-band with the customer traffic

Devices that cannot interpret CFM Messages forward them as normal data frames

Standardized by IEEE (P802.1ag) in late 2007IEEE std. 802.1ag-2007


CFM Overview (Cont.)

Key CFM mechanisms include:Nested Maintenance Domains (MDs) that break up the responsibilities for network administration of a given end-to-end service

Maintenance Associations (MAs) that monitor service instances under a given MD

Maintenance Points (MPs) that generate and respond to CFM PDUs

Protocols (Continuity Check, Loopback and Linktrace) used for Fault Management activities


10


CFM ConceptsMaintenance Domain (MD)

Defined by Operational/Contractual Boundariese.g. Customer/Service Provider/Operator

MD may nest and touch, but never intersect

Up to eight levels of “nesting”: MD Level (0..7)The higher the level, the broader its reach

Operator A Operator B

Service Provider

Customer

CE CE


CFM ConceptsMaintenance Association (MA)


Monitors connectivity of a particular service instance in a given MD (e.g. one service traversing four MDs = four MAs)

Defined by a set of Maintenance End Points (MEP) at the edge of a domain

Identified by MAID == “Short MA” Name + MD Name


11


CFM ConceptsMaintenance Point (MP)—MEP

Maintenance Association End Point (MEP)Define the boundaries of a MDSupport the detection of connectivity failures between any pair of MEPs in an MAAssociated per MA and identified by a MEPID (1-8191)Can initiate and respond to CFM PDUs


MEP MEP

MEP MEP

MEP MEP MEP MEP



MEP MEPMIP MIP

MEP MEPMIPMIP

MEP MEP MEP MEP

MIP MIP

MIP MIP

MIP MIP

MIPMIPMIPMIP

CFM ConceptsMaintenance Point (MP)—MIP

Maintenance Domain Intermediate Point (MIP)

Support the discovery of paths among MEPs and location of faults along those paths

Can be associated per MD, rather than per MA

Can add, check and respond to received CFM PDUs


12


CFM ConceptsUP/Inward-Facing MEP

CFM PDUs generated by the MEP are sent toward the Bridge’s Relay Function and not via the wire connected to the port where the MEP is configured

CFM PDUs to be responded by the MEP are expected to arrive via the Bridge’s Relay Function

Applicable to switches

Port A

Bridge

RelayEntity

Port B

CFM PDUs


CFM ConceptsDOWN/Outward-Facing MEP

CFM PDUs generated by the MEP are sent via the wire connected to the port where the MEP is configured

CFM PDUs to be responded by the MEP are expected to arrive via the wire connected to the port where the MEP is configured

Applicable to routersand switches

Port A

Bridge/Router

RelayEntity

Port B

CFM PDUs


13


Monitored Area

CFM ConceptsMAs and UP/DOWN MEPs

DOWN MEPs are typically used for MAs spanning a single link

UP MEPs are commonly used for MAs with a wider reach (e.g. end-to-end, beyond a single link

Bridge

Port

Bridge 1

RelayEntity

Bridge

Port

Bridge

Port

Bridge 2

RelayEntity

Bridge

Port

Monitored Area

Bridge

Port

Bridge 1

RelayEntity

Bridge

Port

Bridge

Port

Bridge 2

RelayEntity

Bridge

Port

UP MEP

DOWN MEPApplicability of UP/DOWN MEPs in switches:


CFM Protocols

There are three (3) protocols defined by CFM

Continuity Check ProtocolFault Detection

Fault Notification

Loopback ProtocolFault Verification

Linktrace ProtocolFault Isolation


14


CFM ProtocolsContinuity Check Protocol


MEP MEPMIPMIPCatalogue Catalogue

Catalogue andTerminate

1 2 3

Continuity Check Message (CCM)

X

Used for Fault Detection and NotificationPer-Maintenance Association multicast “heart-beat” messages

Carries status of port on which MEP is configuredUni-directional (no response required)Transmitted at a configurable periodic interval by MEPs

Catalogued by MIPs at the same MD-Level, terminated by remote MEPs in the same MA


CFM ProtocolsContinuity Check Protocol—Fault Detection

Reception of its own CCM

Remote port failure indicated by the reception of a CCM containing a Port Status TLV or Interface Status TLV

Reception of a CCM containing an RDI Flag bit set

Inability to receive CCMs from a remote MEP configured in the receiving device

Reception of a CCM with an incorrect transmission interval

Inability to receive consecutive CCMs from a remote MEP in the same MA

Reception of a CCM from a remote MEP not configured in the receiving device

Reception of a CCM with an incorrect MPID (i.e. duplicate value)

Reception of a CCM with an MD Level lower than that of the receiving MEP

Reception of a CCM with an incorrect MAID (e.g. MEP in another MA)

Detectable Faults


15


CrossCheck FunctionPost-Provisioning Verification

Timer-driven post-provisioning service verification utilityNot a CFM protocolComplements Continuity Check

Compares remote MEPs dynamically discovered (via CCM DB) versus expected MEPs (via config) for a given serviceSupport alarms/notifications for

Service Operational/Unexpected End-Point/Missing End-Point

CE 1 CE 4

MEP 1

CE 2 CE 3

MEP 4

MEP 2 MEP 3

mpid 1mpid 3mpid 4

mpid 1mpid 2mpid 4

mpid 1mpid 2mpid 3

mpid 2mpid 3mpid 4

Crosscheck List:


CFM ProtocolsLoopback Protocol


MEP MEPMIPMIPS D

Loopback Message (LBM)Loopback Reply (LBR)

12

12

Used for Fault Verification—Ethernet Ping

MEP can transmit a unicast LBM to a MEP or MIP in the same MA

Receiving MP responds by transforming the LBM into a unicast LBR sent back to the originating MEP


16


CFM ProtocolsLinktrace Protocol

Used for Path Discovery and Fault Isolation—Ethernet Traceroute

MEP can transmit a multicast message (LTM) in order to discover the MPs and path to a MIP or MEP in the same MA

Each MIP along the path and the terminating MP return a unicast LTR to originating MEP


MEP MEPMIPMIPS D

1 3 5

24 6

1, 3, 5 Linktrace Message (LTM)

2, 4, 6 Linktrace Reply (LTR)

XY


CFM ProtocolsPutting Everything Together

1. Run Connectivity Check to proactively detecta soft or hard failure

2. Upon a failure detection, use Loopback to verify it

3. Upon verification, run Traceroute to isolate it; multiple segment LPs can also be used to isolate the fault

4. If the isolated fault points to a virtual circuit, then the OAM tools for that technology can be used to further fault isolation—e.g., for MPLS PW, VCCV and MPLS ping can be used


17


Troubleshooting: Example

CE 1

MPLS Access

MPLS CoreEthernetAccess

CE 2uPE AnPE AnPE BuPE B

Customer Service Provider

PE-Agg B

Service Provider Domain

Operator Domains

Customer Domain

!

Defect Locality Zone

Loopback andLink Trace Tests

‘Uncertainty’ Zone Shrinks with Every

Lower Level Domain

Defect Successfully Isolated


Cisco CFM ImplementationCFM Network and Service Provisioning


interface GigabitEthernet2/7ethernet cfm mip level 7ethernet cfm mep level 4 mpid 1500 vlan 500

MEP

Global Configuration

MIP

MD and MD LevelMA

MEP MIP

interface GigabitEthernet2/1ethernet cfm mip level 4

ethernet cfm domain Customer_Domain level 7ethernet cfm domain Provider_Domain level 4

service customer_500_provider vlan 500ethernet cfm enableethernet cfm traceroute cache!ethernet cfm cc enable level any vlan any!snmp-server enable traps ethernet cfm cc mep-up mep-down cross-connect loop configsnmp-server enable traps ethernet cfm crosscheck mep-missing mep-unknown service-up

MEPGE2/7

MIPGE2/1


18


CFM DeploymentScenario A

Access 1 Access 2Aggregation 1 Aggregation 2CE1 CE2

Admin Domain “A”

End to End service provided over a single Administrative Domain (e.g. Carrier A)

Ethernet Aggregation


CFM DeploymentScenario A (Cont.)

CustomerDomain

SPDomain

LinkDomain

MEP MIP




19


CFM DeploymentScenario B

Admin Domain “B”Admin Domain “A”


End to End service provided by a SP (e.g. Carrier A) who relies on another SP access network (e.g. Carrier B) to reach some customer sites



CFM DeploymentScenario B (Cont.)

CustomerDomain

SPDomain

OperatorDomain

LinkDomain

MEP MIP




20


ITU Y.1731 OAM Functions and Mechanisms for Ethernet-Based Networks


ITU-T Y.1731

OAM Functions for Fault ManagementEthernet Continuity Check, Loopback and Link Trace (ETH-CC, ETH-LB and ETH-LT)

Inline with CFM standard with added extensions:Multicast LBM, unicast CCM possible in Y.1731

Ethernet Locked Signal (ETH-LCK)Ethernet Test Signal (ETH-TEST)Alarm Indication Signal (ETH-AIS)Ethernet Remote Defect Indication (ETH-RDI)

OAM Functions for Performance ManagementFrame Loss Measurement (ETH-LM)Frame Delay Measurement (ETH-DM)

Approved on May 2006 by ITU-T SG 13


21


MEF Ethernet Local Management Interface (E-LMI)


Ethernet LMIOverview

Provides protocol and mechanisms used for:Notification of Remote UNI status to CE

Notification of EVC addition, deletion or status (Active, Not Active, Partially Active) to CE

Communication of UNI and EVC attributes to CE (e.g. CE-VLAN to EVC map)

CE auto-configuration

Asymmetric protocol based on Frame Relay LMI, mainly applicable to the UNI (UNI-C and UNI-N)

Specification completed by MEF:http://www.metroethernetforum.org/PDFs/Standards/MEF16.doc

CE

User Network Interface(UNI)

UNI-C UNI-N

E-LMI

MetroEthernetNetwork


22


Ethernet LMIPeriodic Polling and Asynchronous Update

Based on polling procedure invoked by CE

N391—Polling Counter, polling cycles between Full Status exchanges

N393—Status Counter, number of consecutive errors

T391—Polling Timer (PT), UNI-C transmits Status Enq.

T392—Polling Verification Timer (PVT), timer by which UNI-N expects to be polled

ELMI-CE (UNI-C) ELMI-PE (UNI-N)STATUS ENQ (Ethernet LMI Check)A

D

B STATUS (Ethernet LMI Check) C

STATUS ENQ (Ethernet LMI Check)STATUS (Ethernet LMI Check)

A

BC

STATUS ENQ (Full Status Req)STATUS (Full Status Resp)

A

BC

STATUS ENQ (Ethernet LMI Check)STATUS (Ethernet LMI Check)

A

B C

STATUS (EVC ASYNC Status) E

A T391 Expiry B Restart T391

C Restart T392 D N391 polls sent

E MEN Update



ELMI-PE*

ethernet lmi globalethernet evc EVC_P2P_500uni count 2oam protocol cfm svlan 500 domain Provider_Domain

!

interface GigabitEthernet2/7description To CE11 gig0/0ethernet uni id CE11_UNIservice instance 666 ethernet EVC_P2P_500ethernet lmi ce-vlan map 500

ethernet lmi interface

ELMI-CE

interface GigabitEthernet0/0description To uPE11 gig2/7ethernet lmi interface

!interface GigabitEthernet0/0.500description L3VPN serviceencapsulation dot1Q 500ip address 2.2.2.2 255.255.255.0

CE uPE

Cisco E-OAM ImplementationE-LMI Provisioning

*The ELMI-PE configuration is incomplete as it is missing the CFM component that allows ELMI to communicate EVC/UNI status to CE; see OAM IW example for complete configuration

GE2/7GE0/0


23


Ethernet OAM Interworking


What Is OAM Interworking?

Ethernetover SONET

Ethernetover MPLS

10GEthernet

ATMRFC1483

Edge Bridge

Bridge

Bridge

Bridge

Edge Router

Switch

Switch

Router

Router

Router

ATM

Switch

ATM

Switch

Operator A Operator B

Network OAM

Network OAM

Custom

er B

ridge

Custom

er B

ridge

Transport OAM

Transport OAM

Transport OAM

Transport OAM

Server Layers Feed Events into

Client Layers

Service OAM

Strict OAM layering should be honored: messages should not cross layers OAM Messages should not leak outside domain boundaries within a layerInterworking is event translations and not necessarily 1:1 message mappingInterworking may be inter-layer and intra-layer

Event Translation Inter-Domains

Intra-Layer


24


Interworking ScenariosMain Examples

MPLS PW OAM

CFM

Link OAM

MPLS PW OAM

E-LMI

E-LMI

CFM

CFM


Interworking ScenariosCFM to E-LMI

Port State TLV of CC Messages carry remote UNI statusMEP Name TLV of CC Messages carry remote UNI nameStatus of remote MEP in CCDB indicates EVC State

CE 11

CE

Ethernet Access

MPLS Aggregation

EthernetAccess

Service Layer OAM

Network Layer OAM

E-LMI

CE 31uPE 31nPE 31nPE 11uPE 11

Provider Level CFM

CFM to E-LMI I/W


CFM at Provider Level acts as MEN OAM: provides EVC Status and Remote UNI Status/Name to E-LMI


25


CE

Ethernet Access

MPLS Aggregation

EthernetAccess


Interworking Scenarios802.3ah to CFM (CC-Based)

Link Layer Defects detected by 802.3ah, relayed to CFM on same device CFM notifies remote devices of localized fault Two variants:

CC-based (802.3ah on edge of domain)AIS-based (802.3ah within domain)

CE 1 CE 31uPE 31nPE 31nPE 11uPE 11 PE-AggService

Layer OAM

Transport Layer OAM

CC

802.3ah802.3ah to CFM I/W


CE

Ethernet Access

MPLS Aggregation

EthernetAccess

Interworking Scenarios802.3ah to CFM (AIS-Based)

Link Layer Defects detected by 802.3ah, relayed to CFM on same device CFM notifies remote devices of localized fault Two variants:

CC-based (802.3ah on edge of domain)AIS-based (802.3ah within domain)

CE 1 CE 31uPE 31nPE 31nPE 11uPE 11 PE-AggService

Layer OAM

Transport Layer OAM

AISAIS

802.3ah 802.3ah to CFM I/W



26


CE

Ethernet Access

MPLS Aggregation

EthernetAccess

Interworking ScenariosMPLS PW OAM to CFM

Directed-LDP and VCCV (BFD mode) running between nPEsD-LDP for defect notification, VCCV for defect detectionThree-way I/W function at nPERequires CFM AIS/RDI

CE 1Service Layer

OAM

Transport Layer OAM

CE 2uPE AnPE AnPE BuPE B PE-Agg B

AISAIS

VCCV-BFDD-LDP

PW OAM to CFM I/W



Interworking ScenariosMPLS PW OAM to E-LMI

Directed-LDP and VCCV (BFD mode) running between PEs

D-LDP for defect notification, VCCV for defect detection

Defects detected/communicated by PW OAM are relayed to E-LMI via I/W function on PE

CE 1

CE

MPLS Core

Service Layer OAM

Transport Layer OAM

CE 2PE APE B


VCCV-BFDD-LDP

E-LMI E-LMI

PW OAM to E-LMI I/W

Customer


27



MEPGE2/7

MIPGE2/1

Cisco E-OAM ImplementationInterworking Provisioning

Interface Configuration

ethernet cfm domain Customer_Domain level 7ethernet cfm domain Provider_Domain level 4

service customer_500_provider vlan 500ethernet cfm enable!ethernet evc EVC_P2P_500uni count 2oam protocol cfm svlan 500 domain Provider_Domain

!ethernet cfm cc enable level any vlan any!snmp-server enable traps ethernet cfm cc mep-up

mep-down cross-connect loop configsnmp-server enable traps ethernet cfm crosscheck

mep-missing mep-unknown service-up

interface GigabitEthernet2/1description NNI Uplinkswitchport trunk allowed vlan 500switchport mode trunkethernet cfm mip level 4

!interface GigabitEthernet2/7description UNI To CE11switchport trunk allowed vlan 500switchport mode trunkethernet uni id CE11_UNIservice instance 666 ethernet

EVC_P2P_500ethernet lmi ce-vlan map 500

ethernet lmi interface ethernet oamethernet cfm mip level 7ethernet cfm mep level 4 mpid 1500 vlan

500

Global Configuration


Ethernet OAM Fault Management “In Action”


28


CFM Instrumentation Cisco SNMP Traps

Cisco-defined MIB (CISCO-ETHER-CFM-MIB)

CCM traps generated by MEPs

cEtherCfmCcLoopcEtherCfmCcCrossconnectcEtherCfmCcMepDowncEtherCfmCcMepUp

CCM

cEtherCfmCcConfigError

ObjectTrap Type


CFM Instrumentation Cisco SNMP Traps (Cont.)

Cisco-defined MIB (CISCO-ETHER-CFM-MIB)

Crosschecks traps generated by MEPs

cEtherCfmXCheckUnknown

cEtherCfmXCheckMissing

cEtherCfmXCheckServiceUpCross-Check

ObjectTrap Type


29


CFM Instrumentation Continuity Check Protocol—Fault Detection

Reception of a CCM from a remote MEP assigned to another service -The reception of a CCM with an incorrect MAID

Reception of a CCM from a remote MEP not configured in the receiving MEP crosscheck list

Reception of a CCM with an incorrect MPID (i.e. duplicate value)

Reception of a CCM with a Lifetime of zero (Last Gasp CCM – due to remote MEP removed or disabled)

Reception of its own CCM

Remote port failure indicated by the reception of a CCM containing a Port Status TLV or Interface Status TLV

Inability to receive CCMs from a remote MEP configured in the receiving MEP crosscheck list

Inability to receive consecutive CCMs from a remote MEP in the same MA

CCM-Based Detectable Faults

CCM Crossconnect

Crosscheck Unknown MEP

CCM Configuration Error

CCM MEP Down(code: lastGasp)

CCM Loop

CCM MEP Up(code: portState)

Crosscheck Missing MEP

CCM MEP Down(code: timeout)

Notification (SNMP Trap)


The reception by a MEP of CCMs from ALL remote MEP configured inthe receiving MEP crosscheck list

Remote port recovery - The reception by a MEP of a CCM containing a Port Status TLV or Interface Status TLV

Re-discovery of a previously expired remote MEP

Discovery of a remote MEP for the first time

CCM-Based Detectable Events

Crosscheck Service Up

CCM MEP Up(code: portState)

CCM MEP Up(code: returning)

CCM MEP Up(code: new)

Notification (SNMP Trap)

CFM Instrumentation Continuity Check Protocol—Fault Detection (Cont.)

There is also notification for the following conditions:CCM Configuration Error clear

CCM Loop clear

CCM Crossconnect clear

Crosscheck Unknown clear


30


Deploying Carrier Ethernet OAMEthernet Layer 2 VPN Services

Ethernet Access

MPLSAggregation/Core

EthernetAccess

Customer Service Provider Customer

ISR 2800 ISR 28003750-MEME-3400 EoMPLS Pseudowire 76007600

Point-to-Point Ethernet Service



CE 11 CE 31uPE 31uPE 11 nPE 31nPE 11

CFME-LMILink OAM E-LMI

Link OAM

OAM Protocol Positioning

EoMPLS Pseudowire

MPLS OAM

Ethernet Access

MPLSAggregation/Core

EthernetAccess

Customer Service Provider Customer


31



CFM Continuity Check Messages (CCM)

t0t1

t2

CE 11 CE 31uPE 31uPE 11 nPE 31nPE 11 EoMPLS Pseudowire

Proactive End-to-End Service Monitoring

uPE11#show ethernet cfm maintenance-points localMPID DomainName Level Type VLAN Port CC-Status MAC1100 PROVIDER_DOMAIN 4 MEP 100 Gi0/1 Enabled 0019.552b.b480

Level Type Port MAC7 MIP Gi0/1 0019.552b.b4804 MIP Gi0/16 0019.552b.b480

uPE11#show ethernet cfm maintenance-points remoteMPID Level Mac Address Vlan PortState InGressPort Age(sec) Service ID3100 4 0012.017c.3d00 100 UP Gi0/16 3 customer_100_provider

CCMDatabase



CFM Loopback Message (LBM)

CFM Loopback Reply (LBR)


uPE11# ping ethernet

End-to-End Service/Failure Verification

uPE11#ping ethernet mpid 3100 level 4 vlan 100

Type escape sequence to abort.Sending 5 Ethernet CFM loopback messages, timeout is 2 seconds:!!!!!Success rate is 100 percent (5/5), round-trip min/avg/max = 1/1/1 ms


32



CFM Linktrace Message (LTM)CFM Linktrace Reply (LTR)


uPE11# traceroute ethernet

Service Path Discovery/Failure Isolation




uPE11# traceroute ethernet

Service Path Discovery/Failure Isolation

uPE11#traceroute ethernet 0012.017c.3d00 level 4 vlan 100Type escape sequence to abort. TTL 255. Per-Hop Timeout is 10 secondsTracing the route to 0012.017c.3d00 on Domain PROVIDER_DOMAIN, Level 4, vlan 100Traceroute sent via GigabitEthernet0/16

--------------------------------------------------------------------------------MAC Ingress Ingress Action Relay Action

Hops Host Forwarded Egress Egress Action Next Hop --------------------------------------------------------------------------------B 1 nPE11 0013.5f21.cec5 Gi3/1 IngOk RlyCCDB

ForwardedB 2 nPE31 0007.8508.3485 RlyFDB

Forwarded Gi3/1 EgrOK uPE31! 3 uPE31 0012.017c.3d00 Gi1/1/1 IngOk RlyNone

Not Forwarded


33



ELMI Status Enquiry Message (Full Status Report)

ELMI Status Message (Full Status Report)


Local UNI ID CE11_UNICE-VLAN/EVC Map type Service_MultiplexingEVC ID EVC_P2P_100EVC Type Point_to_PointCE-VLAN/EVC Map vlan 100EVC Status New, ActiveRemote UNI count – configured 1Remote UNI count – active 1Remote UNI ID CE31_UNIRemote UNI status UP

Example:

CE Notification




ELMI Status Enquiry Message (Full Status Report)

ELMI Status Message (Full Status Report)

CE Notification

CE11#show ethernet lmi evc detail EVC_P2P_100EVC Id: EVC_P2P_100interface GigabitEthernet0/0Time since Last Full Report: 00:08:24Ether LMI Link Status: UpUNI Status: UpUNI Id: CE11_UNICE-VLAN/EVC Map Type: Service Multiplexing with no bundlingVLAN: 100

EVC Status: ActiveEVC Type: Point-to-PointRemote UNI Count: Configured = 1, Active = 1

UNI Id UNI Status Port------ ---------- ----CE31_UNI Up Remote


34




P Failure:“no mpls ip”

PE Looses Directly Attached LDP NeighborLFIB Cleanup; No Tunnel Label for PW

PE Transmits LDP Status TLVLocal LDP TLV Status sent: Down (pw-tx-fault)Remote LDP TLV Status

Received: Down (pw-tx-fault)

ELMI Status MessageAsync EVC Report


CE Brings Down(Sub)interface


X

Failure Scenario: MPLS P Node

CFM Remote MEP TimeoutMEP Down (Timeout) SNMP TrapEVC Declared InactiveCFM to ELMI Interworking

CFM Remote MEP TimeoutMEP Down (Timeout) SNMP TrapEVC Declared InactiveCFM to ELMI Interworking




X

CE11#Feb 3 02:22:40.820: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0.100,changed state to down


EVC Status: InactiveEVC Type: Point-to-PointRemote UNI Count: Configured = 1, Active = 0

UNI Id UNI Status Port------ ---------- ----CE31_UNI Unreachable Remote


35




X

uPE11#Feb 3 02:22:39.814: %ETHER_SERVICE-6-EVC_STATUS_CHANGED: status of EVC_P2P_100 changed to InActive

uPE11#show ethernet cfm errorsLevel Vlan MPID Remote MAC Reason Service ID4 100 3100 0012.017c.3d00 Lifetime Timer Expir customer_100_provider

uPE11#ping ethernet mpid 3100 level 4 vlan 100Type escape sequence to abort.Sending 5 Ethernet CFM loopback messages, timeout is 2 seconds:.....Success rate is 0 percent (0/5)

uPE11#traceroute ethernet 0012.017c.3d00 level 4 vlan 100Type escape sequence to abort. TTL 255. Per-Hop Timeout is 10 secondsTracing the route to 0012.017c.3d00 on Domain PROVIDER_DOMAIN, Level 4, vlan 100Traceroute sent via GigabitEthernet0/16

--------------------------------------------------------------------------------MAC Ingress Ingress Action Relay Action

Hops Host Forwarded Egress Egress Action Next Hop --------------------------------------------------------------------------------B 1 nPE11 0013.5f21.cec5 Gi3/1 IngOk RlyCCDB

Forwarded **




CE UNI Failure:Admin “Shutdown”

CE Transmits802.3ah Dying Gasp



CFM MEP Up (Port Sate Down) SNMP TrapEVC Declared InactiveCFM to ELMI InterWorking

EVC Declared Inactive 802.3ah to CFM InterWorking

CFM CCMPort State TLV DOWN

X

Failure Scenario: UNI Failure


36




X

CE11#Feb 4 15:03:08.183: %LINEPROTO-5-UPDOWN: Line protocol on Interface GigabitEthernet0/0.100, changed state to down


EVC Status: InactiveEVC Type: Point-to-PointRemote UNI Count: Configured = 1, Active = 0

UNI Id UNI Status Port------ ---------- ----CE31_UNI Down Remote

uPE11#Feb 4 15:03:08.182: %ETHER_SERVICE-6-EVC_STATUS_CHANGED: status of EVC_P2P_100 changed to InActive

uPE11#show ethernet cfm maintenance-points remoteMPID Level Mac Address Vlan PortState InGressPort Age(sec) Service ID3100* 4 0012.017c.3d00 100 DOWN Gi0/16 7 customer_100_provider


Cisco IP SLA Ethernet Performance Management


37


Cisco IP SLAsPerformance Management

Cisco IP SLAs Embedded Policy ManagementScheduling Automation/Policy Alerts/Data Collection

In-Band Performance Management Tool for EthernetDelay, Delay Variation and Packet Loss measurementBuilt in CFM principles

Automatic Discovery of Probe Endpoints

Cisco IP SLAs

CFM IPMPLS

Echo ProbeJitter Probe

Embedded Policy Management


Cisco IP SLACFM Integration Highlights

In-Band Performance Management Tool for EthernetUse native Ethernet frames

IP not required

Built over CFMUse Ethernet CFM frames to collect statistics

Probes performed in context of a VLAN and a CFM Maintenance Domain

CFM MEPs define probe endpoints

Automatic Discovery of Probe EndpointsRely on CFM Continuity Check Database (CCDB) to automatically discover Probe Endpoints

EVC and Maintenance Domain based

Support ‘static’ probes and exclusions


38


Cisco IP SLAEthernet Probe Types

Per Service, Ethernet Probe

Uses Proprietary CFM Messages

Measures Unidirectional Packet Loss, Jitter and Latency

Jitter Probe

Echo Probe

Probe Type

Per Service, Ethernet Probe

Uses CFM LBM/LBR PDUs

Measures RTT

Capability


MEP• Probe Initiation/End Point

Auto-Discovers All Other MEPs in Domain/VLAN

U-PE A

U-PE B U-PE C

N-PE 3

N-PE 4N-PE 2

N-PE 1

CustomerEquipment

CE

CE CE

SP NetworkAccess Core

CEU-PE D

MPLSMPLS

NativeEthernet

NativeEthernet

Provider Domain

Operator Domain

Cisco IP SLAHierarchical Performance Management

SLA measurement operations in one domain are transparent to higher/lower domains

Allows for ‘segmented’, ‘composite’ and ‘end-to-end’ measurements

Follows CFM Maintenance Domain Hierarchical Model: Customer, Service Provider, Operator

Customer Domain


39


Cisco IP SLAProbe Endpoint Auto Discovery

Probe endpoints dynamically discovered for given VLAN within a Maintenance Domain

New probes automatically created for newly added endpoints (sites)

U-PE A

U-PE B U-PE C

N-PE 3

N-PE 4N-PE 2

N-PE 1

CustomerEquipment

CE

CE CE

SP NetworkAccess Core

CEU-PE D

MPLSMPLS

NativeEthernet

NativeEthernet A

B

Probe: VLAN 100 Domain SP1A MPID AAAAB MPID BBBBC MPID CCCC

Add New Site

Only Need to Configure New Site CE for CFM

No Changes to Existing Sites for SLA Measurement

C


Summary


40


Cisco E-OAM ImplementationShipping Platforms and Features

XN/AN/AN/AN/AMPLS PW OAM to E-LMI IW

X

X

Cisco Catalyst 6500,

ME-6524

X

X

X

X

X

X

Cisco 7600

XXN/AN/AN/ACFM to E-LMI IW

XXN/AN/AN/AEthernet LMI PE

XXXXXLink OAM (IEEE 802.3ah)

XXIP SLA for Metro Ethernet

XXN/AN/AN/ALink OAM to CFM IW

XXXXXEthernet LMI CE

XXXXXCFM (IEEE 802.1ag)

Cisco Catalyst®3750-ME

Cisco ME-3400Cisco 3800Cisco 2800Cisco

1800

Platform

Feature

X = Shipping N/A = Not Applicable


Cisco E-OAM ImplementationShipping Platforms and Features (Cont.)

N/AN/AN/ACFM to E-LMI IW

N/AN/AN/AEthernet LMI PE

XXXLink OAM (IEEE 802.3ah)

IP SLA for Metro Ethernet

N/AN/AN/ALink OAM to CFM IW

XXXEthernet LMI CE

XXXCFM (IEEE 802.1ag)

Cisco 7301Cisco 7201Cisco 7200 7200-NPE-G2

X = Shipping N/A = Not Applicable

Platform

Feature


41


Cisco E-OAM ImplementationUpcoming Platforms and Features

Q3 CY’08—12.2(46)XO

K5-Metro(ME-X45-SUP6-E)

Q3 CY’08—Rel. 9.0

Q3 CY’08—Rel. 9.0

ONS 15454 (ML-MR-10)

Q3 CY’08—12.2(46)SG

Q3 CY’08—12.2(46)SG

IP SLA for Metro Ethernet

Q3 CY’08—12.2(46)SG

Q3 CY’08—12.2(46)SG

Q3 CY’08—12.2(46)SG

Cisco Catalyst 4500/Cisco

Catalyst 4500-E (Supported SUPs*)

Q3 CY’08—12.2(46)SG

Q3 CY’08—12.2(46)SG

Q3 CY’08—12.2(46)SG

Cisco Catalyst ME-4924/Cisco

Catalyst 4948/Cisco Catalyst 4900M

CFM to E-LMI IW

Ethernet LMI (MEF-16) PE/CE

Link OAM (IEEE 802.3ah)

Link OAM to CFM IW

CFM (IEEE 802.1ag)

Platform

Feature

*Sup II-Plus, Sup II-Plus-TS, Sup II-Plus-10GE, Sup III (EOL), Sup IV, Sup V, Sup V-10GE, Sup 6-E


Summary

1800, 2800, 3800 ISR

ME 3400,3750 Metro

7600

ISR

ISR

ISR

802.1ag

E-LMI

802.3ah802.3ah 802.3ah802.3ah802.3ah 802.3ahService

LinkService

ME 34003750 Metro

ISRME 3400

7600

Core

7600 7600 7600

E-LMI

Cisco Carrier Ethernet CapabilitiesIEEE 802.1ag: Fault Management per Service/VLANIEEE 802.3ah Link Protection and MonitoringMEF 16 E-LMI for Customer Premise Equipment

BenefitsEnd-to-End Service ManageabilityFirst Mile Physical Connectivity VerificationPro-active Service Status and Availability

Cisco’s Carrier Ethernet OAM: Industry’s Only Solution with End-to-End Manageability and Customer Loyalty—Service Level Assurance


42


E-OAM Information at Cisco.com

Ethernet Operations, Administration and Maintenance—White Paper

http://www.cisco.com/en/US/products/hw/routers/ps368/products_white_paper0900aecd804a0266.shtml

FAQ OAM for Carrier Ethernet Networkshttp://www.cisco.com/en/US/netsol/ns341/ns121/ns389/netqa0900aecd8052f3c3.html

Cisco IOS® 12.2SR—Cisco 7600, Connectivity Fault Management (CFM)

http://www.cisco.com/univercd/cc/td/doc/product/software/ios122sr/newft/122sra33/srethcfm.htm

Cisco IOS 12.2SR—Cisco 7600, Ethernet Local Management Interface (E-LMI)

http://www.cisco.com/univercd/cc/td/doc/product/software/ios122sr/newft/122srb33/srbpelmi.htm


E-OAM Information at Cisco.com (Cont.)

Cisco IOS 12.2SR—Cisco 7600, Link OAM (802.3ah)http://www.cisco.com/univercd/cc/td/doc/product/software/ios122sr/newft/122sra33/srethoam.htm

Cisco IOS 12.2SR—Cisco 7600 FE/GE SPA, Link OAM (802.3ah)http://www.cisco.com/univercd/cc/td/doc/product/core/cis7600/76sipspa/sipspasw/76ethspa/76cfgeth.htm#wp1199442

Cisco IOS 12.2SR—IP SLA for Metro Ethernethttp://www.cisco.com/univercd/cc/td/doc/product/software/ios122sr/newft/122srb33/sr_meth.htm

Cisco IOS 12.2SR—EoMPLS Remote Link Failure Notification via E-LMI (aka Remote Port Shutdown)

http://www.cisco.com/univercd/cc/td/doc/product/software/ios122sr/newft/122srb33/srbrpsdn.htm


43


E-OAM Information at Cisco.com (Cont.)

Cisco IOS 12.2(37)SE—Cisco ME-3400, CFM, E-LMI and Link OAM

http://www.cisco.com/univercd/cc/td/doc/product/metro/me3400/12237se1/scg/swoam.htm

Cisco IOS 12.2(37)SE—Cisco Catalyst 3750-ME, CFM, E-LMI and Link OAM

http://www.cisco.com/univercd/cc/td/doc/product/lan/cat3750m/12237se/scg/swoam.htm

Cisco IOS 12.4(9)T—Cisco ISR Router Family, Ethernet Local Management Interface (E-LMI)

http://www.cisco.com/univercd/cc/td/doc/product/software/ios124/124newft/124t/124t9/htethlmi.htm

Cisco IOS 12.4(11)T—Cisco ISR Router Family, Connectivity Fault Management (CFM)

http://www.cisco.com/univercd/cc/td/doc/product/software/ios124/124newft/124t/124t11/srethcfm.htm


Acronyms

MA Identifier (see MA)MAID

Maintenance DomainMD

Maintenance AssociationMA

Local Management InterfaceLMI

Loopback ReplyLBR

Loopback MessageLBM

Linktrace MessageLTM

Linktrace ReplyLTR

International Telecommunication UnionITU

Alarm Indication SignalAIS

Ethernet OAM (see OAM)E-OAM

Connectivity Fault ManagementCFM

IEEE

EVC

E-LMI

EFM

CE

CCMDB

CCM

Acronym

Ethernet in the First Mile

Customer Edge

CCM Data Base (see CCM)

Continuity Check Message

Ethernet Virtual Connection

Ethernet LMI (see LMI)

Institute of Electrical and Electronics Engineers

Network Side of UNI (see UNI)UNI-N

VLAN IdentifierVID

Virtual LANVLAN

User to Network InterfaceUNI

Type, Length, ValueTLV

Maintenance Association End PointMEP

MEP Identifier (see MEP)MEPID

MIP Half Function (see MIP)MHF

Management Information BaseMIB

Maintenance Domain Intermediate PointMIP

Maintenance PointMP

Remote Defect IndicatorRDI

Provide EdgePE

Protocol Data UnitPDU

Remote Failure IndicatorRFI

Customer Side of UNI (see UNI)UNI-C

Operations, Administration and MaintenanceOAM

MEN

MEF

AcronymMetro Ethernet Forum

Metro Ethernet Network


44


Q and A


Recommended Reading

Continue your Cisco Live learning experience with further reading from Cisco Press®

Check the Recommended Reading flyer for suggested books

Available Onsite at the Cisco Company Store


45


Complete Your Online Session Evaluation

Give us your feedback and you could win fabulous prizes; winners announced daily

Receive 20 Passport points for each session evaluation you complete

Complete your session evaluation online now (open a browser through our wireless network to access our portal) or visit one of the Internet stations throughout the Convention Center

Don’t forget to activate your Cisco Live virtual account for access to all session material on-demand and return for our live virtual event in October 2008.

Go to the Collaboration Zone in World of Solutions or visit www.cisco-live.com.


BRKOPT-2114 Ethernet Operations,Administration and Maintenance (E-OAM)Technical Overview

Documents

Transcript of BRKOPT-2114 Ethernet Operations,Administration and Maintenance (E-OAM)Technical Overview