Cisco TERENA Dce Overview

© 2 0 0 6 C i s c o S y s t e m s , I n c . A l l r i g h t s r e s e r v e d . C i s c o C o n f i d e n t i a lP r e s e n t a t i o n _ I D 1

TERENA Workshop Day 2 – S e pt e m b e r 2nd 1 0 : 1 5 - 1 0 : 4 5

Data Center Ethernet -The Framework for Server I / O C on s ol i d at i on , V i rt u al i z at i on an d U n i fi ed Fab ri c

Ray O’H an l o nC i s c o E u r o p e


Data Center N etw o rk i ng Env i ro nm ent� Clustered and Grid apps are becoming more common� M ulti-Core CP U arch itectures and serv er v irtualiz ation is driv ing th e need f or more bandw idth per serv er

� N etw ork traf f ic is:Client to S erv er, S erv er to S erv er, S erv er to S torage and S torage to S torage

� H igh er dependency of A pplication perf ormance on netw ork perf ormance

� B andw idth and L atency matter� T raf f ic ch aracteriz ation includes:

S h ort and bursty messages: client to serv er and serv er to serv er & L ong steady messages: serv er to storage and storage to storage

� P ack et “drop” af f ects most traf f ic ty pes� F lat N etw ork s are common


T he Cas e f o r 1 0 G b E to the S erv erM ulti-Core CP U arch itectures allow ing bigger and multiple w ork loads on th e same mach ine

S erv er v irtualiz ation driv ing th e need f or more I / O bandw idth per serv er

Grow ing need f or netw ork storage driv ing th e demand f or h igh er netw ork bandw idth to th e serv er

1 0 GE L A N on serv er M oth erboards ( L oM ) beginning mid-2 0 0 8 (source: Broadcom )


M ak i ng 1 0 G b E Co s t Ef f ec ti v e

Cable T r an s c ei v erL at en c y ( li n k )

P o w er( eac h s i d e)D i s t an c eT ec h n o lo g y

Twinax ~ 0 . 1 µs~ 0 . 1 W1 0 mS F P + C UC o p p e r

M M 6 2 . 5 µmM M 5 0 µm ~ 01 W8 2 m

3 0 0 mS F P + S Rsh o r t r e ac h

M M O M 2M M O M 3 ~ 01 W1 0 m

1 0 0 mS F P + U S Ru l t r a sh o r t r e ac h

Cat6Cat6a/ 7Cat6a/ 7

2 . 5 µs2 . 5 µs1 . 5 µs

~ 8 W~ 8 W~ 4 W

5 5 m1 0 0 m3 0 m

1 0 G B A S E -T

100Mb 1G b 10G b

UTP Cat 5 UTP Cat 5S F P F i b e r

10Mb

UTP Cat 3

Mid 1980’s Mid 1990’s E a r l y 2 000’s L a t e 2 000’s

X2S F P + C u (BER better than 10 )S F P + F i b e rC a t 6 / 7

-1 8

S F P + C uS F P + C uS F P + t o S F P +S F P + t o S F P +


U ni f i ed F ab ri cIncreased Efficiency, Simpler Operations

UnifiedF a b r icUnifiedF a b r ic

Unified F a b r ic a nd I / OUnified F a b r ic a nd I / O

S t o r a g e N et w o r kS t o r a g e N et w o r k

M g m t N et w o r kM g m t

N et w o r k

B a c k u pN et w o r kB a c k u pN et w o r k

B a c k -E nd N et w o r kB a c k -E nd N et w o r k

F r o nt -E nd N et w o r kF r o nt -E nd N et w o r k


T he Cas e f o r N etw o rk Co nv erg enc e

R educe ov erall data pow er consumption by up to 8 % . E x tend th e lif ecy cle of current data center.

W ire h osts once to connect to any netw ork - S A N , L A N , H P C. F aster rollout of new apps and serv ices.

E v ery h ost w ill be able to mount any storage target. D riv e storage consolidation and improv e utiliz ation.

R ack , R ow , and X -D ata Center V M portability become possible.


� M apping of F C F rames ov er E th ernet

� E nables F C to R un on a L ossless E th ernet N etw ork

� F ew er CablesBoth block I/O & Ethernet tra f f i c co-ex i st on sa m e ca ble

� F ew er adapters needed� O v erall less pow er� I nteroperates w ith ex isting S A N ’s – S ame M anagement model

� N o Gatew ay - S tateless

F C o EF C o E B e n e f i t sB e n e f i t s

F C o v er Ethernet ( F Co E)

F i bre C ha nnel T ra f f i c

Ethernet


F Co E Enab l ersEthe

rnet

Head

er

FCoE

Head

er

FCHe

ader F C P a y loa d CRC

EOF

FCS

Same as a physical FC frame

Co n t ro l in fo rmat io n : v ersio n , o rd ered set s (SO F, E O F)

E t hern et V 2 Frame, E t hert ype = FCo E

� 1 0 G b ps Et he rn e t� L ossl e ss Et he rn e t ( Dat a C e n t e r Et he rn e t )

M at ches t he B 2 B cred it s u sed in Fib rechan n el t o pro v id e a lo ssless serv ice

� Et he rn e t j u m b o f ram e s ( 21 8 0 B yt e s)M ax FC frame paylo ad = 2 1 1 2 b yt es

T.11 Committee FC-B B -5 W or k in g G r ou pw w w .t11.or g / f c oew w w .f c oe.c om


A d minist r at io n/ V M R CF C S A N BF C S A N A

V M N e t 1V M N e t 2V M N e t 3V M o t io nS e r v e r N I C

V M N e t 1 B ac k u pV M N e t 2 B ac k u pV M N e t 3 B ac k u p

V M o t io n B ac k u p

A d minist r at io n/ V M R CS e r v e r N I C

F Co E f o r Co nv erg ed N etw o rk s

� T w o Serv er L O M E t hern et P o rt s� T w o 1 G Q u ad -P o rt N I Cs� T w o 4 G Sin g le P o rt H B A s

� T w o Serv er L O M E t hern et P o rt s� T w o 1 0 G Sin g le P o rt Co n v erg ed

N et w o rk A d apt ers (CN A )

T od a y ’s M od el C onv erg ed N etw orks U si ng F C oE:

F C S A N B

F C S A N A

EthernetL i nk

F C o E T ra f f i cO ther N etw o rk i ng

T ra f f i c

S o u r c e : H P W e b sit e

V M N e t 1 B ac k u pV M N e t 2 B ac k u pV M N e t 3 B ac k u p

V M o t io n B ac k u p

V M N e t 1V M N e t 2V M N e t 3V M o t io n


V M A w are N etw o rk S erv i c es� Network services d el ivered a t V M l evel

g ra n u l a rity� P rovid es im p roved V M

p orta b il ity� A b il ity to cu stom iz e n etwork ch a ra cteristics

a t th e V M l evel a t wiresp eed

V i r t u al I n t er f ac es w i t h P h y s i c al I n t er f ac e Ch ar ac t er i s t i c s

I n d i v i d u al Co n t r o lan d E t h er n et P o li c i es

S e r v e r

V M 1 V M 3V M 2 V M 4

S w i t c hP o r t


W hat i s Data Center Ethernet ( DCE) ?

D a ta C en ter E th ern et is a n a rch itectu ra l col l ection of E th ern et ex ten sion s d esig n ed to im p rove E th ern et n etworkin g a n d m a n a g em en t in th e D a ta C en ter. C isco is sh owin g in n ova tion wh il e workin g th rou g h th e sta n d a rd iz a tion p rocess with th ese ex ten sion s in op en sta n d a rd s f oru m s.


P ro v id es ab ilit y t o t ran spo rt v ario u s t raffic t ypes (e. g . St o rag e, R D M A )L o ssless E t hern et

F eature / S tandard B enef itP rio rit y Flo w Co n t ro l (P FC)IEEE 8 0 2. 1Q bb

P ro v id es class o f serv ice flo w co n t ro l. A b ilit y t o su ppo rt st o rag e t raffic

B an d w id t h M an ag emen tIEEE 8 0 2. 1Q a z

G ro u pin g classes o f t raffic in t o “Serv ice L an es”Co S b ased E n han ced T ran smissio n

Co n g est io n M an ag emen tIEEE 8 0 2. 1Q a u

E n d -t o -en d co n g est io n man ag emen t fo r L 2 n et w o rk

D at a Cen t er B rid g in g E x chan g e P ro t o co l ( D C BX )

M an ag emen t & A u t o -n eg o t iat io n pro t o co l fo r en han ced E t hern et capab ilit ies

L 2 M u lt ipat h fo rU n icast an d M u lt icast

U t iliz e fu ll B i-Sect io n al b an d w id t h acro ss mu lt iple act iv e pat hs. E limin at e span n in g t ree

Data Center Ethernet F eatu resOv e r v i e w


Data Center Ethernet F eatu res

� Ena bles lossless F a bri cs f or ea ch cla ss of serv i ce� P A U S E sent p er v i rtu a l la ne w hen bu f f ers li m i t ex ceed ed� N etw ork resou rces a re p a rti ti oned betw een V L ’s ( E. g . i np u tbu f f er a nd ou tp u t q u eu e)

� T he sw i tch beha v i or i s neg oti a ble p er V L

P riority -B ased F low Control ( P F C)P riority -B ased F low Control ( P F C)


Data Center Ethernet F eatu res

E nh anced T ransmission S election ( E T S )E nh anced T ransmission S election ( E T S )

� Ena bles Intelli g ent sha ri ng ofba nd w i d th betw een tra f f i c cla sses control of ba nd w i d th

� Bei ng S ta nd a rd i z ed i n IEEE 8 0 2. 1Q a z� A lso know n a s P ri ori ty G rou p i ng


Data Center Ethernet F eatu resCongestion M anagementCongestion M anagement

� M ov es cong esti on ou t of the core to a v oi d cong esti on sp rea d i ng� A llow s End -to-End cong esti on m a na g em ent� S ta nd a rd s tra ck i n 8 0 2. 1Q a u


Data Center Ethernet F eatu resD ata Center B ridging Capability eX ch ange P rotocolD ata Center B ridging Capability eX ch ange P rotocol

H a nd sha ki ng N eg oti a ti on f or:� C oS BW M a na g em ent� C la ss Ba sed F low C ontrol� C ong esti on M a na g em ent ( BC N /Q C N )� A p p li ca ti on ( u ser_ p ri ori ty u sa g e)� L og i ca l L i nk D ow n

Data Center Ethernet

Data Center Ethernet


Data Center Ethernet F eatu resL ay er 2 M ulti-P ath ing optionsL ay er 2 M ulti-P ath ing options

L A N

Active-Active

M ACB

M ACA

M ACA

M ACB

L A N L A N

vP CL 2 E C M P

L 2 E C M P

11 22 33

� El i m i na tes S T P o n U p l i nkB ri d g e P o rts

� A l l o w s M u l ti p l e A c ti v eU p l i nk s S w i tc h to N etw o rk

� P rev ents L o o p s b y P i nni ng aM A C A d d res s to O nl y O neP o rt

� C o m p l etel y T ra ns p a rent toN ex t H o p S w i tc h

� V i rtu a l S w i tc h reta i ns p hy s i c a l s w i tc hes i nd ep end ent c o ntro l a nd d a ta p l a nes� V i rtu a l p o rt c ha nnel m ec ha ni s m i s tra ns p a rent to ho s ts o r s w i tc hes c o nnec ted to the v i rtu a l s w i tc h� S T P a s f a i l -s a f e m ec ha ni s m to p rev ent l o o p s ev en i n the c a s e o f c o ntro l p l a ne f a i l u re

� U s es I S I S b a s ed to p o l o g y� El i m i na tes S T P f ro m L 2d o m a i n

� P ref erred p a th s el ec ti o n

V ir tu a lS w itch


S u m m ary

A Unified fa b r ic is t h e end s t a t e net w o r k w h er e L A N , S A N , a nd I P C t r a ffic a r e c o nv er g ed o nt o a s ing l e net w o r k infr a s t r u c t u r e

D a t a C ent er E t h er net is t h e fo u nda t io n fo r del iv er ing a Unified F a b r ic . D C E w il l a l s o a p p ea l t o c u s t o m er s t h a t a r e no t p l a nning fo r c o ns o l ida t ed I / O du e t o it s L 2 m u l t ip a t h ingc a p a b il it ies a nd it s l o s s l es s s er v ic e b eh a v io r

D C E c o m p r is es a s et o f E t h er net enh a nc em ent s t a nda r ds t h a t a dh er e t o t h e em er g ing I E E E D a t a C ent er B r idg ing s p ec ific a t io n.

h ttp: / / w w w . ieee8 0 2 . org/ 1 / pages/ dcbridges. h tml


S ta nd a rd s

E t h e r n e t L A N S A N BS A N A

N 5 0 0 0

L A N

N 5 0 0 0

Active-Active

MACB

MACA

LAN S AN BS AN ALAN S AN BS AN A

N 5 0 0 0

MACB

MACA MAC

C

A & B C

E n d n o d e s

LAN

MACB

MACA MAC

C

A & B C

E n d n o d e s

LAN

W i r e S p eed 1 0 G bE S w i t c h i n gCap ac i t y

D at a Cen t er E t h er n etS c alabi li t y

F i br e Ch an n el o v er E t h er n etCo n s o li d at i o n

V M A w ar e N et w o r k i n gV i r t u ali z at i o n

Eco-S y stem

Del i v eri ng N etw o rk Co nv erg enc e to d ay


Implementing Unified Fabric with Nexus 5000

1 0 G b E

1 0 G b E D a ta C en ter E th er n etF ib r e C h a n n el

1 0 G b EF C o E / D a ta C en terE th er n et

C on sol i d at e d I / OS e rv e rs t o Ac c e ss L aye r

Dat a C e n t e r Et he rn e t / F C oE L i n ks

Cisco N ex us 5 0 0 0

P re se rv e s Ex i st i n gL A N an d S A NI n v e st m e n t s

M D SM D SN ex u sN ex u sC a t a l y s tC a t a l y s tS A N BL A N S A N AL A N

P re se rv e s Ex i st i n gDu al S A NEn v i ron m e n t s


Enc ap s u l ati o n tec hno l o g i es

Ethernet

1 , 1 0 G b p s

IPT C P

i S C S I

I nf i ni B a nd

S R P

IPT C PF C IP F C P*

IPT C Pi F C PF C P*

F i b rec ha nnel

F C P*

1 , 2 , 4 , ( 8 ) , 1 0 G b p s 1 0 , 2 0 G b p s

iS CS I F CoE I nf iniB and

i S E Ri S C S I

D a ta C enter Ethernet

F C o E

F C P*S C S I L a y e r

O p e r a t i n g S y s t e m / A p p l i c a t i o n s

( 1 ) , 1 0 G b p s

* I nc l u d e s F C L ay e r

Cisco TERENA Dce Overview

Documents

Transcript of Cisco TERENA Dce Overview