UCS Deeper Dive -...

© 2012 Cisco and/or its affiliates. All rights reserved. BRKCOM-2001 (CiscoLive 2012 Mexico - M. Sean McGee) Cisco Public

UCS Deeper Dive BRKCOM-2001 Sean McGee

CSE, CCIE #18040

Cisco Systems, Inc.


BRKCOM-2001: UCS Deep Dive

1. Quick Overview of UCS Architecture Fundamentals (Review)

2. Definition of a Cloud Computing Instance

3. UCS Features for Operational Efficiency (a.k.a Cloud Enablement)

4. Live Demonstration of some key UCS Manager Features

Agenda

Quick Review:

Cisco UCS Architecture Fundamentals


Traditional Rack Duplicate Infrastructure

for Every 16 Servers Divide into Mini-Racks

Evolution of the Mini-Rack Architecture

Blade Mini-Rack 1 (16 blade servers)

Blade Mini-Rack 2 (16 blade servers)


Legacy Blade Architecture

SAN LAN

SAN

LAN

MGMT MGMT

Over the Past 10 Years

An evolution of size, not thinking

More servers and switches than ever

More switches per server

Management applied, not integrated

An Accidental Architecture

Result: Complexity

More points of management

More difficult to maintain policy coherence

More difficult to secure

More difficult to scale

Additional LAN and SAN Connections

Additional Management Connections

Multiple Ethernet Connections

Multiple SAN Connections

Separate Remote Management

per Chassis

Multiple Management Modules




Cisco UCS—Reducing Complexity

• Embed management

• Remove unnecessary:

Switches

Adapters

Management modules

• Unify the Fabric

Network, Storage, Mgmt

• Power and cooling

1/3rd less infrastructure

Lower power

• Built for virtualization

Processor density

VM/host ratio

I/O improvement

Extended memory

SAN

LAN

MGMT SAN

LAN

MGMT

Multiple Ethernet Connections

Multiple SAN Connections

Separate Remote Management

per Chassis

Multiple Management Modules






Cisco Unified Computing System Summary of UCS Components

Anatomy of

Cisco Unified Computing System

BEYOND EFFICIENCY MORE EFFECTIVE IT • Cisco UCS breeds simplicity

• Agile, flexible, high-performance, self-integrating IT

• Reduced staff costs

• Increased uptime

• Automation

• Rapid return on investment

Cisco UCS Manager

Cisco UCS Fabric Interconnects

Cisco UCS and Cisco Nexus Fabric Extenders

Cisco UCS C-Series Rack-Mount Servers

Cisco UCS Blade Server Chassis

Cisco UCS B-Series Blade Servers

Cisco UCS Virtual Interface Cards for B-Series & C-Series Servers


UCS Fabric Infrastructure Portfolio

Cisco UCS™ 6200 and 2200 with Unified Ports

Cisco UCS 6140/ 6120

Forward compatible with Second Generation

I/O Modules

At UCS Launch

Typical Deployments

UCS 6248 FI

48 Port Fabric Interconnect

1TB switching throughput

48 ports in 1RU

Unified Ports

Investment protection

High End Deployments

UCS 6296 FI

96 Port Fabric Interconnect

2TB switching throughput

96 ports in 2RU

Unified Ports

Investment protection

Forward compatible with Second Generation

Interconnects

Cisco UCS 2104 I/O Module

20 Port I/O Module

UCS 2204 IOM

80G per chassis

20G to the Blade

Entry point pricing

Port Channel Capable

40 Port I/O Module

UCS 2208 IOM

160G per chassis

40G to the Blade

Lower Latency

Port Channel Capable

Cisco UCS™ 6100 and 2100

UCS Fabric Interconnects

UCS I/O Modules

New!

New!


What’s New: Compute Performance Optimized for Bare-Metal, Virtualized and Cloud Applications

12

Rac

k

Intensive / Mission Critical Scale Out Enterprise Performance

Bla

de

UCS B420 M3 Unified Computing in an Enterprise Class, 4-socket blade for

large, memory intensive bare metal & virtualized applications

Cisco UCS: Many Server Form Factors, One System

Avail

Avail

Avail Avail

Q4’12 UCS C240 M3 Ideal platform for Big Data, ERP and database

applications

UCS C220 M3 Versatile, general purpose enterprise infrastructure

and application server

UCS B200 M3 Optimal choice for VDI, Private Cloud or dense

virtualization / consolidation workloads

UCS C24 M3 Entry, expandable rack server for storage

intensive workloads

UCS C22 M3 Entry rack server for distributed & web

infrastructure applications

UCS B22 M3 Entry blade server for IT infrastructure and web

applications

Avail

Avail

UCS C420 M3 Unified Computing in an Enterprise Class, 4-

socket rack server for large, memory intensive bare metal & virtualized applications

Industry-leading compute without compromise

Avail


• Embedded device manager

for family of UCS

components

• Enables stateless

computing via Service

Profiles

• Efficient scale: Same effort

for 1 to 320 blades

• APIs for integration with

new and existing data

center infrastructure

Unified Computing System Manager Single Pain of Glass for BMaaS



Form Factor Independence and Cloud Scale

Cloud Scale Increases Mobility, Utilisation and Availability

LAN Any IEEE Compliant LAN

SAN A Any ANSI T11

Compliant SAN

SAN B Any ANSI T11

Compliant SAN

Mgmt

One Logical Chassis to Manage*

LAN Connectivity

SAN Networking

Blade Chassis’

Server Blades

Rack Servers

Server Identity

Management

Monitoring,

Troubleshooting

Etc.

Simplicity

Definition of a Cloud Computing Instance


What is your perspective of Cloud Computing?

“Once upon a time, there were six blind men. The

blind men wished to know what an elephant

looked like.

The six blind men all perceived one aspect of the

elephant and were each right in their own way, but

none of them knew what the whole elephant really

looked like.”

Your definition of something may depend on your perspective…

16

It’s like a rope!

It’s like a wall!

It’s like a fan!

It’s like a snake!

It’s like a spear!

It’s virtualization!

It’s automation!

It’s statelessness!

It’s on-demand computing!

Cloud Computing

It’s a self-service portal!

Its “Anything as a

Service” (XaaS)!

“Once upon a time, there were six IT people. The

IT people wished to know what cloud computing

looked like.

The six IT people all perceived one aspect of the

cloud and were each right in their own way, but

none of them knew what the whole cloud really

looked like.”

Elephant

It’s like tree!


Session Objectives

• Flexible

• Scalable

• Shareable

• Interoperable

• Rapidly Deployable

• Programmable

• Self-Serviceable

• Cisco UCS

• FlexPod, VBlock

• vCloud Director, UIM

• UCS Manager

• Service Profiles

• XML API

• VM-FEX, Adapter-FEX

• Open API

• Identity Abstraction

• Configuration Abstraction

• Server Virtualization

• Hypervisor Integration

• RBAC

• User Portal

• Secure Platforms

• Workload Mobility

• Extensible L2 Connectivity

The CTO says…

The Engineer needs…

The Supplier develops…

Mapping Cloud Characteristics Technology Requirements Real Products & Features

O

pera

tional C

hara

cte

ristic

s

Tech

nolo

gy C

hara

cte

ristics

Pro

duct C

hara

cte

ristic

s

A Layered Approached to

Defining a Cloud Computing Instance


Physical

Server

Technology Layers of a “Cloud Computing Instance” The Basic Building Block of a Cloud – Servers, Networking, and Storage

Storage

Interface Local Config Factory Identity Hardware

Virtualization

OS

Application &

Software

Facilities

References: Cloud Security Alliance, “Security Guidance for Critical Areas of Focus in Cloud Computing”

Network

Interface

Network Connectivity

Connectivity Configuration and Cabling

Remote Storage

Remote Storage Connectivity

Power Cooling Physical Location


Physical

Server

Technology Layers of a “Cloud Computing Instance” Bare Metal as a Service (BMaaS)

BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage

Interface Local Config Factory Identity

Programmable API

Configuration UI/Portal Identity and

Configuration

Abstraction

Hardware

Virtualization

OS

Application &

Software

Facilities


Unified Computing System

Network

Interface



Remote Storage




Physical

Server

Technology Layers of a “Cloud Computing Instance” Bare Metal as a Service (BMaaS)

BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage

Interface Local Config Factory Identity

Programmable API

Configuration UI/Portal Identity and

Configuration

Abstraction

Hardware

Virtualization

OS

Application &

Software

Facilities



Network

Interface



Remote Storage



BMaaS’s Job: Make All Of This Unimportant

to the BMaaS End User


Physical

Server

Technology Layers of a “Cloud Computing Instance” Infrastructure as a Service (IaaS)

BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage

Interface

Hypervisor

Local Config Factory Identity

Programmable API

Configuration UI/Portal

Programmable API


Identity and

Configuration

Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Hardware

Virtualization

OS

Application &

Software

Facilities



vCloud Director FlexPod

Virtual Services

Network

Interface



Remote Storage



CIAC


Physical

Server

Technology Layers of a “Cloud Computing Instance” Infrastructure as a Service (IaaS)

BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage

Interface

Hypervisor


Programmable API


Programmable API


Identity and

Configuration

Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Hardware

Virtualization

OS

Application &

Software

Facilities



Virtual Services

Network

Interface



Remote Storage



IaaS’s Job: Make All Of This Unimportant

to the IaaS End User

vCloud Director FlexPod CIAC


Physical

Server

Technology Layers of a “Cloud Computing Instance” Platform as a Service (PaaS)

BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage

Interface

Hypervisor

x86 OS


Programmable API


Programmable API


Integrated

Development

Environment (IDE)

Middleware

Others

Identity and

Configuration

Abstraction

Database Interprocess Communication

Runtime

Application

Container

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Paa

S (P

latf

orm

as

a Se

rvic

e)

Hardware

Virtualization

OS

Application &

Software

Facilities



Virtual Services

Network

Interface



Remote Storage



VXI



Physical

Server

Technology Layers of a “Cloud Computing Instance” Platform as a Service (PaaS)

BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage

Interface

Hypervisor

x86 OS


Programmable API


Programmable API


Integrated

Development

Environment (IDE)

Middleware

Others

Identity and

Configuration

Abstraction


Runtime

Application

Container

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Paa

S (P

latf

orm

as

a Se

rvic

e)

Hardware

Virtualization

OS

Application &

Software

Facilities



Virtual Services

Network

Interface



Remote Storage



VXI

PaaS’s Job: Make All Of This Unimportant

to the PaaS End User



Physical

Server

Technology Layers of a “Cloud Computing Instance” Software as a Service (SaaS)

BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage

Interface

Hypervisor

x86 OS


Programmable API


Programmable API


Integrated

Development

Environment (IDE)

End User Service

(Application Presentation)

Middleware

Applications

Others

Identity and

Configuration

Abstraction


Data/Metadata/Content

Runtime

Application

Container

Virtual Server

Programmable API


IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Paa

S (P

latf

orm

as

a Se

rvic

e)

SaaS

(S

oft

war

e as

a S

erv

ice)

Hardware

Virtualization

OS

Application &

Software

Facilities



Virtual Services

Network

Interface



Remote Storage



VXI SaaS’s Job:

Make All Of This Unimportant

to the SaaS End User vCloud Director

FlexPod CIAC


Physical

Server

Technology Layers of a “Cloud Computing Instance” Software as a Service (SaaS)

BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage

Interface

Hypervisor

x86 OS


Programmable API


Programmable API


Integrated

Development

Environment (IDE)

End User Service


Middleware

Applications

Others

Identity and

Configuration

Abstraction



Runtime

Application

Container

Virtual Server

Programmable API


IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Paa

S (P

latf

orm

as

a Se

rvic

e)

SaaS

(S

oft

war

e as

a S

erv

ice)

Hardware

Virtualization

OS

Application &

Software

Facilities



Virtual Services

Network

Interface



Remote Storage



VXI



SaaS

(S

oft

war

e as

a S

erv

ice)

End User Service


Applications

Data/Metadata/Content Programmable API


x86 OS

Integrated

Development

Environment (IDE)

Middleware

Others


Runtime

Application

Container

Technology Layer Focus for BRKCOM-2001: BMaaS & IaaS

Paa

S (P

latf

orm

as

a Se

rvic

e)

Hardware

Virtualization

OS

Application &

Software

Facilities


Physical

Server Storage

Interface

Hypervisor


Programmable API


Programmable API


Identity and

Configuration

Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e) Virtual Services

Network

Interface



Remote Storage


BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)




Hypervisor Programmable API

Configuration UI/Portal Virtual Server

Virtual Services

x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface Local Config Factory Identity

Programmable API


Identity and Configuration

Abstraction

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Network Interface



Remote Storage



Hardware

Virtualization

OS

Facilities

Bare Metal as a Service (BMaaS) The Context for Cisco’s Unified Computing System


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage



Why UCS For Your Cloud Infrastructure

Hardware

Virtualization

OS

Facilities

UCS

Service Profile

Ad

ap

ter

FE

X

Hyp

erv

iso

r

AP

I

UC

S M

an

ag

er

UI

Un

ifie

d F

ab

ric

(FC

oE

)

Bo

rder

Po

rt

Pin

nin

g

Serv

er

Po

ols

Hyp

erv

iso

r

Byp

ass

RB

AC

, O

rgan

izati

on

s,

Lo

cale

s

Fab

ric

Failo

ver

VM

-FE

X

Po

wer

Cap

pin

g

UC

S M

an

ag

er

AP

I

UCS Is The Only Platform Designed For Next Generation Computing

UCS Features For Operational Efficiency


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage



UCS Feature Mapping to Reference Model

Hardware

Virtualization

OS

Facilities


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage




Hardware

Virtualization

OS

Facilities

UC

S M

an

ag

er

UI

UCS Manager UI


UCS Manager

Embedded device manager

‒ Discovery, Inventory, Monitoring,

Diagnostics, Statistics Collection,

Configuration

Unifies many UCS HW components into a

single, cohesive, system

‒ Adapters, blades, chassis, fabric

extenders, fabric interconnects

APIs for integration with new and existing

data center infrastructure

‒ SMASH-CLP, IPMI, SNMP

XML SDK for commercial and custom

implementations

UCS Manager

GUI

Packaged Systems Management Software

User Developed Portal, Tools, Utilities

CLI


UCS Manager

Service Profile Templates

Initial Service

Templates

Updating Service

Templates

HTTPS XML HTTP SNMP

Organizations

Locales

Customizable User Roles

LAN Rights

VLANs MACs QoS

Policies Etc.

Server Rights

Profiles

Blade HW Stats

Policies Etc.

SAN Rights

vSANs WWNs Stats

Policies Etc.

Pod Rights

Users Orgs Stats

Timezone Etc

LAN Admin User

Policies

SAN Admin User

Server Admin User

Adapter Settings

Boot

BIOS Firmware

IPMI

Disk (RAID)

KVM Firmware

Bios Scrub

Disk Scrub

Serial Over LAN

Server Pools

QoS Statistics

Thresholds

Telnet SSH

Local, TACACS+ RADIUS, LDAP

Device Management User Management

UCS Manager Architecture Overview


Compute Capacity: Units of Scale

Server Chassis

Domain Single

Datacenter

Global Datacenters

UCS Manager


Unified Management for Multi-UCS Environments

Unified Management at Scale

UCS Manager UCS Manager

Data Center 1

UCS Manager UCS Manager

Data Center 2

UCS Manager

Data Center 3

• Unifies management of multi UCS domains

• Leverages UCS Manager technology

• Simplify global operations with centralized inventory, faults, logs and

server consoles

• Delivers global policies, service profiles, ID

pools and templates

• Foundation for high availability, disaster recovery and workload mobility

• Model based API for large scale automation

“UCS Central”


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage




Hardware

Virtualization

OS

Facilities

UC

S M

an

ag

er

UI

UCS Manager Open XML API

Hyp

erv

iso

r

AP

I

UC

S M

an

ag

er

AP

I


Programmatic Infrastructure

Comprehensive XML API, standards-based interfaces

Bi-Directional access to physical & logical internals

XML API

Direct

System Status Physical Inventory Logical Inventory

• Broad 3rd party integration support

• Faster custom integration for customer use cases

• Consistent data and views across ALL interfaces

UCS CLI UCS GUI 3rd Party Customer

Self Serve portals

Management Tools

Auditing Tools


1. Capture

2. Create

3. Execute

goUCS Automation Tool

Command line drive utility that executes XML “cmdlets” against one or many UCS domain

An Example: Automating VLAN creation

Making Automation Simple

X:\>goucs createvlan realtime indent TestVLAN 321

User Arguments

UserArg1=%inUserArg1%

UserArg2=%inUserArg2%

UserArg3=

...

UserArg10=

Create the XMLwrapper using the captured logs

Create variables for parameters

Run the command on one or more UCS systems substituting values for variables

Available now on Cisco Developer Network: http://developer.cisco.com/web/unifiedcomputing/goucs

Perform the task in UCS Manager

Use goUCS filterlog to capture the transaction

X:\>mkdir X:\goucs\cmdwrappers\CreateNewVlan

For Your Reference

http://developer.cisco.com/web/unifiedcomputing/goucs


Related Sessions

49

‒ BRKAPP-2026 Unified Network Services Strategy for Datacenters

‒ BRKDCT-3060 Datacenter Interconnect: Deployment challenges and best practices

‒ BRKDCT-2204 Cisco Complete Nexus portfolio deployment best practices

‒ BRKVIR-2931 End to End Datacenter virtualization

‒ BRKDCT-2234 Mission Critical Application on UCS with focus on SAP/ORACLE/MSFT/VDI/RISC

‒ BRKDCT-2251 Cisco Fabric Path - Technology update and Implementation guideline

‒ BRKDCT-2255 Cisco's Cloud Ready Infrastructure reference architecture

‒ BRKDCT-2256 Cisco Cloud Infrastructure Orchestration using Cisco Intelligent Automation for Cloud

‒ BRKDCT-2899 Cisco's Cloud Ready Infrastructure reference architecture

‒ BRKSAN-1121 San Design Best Practices and Lessons learnt

‒ BRKCOM-1004 Automating UCS for Systems Administrators

‒ BRKCOM-2001 UCS Deep Dive

‒ BRKVIR-2888 Multi Hypervisor Nexus 100v and Virtualized Services Strategy

‒ BRKBRKDCT-2951 Deploying N7K in DC

‒ LTRDCT-2678 UCS Hands-On Experience

‒ BRKCRT-4567 CCIE Data Center

‒ . . . (and many more)

49 49

© 2012 Cisco and/or its affiliates. All rights reserved. TECDCT-2001 Cisco Public


UCS—There’s an App for That! Manage a UCS System from your mobile phone

For Your Reference


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage




Hardware

Virtualization

OS

Facilities

RB

AC

, O

rgan

izati

on

s,

Lo

cale

s

Multi-Tenancy Enablement

Hyp

erv

iso

r

AP

I

UC

S M

an

ag

er

AP

I


UCS Manager

Service Profile Templates

Initial Service

Templates

Updating Service

Templates

HTTPS XML HTTP SNMP

Organizations

Locales

Customizable User Roles

LAN Rights

VLANs MACs QoS

Policies Etc.

Server Rights

Profiles

Blade HW Stats

Policies Etc.

SAN Rights

vSANs WWNs Stats

Policies Etc.

Pod Rights

Users Orgs Stats

Timezone Etc

LAN Admin User

Policies

SAN Admin User

Server Admin User

Adapter Settings

Boot

BIOS Firmware

IPMI

Disk (RAID)

KVM Firmware

Bios Scrub

Disk Scrub

Serial Over LAN

Server Pools

QoS Statistics

Thresholds

Telnet SSH

Local, TACACS+ RADIUS, LDAP

Device Management User Management

Multi-Tenancy Features of UCS Manager

Organizations,

Locales, Object

Rights,

Customizable

User Roles, and

multiple

authentication

methods


UCS Orgs, Locales, and User Roles…

54

Create Orgs Create Locales from Orgs

Create Users and Assign Roles & Locales

1. Create Organizations

2. Create Locale (collection of 1+ Organizations)

3. Create User

4. Assign to Locale(s)

5. Assign User Role(s)


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage




Hardware

Virtualization

OS

Facilities

Un

ifie

d F

ab

ric

(FC

oE

)

Unified Fabric and FCoE

RB

AC

, O

rgan

izati

on

s,

Lo

cale

s



Unified Fabric

Single Wire for LAN, SAN, and Management Connectivity

LAN Any IEEE Compliant LAN

SAN A Any ANSI T11

Compliant SAN

SAN B Any ANSI T11

Compliant SAN

Mgmt

Simplicity


UC

S B

lad

e C

hassis

1

Cisco UCS FCoE Diagram Physical View of Network and Storage Connectivity for 160 Cisco Blade Servers

LAN

UC

S B

lad

e C

hassis

20

UCS Blade Server 1

C

NA

OS

Eth0 Eth1

Port 1

vHBA

Port 2

vHBA

UCS Blade Server 2

C

NA

OS

Eth0 Eth1

Port 1

vHBA

Port 2

vHBA

UCS Blade Server 159

C

NA

OS

Eth0 Eth1

Port 1

vHBA

Port 2

vHBA


C

NA

OS

Eth0 Eth1

Port 1

vHBA

Port 2

vHBA

SAN A SAN B


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage




Hardware

Virtualization

OS

Facilities

Ad

ap

ter

FE

X

Hyp

erv

iso

r

Byp

ass

V

M-F

EX

Cisco’s Fabric Extender (FEX) Technology

Un

ifie

d F

ab

ric

(FC

oE

)


4 Deployments of Cisco’s FEX Technology

Nexus 5k + Nexus 2k UCS FI + UCS IOM UCS FI or Nexus 5500 + VIC + VM Mgmt Link

Server Rack

Rack Server

Rack Server

Rack Server

Rack Server

Rack Server

Rack Server

Rack Server

Rack Server

Rack Server

Rack Server

Rack Server

Rack Server

#1 Rack FEX

FEX

Switch 1 2 32 …

Virtual Machine Manager

Man

agem

en

t Plan

e

Inte

gration

UCS Manager

FEX

#2 Chassis FEX

1 2 8

8

2

1

…

… Switch

Blade Server

Blade Server

Blade Server

Blade Server

Blade Server

Blade Server Chassis

Blade Server

Blade Server

Blade Server

UCS FI or Nexus 5500 + VIC

Bare Metal Blade/RackServer

OS

FEX

#3 Adapter FEX

1 2 116 …

1 2 116 …

Switch

VM Host

Hypervisor

VM

VM

FEX

#4 VM-FEX

VM

1 2 112

1 2 112 …

… Switch

1 2 32 …


Cisco’s VM-FEX Technology “Glues” Each VM to Their Own Logical Switch Port on the UCS Fabric Interconnect

66

LAN

UCS Manager Management Plane Integration Between Cisco & Hypervisor Manager

UCS Fabric Interconnect

Hypervisor Manager

Bla

de C

ha

ssis

1

ES

X H

ost

A

Virtual Machine 1

OS

Eth0

vEth711

Bla

de C

ha

ssis

20

ES

X H

ost

B

Virtual Machine 3

OS

Eth0

vEth711 vEth754

Virtual Machine 2

OS

Eth0

vEth734

VIC (VM FEX) VIC (VM FEX)


UCS 1280 Virtual Interface Card

2nd Generation VIC

Dual 4x10 Gbps connectivity into fabric

PCIe x16 GEN2 host interface

Capable of 256 PCIe devices

‒ OS dependent

‒ Current maximum of 116 virtual interfaces

Same host side drivers as VIC

Retains VIC features with enhancements

‒ iSCSI boot, Fabric Failover

SR-IOV capable device

2nd Generation Mezzanine Adapter

1280-VIC

Up to 2x 40Gb

UCS 5108

Chassis backplane

A B

IOM IOM

Up to 2 x 80Gb

FI-A FI-B


UC

S B

lade C

hassis

Serv

er

Bla

de

1280 VIC Mezzanine Adapter

OS

Cisco 1280 VIC Adapter

Presents up to 116 Interfaces to the OS—NICs or HBAs

vNIC

51

vNIC

52

vNIC

53

vNIC

54

vNIC

55

vNIC

56

vNIC

57

vNIC

58

vNIC

43

vNIC

44

vNIC

45

vNIC

46

vNIC

47

vNIC

48

vNIC

49

vNIC

50

vNIC

35

vNIC

36

vNIC

37

vNIC

38

vNIC

39

vNIC

40

vNIC

41

vNIC

42

vNIC

27

vNIC

28

vNIC

29

vNIC

30

vNIC

31

vNIC

32

vNIC

33

vNIC

34

vNIC

19

vNIC

20

vNIC

21

vNIC

22

vNIC

23

vNIC

24

vNIC

25

vNIC

26

vNIC

11

vNIC

12

vNIC

13

vNIC

14

vNIC

15

vNIC

16

vNIC

17

vNIC

18

vNIC

3

vNIC

4

vNIC

5

vNIC

6

vNIC

7

vNIC

8

vNIC

9

vNIC

10

vNIC

65

vNIC

72

vNIC

64

vNIC

71

vNIC

63

vNIC

70

vNIC

62

vNIC

69

vNIC

61

vNIC

68

vNIC

60

vNIC

67

vNIC

59

vNIC

66

vNIC

79

vNIC

86

vNIC

78

vNIC

85

vNIC

77

vNIC

84

vNIC

76

vNIC

83

vNIC

75

vNIC

82

vNIC

74

vNIC

81

vNIC

73

vNIC

80

vNIC

93

vNIC

100

vNIC

92

vNIC

99

vNIC

91

vNIC

98

vNIC

90

vNIC

97

vNIC

89

vNIC

96

vNIC

88

vNIC

95

vNIC

87

vNIC

94

vNIC

107

vNIC

106

vNIC

105

vNIC

104

vNIC

103

vNIC

102

vNIC

101

vNIC

114

vNIC

113

vNIC

112

vNIC

111

vNIC

110

vNIC

109

vNIC

108

vNIC

115

vNIC

116

IOM (2208)

UCS 6248

Fabric Interconnect A

Physical Port 1 Physical Port 3 Physical Port 4 Physical Port 2

IOM (2208)

UCS 6248

Fabric Interconnect B

vHBA

1

vHBA

2

Physical Port 5 Physical Port 7 Physical Port 8 Physical Port 6


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage




Hardware

Virtualization

OS

Facilities

Fab

ric

Failo

ver

Fabric Failover: Hardware-based NIC Fault Tolerance

Ad

ap

ter

FE

X

Hyp

erv

iso

r

Byp

ass

V

M-F

EX


UCS Fabric-Based NIC Teaming

Fabric Failover Enhances Multi Hypervisor Clouds

Chassis backplane (or Fabric) provides

redundant path for each vNIC

Failures detected on border ports or

fabric ports

Transparent to Operating System

Unlike OS NIC Teaming, redundancy

provided with single interface

After failover:

‒ Transmit GARP

‒ Multicast Group reRegistration

VIC1280 offers up to 256 vNIC’s UC

S B

lade C

hassis

UC

S B

lade S

erv

er

OS

LAN

Fabric Interconnect A C

NA

Fabric Interconnect B

CNA

Port 1 Port 2

IOM-A IOM-B

vNIC 2 vNIC 1 Local Area Connection 0

1.1.1.1

Local Area Connection 1

2.2.2.2


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage




Hardware

Virtualization

OS

Facilities

Bo

rder

Po

rt

Pin

nin

g

Workload Traffic Steering

Fab

ric

Failo

ver


UC

S B

lad

e C

hassis

1

Cisco’s FEX-Link Architecture Physical View of Connectivity for Blade Servers

LAN

UCS Blade Server 1

C

NA

UCS Blade Server 8

UC

S B

lad

e C

hassis

20


OS


C

NA

OS

C

NA

OS

C

NA

OS

Eth0 Eth1

Port 2 Port 1

Eth0 Eth57

Port 2 Port 1

Eth0 Eth1

Port 2 Port 1

Eth0 Eth1

Port 2 Port 1

Border Ports Assign this Server NIC to this

uplink (border port) Access

Distribution/Core


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage




Hardware

Virtualization

OS

Facilities

UCS

Service Profile

UCS Service Profiles (a.k.a. Software Define Computing)

Bo

rder

Po

rt

Pin

nin

g


VM Migration vs. UCS Service Profile Migration Live Migration of a VM vs. a Cold Migration of a Bare Metal Server

75

Physic

al U

CS

Serv

er A

Physic

al S

erv

er A

Physic

al S

erv

er B

Host Server B

External Network Fabric

BIOS: <settings>

Firmware: Version 2B

UUID: 3344CD

MACs: A2 & B2

WWNs: C2 & D2

Host Server A

Hypervisor

Host OS

BIOS: <settings>

Firmware: Version 1A

UUID: 1122AB

MACs: A1 & B1

WWNs: C1 & D1

VM Migration

Hypervisor

Host OS

Guest Server

3

OS Image

VLAN 4 Fabric B

FC Fabrics A&B

VLANs 1-5

BIOS: <settings>


UUID: 1122AB

MACs: A1 & B1

WWNs: C1 & D1

Guest Server

1

OS Image

Guest Server

2

OS Image

VLAN 3 Fabric A

FC Fabrics A&B

VLANs 1-5

VLAN 1 Fabric A

Physic

al U

CS

Serv

er B

BIOS: <settings>

Firmware: Version 1C

UUID: 3344CD

MACs: A2 & B2

WWNs: C2 & D2

External Network Fabric

UCS Fabric Interconnect

FC Fabrics A& B; VLANs 1- 5

UCS Service Profile Migration

Host Server 1

(Windows, ESX, Linux, etc)

OS Image (Boot from SAN)

BIOS: <settings>


UCS UUID: 5566EF

UCS MACs: A3 & B3

UCS WWNs: C3 & D3

FC Fabric A

VLANs 1 & 2

**A

NIM

ATE

D S

LID

E**

V

IEW

IN S

LID

E SH

OW

MO

DE


Stateless Computing: Service Profiles They’re like “Software Defined Computing”…

LAN

SAN

SERVER IDENTITY

Adds: • Portability • More flexibility • Improved uptime

UCS Service Profile

NIC MACs HBA WWNs Server UUID

VLAN Assignments VLAN Tagging

FC Fabrics Assignments FC Boot Parameters

Quantity of NICs Boot Order PXE Settings IPMI Settings

Quantity of HBAs QoS Settings

Call Home Statistic Thresholds System Firmware Adapter Firmware

CIMC Firmware RAID Settings

NIC Teaming in HW BIOS Settings etc., etc., etc.


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage



Hardware

Virtualization

OS

Facilities

Service Profile Feature Mapping to Reference Model

UCS

Service Profile Sta

tic v

NIC

s

(Ad

ap

ter

FE

X)

Dyn

am

ic v

NIC

s

(VM

-FE

X)

vH

BA

s

Serv

er

Po

wer

Cap

Serv

er

Po

ol

Assig

nm

en

t

UC

S W

WN

s

UC

S M

AC

s

VLANs/QoS

BIOS

Settings

VSANs/QoS

Firmware

Bo

ot

Fro

m

SA

N S

ett

ing

s

Remote KVM Settings P

XE

/iS

CS

I

Bo

ot

Sett

ing

s

Fault Tolerance

Switch Uplink Assignment Switch Uplink Assignment

Components of a UCS Service Profile


A UCS Service Profile: 120+ server settings in a single object…

81

BIOS: Quiet Boot BIOS: Post Error Pause BIOS: Resume A/C on Power Loss BIOS: Front Panel Lockout BIOS: Turbo Boost BIOS: ACPI10 Support BIOS: Enhanced Intel Speedstep BIOS: Hyper Threading BIOS: Core Multi Processing BIOS: Virtualization Technology (VT) BIOS: Execute Disabled Bit BIOS: Direct Cache Access BIOS: Processor C State BIOS: Processor C1E BIOS: Processor C3 Report BIOS: Processor C6 Report BIOS: CPU Performance BIOS: Max Variable MTRR Setting BIOS: VT for Directed IO BIOS: Interrupt Remap BIOS: Coherency Support BIOS: ATS Support BIOS: Passthrough DMA Support BIOS: Memory RAS Config BIOS: NUMA BIOS: Low Voltage DDR Mode BIOS: Serial Port A state BIOS: USB Make Device Non Bootable BIOS: USB System Idle Power Optimizing Setting BIOS: USB Front Panel Access Lock BIOS: PCI Max Memory Below 4G

BIOS: PCI Memory Mapped IO Above 4Gb Config BIOS: Boot Option Retry BIOS: UCSM Boot Order Rule Control BIOS: Intel Entry SAS RAID BIOS: Intel Entry SAS RAID Module BIOS: Assert Nmi on Serr BIOS: Assert Nmi on Perr BIOS: OS Boot Watchdog Timer BIOS: Console Redirection BIOS: Console Flow Control BIOS: Console BAUD rate BIOS: Console Terminal Type BIOS: Console Legacy OS Redirect Server Boot Order (HDD, CD-ROM, SAN, USB, Floppy, PXE) Server BIOS Firmware Ethernet Adapter Firmware Fiber Channel Adapter Firmware HBA Option ROM Firmware Storage Controller Firmware Remote Management Controller (e.g. HP iLO) Firmware Server UUID Virtual Server Serial Number Define Number of vNICs on Server Define Number of Dynamic vNICs (for VMware Pass-through) Settable vNIC/FlexNIC Speed (reflected in OS) PXE Boot Setting Fabric Failover (NIC Teaming) Settings VLAN Assignment per NIC

VLAN Tagging Settings per NIC NIC Transmit Rate Limiting NIC MAC Address Assignment NIC Maximum Transmission Unit (MTU) Number of NIC Transmit Queues NIC Transmit Queue Ring Size NIC Receive Queues NIC Receive Queue Ring Size NIC Completion Queues NIC Interrupts NIC Transmit Checksum Offload NIC Receive Checksum Offload NIC TCP Segmentation Offload NIC TCP Large Receive Offload NIC Receive Side Scaling (RSS) NIC Failback Timeout NIC Interrupt Mode NIC Interrupt Coalescing NIC Interrupt Timer NIC QoS Host Control Option Enable/Disable Cisco Discovery Protocol for VMware vSwitch MAC Security per NIC QoS settings per NIC NIC action on Switch uplink failure Distribution Enet Switch Uplink Assignment Per NIC (Pin Group) Server Pool Assignment Maintenance Policy IPMI Usernames & Passwords IPMI User Roles Server Management IP Address Serial over LAN Configuration Power Control Policy Capping and Priority PCIe Bus Device Scan Order for NICs/HBAs PCIe Virtual Device Slot Placement for NIC/HBA BIOS Scrub Actions

Disk Scrub Actions Thresholds for Monitored Statistics Number of vHBAs on Server Local HDD RAID Configuration Define Number of iSCSI interfaces on Server Define Number of vHBAs on Server Distribution FC Switch Uplink Assignment Per HBA (Pin Group) HBA World Wide Port Name (WWPN) Assignment HBA Fiber Channel SAN Membership Fiber Channel Boot Parameters HBA-to-Distribution FC Switch Uplink Persistent Binding HBA Maximum Data Field Size (MTU) HBA Transmit Queue Ring Size HBA Receive Queue Ring Size HBA SCSI I/O Queues HBA SCSI I/O Queue Ring Size HBA FCP Error Recovery HBA Flogi Retries HBA Flogi Timeout HBA Plogi Retries HBA Plogi Timeout HBA Port Down Timeout HBA Port Down IO Retry HBA Link Down Timeout HBA IO Throttle Count HBA Max LUNs Per Target HBA Interrupt Mode HBA QoS Priority HBA QoS Burst size HBA QoS Rate limit HBA QoS Host Control Option HBA World Wide Node Name (WWNN) Assignment

For Your Reference


Cisco UCS Test Drive

Got To Cisco.com to see Service Profile Creation in action

http://www.cisco.com/assets/sol/ucp/flash/cisco-ucs-test-drive/index.html

An interactive demo tool that introduces UCS Manager benefits

UCS Test Drive takes you on a guided tour of UCS Manager in action.

The flash demo walks the viewer through either detailed or summary

demos for three key UCS Advantages

‒ Rapid Server Provisioning,

‒ Agility and Improved Availability

‒ Capital Expense Reduction with Server Repurposing.

For Your Reference










x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage



Why UCS For Your Cloud Infrastructure

Hardware

Virtualization

OS

Facilities

UCS

Service Profile

Ad

ap

ter

FE

X

Hyp

erv

iso

r

AP

I

UC

S M

an

ag

er

UI

Un

ifie

d F

ab

ric

(FC

oE

)

Bo

rder

Po

rt

Pin

nin

g

Serv

er

Po

ols

Hyp

erv

iso

r

Byp

ass

RB

AC

, O

rgan

izati

on

s,

Lo

cale

s

Fab

ric

Failo

ver

VM

-FE

X

Po

wer

Cap

pin

g

UC

S M

an

ag

er

AP

I

UCS Is The Only Platform Designed For Next Generation Computing


Complete Your Online

Session Evaluation

Receive Passport points for each

session evaluation you complete.

Gives your feedback and redeem

your points @ the onsite Cisco

Store.

Complete your session evaluation

online now:

Look for the QR and/or URL

outside the room

Don’t forget to activate your Cisco Live Virtual account for access to all session material, communities, and on-demand and live activities throughout the year. Activate your account at the Cisco booth in the World of Solutions or visit www.ciscolive.com.

86

http://www.ciscolive.com

Integrated Compute Stacks


Physical

Server

Technology Layers of a “Cloud Computing Instance” Integrated Compute Stacks Deliver “packaged IaaS”

BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage

Interface

Hypervisor

x86 OS


Programmable API


Programmable API


Integrated

Development

Environment (IDE)

End User Service


Middleware

Applications

Others

Identity and

Configuration

Abstraction



Runtime

Application

Container

Virtual Server

Programmable API


IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Paa

S (P

latf

orm

as

a Se

rvic

e)

SaaS

(S

oft

war

e as

a S

erv

ice)

Hardware

Virtualization

OS

Application &

Software

Facilities



Virtual Services

Network

Interface



Remote Storage



FlexPod


Vblock: Delivered By VCE A Joint Venture between Cisco and EMC with VMware and Intel

Pre-packaged converged

infrastructure from Cisco, EMC and

VMware via The VCE Company

Single point of configuration validation,

ordering, delivery, support and

warranty

Benefits:

‒ 30 days from Order to Production

‒ Complete System Integration

‒ Seamless support from VCE


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage



UCS Feature Mapping to Reference Model Elements of a VCE Vblock

Hardware

Virtualization

OS

Facilities

EMC Storage Cisco Networking


VMware Virtualization

EMC Ionix

Unified

Infrastructure

Manager

VM

ware

vC

en

ter

UC

S M

an

ag

er

EM

C

UI

Cis

co

UI


Introducing FlexPod

Platform that hosts infrastructure software

and business applications in a virtualized

and bare-metal environment.

Tested and validated by Cisco and NetApp

against wide range of hypervisors,

management platforms, applications

Benefits

‒ Right-sized for scale

‒ Efficiency via unified storage, management

and networks

‒ Choice of Hypervisor

‒ Secure Multi-tenancy

Joint Cisco and NetApp Solution for Virtualized Infrastructure and cloud

FlexPod


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage



UCS Feature Mapping to Reference Model Elements of a NetApp FlexPod

Hardware

Virtualization

OS

Facilities

NetApp Storage Cisco Networking


VMware

Virtualization

VM

ware

vC

en

ter

UC

S M

an

ag

er

NetA

pp

UI

Cis

co

UI

Microsoft

Virtualization

Mic

roso

ft

SC

VM

M

RedHat

Virtualization RH

EV

Man

ag

er


x86 OS Others

Physical

Server BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage Interface

Hypervisor


Programmable API


Programmable API



Abstraction

Virtual Server

IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Virtual Services

Network Interface



Remote Storage



UCS Feature Mapping to Reference Model Elements of a NetApp FlexPod

Hardware

Virtualization

OS

Facilities

NetApp Storage Cisco Networking


UC

S M

an

ag

er

NetA

pp

UI

Cis

co

UI

3rd

part

y O

rch

estr

ati

on

Man

ag

em

en

t

VMware

Virtualization

VM

ware

vC

en

ter

Microsoft

Virtualization

Mic

roso

ft

SC

VM

M

RedHat

Virtualization RH

EV

Man

ag

er


FlexPod’s Platform for Cloud Services

FlexPod Orchestration Management ( 20 partners)

Cisco UCS

APIs

Cisco Nexus

& DCNM

APIs

NetApp

OnCommand

APIs

VMware vCenter &

vCloud Orchestrator

APIs

VMware VMware VMware • Prescriptive • Pool-based • Policy-driven


Physical

Server

Technology Layers of a “Cloud Computing Instance” Review

BM

aaS

(Bar

e M

etal

as

a Se

rvic

e)

Storage

Interface

Hypervisor

x86 OS


Programmable API


Programmable API


Integrated

Development

Environment (IDE)

End User Service


Middleware

Applications

Others

Identity and

Configuration

Abstraction



Runtime

Application

Container

Virtual Server

Programmable API


IaaS

(I

nfr

astr

uct

ure

as

a Se

rvic

e)

Paa

S (P

latf

orm

as

a Se

rvic

e)

SaaS

(S

oft

war

e as

a S

erv

ice)

Hardware

Virtualization

OS

Application &

Software

Facilities



Virtual Services

Network

Interface



Remote Storage



VXI



Session Objectives (Review)

• Flexible

• Scalable

• Shareable

• Interoperable

• Rapidly Deployable

• Programmable

• Self-Serviceable

• Cisco UCS

• FlexPod, VBlock

• vCloud Director, UIM

• UCS Manager

• Service Profiles

• XML API

• VM-FEX, Adapter-FEX

• Open API

• Identity Abstraction

• Configuration Abstraction

• Server Virtualization

• Hypervisor Integration

• RBAC

• User Portal

• Secure Platforms

• Workload Mobility

The CTO says…

The Engineer needs…

The Supplier develops…

Mapping Cloud Characteristics Technology Requirements Real Products & Features

O

pera

tional C

hara

cte

ristic

s

Tech

nolo

gy C

hara

cte

ristics

Pro

duct C

hara

cte

ristic

s


Complete Your Online

Session Evaluation

Receive Passport points for each

session evaluation you complete.

Gives your feedback and redeem

your points @ the onsite Cisco

Store.

Complete your session evaluation

online now:

Look for the QR and/or URL

outside the room

Don’t forget to activate your Cisco Live Virtual account for access to all session material, communities, and on-demand and live activities throughout the year. Activate your account at the Cisco booth in the World of Solutions or visit www.ciscolive.com.

98

http://www.ciscolive.com

UCS Deeper Dive -...

Documents

Transcript of UCS Deeper Dive -...