Network Support for Cloud Applications - Felix Cuadrado
-
Upload
cpqd -
Category
Technology
-
view
162 -
download
2
description
Transcript of Network Support for Cloud Applications - Felix Cuadrado
Félix CuadradoNetwork Support for Cloud Applications
International Workshop in Trends in Future CommunicationsCPqD, Campinas, Brazil25th February 2014
• 18,000 students in London• Member of Russell Group
• School of EECS• 70 academic staff• £37M research grant portfolio• Networks research group
• Wireless and systems networking• 16 academic staff• 50+ PhDs and Postdocs
Queen Mary University of London
2
• Distributed services management in the datacenter
• Monitoring of events• Objectives-based management
• Automated diagnosis• Self-configuration• Self-healing
Datacenter Services Management
3
Node N1
Container static_web
Node N6 Node N10
Node N3 Node N5
Node N4
Container esb1 Container esb1
Container prc2
Container esb2Container esb1
Container prc1
Container dyn_web2
Container bsn_logic1 Container ora_db
Container ora_db
CoRs
PrRc
PrCg
PrMg
ClMg
AcMg
AcDA
CPDA
ClDA
OpAc
ClPo
ClPS
ClDS
CrPD
AcDS
CPDA
Container bsn_logic2
Container bsn_logic2 C
Node N1
Container static_web
Node N6 Node N10
Node N3
Node N5 Node N4
Container esb1 Container esb1
Container prc2
Container esb2Container esb1
Container prc1
Container dyn_web2
Container bsn_logic1 Container ora_db
Container ora_db
CoRs
PrRc
PrCg
PrMg
ClMg
AcM
g
AcD
A
CPDA
ClDA
OpA
c
ClPo
ClPS
ClDS
CrPD
AcD
S
CPDA
Container bsn_logic2
Container bsn_logic2
Container bsn_rule1
PrRR
OA
cPPrRP
Migrate
Compute, MessagingUpdate Graph
Decide Migrations
BSP SYNC BARRIER
BSP SYNC BARRIER
Distributed Graph Processing
The Cloud 1.0
4
User Latency
Reliability
Geo-distributed Cloud Applications
5
User Latency
Reliability
Dynamism
• Spans over a multi tenant infrastructure• Datacenters, CDN: computing resources• Internet Service Providers, IXPs
• Distributed Application Overlay• Nodes (computing), and links (connectivity)
• Requirements on links to end users and intra-application links
• Elasticity: dynamically adapt to user workload
Anatomy of a Cross Cloud Application
6
• Applications know what they need (QoS, requirements)
• Latency, bandwidth are often the performance bottlenecks
• But only control cloud resources• Where to deploy?• Hack network at application layer
(proxies, load balancer, middleboxes)
• Compensate/adjust on transport protocols
Applications and Networks don’t talk
7
• Network views aggregated packet information
• Internal information hidden for other stakeholders
• Static network configuration
• Programmatic control plane for the network• Control forwarding behaviour• Break into the protocol stack• Network virtualization resources can be dynamically allocated
Enter SDN
8
Logically Centralised Control Plane, on a Internet Scale, multi-tenant infrastructure?
• Applications are managed based on measured server metrics. • CPU, memory, requests/second, service time
• We also need network information monitoring!• Static information (topology)• Dynamic information (network status) … “real time”
Network analytics
9
Scalable Fine-grained Network Monitoring
Network plus Server App Analytics
Application-aware network management
• Applications management plane has to orchestrate both compute and network infrastructure
• Use SDN to help with transient states, migration• … and automatically handle application high availability
Dynamic Cloud App management with SDN
10
Infrastructure ecosystem
Act at the right timescale
Decide where and how much
Manage transitional states
• Cloud applications require some services• Security, load balancing, forwarding…
• Geo-distributed applications need similar support!
• How to extend to a network-wide scale?• Co-location of application nodes- support services
• Efficient support of dynamic overlays• Configure with changing network-wide policies
Network-wide services for applications
11
Load Balan
cer
Proxy
Transcoder FW
IDSCache
…
As challenging to manage as the applications themselves
• Cloud applications are a strong use case for SDN• Support latency requirements• Link to end user, intra application communications
• We need to talk!• Application management needs to become aware of the
networking side• Orchestration of the network and computing
infrastructure must be addressed• How do we support autonomic dynamic application
management, in a scalable way?
Conclusions
12
International Workshop in Trends in Future CommunicationsCPqD, Campinas, Brazil25th February 2014