EucaMeetup NYC - April 10, 2012
-
Upload
eucalyptus-systems-inc -
Category
Technology
-
view
767 -
download
1
Transcript of EucaMeetup NYC - April 10, 2012
© 2011 Eucalyptus Systems, Inc.
Eucalyptus is the world’s most widely
deployed on-premise Infrastructure as a Service
Cloud
© 2011 Eucalyptus Systems, Inc.
Cloud App Development
Data Center Automation
Cloud Management
Cloud Data Center
Platform and Infrastructure
System Integrators
Partner Ecosystem
© 2011 Eucalyptus Systems, Inc.
IT as a Service Resource Platform
Self-Service Resource
Configuration
Self-Service Resource
Provisioning
Dynamic Resource
Management
Resource Chargeback
and Reporting
Infrastructure as a Service (IaaS)
Applications
On-premise
© 2011 Eucalyptus Systems, Inc.
Highly Available Cloud Services in an Application Self-Service World
Govind Rangasamy Director, Product Management
© 2011 Eucalyptus Systems, Inc.
Customer Need for Cloud Agility is key…
Flexibility Automation Speed Trust
Self-Service Resource
Configuration
Self-Service Resource
Provisioning
Dynamic Resource
Management
Resource Chargeback
and Reporting
Infrastructure as a Service (IaaS)
© 2011 Eucalyptus Systems, Inc.
An enterprise open source, on-premise cloud Infrastructure-as-a-Service (IaaS) software platform
Physical resource management tools interface with hypervisor, storage, and network infrastructure
Virtual resource management orchestrates disposable virtual cloud resources placement, handles security & traffic isolation, identity and storage
Cloud compute, network, storage and identity resources are accessible as services
Web services API to enable Self-serviceable infrastructure
© 2011 Eucalyptus Systems, Inc.
Eucalyptus IaaS Deployment (non HA)
• Cloud Controller
• Cloud level - Virtual Resource System
• AWS EC2 Compatible
• Walrus Storage
• Persistent data store
• Bucket-based, like S3
• Cluster Controller
• Node level - Virtual Resource System
• Manage Virtual Network
• Storage Controller
• Block accessed network storage
• Like EBS
• Node Controller
• VM management
• Instance management
• VMware Broker
• ESX, ESXi management
• vCenter server compatible
Cloud Controller
Node Controller
Cluster Controller
VMware Broker
Cluster Controller
ESX ESXi
Walrus Storage
SAN
NAS
VM
Storage Controller
Storage Controller
Resource Admin
VM
VM
VM
© 2011 Eucalyptus Systems, Inc.
Cloud IaaS Technology Benefits
• Cloud separates servers/applications from infrastructure • Cloud standardizes applications and servers into portable
containers • Cloud allows carrying security with portable containers • Cloud provides greater availability with resource isolation • Cloud allows scale-out using built-in elasticity • Cloud allows easier scale-in • Cloud allows rapid resource provisioning • Cloud allows easy DR
© 2011 Eucalyptus Systems, Inc.
SCM
Standardize Stacks => Portable Containers
Linux
JEE
Hibernate
Spring
Log4J
Proprietary code
App Server
Web Server
Various Agents
EMI Linux
Various Agents
JEE
App Server
Web Server
Proprietary code
Log4J
Spring Hibernate
Convert Existing stack to portable
Container
Walrus
Self-Service
VM
VM
VM
© 2011 Eucalyptus Systems, Inc.
Developer/QA Self-Service
• Intuitive self-service compute, network, storage UI
• Key management and encryptions
• Shell/RDP access • Elastic Block Storage
encryption • Remote logging • Virtual Machine Monitoring • Budgeting and chargebacks
© 2011 Eucalyptus Systems, Inc.
App Dev/Test Workflow System
• Orchestrate cloud resources • Integrates with developer tool
chain – Build tools – SCM systems – Application servers – Testing and code analysis
tools
• Process and utilization reporting
• Dev. Configuration sharing
Orchestration through Cloud Self-service API
© 2011 Eucalyptus Systems, Inc.
Scalable Web Apps
• Scalability • Unpredictable
workloads • High Availability • Performance • Manageability • Low Cost
Website/SocialGami
ng
App Server
App Server
App Server
MySQL MySQL Replication
Web Server
Web Server
Web Server
LB
LB
External Firewall Hardware or software to open standard ports (80,
443) Web Load Balancer
Hardware or software to distribute network traffic
across several web servers
Web Server Farm to handle http requests
Backend firewall to limit access to App Servers (software or hardware)
App Servers and Cache servers that implement
business logic
Data Tier with protection
© 2011 Eucalyptus Systems, Inc.
Example: Scalable Web Services Cloud
HLB
NFS Store (NetApp)
Puma.com
MySQL
M
Nagios
Zone 1
SLB
Web Server Web Server
App Server App Server
Zone 2
SLB
Web Server Web Server
App Server App Server
Walrus with Images
Puppet
M Merlin
Bare Metal Provisioner
© 2011 Eucalyptus Systems, Inc.
Reactive IT to Proactive IT using standardized portable containers with IaaS
Application Slows down
Track down the troubled server
Application Slows down Users Wait
Determine impact to other
critical Apps
Determine the root cause Talk to Admins
Fix the application
(Auto) provision another exact instance to fix the
application
Reactive IT Workflow Proactive IT Workflow with Cloud
Identify the root cause
Fix infrastructure issues
Decide to include or exclude the Infrastructure
resource from the cloud
© 2011 Eucalyptus Systems, Inc. 23
Business impact of downtime The risks to business performance
$ B
illio
ns
Productivity/ employees
Productivity: Number employee x impacted x hours out x burdened hours = ?
$ M
illio
ns
Minutes Days Time
$ Im
pact
Direct financial/ customer
Revenue: Direct loss, compensatory payment, lost future revenues, billing losses and investment losses
Damaged reputation
Damaged reputation: Customers, competitors gain advantage, suppliers, financial markets, business partners
Financial performance
Financial performance: Revenue recognition, cash flow, credit rating, stock price, regulatory fines
Constant increase
Exponential increase
Source: IDC Business Value Database
© 2011 Eucalyptus Systems, Inc.
Cost of downtime
Industry sector Lost productivity Lost revenue
Retail Manufacturing Healthcare Financial Public Sector Communication, Media & Entertainment (CME)
$95,852 $397,822 $1,128,970 $127,027 $74,625 $347,964
$888,498 $21,900,898 $12,767,013 $11,648,105 N/A $49,489,612
Average Annual Costs
$362,043 $16,115,687
Source: IDC Business Value Database
© 2011 Eucalyptus Systems, Inc.
Eucalyptus IaaS High Availability
Autonomic IaaS Maintain Service Integrity
Respond to Change Quickly
Reduce Administrative Costs Reduce downtime
• Resilient and reliable cloud service availability
• Self-aware services failure detection
• Coordinated recovery of failed cloud services
• Preserves virtual instances location
• Preserves VM isolation configurations, Elastic IPs, Security Groups
• Protects storage buckets • Preserves VM to storage
mapping
Faster time to Market
• Flexible placement of instances
• Detect and failover of services to available resources
• Separation of service and data for faster recovery
• Adaptive network and security services
© 2011 Eucalyptus Systems, Inc.
Self-Aware IaaS Service Failure Detection and Reporting
• Eucalyptus monitors its services constantly for
– Public and private network connectivity failures
– Disk failures – Physical server failures
• Logs appropriate error messages for tracking and auditing
– Service state (ENABLED, DISABLED, NOTREADY, STOPPED, BROKEN)
– Tools for reporting service state
VM
NC NC
VM VM VM
SAN/NAS
Walrus
Walrus
CLC
CLC
CC
CC
SC SC
Zone
© 2011 Eucalyptus Systems, Inc.
Preserving Virtual Instance Location, Security Groups, VNETs
• Virtual instances’ location in a zone
• Security groups within and across zones
– L2TP Tunnels between two CC
• VM isolation configurations
VM 5
NC NC
VM 6 VM 7 VM 8
Walrus
Walrus
CLC
CLC
Zone 2
CC CC
VM 1
NC NC
VM 2 VM 3 VM 4
Zone 1
CC CC
Security Group 1
Security Group 3
Security Group 2
© 2011 Eucalyptus Systems, Inc.
Storage Controller HA with SAN adapter
• Preserves – Storage Controller to SAN
array connectivity/authentication
– Storage Mapping between NCs and SAN volumes
– Snapshots history – User and resource association
• Keeps track of service state for auditing and maintenance
VM
NC NC
VM VM VM
Walrus
Walrus
CLC
CLC
CC
CC
SC SC
Zone
SP1 SP2
iSCSI Storage Array
Storage Control
path
Storage Data path
© 2011 Eucalyptus Systems, Inc.
Walrus HA Protects Storage Buckets
Walrus
Walrus
CLC
Block level replication
• All user buckets are protected
– Storage mirroring using network RAID-1
• HA failover happens – After a node outage – After an outage of storage
subsystem – After loss of connectivity
between user and Walrus
• User key mappings are preserved
© 2011 Eucalyptus Systems, Inc.
Implement Your WebApp on a Highly Available IaaS Platform
Cloud Controller HA
Walrus Storage HA
Cluster Controller HA
Node Controllers
ESXi
NAS
SAN Storage Arrays
NAS
SAN Storage Arrays
Storage Controller HA
Storage Controller HA
Cluster Controller HA
VM VM VM VM
VM VM
VM VM VM VM
VM VM
Programmatic Cloud Access
Self-Service GUI
© 2011 Eucalyptus Systems, Inc.
Scale quickly using Rapid Instancing
• Scale up zones using Rapid Instancing using Copy-on-Write enabled EMIs
• Use Node Controller
storage efficiently using CoW snapshots
EMI
NC
Walrus
NC
VM VM VM VM
Full Copy Instancing
VM VM VM VM
Rapid Instancing with CoW EMIs
© 2011 Eucalyptus Systems, Inc.
Control Access to Resources
Test Zone 1
WEB App DB
WEB App DB
WEB App DB
WEB App DB
WEB App DB
WEB App DB
Built-in policy enforcement
engine
• Allow or deny API and Resource* access
• Allow or deny specific API/User actions
• Specify resource access time limits
* Extension to AWS IAM
© 2011 Eucalyptus Systems, Inc.
Use Cases Testing and QA
Big Data St-as-a-Service
Zone 2
SLB
Web Server Web Server
App Server
App Server
Zone 1
SLB
Web Server Web Server
App Server
App Server
HLB
Scalable Web Service.com
Test Zone 2
WEB App DB
WEB App DB
WEB App DB
WEB App DB
Test Zone 1
WEB App DB
WEB App DB
WEB App DB
WEB App DB
Test Control System
Hadoop Zone 1
Job Server
Data Node
Data Node
Data Node
Data Node
Data Node
Data Node
Name Node
Hadoop Zone 2
Job Server
Data Node
Data Node
Data Node
Data Node
Data Node
Data Node
Name Node
Big Data Client
Scalable Web Services
Backup/R
estore Walrus (S3)
© 2011 Eucalyptus Systems, Inc. 35
Source:
Gateway/Router
CLC1
Walrus1 Switch1
Internet/User Network
SC1
CC1
CLC2
Walrus2
SC2
CC2 NC
NC NC
© 2011 Eucalyptus Systems, Inc.
Gateway/Router CLC1/Walrus1
CC1/SC1
NC
Switch1
Internet/User Network
CLC2/Walrus2 CC2/SC2
Switch2
NC NC
© 2011 Eucalyptus Systems, Inc.
Euca IaaS support stack
Physical Resource Management
Virtual Resource Management
Cloud Resources
IaaS Web Services
Third Party Management
SaaS / PaaS Providers
© 2011 Eucalyptus Systems, Inc.
Thank you
Email: [email protected] Resources http://www.eucalyptus.com/eucalyptus-cloud/iaas/features http://www.eucalyptus.com/eucalyptus-cloud/iaas/roadmap http://www.eucalyptus.com/eucalyptus-cloud/iaas/compatibility
© 2011 Eucalyptus Systems, Inc.
Join us for the inaugural Eucalyptus conference, taking place in New York City on Wednesday, April 25th. EucaDay NYC will be a day of education and celebration of the cloud, bringing together customers, partners, and the Eucalyptus Community. Wednesday, April 25, 8:00 AM – 6:30 PM • The Bailey, NYC AGENDA 8:00 AM – 9:30 AM • Keynote and Eucalyptus 3 Marten Mikos, CEO and Tim Cramer, VP of Engineering 9:30 AM – 2:30 PM • Eucalyptus in Action Use Cases and Customer Stories (Including Lunch) 2:30 PM – 4:30 PM • Eucalyptus Community and Closing Remarks Greg DeKoeningsberg, VP of Community and Marten Mickos 4:30 PM – 6:30 PM • EucaSocial Networking Reception www.eucalyptus.com/news/events
EucaDay NYC
© 2011 Eucalyptus Systems, Inc.
Questions? Alliances: Brady Murray, [email protected]
Community: Greg DeKoenigsberg, [email protected] Product Management: Govind Rangasamy, [email protected] Marketing: David Butler, [email protected] Sales (US East): Tim Zeller, [email protected] Field Marketing: Nelli Lahteenmaki, [email protected]
© 2011 Eucalyptus Systems, Inc.
Cloud IaaS vs. Virtualization
Capability Virtualization Cloud IaaS
Virtual Machine behavior
Very similar to physical servers due to PàV conversions
VMs are not tied to a single physical server and are disposable
Application behavior
Applications stick to VMs with tightly coupled configurations
Applications and their infrastructures are decoupled for auto scalability and elasticity
Resource Elasticity Resource pooling at the hypervisor, or cluster level
Resource pools of compute, network and storage at the cloud availability zone level
Resource access isolation
VMs CPU, Memory, Network and Storage resources access is not isolated
Resources are completely isolated
Resource access authentication
Virtualization allows unauthenticated access to resources
Cloud has very granular per user level resource access authentication
SLA and Quality of Service
Defining and maintaining SLA is hard especially with quality of service guarantees
Relatively easy because of resource access isolation and authentication
Chargeback and billing
Chargeback and billing are hard problems in just a virtualized environments
Due to per user level access and resource access isolation, chargeback and billing are much simpler
A well designed virtualization environment is the basis for private clouds
© 2011 Eucalyptus Systems, Inc.
Features: l Standardized on-demand compute
devices
l Elastic pool of compute entities with fast provisioning
l Automatic virtual Instance Configurations
l CPU, Memory, Network and storage
Benefits: l Compute self-serviceability
l Scale-out and scale-in for better utilization
Eucalyptus IaaS: Compute
© 2011 Eucalyptus Systems, Inc.
Features: l On-demand Elastic IPs
l VM isolation with security groups
l Virtual networking
l Pubilc/private IP translation (NATing), DHCP
l Multiple Networking Modes for Assigning Addresses to VMs
Benefits: l Single point of management for all cloud
networking
l Self-serviceability
l Scale-out and scale-in network resources for better utilization
Eucalyptus IaaS: Networking
© 2011 Eucalyptus Systems, Inc.
Features: l On-demand, Highly Scalable and
Secure Bucket Based Object Store
l Highly Reliable, Elastic Block Storage with configurable SAN adapters
l Ability to boot from block storage
l Flexible configuration with existing storage infrastructure on DAS, NAS, and SAN
Benefits: l Storage self-serviceability
l Scale-out and scale-in for better storage utilization
Eucalyptus IaaS: Storage
© 2011 Eucalyptus Systems, Inc.
Features: • Users, groups and accounts management
• Security credentials management
• Flexible policy based resource access management
• Authenticate instances using existing AD/
LDAP systems • Flexible policy based resource utilization
management
Benefits: • Centralized efficient management of self-
service infrastructure access
• Centralized efficient utilization control of infrastructure resources
Eucalyptus IaaS: Identity Management
© 2011 Eucalyptus Systems, Inc.
Run Critical Web Services Using Secure IaaS Platform
WS-Security, WS-SecurityPolicy, SSH, SSL, Crypto Certificates
Application Self-service
User Self-Service
Cluster Controller
Node Controllers
VM
VM V
M VM VM VM
NAS
SAN Storage Arrays
Storage Controller
WS-S
WS-S WS-S
WS-S
WS-S
Cloud Controller
Walrus
https
https
API
GUI/CLI
API or GUI Entry
Point
VM Access using Keys and
Certificates
Access using Keys and
Certificates
Access using Keys (REST)
and Certificates (SOAP)