Redefining Backup for VMware Environment€¦ · Source: X86 Virtualization Adaptors Hit the...
Transcript of Redefining Backup for VMware Environment€¦ · Source: X86 Virtualization Adaptors Hit the...
1© Copyright 2009 EMC Corporation. All rights reserved.
Redefining Backup for VMware Environment
2© Copyright 2009 EMC Corporation. All rights reserved.
Agenda
2
VMware infrastructure backup and recovery challenges
Introduction to EMC Avamar
Avamar solutions for VMware infrastructure
Key takeaways
© Copyright 2008 EMC Corporation. All rights reserved.
3© Copyright 2009 EMC Corporation. All rights reserved.
0%10%20%30%40%50%60%70%
1980 1990 2007Server utilization rates*
Efficiency
1990 1997 2007
# co
mpo
nent
s
Numbers of components that need to be procured, provisioned, managed, secured, etc.
Complexity
Today’s IT Reality
What’s Increasing
Pressures
Do more with less
Comply with security and regulatory
requirements
What’s Decreasing
Resources
Less able to add new
functionality or improve IT service levels
*Source: VMware, November 2007
4© Copyright 2009 EMC Corporation. All rights reserved.
Virtualization Goes Mainstream
Source: X86 Virtualization Adaptors Hit the Tipping Point, Forrester Research, Inc., November 30, 2007
65% Will Adopt Server Utilization by 2009
Firms that don’t expect to virtualize by 2009
35%
Believe they will implement by 2009
15%
Already implemented in 2007
37%
Implemented by 200815%
Base: 275 enterprise server decision-makers
50% Will Have at Least Two Years ExperiencePercent of enterprises with two or more years of x86 virtualization
experience, by year
Base: 125 enterprise server decision-makers that are using or implementing x86 virtualization
2004 2005 2006 2007 2008 2009
3% 4% 8%
23%
38%
51%
Reached two years of experience in current yearBase of experienced firms from previous year
X86 Server Virtualization Will Grow from 24% Today to 45% by 2009
“Approximately what percentage of your x86 servers are virtualized today?”
2007(Actual)
24%
“Approximately what percentage of your x86 servers do you believe will be virtualized two
years from today?”
2009(Expected)
45%
Base: 131 server decision-makers who are using server virtualization as of mid-2007
Base: 179 server decision-makers who have virtualized or will virtualize by mid-2009
5© Copyright 2009 EMC Corporation. All rights reserved.
Virtualization Value
Server consolidation and infrastructure optimization
– Pools common infrastructure resources– Breaks legacy “one application to one server”
Physical infrastructure cost reduction– Reduces hardware, real estate, power and
cooling costs
Improved operational flexibility and responsiveness
– Reduces time spent on provisioning, configuration, monitoring, and maintenance
Increased application availability and improved business continuity
– Eliminates planned downtime
“Virtualization will be the most impactful trend in infrastructure and operations through 2010.”
— Gartner*Source: Gartner, Virtualization Will Drive Major Change in IT Infrastructure and Operations in the Next Three Years, May 8, 2007
6© Copyright 2009 EMC Corporation. All rights reserved.
New Backup Challenges
OLD PARADIGMLow overall server utilization and plenty of
bandwidth for backup
NEW PARADIGMHigh overall server utilization, but
little bandwidth for backup
Virtualization Changes Server, Application, and Information Paradigm…Backup Must Evolve to Deliver Even Greater Consolidation and Value
7© Copyright 2009 EMC Corporation. All rights reserved.
Introducing EMC Avamar
Reduces the size of backup data at the source—before it is transferred across the network—reducing backup times by up to 10 times
Reduces required network bandwidth—and the amount of data backed up daily—by up to 500 times
De-duplicates across sites and servers for maximum efficiency
Cost-effectively stores a greater number of full backups on disk—reducing or eliminating the need for tape
Ideal for protecting remote offices, VMware environments, LAN servers in the data center—enabling fast, reliable, and secure backups over existing network connections
Revolutionizes Backup with Global, Source Data De-duplication
7
8© Copyright 2009 EMC Corporation. All rights reserved.
Avamar: Optimized Backup for VMware Infrastructure
Optimal location: Reduces data at the source– Duplicate data never traverses congested shared resources– Data backed up is reduced from ~200 percent to ~2 percent of primary weekly– Significantly reduces contention for shared resources– De-duplicates within and across virtual machines and/or VMDK (virtual machine disk
format) files
Optimal granularity: Sub-file, variable-length segments– VMDK is one large file; any changes cause an incremental/full traditional backup– Fixed-length segment de-duplication fails due to frame offset– Sub-file, variable-length segment de-duplication finds changes anywhere in VMDK– Dramatically cuts the amount of data backed up daily– Significantly reduces daily backup time
Ideal for the protection of VMware environments– Enables fast, secure backups over existing virtual infrastructure– Permits greater server consolidation and maximum value from VMware
Avamar De-duplicates at the Optimal Location and Level of Granularity
9© Copyright 2009 EMC Corporation. All rights reserved.
Avamar Data Store or Avamar server
How Source De-duplication Works
Global Data De-duplication Instances
Client agent scans the data for changes
Modified files broken into sub-file variable length segments
Only unique sub-file segments are backed up
Queries local file cache to identify and disregard static files
Compresses and applies a hash to each object
Queries local hash cache, and then the Avamar server to determine if objects are unique
10© Copyright 2009 EMC Corporation. All rights reserved.
Remote Site 1Duplicate Instance
Data already backed up, so only unique IDs stored (20 byte pointers)
DataCenter
A B C D
De-duplication Server (stored backup data)
Only unique data segments are backed up
E
E
AB
CD
First InstanceRemote Site 2Modified Instance
New data segment identified and backed up
Avamar: How it Works
Simple Example of Global, Source Data De-duplication
11© Copyright 2009 EMC Corporation. All rights reserved.
Target and Source De-duplication Only Source-Based De-duplication Reduces Network Bandwidth Requirements and Provides Immediate, One-Step Restore
TARGET DE-DUPLICATION
Up to 50 times reduction in backup storageMoves ~200 percent of primary data weeklyBackups are typically restored from full and incremental imagesData viewed as file systems and/or virtual tape library target for traditional backup environments
De-duplication Device
B B B B B B
BackupServer
SOURCE-BASED DE-DUPLICATION
Up to 50 times reduction in backup storageMoves ~2 percent of primary data weeklyUp to 500 times reduction in network impactUp to 10 times faster daily full backupsAll backups are full; immediate, single-step recoveryNext-generation backup and recovery
AvamarServer
12© Copyright 2009 EMC Corporation. All rights reserved.
Avamar Real-World Results
Data Type
Amount of Primary Data Backed Up
Amount of Data Moved Daily
Daily De-duplication Ratio
Windows file systems 3,573 GB 6.1 GB 586:1
Mix of Windows, Linux, and UNIX file systems 5,097 GB 11.7 GB 436:1
Engineering files on NAS (NDMP backups) 3,265 GB 24.2 GB 135:1
Mix of 20 percent databases, 80 percent file systems (Windows and UNIX) 9,583 GB 80.0 GB 120:1
Mix of Linux file systems and databases 7,831 GB 104.2 GB 75:1
Source: EMC
Results May Vary: Customer Ratios vs. Full Backups
13© Copyright 2009 EMC Corporation. All rights reserved.
Avamar Flexible Deployment
WAN
(ENCRYPTED)
(ENCRYPTED)
DATA CENTER
Primary systems
Avamar Data Store
(ENCRYPTED)
REMOTE RECOVERY SITE
Primary systems
TapeVault
Avamar Data Store
SMALL REMOTE SITE
Avamar agent onlyon primary systems
LARGE REMOTE SITE
Primary systems
Avamar Data Store
(ENCRYPTED)
Avamar Software Agent
14© Copyright 2009 EMC Corporation. All rights reserved.
Avamar Client Backup Solutions
Avamar client software runs on the VCB proxy
server
VMware Consolidated Backup
PhysicalServer
Virtual Machines
App
OS
App
OS
App
OS
ESX Server
SANStorage
SNAPSHOT
SNAPSHOT
SNAPSHOT
VCB proxy serverwith Avamar agent
MOUNT
CentralizedData Mover
Avamarserver
Avamaragents
Avamar client software runs directly on the ESX
console
Service Console
Hardware
VMware
DiskNICMemoryCPU
ApplicationApplicationApplication
Operating System Operating SystemOperating System
Avamarserver
ESXServer
Avamaragents
Guest
x86 Architecture
VMware Virtualization Layer
DiskNICMemoryCPU
Application
Operating System
Application
Operating System
Avamar client software runs directly on each
virtual machine
15© Copyright 2009 EMC Corporation. All rights reserved.
Avamar Backup for VMware Guests
Avamar agent resides inside each virtual machine
De-duplicates data within the virtual machine, as if they were physical servers
Moves minimal backup data– Reduces resource contention and
accelerates backups
Provides file-level restore for Windows, Linux, and Solaris
Avamar agents
x86 Architecture
VMware Virtualization Layer
DiskNICMemoryCPU
Application
Operating System
Application
Operating System
16© Copyright 2009 EMC Corporation. All rights reserved.
Up to 95% reduction in data moved
Up to 90% reduction in backup times
Up to 50% reduction in disk impact
Up to 95% reduction in NIC usage
Up to 80% reduction in CPU usage
Up to 50% reduction in memory usage
All backups are stored as “virtual full backups,” ready for immediate restore
Maintains effective consolidation ratios without overtaxing CPU utilization
Optimized Backup for VMware InfrastructureAvamar Efficiently Protects Virtual Machines
x86 Architecture
VMware Virtualization Layer
Traditional moves ~200% weekly
Avamar moves ~2% weekly
x86 Architecture
VMware Virtualization Layer
DiskNICMemoryCPU
Application
Operating System
Application
Operating System
AppOS
AppOS
AppOS
AppOS
AppOS
AppOS
AppOS
AppOS
AppOS
AppOS
AppOS
AppOS
DiskNICMemoryCPU
17© Copyright 2009 EMC Corporation. All rights reserved.
VMware Consolidated Backup (VCB)
Moves backup processing off the virtual machine
Eliminate virtual machine backup traffic on LAN
Supported by major third-party backup products
PhysicalServer
Virtual Machines
App
OS
App
OS
App
OS
ESX Server
SANStorage
SNAPSHOT
SNAPSHOT
SNAPSHOT
BackupProxy
Server
MOUNT
CentralizedData Mover
BackupDisk
18© Copyright 2009 EMC Corporation. All rights reserved.
Avamar and VMware Consolidated Backup
Avamar agent resides on the proxy server
De-duplicates within and across VMDK files
Supports both VCB file (Windows only) and image-level backup
Avamar replication provides disaster recovery for backed up VMDKs
PhysicalServer
Virtual Machines
App
OS
App
OS
App
OS
ESX Server
SANStorage
SNAPSHOT
SNAPSHOT
SNAPSHOT
VCB Proxy Serverwith Avamar agent
MOUNT
CentralizedData Mover
Avamarserver
Avamaragents
19© Copyright 2009 EMC Corporation. All rights reserved.
Avamar Backup at the Console Level
Avamar agent resides on the ESX console operating system
De-duplicates within and across VMDK files
Provides VMDK image-level (no file-level) backup without VCB
No proxy server or SAN required
Hardware
VMware
DiskNICMemoryCPU
ApplicationApplicationApplication
Operating System Operating SystemOperating System
Avamarserver
ESXServer
Avamaragents
20© Copyright 2009 EMC Corporation. All rights reserved.
Avamar Server Backup Products
Avamar Software Avamar Data Store Avamar Virtual Edition for VMware
Fully integrated hardware/software product with single point of support
Single-node Avamar server running as a virtual machine
Avamar VM
Operating System
Hardware
ESX Server
DiskNICMemoryCPU
Avamar VM
Operating System
Application
Operating System
Deployed on qualified, industry-standard servers
21© Copyright 2009 EMC Corporation. All rights reserved.
Avamar Data Store Gen 2
Complete EMC backup and recovery product– Avamar backup and recovery software with integrated
de-duplication – EMC-certified hardware—fully configured and delivered
Built-in high availability– Avamar RAIN technology– Spare node, RAID– Redundant power distribution
Simplifies– Purchase (single vendor, certified hardware)– Deployment (minimizes onsite setup)– Service (single vendor support)
Fully Integrated Software/Hardware Product
New Avamar DataStore Gen 2
doubles de-duplicated
backup capacity
22© Copyright 2009 EMC Corporation. All rights reserved.
Avamar Virtual Edition for VMware
Avamar Server Software Deployed as a Virtual Appliance
Industry’s first de-duplication virtual appliance for backup, recovery, and disaster recovery
– No other VMware backup and recovery product encapsulates both backup and disaster recovery
Leverages existing servers and storage – Can utilize any storage (SAN, NAS, or DAS)
Replication (of applications and storage) eliminates shipping tapes
– Replicate between Avamar virtual machines, or from Avamar virtual machines to Avamar Data Store or other server solutions
Facilitates rapid, cost-effective deployment and return on investment
Avamar VM
Operating System
Hardware
ESX Server
DiskNICMemoryCPU
Avamar VM
Operating System
Application
Operating System
23© Copyright 2009 EMC Corporation. All rights reserved.
Avamar Products for VMware Infrastructure
VMware Data Center with Guest-Level Backup
Remote Offices without VMwareRemote Offices with VMware
VMware Data Center with VMware Consolidated Backup
Avamar agent moves data to Avamar Virtual Edition for VMware; data is then replicated to the corporate data center
Avamar agent moves data to a physical Avamar Single Node server; data is then replicated to the corporate data center, OR an Avamar agent can back up directly to the data center over the WAN
WAN
LAN/SAN SAN
VCB Proxy Server
(ENCRYPTED) (ENCRYPTED)
(ENCRYPTED)
Hardware
ESX Server
DiskNICMemoryCPU
Avamar VM
Operating System
Application
Operating System
x86 Architecture
VMware Virtualization Layer
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
DiskNICMemoryCPU
x86 Architecture
VMware Virtualization Layer
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
DiskNICMemoryCPU
x86 Architecture
VMware Virtualization Layer
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
DiskNICMemoryCPU
x86 Architecture
VMware Virtualization Layer
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
DiskNICMemoryCPU
x86 Architecture
VMware Virtualization Layer
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
DiskNICMemoryCPU
x86 Architecture
VMware Virtualization Layer
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
App
OS
DiskNICMemoryCPU
24© Copyright 2009 EMC Corporation. All rights reserved.
Avamar Supported Operating Systems and Applications
Client Operating Systems SupportedMicrosoft Windows Server 2003 Standard and Enterprise
Microsoft Windows 2000 Server and Advanced Server
Microsoft Windows NT 4.0 Server
Microsoft Windows XP, XP Professional, Vista
Red Hat Linux 8.0, 9.0Red Hat Enterprise Linux (RHEL) 2.1, 3.0, 4.0
Solaris 2.6, 7, 8, 9, 10
SUSE Linux Enterprise Server 8, 9, 10
IBM AIX 5.1, 5.2, 5.3
HP-UX 11.0, 11iV1, 11iV2
Mac OS X 10.4x
NetWare 6.5
Novell Storage Services (NSS) OES 2
NDMP (EMC Celerra) DART 5.5NDMP (NetApp) Data ONTAP 6.3, 6.4, 6.5, 7.0.4, 7.0.5, 7.0.6
IBM DB2 8.2.x
Oracle 9i, 10g, 10gR2
Microsoft SQL Server 7.0, 2000, 2005
Microsoft Exchange 5.5, 2000, 2003
Application Modules
= ESX client OS-certified using RHEL 4 client (support within virtual machines depends on VMware support of client operating system)
VMware InfrastructureVMware ESX Server versions 2.5.3, 3.0.x, 3.5New
Avamar V4.0software expands client operating
system, applicationsupport
25© Copyright 2009 EMC Corporation. All rights reserved.
Avamar: Backup Built for VMware
VMware and Avamar—technologies that align perfectly– Virtual environments provide great opportunities for source de-duplication– Avamar is the best and most versatile solution for these environments
VMware adoption is a good time for a fresh look at backup and recovery– The perfect opportunity to consider Avamar and de-duplication– Achieve higher levels of consolidation without backup bottlenecks
27© Copyright 2009 EMC Corporation. All rights reserved.
Backing Up VMware Infrastructure
27
Before AvamarData center re-design focused on server consolidation and virtualizationConcern about traditional, tape-based backup in VMware environmentBackup windows strained; physical resources overburdened
With AvamarDeployed agents within virtual machines95 percent reduction in data moved90 percent reduction in backup timesMajor reductions in NIC, CPU, and memory usageCentralized management and control
“Avamar provides a huge time and cost savings for backup of multiple virtual machines.”
With Avamar, we can centrally manage all of our backups, and we also gain the ability to rapidly restore data down to the file level.”
— Curtis Damhof, Network Manager, St. Peter’s Health Care Services
28© Copyright 2009 EMC Corporation. All rights reserved.
Global Industrial Manufacturer
Before AvamarStruggling to meet backup, recovery, and reliability goals
Shipping tapes offsite—risky, slow recovery
With AvamarBackup for VMware (24 ESX Servers, 332 virtual clients)
Avamar agents installed in VM guests
Backup performance increased tenfold
Backup network traffic reduced by 95 percent
Reduced backup and recovery administrative burden
Eliminated physical tape management
28
29© Copyright 2009 EMC Corporation. All rights reserved.
Fortune 20 Healthcare Supplier
Before AvamarGrowing VMware environment struggles to meet backup windowDaily tape backup and offsite tape shipments—risky, slow recovery Unable to quickly replicate data via WAN for disaster recovery
With AvamarGlobal de-duplication effective within and across VMDK filesOver 70 percent reduction in first backup and average of 99.7 percent thereafter Compared to traditional alternatives, testing showed…
– Avamar moved one-fifth of the data that Symantec PureDisk moved
– Avamar moved 190 percent less data than traditional tape backup software moved
29