Tivoli Storage Manager On VMware - IBM · PDF fileTivoli Storage Manager On VMware ......
Transcript of Tivoli Storage Manager On VMware - IBM · PDF fileTivoli Storage Manager On VMware ......
San Jose, California
Tom Hepner
Advanced Technical Support
Tivoli Storage Manager On VMware
Mar 2007
®
© IBM Corporation 2005
IBM TotalStorage ®
© 2005 IBM Corporation
®
Agenda
VMware virtualization servers
TSM installation and configuration
Backup methods
Scheduled backups
Restore issues
FAQs
References
IBM TotalStorage ®
© 2005 IBM Corporation
®
VMware Virtualization Servers
VMware servers create a virtual infrastructure for x86-based servers.
These servers are used for server consolidation, disaster recovery and streamlining software development processes.
All x86-based platforms are supported by VMware ESX and GSX server software.
IBM TotalStorage ®
© 2005 IBM Corporation
®
VMware Support for TSM
TSM backup-archive & data protection component clients
TSM client support is virtually the same as thatprovided for systems on native machines.
VMware unique problems should be reported to VMware.
IBM TotalStorage ®
© 2005 IBM Corporation
®
VMware Support for TSM
Support is for VMware ESX and GSX versions.
The TSM server, storage agent (LAN-free clients) or client backup sets are NOT supported on VMware at this time
Virtual machines on VMware must connect via TCP/IP to a TSM server that is not running on VMware
IBM TotalStorage ®
© 2005 IBM Corporation
®
Hardware - Host - Guest Virtual Machines
•Guest VM 1 -Linux Suse
•Guest VM 2 -Linux Redhat
•Guest VM 4 -Windows 2000
•Guest VM 3 -Windows 2003
•Host – Linux
•Hardware – x86
IBM TotalStorage ®
© 2005 IBM Corporation
®
TSM & VMware Software Requirements
A TSM Linux x86 client at V5.5.5 or newer
A TSM server at the V5.1.X or newer
VMware 2.0 or newer
IBM TotalStorage ®
© 2005 IBM Corporation
®
TSM Installation and Configuration
TSM client download site & files• ftp.software.ibm.com/storage/tivoli-storage-
management/maintenance/client/v5r2/Linux/Linux86/v522/(see README for download instructions)
• TIVsm-BA-i386.Rpm
• TIVsm-API-i386.Rpm
IBM TotalStorage ®
© 2005 IBM Corporation
®
TSM Installation and ConfigurationThe TSM client acceptor daemon can be used,Optionally, to remotely access the TSM client toManage VMFS volumes.
The TSM web client is made available by startingThe TSM client acceptor daemon (dsmcad) on theVMware servers.
With a properly defined virtualmountpoint option,The /vmfs directory will be displayed within the localFolder in the file tree for backup and archive.
IBM TotalStorage ®
© 2005 IBM Corporation
®
Backup Methods
File-level incremental
Full guest VM backup• Inactive virtual machine• Based on a copy of the .dsk files• Suspended virtual machine• Active virtual machine
Consolidated Backup Integration Modules
IBM TotalStorage ®
© 2005 IBM Corporation
®
Backup MethodsFile-level Incremental
To achieve a complete TSM file-levelBackup/restore environment, install andConfigure a TSM client onto each guestOs.
These file-level backups are independent ofThe complete guest VM backup described inThe following pages.
IBM TotalStorage ®
© 2005 IBM Corporation
®
Backup MethodsBackup of an Inactive Virtual Machine
Backup .dsk files when VM is shutdownUse a selective backup for .dsk files>dsmc sel /vmfs/vmhba2:0:0:6/win2000.dsk>dsmc sel /vmfs/vmhba2:0:0:6/win2000_2.dskor>dsmc sel /vmfs/vmhba2:0:0:6/win2000.dsk \ /vmfs/ vmhba2:0:0:6/win2000_2.dsk
IBM TotalStorage ®
© 2005 IBM Corporation
®
Backup MethodsBackup of an Inactive Virtual Machine
Advantage• Ensures backup consistency
Disadvantage• Requires maximum down time of the VM
IBM TotalStorage ®
© 2005 IBM Corporation
®
Backup MethodsBackup Based on a Copy of the .dsk
File
Shutdown the VM to be backed up.Create a copy of all .dsk files used by the VM using the "dd" command.Restart the virtual machine. Use the TSM client to backup copiesDelete the .dsk file copies
IBM TotalStorage ®
© 2005 IBM Corporation
®
Backup MethodsBackup Based on a Copy of the .dsk
FileAdvantage
• Reduces VM shutdown window
• Ensures backup consistencyDisadvantage
• Requires additional temporary disk space
• Requires additional processing either manually or by scripting
IBM TotalStorage ®
© 2005 IBM Corporation
®
Backup MethodsVM Downtime Comparison
21 minutes9 minutesTotal down time
3 minutes3 minutesVM Restart
16 minutesN/A Backup
N/A 4 minutesCopy of .dsk file
2 minutes 2 minutes VM Shutdown
Non-copy Copy basedActivity
IBM TotalStorage ®
© 2005 IBM Corporation
®
Backup MethodsBackup of a Suspended Virtual
MachineSuspend the VM
• Click suspend button on console
• Use command vmware-cmd
• Use calls available in the VMware Perl APIBackup .dsk files associated with the VMResume the VM
IBM TotalStorage ®
© 2005 IBM Corporation
®
Backup MethodsBackup of a Suspended Virtual
MachineAdvantages
• Reduced VM downtimeDisadvantages
• Backups of .dsk files may have inconsistencies
Note: we recommend doing test restores to validate your procedure
IBM TotalStorage ®
© 2005 IBM Corporation
®
Backup MethodsBackup of an Active Virtual Machine
Freeze VM (use preschedulecmd)vmware-cmd /root/vmware/w2k3/w2k3.vmx addredo scsi0:0Backup .dsk filesUnfreeze / commit redo log
Note: we recommend doing test restores to validate your procedure
IBM TotalStorage ®
© 2005 IBM Corporation
®
Backup MethodsBackup of an Active Virtual Machine
Advantages• Reduced VM downtime
Disadvantages• Backups of .dsk files may have inconsistencies • Backup/restore procedure more complicated
Note: we recommend doing test restores to validate your procedure
IBM TotalStorage ®
© 2005 IBM Corporation
®
Scheduled Backups
Prior to backup, the VM’s state must beverified and match what is expected
Creating a separate schedule for each VM may simplify the procedure
Use consistent naming convention for the .dsk files to take advantage of wild carding
Multiple objects can be included in a single backup specification
Use command scripts to run multiple dsmc commands
IBM TotalStorage ®
© 2005 IBM Corporation
®
Scheduled Backups
Ensure that .dsk files are not in useVmware-cmd utility or the VMware API functions can suspend, shutdown, or place into redo mode a virtual machineNative commands, i.E. cron, can be used to issue preparatory commands.Use pre/postschedulecmd features of the TSM scheduler to resume VM activity
IBM TotalStorage ®
© 2005 IBM Corporation
®
Restore
The .dsk files can be restored by command line or from the WEB client
Use the virtualmountpoint option to create TSM filespace for the /vmfs directory
Shutdown the virtual machine if it is running
IBM TotalStorage ®
© 2005 IBM Corporation
®
Restore
Restore the corresponding .dsk files to the original location with the replace option. dsmc restore /vmfs/vmhba2:0:0:6/”win2000*.dsk” –rep=yes
Or you can choose to restore a backup taken at an earlier time by using the -pick option: dsmc restore /vmfs/vmhba2:0:0:6/”win2000*.dsk” –rep=yes –inactive -pick
Restart the vm
IBM TotalStorage ®
© 2005 IBM Corporation
®
Restore
Rebuilding a virtual machine definition and restoring data • Restore the .dsk file to desired VMFS location
• Using the VMware management interface, add a new virtual machine with the correct operating system type
• When prompted, choose the option to use an existing disk, and point to the .dsk file which was just restored.
IBM TotalStorage ®
© 2005 IBM Corporation
®
Restore
Building a VM definition on another machine• Define a virtualnodename option to temporarily access remote
.dsk files
• Use procedure on previous page
IBM TotalStorage ®
© 2005 IBM Corporation
®
Restore
Restoring a backup taken of a suspended or active virtual machine
the procedure for restoring a backup taken of a suspended or active VM is identical to those described in previous sections.
IBM TotalStorage ®
© 2005 IBM Corporation
®
Failure on the first backupIn the event that the virtual machine is still up and running whenyou attempt to backup, the corresponding .dsk file using the TSM client, you will get an “internal system error”.
Reason: the .dsk files are in use and cannot be opened by TSM.
Message:
IBM TotalStorage ®
© 2005 IBM Corporation
®
TSM Client Error
Error :
09/06/2006 12:22:39 ANS1492S Invalid virtual mountpoint /vmfs/volumes/vmw-1: File not found.
09/06/2006 12:22:39 ANS1492S Invalid virtual mountpoint /vmfs/volumes/vmw-2: File not found.
09/06/2006 12:22:39 ANS1492S Invalid virtual mountpoint /vmfs/volumes/vmw-1: File not found.
09/06/2006 12:22:39 ANS1492S Invalid virtual mountpoint /vmfs/volumes/vmw-2: File not found.
09/08/2006 18:23:03 Error opening input file/opt/tivoli/tsm/client/ba/bin/de_DE/dscjres.txt
09/08/2006 18:31:06 TransErrno: Unexpected error from open, errno = 1609/08/2006 18:31:11 Internal system error. Please check the TSM Error Log for any additional information.09/08/2006 18:32:39 TransErrno: Unexpected error from open, errno = 1609/08/2006 18:32:45 Internal system error
VMware Consolidated Backup
IBM TotalStorage ®
© 2005 IBM Corporation
®
Agenda
• Overall Vision of the Future• Pre-ESX 3.0 State of the Art with VMware
Backups
• Problems with the current State
• Solution: Consolidated Backup
• Integrations
IBM TotalStorage ®
© 2005 IBM Corporation
®
VMware’s Long-Term Vision
• VMware Virtual Infrastructure should be superior to physical infrastructure
• More “Available”• Better Resource Utilization• Easier to protect
VMware Consolidated Backup is one step towards that goal
IBM TotalStorage ®
© 2005 IBM Corporation
®
Agenda
• Overall Vision of the Future
• Pre-ESX 3.0 State of-the-Art with VMware Backups
• Problems with the current State
• Solution: Consolidated Backup
• Integrations
IBM TotalStorage ®
© 2005 IBM Corporation
®
Pre-3.0: Standard Backup Techniques
Backup Server
VM1ESX
VM2
VM3
AGENT
Ser
vice
Con
sole
AGENT
AGENT
AGENT
Filesystem Level
Backups
Whole-VMBackups
Storage(Tape, Disk)
LAN, SAN, SCSILAN ONLY
Advantages:• Just like physical
host
• PLUS Whole-VM backup
• Easy to implement—and your capabilities have increased.
IBM TotalStorage ®
© 2005 IBM Corporation
®
Agenda
• Overall Vision of the Future
• Pre-ESX 3.0 State of the Art with VMware Backups
• Problems with the current State• Solution: Consolidated Backup
• Integrations
IBM TotalStorage ®
© 2005 IBM Corporation
®
Problems with the Current State of the Art
Agent-Based• Backup load is cumulative
5% CPU load is OK…Until you have 20 virtual machines backing up at once
• Backup load is very difficult to virtualize.Intense Disk I/O coupled with intense Network I/O
• Backing up Disk images over the Service Console can be slow.
IBM TotalStorage ®
© 2005 IBM Corporation
®
Agenda
• Overall Vision of the Future
• State of-the-Art with VMware Backups
• Problems with the current State
• Solution: Consolidated BackupWhat does it do?What is it missing?
• Integrations
IBM TotalStorage ®
© 2005 IBM Corporation
®
Solution: Consolidated Backup
VCB Goals• Leverage VMware’s unique technology
to improve filesystem backup
• Offload backup cycles from ESX Server
• Work without SAN-specific software
• Easy implementation for end users
• Begin reducing the overall complexity of backup infrastructure
IBM TotalStorage ®
© 2005 IBM Corporation
®
VCB: The EffectESX
VM
2V
M3
VM
1
VMFS
VMDK
Ser
vice
Con
sole
SAN
VMDK
What’s The
EffectBackupProxy
VMDK
TSMCLIENT
vmkernel
LAN SCSISAN
IBM TotalStorage ®
© 2005 IBM Corporation
®
VM
2V
M3
VM
1
Ser
vice
Con
sole
vmkernel
BackupProxy
VCB
VCB: How it WorksESX
VMFS
VMDK
SAN
VMDK
What’s Happening
VMDKVMDK
REDO
SYNC
BLOCKLIST
PRE
POST
SAN
TSMCLIENTTSM IM
IBM TotalStorage ®
© 2005 IBM Corporation
®
VM
2V
M3
VM
1
Ser
vice
Con
sole
vmkernel
BackupProxy
VCB
VCB: How it WorksESX
VMFS
VMDK
SAN
VMDK
Full-VM Export
VMDKVMDK
REDO
SYNC
BLOCKLIST
2GB2GB
2GB
PRE
POST
SAN
TSMC
LIENT
UserScript
IBM TotalStorage ®
© 2005 IBM Corporation
®
What about Restore?
• No Proxy-Based Restore Yet.
• Options:Put an agent in each VM, restore files to that target.Have “restore target” VMs with agents. Restore to those VMs, then manually move files.To restore whole VMs, restore to a filesystem accessible by the Service Console and import files to VMFS.
IBM TotalStorage ®
© 2005 IBM Corporation
®
What about Restore? (cont.)
• Why release this without restore?Backups happen every single night, Restores are infrequent. We wanted to make an improvement over the situation today.
IBM TotalStorage ®
© 2005 IBM Corporation
®
Important Points to Remember
• This is not a replacement for backup software.
Backup products are the primary consumers of the new VCB APIsVCB integrates into existing infrastructure
• No Linux SupportIn version 1.0, file-based backup is only for Windows guests
IBM TotalStorage ®
© 2005 IBM Corporation
®
Agenda
• Overall Vision of the Future
• Pre-ESX 3.0 State of the Art with VMware Backups
• Problems with the current State
• Solution: Consolidated Backup
• Integrations
IBM TotalStorage ®
© 2005 IBM Corporation
®
VCB: Integrations
VMware hasproduced an integrations to:Tivoli Storage Manager Veritas NetBackupSymantec BackupExecLegato Networker.
These are basic integration only—commandline, pre-and-post job scripts
Questions?
Backup Slides
IBM TotalStorage ®
© 2005 IBM Corporation
®
BackupProxy
VLUN
VCB: How it Really WorksESX
VM
2V
M3
VM
1
VMFS
VMDK
Ser
vice
Con
sole
SAN
VMDK
What’s REALLY
Happening
VMDK
REDO
VMDK
JSLIB
RA
RY
VirtualCenter
vmkernelVM DNS
NAME
VMSNAP
SYNC
BACKUPINFO
BACKUPINFO
BLOCKLIST
SNAP IDPRE
POST
SAN
IBM TotalStorage ®
© 2005 IBM Corporation
®
Reference Information
TSM Linux x86 V5.3 clienthttp://publib.boulder.ibm.com/infocenter/tivihelp/index.jsp?toc=/com.ibm.itstorage.doc/toc.xml
VMware ESX Server Documentationhttp://www.vmware.com/support/pubs/esx_pubs.html
VMware Perl API documentation:http://www.vmware.com/pdf/Scripting_API_21.pdf
VMware Professional Services: http://www.vmware.com/services/
IBM TotalStorage ®
© 2005 IBM Corporation
®
Reference InformationUsers guide for the TSM Linux x86 and other TSM clients: http://publib.boulder.ibm.com/tividd/td/IBMTivoliStoragemanagerclient5.2.2.Html VMware servers 2.1 administration guide http://www.vmware.com/pdf/esx/esx21admin.pdfVMware Perl API documentation http://www.vmware.Com/pdf/scripting_API_21.pdf VMware professional serviceshttp://www.vmware.com/services/Using IBM Tivoli storage manager for backup and restore on the VMware ESX console http://www.vmware.com/pdf/esx3_backup_wp.pdfHttp://w3-03.ibm.Com/support/americas/storage/tsm.Html
http://www.vmware.com/download/vi/drivers_tools.html