AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

13
AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research

Transcript of AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

Page 1: AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

AFS backups with Amanda

Mitch Collinsworth

Cornell Center for Materials Research

Page 2: AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

Motivation

A flexible, automated backup system for both AFS and non-AFS filesystems

Page 3: AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

Existing alternatives

AFS backupADSM/TSMOthers?

Page 4: AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

AFS backup

Complex and difficult to automate typical implementation uses home-

grown scripts errors recovery requires manual

interventionCan’t share tapes with non-AFS

backups

Page 5: AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

ADSM/TSM

Good automation bus costly for smaller sites

No server for free OS’s (Linux, FreeBSD...)

Data integrity dependent on a database “Good” tapes are worthless if database

is compromised

Page 6: AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

Amanda

A backup manager, not a backup program

Manages native backup programsFreewareTapes are in native formatTape library support (extensible)

Page 7: AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

Amanda...

Optimizes daily tape usage spreads full dumps across the backup cycle

Optimizes daily backup window Multiple dumps in parallel to a holding disk

Optimizes tape speed/usage Keeps tape streaming by feeding from the

holding disk

Page 8: AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

Amanda...

Easy to add filesystems to backup list

Easy to add tapes to the tape cycle

Easy interactive restores from any client

Compression in software or hardware

Page 9: AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

Amanda - deficiencies

Windows support (smbtar) currently a kludge

No Mac support

No tape spanning or appending

Page 10: AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

Amanda - advantages

Share tapes with non-AFS backupsMultiple backups in parallelAutomated error recoveryDegraded mode - tape errors don’t

stop the whole show

Page 11: AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

Advantages...

Free, runs on any unix

Supports for tape libraries

Keeps high capacity tapes streaming

Page 12: AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

Implementation

Use ‘backup dump’ or ‘vos dump’ ?

Volume sets?

Dumpdates equivalent

Page 13: AFS backups with Amanda Mitch Collinsworth Cornell Center for Materials Research.

Implementation...

Needed functions Estimate Backup Index generation

Recovery dumptool (Ken Hornstein) might be

useful. Needs to run in a single pass so can be pipelined.