SAN, NAS and IP Storage: How to get your bits off disks to your servers.
Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for...
-
Upload
samalanmeister -
Category
Education
-
view
495 -
download
2
description
Transcript of Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for...
![Page 1: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/1.jpg)
Getting Bits off Disks:Using open source tools to stabilize and
prepare born-digital materials for long-term preservation
Sam MeisterUniversity of Montana
Best Practices Exchange 2013 November 13, 2013
![Page 2: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/2.jpg)
Born-Digital Workflow
Acquisition Accession
Arrangement&
Description
Discovery&
Access
![Page 3: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/3.jpg)
Acquisition Accession
Arrangement&
Description
Discovery&
Access
![Page 4: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/4.jpg)
Acquisition Process
Donor Survey
Feasibility Assessment
Transfer Agreement
![Page 5: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/5.jpg)
Donor Survey
Creation
Context
Organization
Privacy & Security
Storage
Technical
Transfer Options
![Page 6: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/6.jpg)
Donor survey
Current
![Page 7: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/7.jpg)
Future
DrupalWeb Form XML / CSV
![Page 8: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/8.jpg)
Feasibility Assessment
Do we have resources to feasibly acquire, preserve, and provide access to the digital materials?
![Page 9: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/9.jpg)
Transfer
Physical Media Network
ARCHIVES
![Page 10: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/10.jpg)
Current
![Page 11: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/11.jpg)
Future
DrupalWeb Form XML / CSV
![Page 12: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/12.jpg)
Acquisition Accession
Arrangement&
Description
Discovery&
Access
![Page 13: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/13.jpg)
Accession Process
Disk Image Media
Initial Analysis
Produce AIP
![Page 14: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/14.jpg)
Data Transfer
3.5 Floppy Drive5.25. Floppy Drive
Zip DriveCD / DVD Drive
USB Write-BlockerSATA / IDE Write-Blocker
Hardware
FTK ImagerGuymager
FC5205
Software
![Page 15: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/15.jpg)
Disk Imaging
“A single file or storage device containing the complete contents and structure representing a data storage medium or device, such as a
hard drive, tape drive, floppy disk, CD/DVD/BD, or USB flash drive”
![Page 16: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/16.jpg)
Disk ImagingBorn Digital Workstation 1.0
![Page 17: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/17.jpg)
Disk ImagingBorn Digital Workstation 2.0
![Page 18: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/18.jpg)
![Page 19: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/19.jpg)
![Page 20: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/20.jpg)
![Page 21: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/21.jpg)
![Page 22: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/22.jpg)
Disk Imaging
Get Media
Assign Identifier
PhotographMedia
Record Characteristics
Write-Protect Media
Create Image
Export Files
Virus Scan
![Page 23: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/23.jpg)
![Page 24: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/24.jpg)
![Page 25: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/25.jpg)
FC5205Disk Image and Browse
![Page 26: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/26.jpg)
![Page 27: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/27.jpg)
![Page 28: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/28.jpg)
![Page 29: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/29.jpg)
![Page 30: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/30.jpg)
![Page 31: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/31.jpg)
![Page 32: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/32.jpg)
FTK Imager
![Page 33: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/33.jpg)
![Page 34: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/34.jpg)
![Page 35: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/35.jpg)
![Page 36: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/36.jpg)
![Page 37: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/37.jpg)
![Page 38: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/38.jpg)
Issue:
Unknown / Unrecognized Filesystems
![Page 39: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/39.jpg)
Options:
Kryoflux
![Page 40: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/40.jpg)
Initial Analysis
Extract Metadata
Identify Restricted
Info
Identify Duplicates
GenerateReports
![Page 41: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/41.jpg)
Initial Analysis
Hardware
BitCuratorfiwalk
Bulk Extractor
Software
![Page 42: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/42.jpg)
“an effort to build, test, and analyze systems and software for incorporating digital forensics methods
into the workflows of a variety of collecting institutions”
![Page 43: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/43.jpg)
BitCurator:
fiwalk
![Page 44: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/44.jpg)
![Page 45: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/45.jpg)
![Page 46: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/46.jpg)
BitCurator:
bulk_extractor
![Page 47: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/47.jpg)
![Page 48: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/48.jpg)
![Page 49: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/49.jpg)
![Page 50: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/50.jpg)
![Page 51: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/51.jpg)
BitCurator:
Reports
![Page 52: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/52.jpg)
![Page 53: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/53.jpg)
![Page 54: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/54.jpg)
AIP = Archival Information Package
Produce AIP
![Page 55: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/55.jpg)
Produce AIP
Hardware
Archivematica
Software
![Page 56: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/56.jpg)
“a free and open-source digital preservation system that is designed to maintain standards-based,
long-term access to collections of digital objects”
![Page 57: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/57.jpg)
![Page 58: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/58.jpg)
![Page 59: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/59.jpg)
![Page 60: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/60.jpg)
![Page 61: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/61.jpg)
![Page 62: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/62.jpg)
![Page 63: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/63.jpg)
Produce AIP
Archivematica
Using version 0.10 on dedicated workstation
(testing as virtual server)
Current
Install version 1.0 on server with multiple client
nodes (workstations)
Future
![Page 64: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/64.jpg)
Acquisition Accession
Arrangement&
Description
Discovery&
Access
![Page 65: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/65.jpg)
A & D
Prepare
Develop Processing Plan
Implement Processing Plan
![Page 66: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/66.jpg)
A & D
• Integrate Born Digital materials into existing A&D process / tools (mix of Excel, Word, XMetal XML editor)
Current
• Determine tools needed for reviewing content (data visualization)
• Integrate Born Digital materials into collection management system
Future
![Page 67: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/67.jpg)
Born-Digital Workflow
Acquisition Accession
Arrangement&
Description
Discovery&
Access
![Page 68: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/68.jpg)
• Embrace iterative approach (use what you have and get what you need when you need it)
• Capture as much metadata as possible (descriptive, structural, administrative)
• Start with workflow requirements (what needs to be done) then test tools (what things will get it done)
• Build flexibility into system (may not always be ideal scenarios)
Lessons Learned
![Page 69: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/69.jpg)
Open Source - Issues
• May require specific IT environment (Linux)
• Tools likely to change quickly
• User interfaces / experience may be simple
• Will need ongoing support from IT / Systems staff
![Page 70: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/70.jpg)
Open Source - Benefits
• Limited initial resources needed to install and test
• Provides opportunity to engage systems / IT in new areas
• Designed and developed in collaboration with archival community
• Direct communication channels to contribute to / modify development roadmap
• Quickly build initial standards-compliant workflow
![Page 71: Getting Bits off Disks: Using open source tools to stabilize and prepare born-digital materials for long-term preservation](https://reader035.fdocuments.in/reader035/viewer/2022081518/54b8cf154a7959313c8b4587/html5/thumbnails/71.jpg)
Resources
FC5205 Disk Image http://www.deviceside.com/fc5025.html
Kryofluxhttp://www.kryoflux.com/
BitCuratorhttp://www.bitcurator.net/
Archivematicahttps://www.archivematica.org/wiki/Main_Page