Post on 27-Mar-2015
Building the Universal Library: The Promise and Challenges of
HathiTrustJohn Wilkin
2 April 2009
www.hathitrust.org
What is HathiTrust?
• origins• intentions• size and growth projections• aspirations
www.hathitrust.org
current members
www.hathitrust.org
Preservation: OAIS Reference Model
GRINInternal Data Loading
GRINInternal Data Loading
Google[OCA]
In-house Conversion
Google[OCA]
In-house Conversion
MARC record extensions (Aleph)
Rights DB
MARC record extensions (Aleph)
Rights DB
Page TurnerHathiTrust API
OAIGeoIP DB
CNRI Handles[Solr]
Page TurnerHathiTrust API
OAIGeoIP DB
CNRI Handles[Solr]
METS/PREMIS objectTIFF G4/JPEG2000
OCRMD5 checksums
METS/PREMIS objectTIFF G4/JPEG2000
OCRMD5 checksums
METS objectPNGOCRPDF
METS objectPNGOCRPDFIsilon
Site ReplicationTSM
MD5 checksum validation
IsilonSite Replication
TSMMD5 checksum validation
GROOVE(JHOVE)GROOVE(JHOVE)
www.hathitrust.org
Mission and Goals
• to contribute to the common good by collecting, organizing, preserving, communicating, and sharing the record of human knowledge – materials converted from print– improve access …to meet the needs of the co-owning
institutions– reliable and accessible electronic representations– coordinate shared storage strategies– “public good” … free-riders.– simultaneously …centralized …open
www.hathitrust.org
growth trajectory
www.hathitrust.org
accomplishments to date
1. 25 partners2. successful ingest and millions of vols online3. mirroring and backup
www.hathitrust.org
Flow of Materials
ingest
ingest
ingest
web
web web
web
SyncIQ
massdigitizationproject nfs nfs
Isilon@UM
Isilon@IU
networkor mediadelivery
www.hathitrust.org
accomplishments to date
1. 25 partners2. successful ingest and millions of vols online3. mirroring and backup4. rich access
www.hathitrust.org
books and journals online?
www.hathitrust.org
Search inside in-copyright
www.hathitrust.org
accomplishments to date
1. 25 partners2. successful ingest and millions of vols online3. mirroring and backup4. rich access5. “collection builder”
Collection Builder
www.hathitrust.org
accomplishments to date
1. 25 partners2. successful ingest and millions of vols online3. mirroring and backup4. rich access5. collection builder6. soon, full text search and data API
Project staff review comments and enrich cataloging records.
TitleWasīlat al-ṭullāb li-ma‘rifat a‘māl al-layl wa-al-nahār bi-ṭarīq al-ḥisāb :
وسيلة الطالب ل معرفة أعمال الليل والنهار بطريق الحساب
manuscript [between 1525? and 1861]
Ḥaṭṭāb, Yaḥyá ibn Muḥammad, 1496 or 7-1586 or 7.
.يحيى ين محمد الحطاب
Author
Comment 1
Comment 2
Comment 3
Catalog recordsLocal OPAC
Page imagesHathiTrustProject Website
Com
mentsE
nric
hed
reco
rds
www.hathitrust.org
next up …
• non-Google ingest (OCA & local digitization)• corpus research support
– SEASR– Data export– Research center
• openness strategies• binding together shared print and digital in
strategy to manage local print
www.hathitrust.org
Universal Library?
• collaborative work around collaborative problem
• preserving the published record• comprehensiveness through consolidation and
sense-making• commitment to perpetuity
www.hathitrust.org
opportunities• economies of scale• comprehensive collection• combining print and digital strategies• more effective digital preservation• stepping stone to preserving other forms of digital
content• platform for new methods of discovery• non-consumptive research
www.hathitrust.org
challenges
• digital preservation• collaboration• understanding what the right services are• The Silence of the Archive: The USPS problem
www.hathitrust.org
thank you!
• http://www.hathitrust.org/• hathitrust-info@umich.edu• jpwilkin@umich.edu