ARSC 2016 Owens presentation final

Preserving the Preservation: The William A. Owens Folksong Collection at Texas A&M University

Preserving the Preservation:The William A. Owens Folksong Collection at Texas A&M UniversityJohn Bondurant, Digital ArchivistCushing Memorial Library & ArchivesTexas A&M University

Association for Recorded Sound Collections50th Annual ConferenceMay13, 2016Bloomington, Indiana

Preserving the preservation - OverviewWilliam A. Owens CollectionCollection ProcessingDigital PreservationDigital Forensics/TestingPreservation WorkflowOutcomes/ConclusionsThe William A. Owens Folksong Collection at Texas A&M University

William a. OwensThe William A. Owens Folksong Collection at Texas A&M University

Folklorist, Author, and Educator.Born November 2, 1905 in Pin Hook, Texas.Southern Methodist University, BA 1932, MA 1933.Masters thesis Swing and Turn: Texas Play-Party Games published in1936.State University of Iowa, 1937, doctoral student in English/FolkloreTexas A&M University, English faculty (1937-1940)Began field recordings in the Brazos Valley region of Texas.Doctoral dissertation Texas Folk Songs published in 1950.Columbia University, professor and dean, 1945-1974.Published sixteen books including texts on folklore, memoirs, and Slave Mutiny (1953) one of the first books about the revolt on the schooner La Amistad.

The William A. Owens Folksong Collection

The William A. Owens Folksong Collection at Texas A&M University

Part of the William A. Owens Papers at Texas A&M University, acquired from Owens beginning in 1977.199 instantaneous disk recordings made between 1937-1941Focus on ethnic communities in Central and East Texas and southwestern Louisiana.Includes Anglo-Texan, African American, Cajun/French, Mexican, Czech, Italian, Swedish, and Swiss.Many ethnicities underrepresented by previous folklorists.Some possible duplicates or dubs of commercial recordings.Many recordings transcribed and included in Owens Texas Folk Songs (Texas Folklore Society, 1950) and Tell Me a StorySing Me a Song (University of Texas Press, 1983).

Collection Processing


Disks separated from manuscript materials, but never fully inventoried.Full inventory, box list, and finding aid created.Original recordings digitized in 2002 by vendor. Audio CD access copies delivered, but not quality checked.Reviewed every CD and noted errors (spellings, track order, omissions, etc...)Reconciled access CD and original disks box list information.Noted corrections on box list of original disks.Linked collections in ARCHON finding aids.

CD CollectionThe William A. Owens Folksong Collection at Texas A&M University

Old CD information in ARCHON

Collection Finding Aidhttp://archon.library.tamu.edu/index.php?p=collections/controlcard&id=1102


L R: Collection Information, Finding Aid, Box List

Why Preserve The Preservation?


Why Preserve the Preservation?Preserving original disks?Not likely to be re-digitizedPreservation/Access CDs?Archival IssuesPreservation Audio FilesMore stable archival formatIncrease user access

CDs are NOT archival!


http://blog.cdrom2go.com/2011/01/archival-cd-dvd-media/

CDs are NOT archival!Optical discs require special mention as unsafe preservation storage media.Need to test quality of optical media and recorded digital content.More costly than other digital media (about 10X more per MB than HDD)Audio files limited to 44.1 kHz, sample rate, 16 bit depth48 kHz, 24 bit is minimal archival preservation standard.Required human intervention to manage optical disc archives adds to cost.

ARSC Technical Committee: Preservation of Archival Sound Recordings Version 1, April 2009http://www.arsc-audio.org/pdf/ARSCTC_preservation.pdf

Potential Problems with optical media


https://en.wikipedia.org/wiki/Compact_Disc_Digital_Audio#/media/File:CD_Diagra.001.jpg

Potential Problems with optical mediaPhysical damage not always visibleWrite/Read Bit ErrorsMedia degradation life expectancyCommercial CD/DVD/BD20-100 years under IDEAL conditionsCD-R/DVD-R5-10 year shelf life BEFORE recording5-15 years after recording under IDEAL conditionsRW & RAM discs are less stableLow Light/Temperature/Humidity is BEST

http://www.clir.org/pubs/reports/pub121

What is Digital Forensics?


Digital Forensics What is it?Recovery and investigation of data in digital devices and files.Originally developed for criminal investigation.Required live forensic analysis, examining within the operating system of a device.Risk of modifying/damaging data = evidence tamperingDigital Forensic ToolsSoftware capture of exact data disc image for analysis, aka dead forensicsData can be examined without risk to original.DF tools now being used by archives, libraries, and museums BitCurator environmentWhat it is NOT! Magic software/hardware/box that can read/run all ancient computer files!

Live Forensics think N.C.I.S. catching hackers

Digital Forensics tools can be any OS, proprietary or Open Source, simple or complex.My focus is on Open Source, Windows OS

The BitCurator Environment


BitCurator Environment - http://www.bitcurator.net/ Developed by UNC-Chapel Hill and University of Maryland.Designed for archives and libraries to process born-digital materials.Suite of open source digital forensics and data analysis tools.Handles many different types of dataFocuses on preservation and inspection of data storage carriersFloppy Disks, HDDs, Optical Media, etcNot really designed for digital a/v preservation

Ubuntu Linux native

Can run in Windows or Mac via a Virtual Machine emulator.

Why Test Optical Media?


Testing Optical Drives/MediaDevice/Media MetadataMedia AnalysisCD/Data TriageOptical Media Testing SoftwareVSO InspectorNero DiscSpeedOptical Drive Testing SoftwareDAE QualityC1, C2 error correction/concealmentExpanded definition of forensics to inspection, testing, and analysis of digital media/capture system.

What can we tell from the properties?Audio CDHow much data is on this disc?Is there any damage to the disc or data?

VSO Inspector


VSO Inspector Optical Drive MetadataOptical Media MetadataOptical Media ScanSurface scanFile testSector viewerVariable scan direction, can start at end of dischttp://www.vso-software.fr/products/inspector/inspector.php

L to R Good disc, Problem disc, Damaged disc

Nero DiscSpeed


Nero DiscSpeedBenchmark testing of drive and mediaCan create test disc if optical drive is compliantMedia informationMedia qualitySurface scan of discScan can be slow if lots of errorsGet older version with less bloatwarehttps://www.raymond.cc/blog/download/did/2795/

L R Good audio CD; Data CD with some errors/damage; Audio CD with lots of damage

Also shows quality of individual files/CD audio tracks

Why Test Optical Drives?


Optical Drive Testing Software/DiscsCommercial test media $90 per test disc http://www.passmark.com/products/testcddvd.htmTest discs available for CD, DVD, and Blu-ray drives DAE Qualityhttp://www.exactaudiocopy.de/en/index.php/other-projects/dae-quality/ Project from EAC, low cost test environmentOnly tests CD drive capabilitiesC2 corrects physical condition and recording errors to disc.C1 corrects for surface scratches, dirt, fingerprints, etc on disc.

Test disc represents media with significant, above average, damage. Controlled for predictable, testable results.

DAE Quality ResultsC1 errors (surface scratches, dirt/dust, fingerprints)


DVD-RW @ 10XDVD-RW @ 40XBlu-ray @ 40X

Darker bar at top represents 0dB(A)Each line below represents drop of -6dB(A)Bottom line is -120 dB(A)

Dae Quality ResultsC2 errors (physical condition & writing errors)


DVD-RW @ 10XBlu-ray @ 40XGreen reported C2 errorsRed corrected C2 errorsBlue unreported C2 errors

Preservation Workflow - ProposedAudio CD PreservationExamine/Test CDs for damage/errors Digital Audio ExtractionCapture Extraction MetadataCreate ChecksumsPreservation StorageThe William A. Owens Folksong Collection at Texas A&M University

http://www.howtogeek.com/wp-content/uploads/2015/09/audio-cd.jpg

Digital Audio Extraction


http://www.knowzy.com/Images/CD_Ripping-Orig.jpg

Digital Audio Extraction (DAE, aka Ripping)Distinct from simple file copyingExtracted audio files are uncompressed 44.1 kHz / 16-bit Linear PCM filesWAV or AIFFRequires software/hardware to decode audio files from CDSoftwareCDRDAO http://cdrdao.sourceforge.net/ Linux/Win32IsoBuster http://www.isobuster.com/ - WindowsExact Audio Copy (EAC) http://www.exactaudiocopy.de/ - WindowsWindows Media Player / iTunes handy, but low end qualityOptical Drive CD/DVDHandles most of the error correction/concealment process

CDRdao


CDRDAODisk-At-Once Recording/Extraction of Audio and Data CD-Rs/CD-RWsIncluded in BitCurator EnvironmentCommand line interfacenot user friendly

ISOBusterThe William A. Owens Folksong Collection at Texas A&M University

IsoBuster - http://www.isobuster.com/Data recovery softwareCan extract CD audio files and create disc imageDisc image is raw .bin format with CUE fileCON CUE file not compatible with all softwarePRO Can also generate md5 hash of image/cue files

L R: CUE and MD5 set; Extract Image; CUE file

Swiss Army Knife of disc/data recovery

Exact Audio Copy


Exact Audio Copy - http://www.exactaudiocopy.de/en/Incorporates advanced error and jitter correctionDetects if drive has an accurate stream and/or cachingDetects sync and correction errors in secure modeCan also extract tracks and ranges of music dataSecure Mode can be slowExtracts uncompressed audio and creates CUE fileCUE sheets read by more software (e.g. Nero)PRO Creates log file of extraction processShows location of uncorrectable errorsCON does not generate checksumsL R audio extraction, CUE sheet file, LOG file

Lots of checksum software such as MD5summer, etc

Not all Rippers are equal!


EAC Burst Mode

EAC Secure Mode

IsoBuster

Windows Media Player

Extraction software can have a substantial impact on audio quality.

Burst mode tests optical drive hardware error correction

EAC Secure Mode adds enhanced error correction

IsoBuster uses burst mode

WMP!

Preservation Workflow - UpdatedAudio CD PreservationExamine/Test CDs for damage/errors VSO Inspector / Nero DiscSpeedDigital Audio ExtractionExact Audio CopyCapture Extraction MetadataEAC log filesCreate ChecksumsMD5summer / FixityPreservation StorageArchivematicaDAMS/DAMEFedoraThe William A. Owens Folksong Collection at Texas A&M University

EAC, the DAE software of choiceIndividual CD tracks extracted using EACCDs were not original artifactsCorrected discrepancies between original disks and CDsAudio files match original box list orderNext StepsPreservation master files to be stored in ArchivematicaAccess files to be available through future DAMS (Fedora)

Outcomes


www.radiomuseum.org

Sweet Home Baptist Church, Guadalupe County, TXTexas A&M Extension Service, University Archiveshttps://www.flickr.com/photos/cushinglibrary/3525218183/in/album-72157617097405711/

Preservation is Preserved!

We dont have to find a Vibro-Master portable recorder!

199 original disks access CDs443 audio preservation master files (44.1/16-bit WAV)8.73 GB dataIncreased Researcher AccessComplete Collection Finding AidCompilation Access CDsOrganized by genre per Owens notes/publications

Increased awareness of A/V collections @ TAMU

Other TAMU A/V collections include sports information/athletics, Wendish oral history, & sci/fi fan filk and vids coming to IASA this fall!

Digital Humanities ProjectsStudent & Faculty ResearchResearch for publicationsCzech Music in Texas Songbook Blues music and the plantation system in the Brazos ValleyHistoric Exhibition @ Cushing Library, Fall 2016Shifting Frontiers: Texas from Spain to Space

Texas Soundmap Project


Texas Soundmap ProjectCollaboration with Performance Studies students/faculty and Cushing Library.Incorporates historic and contemporaryfield recordings.https://goo.gl/Dct1PG

Go to Sleep, Baby Mrs. Imogene Hyde, Calvert, TX [1937] [disk 7b]


Included in both Texas Folk Songs as a childrens song and Tell Me a StorySing Me a Song as an African American secular song.

CD track #1

aovuEthel Jecmenek, Rosebud, TX [1940] [disk 134b]


(Zha Sha Voo)aovu Ethel Jecmenek, Rosebud, TX [1940] [disk 134b]

Included in Tell Me a StorySing Me a Song

Originally from Moravia, still performed at some wedding receptions in Texas.(via Frances Barton, Austin, TX email to J. Bondurant, 03/21/2016)English version substitutes Rosebud for aovu, thought to bethe village of origin.

CD Track #2

Hitler BluesGrey Ghost (R. T. Williams), Smithville, TX [1940] [disk 178b]


Hitler Blues Grey Ghost (R. T. Williams), Smithville, TX [1940] [disk 178b]Grey Ghost became a popular local figure after a story about song appeared in Austin, TX newspaper.

CD Track #3

Conclusions


Process Collections, Please!Enhance Discoverability & Enable WorkflowCDs/Optical Media are NOT Archival!Choice of Hardware and Software MattersTest Drive DrivesError Correction and ConcealmentMetadata: Lost & FoundCollection Context MattersDigitized vs. Born-DigitalTesting optical drives allows for best choice, also lower extraction speeds are preferable.Generally, Plextor drive are considered the best, but your mileage may vary.

Preferred Exact Audio Copys enhanced error correction, much better than WMP!

Metadata: Not only do Audio CDs require extra mediation for preservation, there is a loss of technical metadata from digitization process (signal chain, software) Born digital audio should be delivered as data files, NOT CDS!!!

Context: digitized objects should match original objectsBorn-digital objects should be preserved as disc images (unchanged structure/format/files)

ReferencesThe William A. Owens Papers - Folk Song Collection: Instantaneous Disks, 1937-1941 - http://archon.library.tamu.edu/index.php?p=collections/controlcard&id=1102 ARSC Technical Committee: Preservation of Archival Sound Recordings Version 1, April 2009, http://www.arsc-audio.org/pdf/ARSCTC_preservation.pdfByers, Fred R., Care and Handling of CDs and DVDs: A Guide for Librarians and Archivists, CLIR pub121 (10/03), http://www.clir.org/pubs/reports/pub121 BitCurator Environment - http://www.bitcurator.net/ VSO Inspector - http://www.vso-software.fr/products/inspector/inspector.php Nero DiscSpeed - https://www.raymond.cc/blog/download/did/2795/ Passmark Software Optical Drive Test Media - http://www.passmark.com/products/testcddvd.htm DAE Quality - http://www.exactaudiocopy.de/en/index.php/other-projects/dae-quality/ CDRDAO - http://cdrdao.sourceforge.net/ IsoBuster - http://www.isobuster.com/MD5summer - http://md5summer.org/ Fixity - https://www.avpreserve.com/tools/fixity/ Archivematica - https://www.archivematica.org/en/ Fedora Repository - http://fedorarepository.org/ Texas Soundmap Project - https://goo.gl/Dct1PG The William A. Owens Folksong Collection at Texas A&M University

Questions?John [email protected] Clinical Assistant Professor, Digital ArchivistCushing Memorial Library & ArchivesTexas A&M UniversityThe William A. Owens Folksong Collection at Texas A&M University

Thank You!


Go To Sleep BabyOwens Disk 7b1937Mrs. Imogene HydeZacovu or Song Sung at a WeddingDisk 134b1940Ethel JecmenekHitler BluesDisk 178b1940Grey Ghost

ARSC 2016 Owens presentation final

Documents

Transcript of ARSC 2016 Owens presentation final