1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage...
-
Upload
joshua-french -
Category
Documents
-
view
221 -
download
1
Transcript of 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage...
![Page 1: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/1.jpg)
1
Newspaper Digitisation Newspaper Digitisation WorkflowsWorkflows
Rose Holley- Manager ANDPRose Holley- Manager ANDPPresentation to Cultural Heritage Digitisation professionalsPresentation to Cultural Heritage Digitisation professionals
26 November 200826 November 2008
![Page 2: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/2.jpg)
2
Preparing for DigitisationPreparing for Digitisation Creation of digital imagesCreation of digital images Adding metadata and Quality AssuranceAdding metadata and Quality Assurance Optical Character RecognitionOptical Character Recognition Quality AssuranceQuality Assurance
Other informationOther information Access & interactionAccess & interaction StatisticsStatistics
General WorkflowGeneral Workflow
![Page 3: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/3.jpg)
3
Identify title to be digitisedIdentify title to be digitised Source master microfilm from ownerSource master microfilm from owner Send master microfilm to scanning Send master microfilm to scanning
contractorscontractors Add title to Content Management Add title to Content Management
SystemSystem
Preparing for Preparing for DigitisationDigitisation
![Page 4: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/4.jpg)
4
Add Title ScreenAdd Title Screen
![Page 5: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/5.jpg)
5
Microfilm converted to digital imagesMicrofilm converted to digital images
![Page 6: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/6.jpg)
6
Image ReceptionImage Reception Images received from scanning Images received from scanning
contractor on LTO2 Tapecontractor on LTO2 Tape Tapes added to tape robot and Tapes added to tape robot and
extractedextracted Reels automatically added to Content Reels automatically added to Content
Management SystemManagement System Reel details are checkedReel details are checked Images ingested into Content Images ingested into Content
Management SystemManagement System
![Page 7: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/7.jpg)
7
Check Reel DetailsCheck Reel Details
![Page 8: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/8.jpg)
8
Ingest ReelsIngest Reels
![Page 9: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/9.jpg)
9
Quality Assurance (QA)Quality Assurance (QA)
QA Phase 1 – Add metadata (dates and QA Phase 1 – Add metadata (dates and page numbers)page numbers)
Supervisor reviews marked pagesSupervisor reviews marked pages QA Phase 2 – Define batches QA Phase 2 – Define batches QA Phase 2 – Resolve duplicatesQA Phase 2 – Resolve duplicates QA Phase 2 – Create missing page QA Phase 2 – Create missing page
targetstargets
![Page 10: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/10.jpg)
10
Adding MetadataAdding Metadata Date and Page Sequence number Date and Page Sequence number
addedadded
![Page 11: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/11.jpg)
11
Supervisor Supervisor ReviewReview
Supervisor Supervisor reviews reviews pages pages marked for marked for attentionattention
![Page 12: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/12.jpg)
12
Define BatchesDefine Batches Batches defined by dateBatches defined by date Each batch contains 2-3000 imagesEach batch contains 2-3000 images Batches are automatically assigned a numberBatches are automatically assigned a number
![Page 13: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/13.jpg)
13
Resolve DuplicatesResolve Duplicates Duplicate pages compared and the best copy is Duplicate pages compared and the best copy is
selectedselected
![Page 14: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/14.jpg)
14
Missing Missing page page targets targets are are generategeneratedd
MissinMissing g
PagesPages
![Page 15: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/15.jpg)
15
Optical Character Optical Character Recognition (OCR)Recognition (OCR)
Complete batches are added to a tapeComplete batches are added to a tape Tapes are generated and written by ITTapes are generated and written by IT Tapes sent to OCR contractorTapes sent to OCR contractor Contractor completes OCR processesContractor completes OCR processes OCR data (not images) is returned via FTPOCR data (not images) is returned via FTP
![Page 16: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/16.jpg)
16
Tapes CreatedTapes Created Completed batches added to a tapeCompleted batches added to a tape
![Page 17: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/17.jpg)
17
Optical Character Recognition (OCR) of pages and article zoningOptical Character Recognition (OCR) of pages and article zoning
![Page 18: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/18.jpg)
18
OCR Data ReceptionOCR Data Reception(Automated process)(Automated process)
OCR contractor advises NLA server that a OCR contractor advises NLA server that a batch has been completedbatch has been completed
NLA server downloads the batchNLA server downloads the batch Batch is ingested into Content Batch is ingested into Content
Management SystemManagement System Checks are performed on data validityChecks are performed on data validity QA Derivatives are generatedQA Derivatives are generated Articles may now be searched, but are not Articles may now be searched, but are not
yet accessibleyet accessible
![Page 19: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/19.jpg)
19
Batch informationBatch information
![Page 20: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/20.jpg)
20
Quality Assurance (QA)Quality Assurance (QA) A random sample of Issues and Articles is A random sample of Issues and Articles is
checkedchecked Volume and Issue number are checked for Volume and Issue number are checked for
accuracyaccuracy Sample articles are checked against Quality Sample articles are checked against Quality
Acceptance Criteria (QAC)Acceptance Criteria (QAC) Error rates calculated against QAC on the flyError rates calculated against QAC on the fly Supervisor checks final result and decides Supervisor checks final result and decides
on accepting the batchon accepting the batch
![Page 21: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/21.jpg)
21
Selecting the batchSelecting the batch
![Page 22: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/22.jpg)
22
Volume & Issue Number Volume & Issue Number CheckCheck
![Page 23: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/23.jpg)
23
Article checked against Article checked against QACQAC
![Page 24: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/24.jpg)
24
Clean fields checked for Clean fields checked for accuracyaccuracy
![Page 25: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/25.jpg)
25
Supervisor checks result Supervisor checks result and makes a decisionand makes a decision
![Page 26: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/26.jpg)
26
QA ResultsQA Results Automated email sent to supplier Automated email sent to supplier
advising the resultadvising the result Emails for rejected batches include a Emails for rejected batches include a
summary of errorssummary of errors Summary of errors saved for all Summary of errors saved for all
batchesbatches Accepted batches are immediately Accepted batches are immediately
accessibleaccessible
![Page 27: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/27.jpg)
27
AccessAccess Access is provided through Australian Access is provided through Australian
Newspapers betaNewspapers beta Users can search or browse Users can search or browse
newspapersnewspapers Search results can be refined using Search results can be refined using
filtersfilters Users can browse by Newspaper title Users can browse by Newspaper title
or Date.or Date.
![Page 28: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/28.jpg)
28Search Results
![Page 29: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/29.jpg)
29
Newspaper informationNewspaper information
![Page 30: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/30.jpg)
30
User InteractionUser Interaction
Users are able toUsers are able to:: Correct the textCorrect the text Add tagsAdd tags Add commentsAdd comments
User-added content is not currently User-added content is not currently moderated, but may be in future.moderated, but may be in future.
![Page 31: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/31.jpg)
31
StatisticsStatistics Stats for content received and QAd Stats for content received and QAd
generated on request by the Content generated on request by the Content Management SystemManagement System
Stats for volume usage of Beta Stats for volume usage of Beta collected using Google Analyticscollected using Google Analytics
Stats for user contributions to beta Stats for user contributions to beta collected on an as-needed basiscollected on an as-needed basis
![Page 32: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/32.jpg)
32
Content StatisticsContent Statistics
![Page 33: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/33.jpg)
33
Work StatisticsWork Statistics
![Page 34: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/34.jpg)
34
Usage StatisticsUsage Statistics
![Page 35: 1 Newspaper Digitisation Workflows Rose Holley- Manager ANDP Presentation to Cultural Heritage Digitisation professionals 26 November 2008.](https://reader038.fdocuments.in/reader038/viewer/2022102907/56649db55503460f94aa6556/html5/thumbnails/35.jpg)
35
Questions?Questions?