Europeana Newspapers
…in a nutshell
Newspapers in Europe and the Digital Agenda for Europe - Final Workshop
29 September 2014, London, British Library
Clemens Neudecker, State Library Berlin
@cneudecker
Copyright: Olmsted County Historical Society
This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp 2
Facts & Figures
• Europeana Newspapers – EU ICT-PSP Best Practice Network
• Started in February 2012 and will run until January 2015
• 18 partners, 11 associated partners, 22 networking partners(28 countries involved)
• Total budget: €5.16M – EC contribution: €4.12M
• Project coordination: State Library Berlin / Preußischer Kulturbesitz
This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp
Europeana Newspapers is all over Europe…and beyond
3
Red = Project Partners
Blue = AssociatedPartners
Green = NetworkingPartners
This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp
Refinement - we‘re scaling it up!
• 8 million pages refined with Optical Character Recognition (OCR)
• 2 million pages refined with Optical Layout Recognition (OLR)
• Technical resources for Named Entity Recognition (NER) in three languages (Dutch, German, French)
• Metadata for >18 million pages ingested to Europeana
In comparison: currently provides access to 8,056,532 pages
4
This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp
Quality & Performance
5
82.4% 85.3%80.9%
75.9%
67.5%
83.4% 84.1%
68.1%
93.1%
57.6%
87.0%
68.3%76.1%
82.6%
54.1%
32.7%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Succ
ess
Rate
Language Setting
Bag of Words OCR EvaluationPer Language
71.9%74.3%
50%
55%
60%
65%
70%
75%
80%
Index based Count based
Succ
ess
Rate
Bag of Words OCR EvaluationIndex based rate vs. count based rate
79.1%
62.2%55.9%
58.8%
94.7%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Keywordsearch
Phrase search Access viacontent
structure
Print/ebookon demand
Contentbased image
retrieval
Succ
ess
Rate
(har
mon
ic,
area
bas
ed)
Evaluation Profile
Layout Analysis PerformancePer evaluation profile
67.3%
81.4%
64.0%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Gothic Normal Mixed
Succ
ess
Rate
Font
Bag of Words OCR EvaluationPer Font
75.3%
53.78%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Succ
ess
Rat
e (
cou
nt
bas
ed
)
OCR Engine
Bag of Words OCR EvaluationFineReader vs. Tesseract
FineReader Tesseract
This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp
Access via TEL & Europeana
• Full text search in TEL Historic Newspapers Browser:
http://www.theeuropeanlibrary.org/tel4/newspapers(recently updated following usability testing)
• Metadata search in Europeana:
http://www.europeana.eu/portal(now with embedded object presentation via TEL)
6
This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp
Full-text search
7
This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp
Browse by date
8
This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp
Explore on a map
9
This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp
Title list
10
This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp 11
Embedded TEL Viewer in Europeana!
This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp
Metadata Best Practices
• Europeana Newspapers METS/ALTO Profile (ENMAP)
• Contributions to ALTO standard v2.x, v3.0
• Structural metadata with tool support - Structify
12
This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp
Media, News, Events
13
This project is partially funded under the ICT Policy Support Programme (ICT PSP) as part of the Competitiveness and Innovation Framework Programme by the European Community http://ec.europa.eu/ict_psp
Lots of opportunities for research & reuse
• Metadata for >18M pages licensed CC0
• Images & full-text for 10M pages licensed public domain
• See also: http://www.europeana-newspapers.eu/category/interviews-with-researchers/
yet another way to reuse newspapers…
14
Thank you for your attention!@eurnews
http://www.europeana-newspapers.eu
http://www.theeuropeanlibrary.org/tel4/newspapers
http://www.europeana.eu/
Top Related