Bratislava WS - Cron - BnF - use cases_pdf
-
Upload
impact-centre-of-competence -
Category
Education
-
view
691 -
download
3
Transcript of Bratislava WS - Cron - BnF - use cases_pdf
![Page 1: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/1.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Geneviève CronBnF (Bibliothèque Nationale de France, French National Library)
07/05/10 Bratislava
Use of digitized and OCR-ised text collections by the end users
![Page 2: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/2.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
http://gallica.bnf.fr
Over 1 000 000 documents
Gallica : BnF digital library Since 1992 OCR : since 2005
![Page 3: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/3.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
OCR-ized documents on BnF Website
Over 180 000 newspapers or periodicals volumes (3 732 titles)
Over 100 000 books
07/05/10 Bratislava 3
Over 60% OCR accuracy
Average : 90 % OCR accuracy
Ocr 98% OCR word accuracy
![Page 4: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/4.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Users Internet Readers
– Readers in the library – Mobile Readers
Handicapped
Europe 86%– France : 70%
Non readers– OCR related works
![Page 5: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/5.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Number of visits per day
![Page 6: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/6.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Queries Among 1000 most frequent queries
![Page 7: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/7.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Content-based queries
![Page 8: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/8.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Thematic queries
![Page 9: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/9.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Bibliographic based queries
![Page 10: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/10.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Ocr workflows & accuracies at BnF
OCR
Manual corrections
99.9%
Manual corrections 98%
(newspaper)
[0% ,100%]
[98% ,100%]
[99,9% ,100%]
[0% , 60%]
[60% ,100%]
Image
![Page 11: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/11.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Ocr Accuracy computation
[98% ,100%]
[99,9% ,100%]
[0% , 60%]
[60% ,100%]
Estimation of number of correct words / characters per page– Using service provider computation
Using ABBYY word confidence Using ABBYY doubtful word information
– Using presence in dictionary
No statistics on – Illegible areas– Numbers– Non-Iso characters– Punctuations
![Page 12: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/12.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Ocr Accuracy
[98% ,100%]
[99,9% ,100%]
[0% , 60%]
[60% ,100%]
90% of BnF OCR-ized Collection
10% of BnF OCR-ized Collection
![Page 13: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/13.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
31%
![Page 14: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/14.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Ocr Accuracy
81 %
![Page 15: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/15.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
[0% , 60%]
According to an internal study :
no USE (only NOISE)
![Page 16: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/16.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Plain text indexation 3 kind of documents :
– Bib only– Bib + Table of Content– Bib + Table of Content + OCR
OCR is interesting when the words in the queries are not in the bibliographic description
– Typically, newspaper
[60% ,100%]
[98% ,100%]
[99,9% ,100%]
[60% ,100%]
![Page 17: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/17.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Word highlighting http://gallica.bnf.fr/ark:/12148/bpt6k57888872.r=BRATISLAVA.f259.langFR.hl
[98% ,100%]
[99,9% ,100%]
[60% ,100%]
ALTO (or ...) is required to describe the place of the word in the page
![Page 18: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/18.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Press browse (most consulted documents) Search for « Bratislava » in the OCR-ized press
http://gallica.bnf.fr/ark:/12148/bpt6k4435907.zoom.r=bratislava.f1.langEN
[98% ,100%]
![Page 19: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/19.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Genealogy Or history of personnal locality
– about 1/3 of queries – Would have no interest whitout OCR since information is not in the notice
BnF has (Commercial) Partnerships– Ancestry– …
[98% ,100%]
[99,9% ,100%]
![Page 20: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/20.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Collaborative correction BnF signed an agreement with Wikimedia to provide 1400
books of various quality and period – Anyone can correct OCR
100 % accuracy
– http://fr.wikisource.org/wiki/Raoul_de_Cambrai/Texte_entier
[60% ,100%]
![Page 21: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/21.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
http://fr.wikisource.org/wiki/Page:Anomyme_-_Raoul_de_Cambrai.djvu/82
![Page 22: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/22.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Quotations in research papers
[98% ,100%]
[99,9% ,100%]
“[…] Now, when these medicines were required, the river was swollen and so turbulent that its upward navigation was almost impracticable. At length even the task of burying the dead was more than the living could perform, and the bodies were tossed into the stream, or left for beasts of prey, and for the gallinazos—those dreadful carrion-birds, which do not always wait for death before they begin their work. Five months the English persisted in what may be called this war against nature; they then left a few men, who seemed proof against the climate, to retain the castle till the Spaniards should choose, when the fit season arrived, to retake it and make them prisoners.”
http://gallica.bnf.fr/ark:/12148/bpt6k5706366b.texteBrut
![Page 23: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/23.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Text to speech conversion
http://gallica.bnf.fr/ark:/12148/bpt6k54789860.vocal.f16.langFR
[99,9% ,100%]
![Page 24: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/24.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
E Pubs
[99,9% ,100%]
BnF has only 3 epubs yet will have about 1000 at the end of the year Is thinking at ALTO to Epub conversion on
its high quality material but work is difficult due to book structure (margins, footnotes)
![Page 25: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/25.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Epub difficulties : book structuration
http://gallica.bnf.fr/ark:/12148/bpt6k73555s.textePage.f70.langFR
![Page 26: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/26.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Tel+ indexation http://www.theeuropeanlibrary.org/portal/organisation/cooperation/telplus/
http://search.theeuropeanlibrary.org/portal/en/index.html?lang=en&pub=&bid=a4d79516-5b46-102a-81b6-ceee3e6c61a2&q=%22%22
[99,9% ,100%]
![Page 27: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/27.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
Learning datasets Image + Its Text Conversion
– Learning datasets for OCR– Evaluation sets for OCR related projects
[99,9% ,100%]
![Page 28: Bratislava WS - Cron - BnF - use cases_pdf](https://reader034.fdocuments.in/reader034/viewer/2022042815/55860996d8b42a3d6b8b4b4a/html5/thumbnails/28.jpg)
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
To conclude
Uses are highly depending on – OCR accuracy– Format
[98% ,100%]
[99,9% ,100%]
[0% , 60%]
[60% ,100%]