Post on 14-Sep-2014
description
WP2: Enrichment & ParticipationMaarten Brinkerink, WP2 Lead
Nick Stanhope, WAWWD
Simone Fonda, Net7
Johan Oomen, NISV
Sergiu Gordea, AIT
17 February 2014, London
Work Package 2 will support discovery and use by improving metadata through innovative methods including semantic enrichment and crowdsourcing
Lead by NISV, with EF, NTUA, AIT, NET7, WAWWD, all content partners; also Wikimedia chapters
Objectives Support discovery and use by improving metadata through
innovative methods including semantic enrichment and crowdsourcing.
• Design and implement mechanisms to improve the quality of existing metadata and contextual information. This will support enhanced exploration, deepen understanding of the collections, and will increase end-user engagement.
• Significantly increase quality of existing and new Europeana metadata for audio and audio-related items though:
• (a) active participation with existing audiences;
• (b) machine-driven tools.
Allowing enrichments to be re-ingested in the information systems of the contributing partners.
Third party playoutThird party playout
Historypin(crowdsourcing)
Historypin(crowdsourcing)
Content provider nContent provider nContent provider 1Content provider 1
Corporate portal(crowdsourcing)Corporate portal(crowdsourcing)
Corporate portal(crowdsourcing)Corporate portal(crowdsourcing)
Wikimediachapters
Wikimediachapters
Semantic enrichmentSemantic
enrichmentEuropeana Sounds
platformEuropeana Sounds
platform
enriched metadata
EuropeanaChannel
(crowdsourcing)
EuropeanaChannel
(crowdsourcing)
Third party playoutThird party playout
Historypin(crowdsourcing)
Historypin(crowdsourcing)
Content provider nContent provider nContent provider 1Content provider 1
Corporate portal(crowdsourcing)Corporate portal(crowdsourcing)
Corporate portal(crowdsourcing)Corporate portal(crowdsourcing)
Wikimediachapters
Wikimediachapters
Semantic enrichmentSemantic
enrichmentEuropeana Sounds
platformEuropeana Sounds
platform
enriched metadata
EuropeanaChannel
(crowdsourcing)
EuropeanaChannel
(crowdsourcing)
Semantic Enrichment (1) automatic and (2) user-contributed annotations
• uncover/highlight connections between recordings and extract knowledge from musical relationships.
• suggest collections based on artists' collaborations, influences, shared members, genres etc.
• mine into Europeana system logs and linking with external resources (e.g. DBpedia) to identify relationships between music related concepts (i.e. make use of Relfinder and the Semantic Shortcuts algorithm developed in Assets).
User-c
ontributed annotatio
ns
User-c
ontributed annotatio
ns
Typed relations among different kind of objects and entities
Define new knowledge
Link to the Web of Data, and access its data
Third party playoutThird party playout
Historypin(crowdsourcing)
Historypin(crowdsourcing)
Content provider nContent provider nContent provider 1Content provider 1
Corporate portal(crowdsourcing)Corporate portal(crowdsourcing)
Corporate portal(crowdsourcing)Corporate portal(crowdsourcing)
Wikimediachapters
Wikimediachapters
Semantic enrichmentSemantic
enrichmentEuropeana Sounds
platformEuropeana Sounds
platform
enriched metadata
EuropeanaChannel
(crowdsourcing)
EuropeanaChannel
(crowdsourcing)
Collaborating with Wikimedia Chapters
Photo of the Wiki Loves Sound Edit-a-Thon in the Netherlands
Example (Cat’s meow)
Reuse in Wikipedia
Third party playoutThird party playout
Historypin(crowdsourcing)
Historypin(crowdsourcing)
Content provider nContent provider nContent provider 1Content provider 1
Corporate portal(crowdsourcing)Corporate portal(crowdsourcing)
Corporate portal(crowdsourcing)Corporate portal(crowdsourcing)
Wikimediachapters
Wikimediachapters
Semantic enrichmentSemantic
enrichmentEuropeana Sounds
platformEuropeana Sounds
platform
enriched metadata
EuropeanaChannel
(crowdsourcing)
EuropeanaChannel
(crowdsourcing)
Crowdsourcing (enrichment)
• ‘happens’ on multiple sites, where users are!
• two user groups (general public and experts)
- Historypin
- Institutional Portals
- Europeana Channel (see also WP4 presentation)
Crowdsourcing: approach
Crowdsourcing: requirements and policy Definition (T2.1.1)
The requirements will differentiate between two target groups: the general public and experts
Crowdsourcing: operationalisation and Evaluation (T2.1.2)
This subtask oversees the successful deployment and end-user evaluation of the crowdsourcing infrastructure: on the Europeana portal, the individual partner sites and on Historypin. Activities include creating training materials and one hands-on workshop.
Web-based game for the general public
YUMA (now Annotorious) from AIT
example
example
Enrichment on institutional portals
Europeana search widget by EF
example
example
Enrichment on Europeana Sounds Channel
Example of the SoundCloud player, with social tagging functionality
example
example
Third party playoutThird party playout
Historypin(crowdsourcing)
Historypin(crowdsourcing)
Content provider nContent provider nContent provider 1Content provider 1
Corporate portal(crowdsourcing)Corporate portal(crowdsourcing)
Corporate portal(crowdsourcing)Corporate portal(crowdsourcing)
Wikimediachapters
Wikimediachapters
Semantic enrichmentSemantic
enrichmentEuropeana Sounds
platformEuropeana Sounds
platform
enriched metadata
EuropeanaChannel
(crowdsourcing)
EuropeanaChannel
(crowdsourcing)
All content p
artners
All content p
artners
Third party playoutThird party playout
Historypin(crowdsourcing)
Historypin(crowdsourcing)
Content provider nContent provider nContent provider 1Content provider 1
Corporate portal(crowdsourcing)Corporate portal(crowdsourcing)
Corporate portal(crowdsourcing)Corporate portal(crowdsourcing)
Wikimediachapters
Wikimediachapters
Semantic enrichmentSemantic
enrichmentEuropeana Sounds
platformEuropeana Sounds
platform
enriched metadata
EuropeanaChannel
(crowdsourcing)
EuropeanaChannel
(crowdsourcing)
Innovative exploration pilots: audio information retrieval and dynamic linking
Linking music to scores
Identify related resources (audio, video, music scores, vocabularies)
Link audio segments to music scores
Automated: midi content to sheet music (digital)
Semi automatic: convert content and music scores to Midi/MusicXML
Manual: markup audio and digitized music scores
Typical applications:
Learning to play an instrument (hear, follow, play)
Compositions (compose, follow, hear )
27 07.04.23
Music information retrievalIndex and retrieve music content
Extract audio features: timbre, chords, harmonies, melody, main pitch, beats per minute or rhythm
Index features and retrieve similar content
Music categorization
Evaluation using Europeana Sounds content
Sound recognition (birds)
Typical applications:
Search/explore music repositories
Music classification and recommendation
Intellectual property protection
28 07.04.23
Existing tools (open source)
OMR: Audiveris, OpenOMR
Midi and scores synchronization: midisheetmusic, musicscore
Feature extraction: JMir, MirToolbox(Mathlab), RP-Extract
Indexing and retrieval: Clubmixer, Marysas
WP2: deliverables
No Title Delivery month
D2.1 Crowdsourcing infrastructure & exchange policy
6
D2.2 Functional design of semantic enrichment 7
D2.3 Linking pilot delivery report (software, documentation)
14
D2.4 Crowdsourcing infrastructure v1 assessment 17
D2.5, 8 GLAM-wiki collaboration progress reports 21, 34
D2.6 MIR pilot report 22
D2.7 Crowdsourcing evaluation & impact assessment
30
D2.9 Evaluation report on semantic enrichment implementation
36
Thank you