Europeana Sounds kick-off - Workpackage 2 Enrichment and Participation

WP2: Enrichment & ParticipationMaarten Brinkerink, WP2 Lead

Nick Stanhope, WAWWD

Simone Fonda, Net7

Johan Oomen, NISV

Sergiu Gordea, AIT

17 February 2014, London

Work Package 2 will support discovery and use by improving metadata through innovative methods including semantic enrichment and crowdsourcing

Lead by NISV, with EF, NTUA, AIT, NET7, WAWWD, all content partners; also Wikimedia chapters

Objectives Support discovery and use by improving metadata through

innovative methods including semantic enrichment and crowdsourcing.

• Design and implement mechanisms to improve the quality of existing metadata and contextual information. This will support enhanced exploration, deepen understanding of the collections, and will increase end-user engagement.

• Significantly increase quality of existing and new Europeana metadata for audio and audio-related items though:

• (a) active participation with existing audiences;

• (b) machine-driven tools.

Allowing enrichments to be re-ingested in the information systems of the contributing partners.

Third party playoutThird party playout

Historypin(crowdsourcing)


Content provider nContent provider nContent provider 1Content provider 1

Corporate portal(crowdsourcing)Corporate portal(crowdsourcing)


Wikimediachapters

Wikimediachapters

Semantic enrichmentSemantic

enrichmentEuropeana Sounds

platformEuropeana Sounds

platform

enriched metadata

EuropeanaChannel

(crowdsourcing)

EuropeanaChannel

(crowdsourcing)

Semantic Enrichment (1) automatic and (2) user-contributed annotations

• uncover/highlight connections between recordings and extract knowledge from musical relationships.

• suggest collections based on artists' collaborations, influences, shared members, genres etc.

• mine into Europeana system logs and linking with external resources (e.g. DBpedia) to identify relationships between music related concepts (i.e. make use of Relfinder and the Semantic Shortcuts algorithm developed in Assets).

User-c

ontributed annotatio

ns

User-c

ontributed annotatio

ns

Typed relations among different kind of objects and entities

Define new knowledge

Link to the Web of Data, and access its data







Wikimediachapters

Wikimediachapters




platform

enriched metadata

EuropeanaChannel

(crowdsourcing)

EuropeanaChannel

(crowdsourcing)

Collaborating with Wikimedia Chapters

Photo of the Wiki Loves Sound Edit-a-Thon in the Netherlands

Example (Cat’s meow)

Reuse in Wikipedia







Wikimediachapters

Wikimediachapters




platform

enriched metadata

EuropeanaChannel

(crowdsourcing)

EuropeanaChannel

(crowdsourcing)

Crowdsourcing (enrichment)

• ‘happens’ on multiple sites, where users are!

• two user groups (general public and experts)

- Historypin

- Institutional Portals

- Europeana Channel (see also WP4 presentation)

Crowdsourcing: approach

Crowdsourcing: requirements and policy Definition (T2.1.1)

The requirements will differentiate between two target groups: the general public and experts

Crowdsourcing: operationalisation and Evaluation (T2.1.2)

This subtask oversees the successful deployment and end-user evaluation of the crowdsourcing infrastructure: on the Europeana portal, the individual partner sites and on Historypin. Activities include creating training materials and one hands-on workshop.

Web-based game for the general public

YUMA (now Annotorious) from AIT

example

example

Enrichment on institutional portals

Europeana search widget by EF

example

example

Enrichment on Europeana Sounds Channel

Example of the SoundCloud player, with social tagging functionality

example

example







Wikimediachapters

Wikimediachapters




platform

enriched metadata

EuropeanaChannel

(crowdsourcing)

EuropeanaChannel

(crowdsourcing)

All content p

artners

All content p

artners







Wikimediachapters

Wikimediachapters




platform

enriched metadata

EuropeanaChannel

(crowdsourcing)

EuropeanaChannel

(crowdsourcing)

Innovative exploration pilots: audio information retrieval and dynamic linking

Linking music to scores

Identify related resources (audio, video, music scores, vocabularies)

Link audio segments to music scores

Automated: midi content to sheet music (digital)

Semi automatic: convert content and music scores to Midi/MusicXML

Manual: markup audio and digitized music scores

Typical applications:

Learning to play an instrument (hear, follow, play)

Compositions (compose, follow, hear )

27 07.04.23

Music information retrievalIndex and retrieve music content

Extract audio features: timbre, chords, harmonies, melody, main pitch, beats per minute or rhythm

Index features and retrieve similar content

Music categorization

Evaluation using Europeana Sounds content

Sound recognition (birds)

Typical applications:

Search/explore music repositories

Music classification and recommendation

Intellectual property protection

28 07.04.23

Existing tools (open source)

OMR: Audiveris, OpenOMR

Midi and scores synchronization: midisheetmusic, musicscore

Feature extraction: JMir, MirToolbox(Mathlab), RP-Extract

Indexing and retrieval: Clubmixer, Marysas

https://audiveris.kenai.com/

http://musescore.org/

WP2: deliverables

No Title Delivery month

D2.1 Crowdsourcing infrastructure & exchange policy

6

D2.2 Functional design of semantic enrichment 7

D2.3 Linking pilot delivery report (software, documentation)

14

D2.4 Crowdsourcing infrastructure v1 assessment 17

D2.5, 8 GLAM-wiki collaboration progress reports 21, 34

D2.6 MIR pilot report 22

D2.7 Crowdsourcing evaluation & impact assessment

30

D2.9 Evaluation report on semantic enrichment implementation

36

Thank you

Europeana Sounds kick-off - Workpackage 2 Enrichment and Participation

Technology

Transcript of Europeana Sounds kick-off - Workpackage 2 Enrichment and Participation