D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the...

28
EUMSSI D8.6 Final Dissemination Report 1 D8.6 FINAL DISSEMINATION REPORT Project co-funded by ICT-7th Framework Programme from the European Commission Grant Agreement nr 611057 Project acronym EUMSSI Start date of project (dur.) December 1st 2013 (36 months) Document due Date : 30/11/2016 Actual date of delivery 09/12/2016 Leader DW Reply to [email protected] Document status Submitted

Transcript of D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the...

Page 1: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 1

D8.6 FINAL DISSEMINATION REPORT

Project co-funded by ICT-7th Framework Programme

from the European Commission

Grant Agreement nr 611057

Project acronym EUMSSI

Start date of project (dur.) December 1st 2013 (36 months)

Document due Date : 30/11/2016

Actual date of delivery 09/12/2016

Leader DW

Reply to [email protected]

Document status Submitted

Page 2: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 2

Project ref. no. 611057

Project acronym EUMSSI

Project full title Event Understanding through Multimodal Social

Stream Interpretation

Document name EUMSSI D8.6 Final Dissemination

Report_20161201

Security (distribution level)

PU - Public

Contractual date of delivery

30/11/2016

Actual date of

delivery

09/12/2016

Deliverable name Dissemination Report

Type R - Report

Status Submitted

Version number 2

Number of pages 28

WP / Task

responsible

VSN / DW

Other contributors Nam Le (LUH)

Author(s) Tim Koch, Kay Macquarrie, Maite Melero

EC Project Officer Ms. Alina Lupu

Abstract Report on the dissemination activities carried

out in the course of the project

Keywords Dissemination, conferences, website,

publications, videos, poster

Circulated to partners Yes

Peer review completed

Yes

Peer-reviewed by Yannick Estève (LIUM)

Coordinator approval Yes

Page 3: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 3

Table of Contents 1. INTRODUCTION ............................................................................................. 4

2. DISSEMINATION IN EUMSSI ........................................................................... 5

2.1. Dissemination Strategy ............................................................................. 5

2.2. Target Groups for Dissemination ............................................................... 6

2.3. Dissemination materials ............................................................................ 6

2.3.1. Website ............................................................................................ 6

2.3.2. Project Flyer...................................................................................... 7

2.3.3. EUMSSI video clips ............................................................................ 8

2.4. Dissemination activities ........................................................................... 10

2.4.1. Papers at scientific conferences/workshops and journal publications ..... 10

2.4.2. Challenges and international evaluation campaigns ............................. 13

2.4.3. EUMSSI demonstrations and exhibition booths at specialized forums .... 14

2.4.4. Participation in commercial trade shows ............................................. 15

2.4.5. Dissemination events organized by the EUMSSI project ....................... 16

2.4.6. Innovation Radar Prize ...................................................................... 17

2.4.7. Media communications and press releases .......................................... 18

2.5. Chronological overview of all dissemination events ..................................... 19

2.6. Social Networks ...................................................................................... 26

2.6.1. Twitter and YouTube ........................................................................ 26

2.6.2. GitHub ............................................................................................. 26

3. CONCLUSIONS .............................................................................................. 28

Page 4: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 4

1. INTRODUCTION

This document is the D8.6 deliverable of the EUMSSI project. It details the dissemination activities performed throughout the project, i.e. the entire 36 months. D8.6 is the third document dealing with dissemination; D8.2 Dissemination and IPR Plan was published after M12, D8.4 Dissemination Report after M24. As D8.6 covers the whole project lifetime, it is inevitable that parts of its information have been published in the other two deliverables before. During the three project years a fair amount of conferences, trade shows and relevant events were attended and 33 scientific papers (conference/workshop papers and articles in journals) were published. The produced dissemination materials include the production of three videos/animations, project brochure and posters. This deliverable is made up of three chapters: the introduction, the dissemination activities (chapter 2) covering all activities carried out in the three project years and the conclusions drawn (chapter 3).

Page 5: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 5

2. DISSEMINATION IN EUMSSI

2.1. Dissemination Strategy

The knowledge about the project was disseminated through several dissemination methods to reach the target audiences.

Method Purpose Description

Inform Awareness Engage Promote

Project Web site X X X X The project web site is one

of the most versatile dissemination tools. It

should have all the

information of the project and must be updated

regularly.

Press releases X It can be used to announce an important achievement

Flyers/brochures X It is useful to create a flyer

that can be circulated at conferences, fairs, etc.

Projects/cluster

meetings

X Projects meetings are

excellent opportunities for projects to learn from each

other, discuss common

issues and get feedback on their world

Conference/fairs

presentations

X X X National and international

conferences are an important opportunity to

share project achievements with experts in the field.

Fairs have a specific impact

on promotion.

Workshop X Workshops are small

interactive events held to

achieve a specific objective. A workshop could be used

to get feedback from users on a demo or to get

feedback from experts on a

particular issue.

Demonstrations X Demonstrations allow showing project

developments and getting feedback

Journal articles X Case studies explain what

has been done and what has been learned so others

can benefit from our

experience

Table 1: Dissemination Methods

Page 6: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 6

2.2. Target Groups for Dissemination

The primary target audiences for the dissemination activities are the following:

1. The EC–ICT community: with the aim to raise awareness regarding the project’s objectives and results and trigger collaborations which enable EUMSSI to exploit synergies with projects sharing similar or complementary goals (such as the close collaborations with the ICT projects MULTISENSOR and SAM).

2. The scientific/research community: with the aim to spread the scientific results and enable triggering their use in other areas as well.

3. The industrial community: to communicate and promote the project results to both technology providers as well as business users.

4. The media industry: to disseminate EUMSSI results in relevant industrial sectors through demonstrations, and promotion at industry events. In particular Deutsche Welle and VSN use their established networks.

5. The general public: it was a goal of the consortium to involve the so-called general public as much as possible.

2.3. Dissemination materials

2.3.1. Website

The project website www.eumssi.eu went online in the first project month (December 2013). It was continuously updated with new project information, conferences to be attended, publications, and it provides the so-called R&D Gossip section where links to interesting articles related to the EUMSSI research fields were published. In total, 29 R&D Gossip posts and 16 project news articles were published. Below you can see a screenshot of the main page.

Page 7: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 7

Figure 1: EUMSSI Website

The EUMSSI project portal provides an extensive overview of the project's aims and main achievements and it is addressing technological aspects that are of interest to the various user groups of EUMSSI (content creators, viewers). The EUMSSI website will be available for at least another year after the official project end.

2.3.2. Project Flyer

A flyer explaining the project in non-technical words was created and made available online1. It outlines the objectives, concepts and vision of EUMSSI. This brochure was

1 http://de.slideshare.net/eumssi/eumssi-flyer

Page 8: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 8

used at public events (conferences, workshops, exhibitions, etc.), which were attended by the EUMSSI partners.

Figure 2: EUMSSI Project Flyer

2.3.3. EUMSSI video clips

In total, three promotional video clips and animations were produced in the course of the project. The first one, produced in December 2013, at the very beginning of the project, contained interviews of the staff involved in EUMSSI and explained their motivation to participate and expectations towards the project.

Page 9: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 9

Figure 3: EUMSSI Interviews

The second one was a short animation outlining the journalistic use case and presenting the EUMSSI technology at that stage. It was released at the first EUMSSI-MULTISENSOR User Day that took place at DW in Bonn in November 2015.

Figure 4: First EUMSSI Animation

Page 10: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 10

The third video clip was a silent, text-only animation published in three languages (English, French, Spanish). It was created with the software GoAnimate and it was released in September 2016 right before the IBC 2016 in Amsterdam, Netherlands, to be shown there for the first time.

Figure 5: Second EUMSSI Animation

All video clips were uploaded to EUMSSI’s YouTube channel and linked from there to the project website.

2.4. Dissemination activities

2.4.1. Papers at scientific conferences/workshops and journal publications

During the project lifetime, the EUMSSI partners published one journal article, with another journal paper in the process of revision2, and 40 scientific and workshop papers on the project results. In June 2016, IDIAP and LIUM released an article on the EUMSSI result in the journal “Frontiers in ICT”:

2 A joint project paper is being reviewed at the moment of writing this report, to be published in the

Multimedia Tools and Applications journal, Special issue on Content-based multimedia indexing: “The

EUMSSI storytelling tool for data journalists. A multi-layered approach to multimedia content analysis”

Page 11: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 11

CRF-Based Context Modeling for Person Identification in Broadcast Videos by Paul Gay, Sylvain Meignier, Paul Deléglise and Jean-Marc Odobez | Frontiers in ICT, June 2016 By the end of the project, 33 papers were published in conference and workshop proceedings:

1. Temporally Subsampled Detection for Accurate and Efficient Face Tracking and Diarization by Nam Le, Alexander Heili, Di Wu, Jean-Marc Odobez (IDIAP) | ICPR 2016, Mexico

2. Learning Multimodal Temporal Representation for Dubbing Detection in Broadcast Media by Nam Le, Jean-Marc Odobez (IDIAP) | ACM Multimedia 2016, The Netherlands

3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc Odobez | MediaEval 2016, Hilversum, Netherlands

4. Long-Term Time-Sensitive Costs for CRF-Based Tracking by Detection by Nam Le, Alexandre Heili, Jean-Marc Odobez | ECCV Workshop on Benchmarking Multi-Target Tracking 2016, Amsterdam, Netherlands

5. Acoustic word embeddings for ASR error detection by Sahar Ghannay, Yannick Estève, Nathalie Camelin, Paul Deléglise | Interspeech 2016, San Francisco, USA

6. The EUMSSI project – Event Understanding through Multimodal Social Stream Interpretation by Jens Grivolla, Yannick Estève, Eelco Herder, Nam Le, Kay Macquarrie, Raúl Marín, Sylvain Meignier, Maite Melero, Jean-Marc Odobez, Susanne Preuss ) | MMDA 2016, The Netherlands

7. EUMSSI: Multilayered analysis of multimedia content using UIMA, MongoDB and Solr by Jens Grivolla, Maite Melero, Toni Badia (UPF) | MMDA 2016, The Netherlands

8. Recent improvements on error detection for automatic speech recognition by Y. Esteve, S. Ghannay and N. Camelin ) | MMDA 2016, The Netherlands

9. An active learning method for speaker identity annotation in audio recordings by P.A. Broux, D. Doukhan, S. Petitrenaud, S. Meignier and J. Carrive | MMDA 2016, The Netherlands

10. Evaluation of acoustic word embeddings by Sahar Ghannay, Yannick Estève, Nathalie Camelin, Paul Deléglise | RepEval@ACL 2016, Berlin, Germany

11. Word embedding evaluation and combination by Sahar Ghannay, Benoit Favre, Yannick Estève, Nathalie Camelin | LREC 2016, Portorož, Slovenia

12. Title assignment for automatic topic segments in TV Broadcast News by Abdessalam Bouchekif, Géraldine Damnati, Delphine Charlet, Nathalie Camelin, Yannick Estève | ICASSP 2016, Shanghai, China

13. Speaker Diarization With Unsupervised Training Framework by Gaël Le Lan, Sylvain Meignier, Delphine Charlet, Paul Deléglise | ICASSP 2016, Shanghai, China

14. Approaches for multi-genre broadcast media transcription by Vishwa Gupta, Paul Deléglise, Gilles Boulianne, Yannick Estève, Sylvain Meignier, Anthony Rousseau (LIUM) | MGB 2015 / ASRU 2015, USA

Page 12: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 12

15. LIUM @ IWSLT’15 Evaluation Campaign by Mercedes García-Martínez, Loïc Barrault, Anthony Rousseau, Paul Deléglise, Yannick Estève | IWSLT 2015, Vietnam

16. Combining continous word representation and prosodic features for ASR error prediction by Sahar Ghannay, Yannick Estève, Nathalie Camelin, Camille Dutrey, Fabian Santiago, Martine Adda-Decker (LIUM) | SLSP 2015, Hungary

17. Which ASR errors are hard to detect? by Sahar Ghannay, Nathalie Camelin, Yannick Estève | 2nd Workshop on Errors by Humans and Machine in multimedia, multimodal and multilingual data processing – ERRARE 2015, Sinaia, Romania

18. EUMSSI team at the MediaEval Person Discovery Challenge by Nam Le, Di Wu, Sylvain Meignier, Jean-Marc Odobez | MediaEval 2015, Wurzen, Germany

19. Word embedding combination and neural networks for robustness in ASR error detection by Sahar Ghannay, Yannick Esteve, Nathalie Camelin | EUSIPCO 2015 – European Signal Processing Conference, Nice, France

20. Joint Graphical Models for Date Selection in Timeline Summarization by Giang Binh Tran, Eelco Herder, Katja Markert | ACL 2015, Beijing, China

21. Detecting Filter Bubbles in Ongoing News Stories by Giang Binh Tran, Eelco Herder | UMAP 2015, Dublin, Ireland

22. The EUMSSI Platform for Multimodal Analysis and Annotation by Jens Grivolla, Maite Melero, Yannick Estève, Eelco Herder, Peggy van der Kreeft, Raul Marin, Jean-Marc Odobez, Susanne Preuß | KESA2015, Barcelona, Spain

23. Timeline Summarization from Relevant Headlines by Giang Binh Tran, Mohammad Alrifai, Eelco Herder | ECIR 2015, Vienna, Austria

24. Integration of word and semantic features for theme identification in telephone conversations by Yannick Estève, Mohamed Bouallegue, Carole Lailler, Mohamed Morchid, Richard Dufour, Georges Linarès, Renato De Mori

25. LIUM and Vecsys @ IWSLT 2014 English to French SLT track, English and Italian ASR tracks by A. Rousseau, L. Barrault, P. Deléglise, Y. Estève, H. Schwenk S. Bennacef, A. Muscariello, S. Vanni | IWSLT 2014

26. Face identification from overlaid texts using Local Face Recurrent Patterns and CRF models by Paul Gay, Elie Khoury, Sylvain Meignier, Jean-Marc Odobez, Paul Deleglise | IEEE International Conference on Image Processing (ICIP 2014), Paris, France

27. Is Incremental Cross-Show Speaker Diarization Efficient to Process Large Volumes of Data? by Grégor Dupuy, Sylvain Meignier and Yannick Estève | 15th Annual Conference of the International Speech Communication Association (ISCA 2014), Singapore

28. EUMSSI: a Platform for Multimodal Analysis and Recommendation using UIMA by Jens Grivolla, Maite Melero, Toni Badia, Cosmin Cabulea, Yannick Estève, Eelco Herder, Jean-Marc Odobez, Susanne Preuß and Raúl Marín | COLING 2014, Dublin, Ireland

Page 13: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 13

29. Recent Improvements on ILP-based Clustering for Broadcast News Speaker Diarization by Grégor Dupuy, Sylvain Meignier, Paul Deléglise, Yannick Estève | ISCA Speaker and Language Recognition Workshop, Joensuu, Finland

30. Comparison of Two Methods for Unsupervised Person Identification in TV Shows by Paul Gay, Grégor Dupuy, Carole Lailler, Jean-Marc Odobez, Sylvain Meignier, and Paul Deléglise | CBMI 2014 International Workshop on Content-Based Multimedia Indexing, Klagenfurt, Austria

31. A Conditional Random Field Approach for Audio-Visual People Diarization by Gay Paul, Khoury Elie, Meignier Sylvain, Odobez Jean-Marc, Deleglise Paul | IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2014, Florence, Italy

32. Metadata as Linked Open Data: mapping disparate XML metadata registries into one RDF/OWL registry by Marta Villegas, Maite Melero, Núria Bel | LREC 2014, Reykjavik, Iceland

33. A hybrid recommender combining user, item and interaction data by Jens Grivolla, Diego Campo, Miquel Sonsona, Jose-Miguel Pulido, Toni Badia | CSCI’14, Las Vegas, USA

2.4.2. Challenges and international evaluation campaigns

The EUMSSI partners have participated in several challenges and evaluation campaigns, achieving very good results, ranking first or second in some of them, as explained in more detail in D3.4 and D3.6. These campaigns are:

MGB campaign 2015. EUMSSI ranked second with the English system at the ASR track.

ASRU 2015

IWSLT 2015. EUMSSI ranked first with the German system at the ASR track. Person Discovery challenge at MediaEval 2015 and 2016. EUMSSI

ranked first in both occasions. Multiple-Object-Tracking challenge at ECCV 2016. RepEval at ACL 2016.

Page 14: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 14

Figure 5: Graphic showing EUMSSI ranking first at MediaEval 2016

2.4.3. EUMSSI demonstrations and exhibition booths at specialized forums

We have taken the opportunity to present EUMSSI’s results and demonstrate the prototype at a range of specialized international forums.

META Forum 2015 (Riga) and 2016 (Lisboa). META-FORUM is an international conference on powerful and innovative language technologies for the multilingual information society, the data value chain and the information market place.

European Data Forum 2016 (Eindhoven). The European Data Forum (EDF) is a meeting place for industry, research, policymakers and community initiatives to discuss the challenges of Big Data and the emerging Data Economy and to develop suitable action plans for addressing these challenges.

HLT Projects Village at LREC 2014 (Reykjavik) and 2016 (Portorož). The main objective of this exhibition for on-going EC-sponsored HLT projects is to disseminate information by describing the activities/objectives and showing progress, either through demos, or through brochures or leaflets if the project is still at an early stage.

Deutsche Welle Global Media Forum (Bonn) 2014, 2015 and 2016 DataBeers BCN (Barcelona). DataBeers is a non-profit and open community

whose mission is to become a summit for professionals and students inside the scope of Big Data and Data Science to discuss and share experiences also promoting events where everybody with an interest in data is welcome to exchange their knowledge.

Idiap Innovation & Open Day (Martigny)

Page 15: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 15

Figure 6: EUMSSI booth at HLT Projects Village - LREC 2016

2.4.4. Participation in commercial trade shows

Participation in the most important international trade shows in the broadcast field has been a fundamental part of the EUMSSI exploitation strategy.

IBC 2015 and 2016 (Amsterdam). Originally the International Broadcasting Convention, IBC has evolved from its technical broadcast roots and today it encompasses the whole breadth of media creation management and delivery, from online content to digital cinema, from automated workflows to high resolution capture and display.

BIT 2015 and 2016 (Madrid). International Audio-Visual Technology Trade Show

NAB 2015 and 2016 (Las Vegas). NAB Show is an annual trade show produced by the National Association of Broadcasters and ranks first in its genre.

CABSAT 2016 (Dubai). CABSAT is the number one event for the satellite, broadcast, digital media and content industries.

NATEXPO (Moscow). NATEXPO is an annual, international exhibition and conference focused on technologies, professional equipment and services for the Television, Radio and New Media Broadcasting and cinema production.

Page 16: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 16

Figure 7: VSN stand at NAB 2016 presenting EUMSSI

Figure 8: EUMSSI demonstration at IBC 2016

2.4.5. Dissemination events organized by the EUMSSI project

EUMSSI-MULTISENSOR User Day is a joint annual event organized by the two projects with the aim to facilitate validation of the prototypes from the users, as well as diffusion among the relevant actors. It is also an occasion for the two consortia to meet and share research activities and knowledge. In 2015, it took place at Deutsche Welle (Bonn), and in 2016 at the Valkiria Hub Space (Barcelona)

Page 17: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 17

1st Workshop on Multimodal Media Data Analytics (MMDA2016) at ECAI

2016, The Hague, Netherlands. Co-organized with the MULTISENSOR project. Proceedings edited by CEUR-WS.org

Workshop on Open Infrastructures and Analysis Frameworks for HLT at COLING 2014, Dublin, Ireland.

Figure 9: First EUMSSI-MULTISENSOR User Day (Bonn)

Figure 10: Second EUMSSI-MULTISENSOR User Day (Barcelona)

2.4.6. Innovation Radar Prize

The 2016 Innovation Radar Prize in the Industrial and Enabling Technologies category was awarded to LIUM for the innovative ASR technology developed under the EUMSSI project. The award was announced at a ceremony in Bratislava on 26 September 2016.

Page 18: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 18

Figure 11: Innovation Radar Prize awarded to LIUM for their developments

in EUMSSI

2.4.7. Media communications and press releases

The following press releases about EUMSSI have been issued:

The European research project EUMSSI arrives to Barcelona. Appeared in 4RFV International Broadcast News on September 7th 2016.

SENSE4US project is announcing its collaboration with EUMSSI project. Appeared in Sense4us news on June 7th 2016.

The EUMSSI project obtains the highest European qualification after its second year of activity. Appeared in 4RFV International Broadcast News on March 4th 2016.

VSN participa en el proyecto europeo de investigación EUMSSI. Appeared in Panorama audiovisual on January 13th 2015.

Page 19: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 19

VSN participates in the EUMSSI European research project. Appeared in

ADVANCED TELEVISION on January 13th 2015.

VSN participates in the EUMSSI European research project. Appeared in 4RFV International Broadcast News on December 26th 2015.

2.5. Chronological overview of all dissemination events

The following table lists chronologically all 63 dissemination events carried over during the three project years, including conference papers, workshops and demonstrations, specifying the project partners in charge. The list is presented in reverse chronological order and is grouped by months: November 2016

1. Demonstration | Multimodal Media Analysis and Visualization for Journalists by Jens Grivolla | Data Beers BCN, Barcelona, Spain

2. Paper | Learning Multimodal Temporal Representation for Dubbing Detection in Broadcast Media by Nam Le, Jean-Marc Odobez | ACM Multimedia 2016, Amsterdam, Netherlands

3. Paper | Temporally Subsampled Detection for Accurate and Efficient Face Tracking and Diarization by Nam Le, Alexander Heili, Di Wu, Jean-Marc Odobez (IDIAP) | ICPR 2016, Mexico

October 2016

4. Workshop paper | Long-Term Time-Sensitive Costs for CRF-Based Tracking by Detection by Nam Le, Alexandre Heili, Jean-Marc Odobez | ECCV Workshop on Benchmarking Multi-Target Tracking 2016, Amsterdam, Netherlands

5. Benchmark Workshop | MediaEval 2016 Multimedia Benchmark Workshop by LIUM & IDIAP | MediaEval 2016, Hilversum, Netherlands

September 2016

6. Demonstration | Idiap Innovation & Open Day by Idiap | Idiap, Martigny, Switzerland

7. Paper | Acoustic word embeddings for ASR error detection by Sahar Ghannay, Yannick Estève, Nathalie Camelin, Paul Deléglise| Interspeech 2016, San Francisco, USA

8. Demonstration | EUMSSI Demonstration & Exhibition Booth at IBC 2016 by VSN | IBC 2016, Amsterdam, Netherlands

9. Demonstration | 2nd EUMSSI-MULTISENSOR User Day at Valkiria Hub Space (Barcelona) by all EUMSSI Partners | EUMSSI-MULTISENSOR User Day, Barcelona, Spain

Page 20: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 20

10. Press release | VSN | The European research project EUMSSI arrives to Barcelona. Appeared in 4RFV International Broadcast News on September 7th 2016.

August 2016

11. Workshop | Joint EUMSSI & MULTISENSOR Workshop on Multimodal Media Data Analytics | MMDA at ECAI 2016, The Hague, Netherlands

12. The EUMSSI project – Event Understanding through Multimodal Social Stream Interpretation by Jens Grivolla, Yannick Estève, Eelco Herder, Nam Le, Kay Macquarrie, Raúl Marín, Sylvain Meignier, Maite Melero, Jean-Marc Odobez, Susanne Preuss | MMDA, The Hague, Netherlands

13. Recent improvements on error detection for automatic speech recognition by Y. Esteve, S. Ghannay and N. Camelin | MMDA, The Hague, Netherlands

14. An active learning method for speaker identity annotation in audio recordings by P.A. Broux, D. Doukhan, S. Petitrenaud, S. Meignier and J. Carrive | MMDA, The Hague, Netherlands

15. EUMSSI: Multilayered analysis of multimedia content using UIMA, MongoDB and Solr by Jens Grivolla, Maite Melero and Toni Badia | MMDA, The Hague, Netherlands

16. Workshop paper | Evaluation of acoustic word embeddings by LIUM | RepEval@ACL 2016, Berlin, Germany

July 2016

17. Exhibition | Project booth at META Forum 2016 by UPF | META-FORUM 2016, Lisbon, Portugal

June 2016

18. Exhibition | Exhibition booth at Global Media Forum 2016 by DW | GMF 2016, Bonn, Germany

19. Demonstration & Exhibition | Project booth at European Data Forum 2016 by UPF | EDF 2016, Eindhoven, Netherlands

20. Press release | SENSE4US project is announcing its collaboration with EUMSSI project. Appeared in Sense4us news on June 7th 2016.

May 2016

21. Demonstration | EUMSSI Demonstration & Exhibition Booth at LREC 2016 by UPF & LIUM | LREC 2016, Portorož, Slovenia

22. Paper | Word embedding evaluation and combination by Sahar Ghannay, Benoit Favre, Yannick Estève, Nathalie Camelin | LREC 2016, Portorož, Slovenia

23. Exhibition | EUMSSI Poster and Information Booth at BIT Broadcast by VSN | BIT 2016, Madrid, Spain

Page 21: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 21

April 2016

24. Demonstration | EUMSSI Demonstration & Exhibition Booth at NAB Show 2016 by VSN | NAB 2016, Las Vegas, Nevada, USA

March 2016

25. Demonstration | EUMSSI Demonstration & Exhibition Booth at CABSAT 2016 by VSN | CABSAT 2016, Dubai, UAE

26. Poster Presentation | Unsupervised Training Models for Speaker Diarization by LIUM | ICASSP 2016, Shanghai, China

27. Paper | Title assignment for automatic topic segments in TV Broadcast News by Abdessalam Bouchekif, Géraldine Damnati, Delphine Charlet, Nathalie Camelin, Yannick Estève | ICASSP 2016, Shanghai, China

28. Press release | VSN | The EUMSSI project obtains the highest European qualification after its second year of activity. Appeared in 4RFV International Broadcast News on March 4th 2016.

December 2015

29. Evaluation campaign | IWSLT 2015 ASR evaluation campaign by LIUM | IWSLT 2015, Da Nang, Vietnam

30. Paper | Approaches for multi-genre broadcast media transcription by Vishwa Gupta, Paul Deléglise, Gilles Boulianne, Yannick Estève, Sylvain Meignier, Anthony Rousseau | MGB Challenge (related to ASRU 2015), Scottsdale, Arizona, USA

November 2015

31. Demonstration | Demonstration & Validation at EUMSSI / MULTISENSOR User Day by all project partners | Deutsche Welle, Bonn, Germany

32. Paper | Combining continous word representation and prosodic features for ASR error prediction by Sahar Ghannay, Yannick Estève, Nathalie Camelin, Camille Dutrey, Fabian Santiago, Martine Adda-Decker (LIUM) | SLSP 2015, Hungary

October 2015

33. Demonstration | EUMSSI Demonstration at NATEXPO 2015

Conference by VSN | NATEXPO, Moscow, Russia

September 2015

Page 22: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 22

34. Exhibition Booth | Booth @ IBC 2015 by VSN | IBC 2015, Amsterdam, Netherlands

35. Paper | Which ASR errors are hard to detect? by Sahar Ghannay, Nathalie Camelin, Yannick Estève | 2nd Workshop on Errors by Humans and Machine in multimedia, multimodal and multilingual data processing – ERRARE 2015, Sinaia, Romania

36. Benchmark Workshop | Multimodal person discovery in Broadcast TV by Nam Le, Di Wu, Sylvain Meignier, Jean-Marc Odobez | MediaEval 2015 Multimedia benchmark workshop – Wurzen, Saxony, Germany

August 2015

37. Paper | Word embedding combination and neural networks for robustness in ASR error detection by Sahar Ghannay, Yannick Esteve, Nathalie Camelin | EUSIPCO 2015 – European Signal Processing Conference, Nice, France

July 2015

38. Paper | Joint Graphical Models for Date Selection in Timeline Summarization by Giang Binh Tran, Eelco Herder, Katja Markert | 2015 Association for Computational Linguistics (ACL) , Beijing, China

June 2015

39. Presentation | Automated Translation in Media Production Environments by Peggy van der Kreeft | SCAIE Workshop by EBU, Geneva, Switzerland

40. Exhibition | Exhibition booth @ Global Media Forum 2015 by DW | GMF 2015, Bonn, Germany

41. Paper | Detecting Filter Bubbles in Ongoing News Stories by Giang Binh Tran, Eelco Herder | 23rd Conference on User Modeling, Adaptation and Personalization, UMAP 2015, Dublin, Ireland

April 2015

42. Demo Paper | The EUMSSI platform for multimodal analysis and annotation by UPF | International Workshop on Knowledge Extraction and Semantic Annotation (KESA 2015), Barcelona, Spain

43. Poster & Presentation | Event Understanding through Multimodal Social Stream Interpretation by UPF & DW | RIGA SUMMIT 2015, Riga, Latvia

Page 23: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 23

March 2015

44. Paper | Timeline Summarization from Relevant Headlines by Giang Binh Tran, Mohammad Alrifai, Eelco Herder | 37th European Conference on Information Retrieval (ECIR 2015), Vienna, Austria

January 2015

45. Workshop Presentation| by Peggy van der Kreeft, DW | Information and Networking Day – Workshop on Multilingual Data Value Chains in the Digital Single Market (ICT-16), Brussels, Belgium

46. Paper | Integration of word and semantic features for theme identification in telephone conversations by Yannick Estève, Mohamed Bouallegue, Carole Lailler, Mohamed Morchid, Richard Dufour, Georges Linarès, Renato De Mori | IWSDS 2015

47. Press release | VSN | VSN participa en el proyecto europeo de investigación EUMSSI. Appeared in Panorama audiovisual on January 13th 2015.

48. Press release | VSN | VSN participates in the EUMSSI European research project. Appeared in ADVANCED TELEVISION on January 13th 2015.

December 2014

49. Hackathon | The Story Stripper — Metadata Extraction and Summarisation Tool by Peggy van der Kreeft, Andy Giefer, Paul Butcher, Yin Lee | BBC Connected Studio Team #newsHACK: Language Technology, London, UK

50. Benchmark Workshop | LIUM and Vecsys @ IWSLT 2014 English to French SLT track, English and Italian ASR tracks by A. Rousseau, L. Barrault, P. Deléglise, Y. Estève, H. Schwenk S. Bennacef, A. Muscariello, S. Vanni | IWSLT 2014

51. Press release | VSN | VSN participates in the EUMSSI European research project. Appeared in 4RFV International Broadcast News on December 26th 2014.

October 2014

52. Paper | Face identification from overlaid texts using Local Face Recurrent Patterns and CRF models by Paul Gay, Elie Khoury, Sylvain Meignier, Jean-Marc Odobez, Paul Deleglise | IEEE International Conference on Image Processing (ICIP 2014), Paris, France

Page 24: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 24

53. Exhibition, Debate| Big Bang Data at CCCB by UPF | CCCB Centre de Cultura Contemporània de Barcelona, Barcelona, Spain

September 2014

54. Paper | Is Incremental Cross-Show Speaker Diarization Efficient to Process Lglobalarge Volumes of Data? by Grégor Dupuy, Sylvain Meignier and Yannick Estève | 15th Annual Conference of the International Speech Communication Association (ISCA 2014), Singapore

August 2014

55. Workshop | Workshop on Open Infrastructures and Analysis Frameworks for HLT by Jens Grivola | COLING 2014, Dublin, Ireland

56. Paper | EUMSSI: a Platform for Multimodal Analysis and Recommendation using UIMA by Jens Grivolla, Maite Melero, Toni Badia, Cosmin Cabulea, Yannick Estève, Eelco Herder, Jean-Marc Odobez, Susanne Preuß and Raúl Marín | COLING 2014, Dublin, Ireland

June 2014

57. Workshop Paper | Comparison of Two Methods for Unsupervised Person Identification in TV Shows by Paul Gay, Grégor Dupuy, Carole Lailler, Jean-Marc Odobez, Sylvain Meignier, and Paul Deléglise | CBMI 2014 International Workshop on Content-Based Multimedia Indexing, Klagenfurt, Austria

58. Workshop Paper | Recent Improvements on ILP-based Clustering for Broadcast News Speaker Diarization by Grégor Dupuy, Sylvain Meignier, Paul Deléglise, Yannick Estève | ISCA Speaker and Language Recognition Workshop, Joensuu, Finland

59. Exhibition | Exhibition @ Global Media Forum by DW | Bonn, Germany

May 2014

60. Exhibition | Exhibition booth at HLT Projects Village @ LREC by UPF | LREC 2014, Reykjavik, Iceland

61. Paper | Metadata as Linked Open Data: mapping disparate XML metadata registries into one RDF/OWL registry by Marta Villegas, Maite Melero, Núria Bel | LREC 2014, Reykjavik, Iceland

62. Paper | A Conditional Random Field Approach for Audio-Visual People Diarization by Gay Paul, Khoury Elie, Meignier Sylvain, Odobez Jean-Marc,

Page 25: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 25

Deleglise Paul | IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2014, Florence, Italy

March 2014

63. Paper | A hybrid recommender combining user, item and interaction data by Jens Grivolla, Diego Campo, Miquel Sonsona, Jose-Miguel Pulido, Toni Badia | CSCI’14, Las Vegas, USA

Page 26: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 26

2.6. Social Networks

2.6.1. Twitter and YouTube

Online social networks are used as complementary dissemination channels. The project results are regularly published on Twitter (www.twitter.com/eumssi) and YouTube (www.youtube.com/eumssi).

Figure 12: EUMSSI’s Twitter Channel

2.6.2. GitHub

Most of the software developed in the EUMSSI project is openly available under the permissive Apache Software License (http://apache.org/licenses/) which is compatible with commercial exploitation. It is published on GitHub and includes the core platform that takes care of data collection, preprocessing, as well as managing the complete workflow (https://github.com/EUMSSI/EUMSSI-platform), the text analysis components for offline as well as on-demand use (https://github.com/EUMSSI/EUMSSI-UIMA), and the two demonstrators (https://github.com/EUMSSI/EUMSSI-demos and https://github.com/EUMSSI/EumssiEventExplorer).

Page 27: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 27

Figure 13: EUMSSI page on GitHub

The documentation is maintained on the platform wiki at https://github.com/EUMSSI/EUMSSI-platform/wiki.

Page 28: D8.6 FINAL DISSEMINATION REPORT - EUMSSI · Multimedia 2016, The Netherlands 3. EUMSSI team at the MediaEval Person Discovery Challenge 2016 by Nam Le, Sylvain Meignier, Jean-Marc

EUMSSI D8.6 Final Dissemination Report 28

3. CONCLUSIONS

The dissemination goals that the EUMSSI project set for itself from the start have been widely covered during these three years. The EUMSSI technical partners have published a sizeable amount of scientific papers, with relevant contributions and successful participation in international challenges and evaluation campaigns. The project has been well-represented in conferences and specialized forums, and, of particular importance for its ensuing exploitation, in most relevant industry events in the field. The dissemination schedule has been well-balanced all through the project duration, starting early and progressively increasing from 15 events in the first year, to 20 during the second and up to 28 on the last year. Special mention should be made of the two workshops organized or co-organized by EUMSSI, the journal papers, the two successful User Days and finally the Innovation Radar Prize awarded to EUMSSI partner LIUM for the innovative technology developed in the framework of EUMSSI. All dissemination events and news regarding the project and related research areas have been regularly reported on the website, which will be kept online for a due period of time. All code developed in the course of the project is well-documented and accessible in GitHub.