Challenge Recap

ACM RecSys 2013, Hong Kong

Torben Brodtplista GmbH

International News RecommenderSystems Workshop and Challenge

October 13th, 2013

Dates

planned● 6 month development● 1 month offline dataset (2013/07)● 3 weeks online evaluation (2013/08)

Dates

actual● 6 month development● 1 month offline dataset (2013/07)● 3 weeks “online evaluation” (2013/08)

○ Registration Problems○ Missing Leaderboard

● 3 weeks ranking period (2013/09)

Number Quiz

How many registrations?

Number Quiz

How many registrations?

23

Number Quiz

How many active teams?

Number Quiz

How many active teams?

11

Participants from

recs

API

real user

researcher

workshops and talks● SIGIR, RecSysteams from● TU Berlin● HPI Potsdam● CWI Amsterdam● NTNU Norway● NTU Singapore● CVUT Prag● UCSB California● Ben Gurion, Israel● etc

Number Quiz

How many active recommenders?

Number Quiz

How many active recommenders?

31

Number Quiz

How many recommendations being delivered?

Number Quiz

How many recommendations being delivered?

571,744,114

Number Quiz

How many clicks being delivered?

Number Quiz

How many clicks being delivered?

764,181

Next steps

● dataset license○ original one: free for use in correlation with challenge○ new one: tba

● reproducability○ reference algorithms?

● questionlist / FAQ

Winners

1. recommenders.netwinner of an ipad

2. inbeatwinner of a nexus 7

3. i2rwinner of a raspberry pi

Questions