Recommender Systems in 2012

30
acm recsys 2012: recommender systems, today @neal_lathia

description

Talk at Data Science London Meetup on Recommender Systems

Transcript of Recommender Systems in 2012

Page 1: Recommender Systems in 2012

acm recsys 2012:recommender systems, today@neal_lathia

Page 2: Recommender Systems in 2012

warning:daunting task

lookout for twitter handles

Page 3: Recommender Systems in 2012

why #recsys?information overload

mailing lists; usenet news (1992)

see: @jkonstan, @presnick

Page 4: Recommender Systems in 2012

why #recsys?information overload

filter failure

movies; books; music (~1995)

Page 5: Recommender Systems in 2012

why #recsys?information overload

filter failurecreating value

advertising; engagement; connection (today)

Page 6: Recommender Systems in 2012

@dtunkelang

Page 7: Recommender Systems in 2012

(1) collaborative“based on the premise that people looking for

information should be able to make use of what others have already found and evaluated”

(maltz & ehrlick)

Page 8: Recommender Systems in 2012

(2) query-less“in September 2010 Schmidt said that one day the

combination of cloud computing and mobile phones would allow Google to pass on

information to users without them even typing in search queries”

Page 9: Recommender Systems in 2012

(3) discovery engines“we are leaving the age of information and

entering the age of recommendation”(anderson)

Page 10: Recommender Systems in 2012
Page 11: Recommender Systems in 2012
Page 12: Recommender Systems in 2012

input: ratings, clicks, viewsusers → items

process: SVD, kNN, RBM, etc.f(user, item) → prediction ~ rating

output: prediction-ranked recommendations

measure:|prediction – rating|(prediction – rating)2

Page 13: Recommender Systems in 2012

traditional problems

accuracy, scalability, distributed computation, similarity, cold-start, …

(don't reinvent the wheel)

Page 14: Recommender Systems in 2012

acm recsys 2012:5 open problems

Page 15: Recommender Systems in 2012

problem 1: predictions

temporality, multiple co-occurring objectives: diversity, novelty, freshness, serendipity,

explainability

Page 16: Recommender Systems in 2012
Page 17: Recommender Systems in 2012

problem 2: algorithms

more algorithms vs. more datavs. more rating effort

Page 18: Recommender Systems in 2012

what is your algorithm doing?f(user, item) → R

f(user, item1, item

2) → R

f(user, [item1...item

n]) → R

e.g., @alexk_z@abellogin

Page 19: Recommender Systems in 2012

problem 3: users + ratings

signals, context, groups, intents, interfaces

Page 20: Recommender Systems in 2012

@xamat

Page 21: Recommender Systems in 2012

problem 4: items

lifestyle, behaviours, decisions, processes, software development

Page 22: Recommender Systems in 2012

@presnick

Page 23: Recommender Systems in 2012

problem 5: measurement

ranking metrics vs. usability testingvs. A/B testing

Page 24: Recommender Systems in 2012

Online Controlled Experiments: Introduction, Learnings, and Humbling Statisticshttp://www.exp-platform.com/Pages/2012RecSys.aspx

Page 25: Recommender Systems in 2012

3 key lessons

Page 26: Recommender Systems in 2012

lesson 1: #recsys is an ensemble...of disciplines

statistics, machine learning,human-computer interaction,

social network analysis,psychology

Page 27: Recommender Systems in 2012

lesson 2: return to the domain

user effort, generative models,cost of a freakommendation,

value you seek to create

Page 28: Recommender Systems in 2012

@plamere

Page 29: Recommender Systems in 2012

lesson 3: join the #recsys community

learn, build, research, deploy:@MyMediaLite, @LensKitRS

@zenogantner, @elehack

contribute, read:#recsyswiki, @alansaid

Page 30: Recommender Systems in 2012

recommender systems, today@neal_lathia