Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April...
Transcript of Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April...
![Page 1: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/1.jpg)
Collaborative Filtering
Presentation by Alex Hugger
![Page 2: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/2.jpg)
Filtering Documents
Mittwoch, 28. April 2010 2Departement/Institut/Gruppe
![Page 3: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/3.jpg)
Content-Based Methods
� Find other popular items by the same author or similar keywords
� Recommendation quality is relatively poor
Mittwoch, 28. April 2010 3
![Page 4: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/4.jpg)
Filtering Music
Mittwoch, 28. April 2010 4
![Page 5: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/5.jpg)
Filtering Jokes
Mittwoch, 28. April 2010 5
www.xkcd.org
![Page 6: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/6.jpg)
Filtering Jokes
� Let the users rate the jokes� Sort by average rating
Mittwoch, 28. April 2010 6
![Page 7: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/7.jpg)
Collaborative Filtering
� People who have agreed in the past tend to agree in the future
Mittwoch, 28. April 2010 7
![Page 8: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/8.jpg)
Good or Bad?
Mittwoch, 28. April 2010 8
Die Hard (1988) Dirty Dancing (1987)
![Page 9: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/9.jpg)
Good or Bad?
Mittwoch, 28. April 2010 9
![Page 10: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/10.jpg)
Mittwoch, 28. April 2010 10
![Page 11: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/11.jpg)
Jester 4.0 (http://eigentaste.berkeley.edu)
Mittwoch, 28. April 2010 11
![Page 12: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/12.jpg)
MovieLens (http://movielens.org)
Mittwoch, 28. April 2010 12
![Page 13: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/13.jpg)
Netflix
� www.netflix.org� DVD/Blue-Ray rental and video streaming� 1’000’000$ for the first beating the current recommendation
algorithm by 10%
� Competition started in October 2006� Ended July 2009
Mittwoch, 28. April 2010 13
![Page 14: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/14.jpg)
GroupLens: An Open Architecture for Collaborative Filtering of NetNews
Research paper from 1994 by:� Paul Resnick, MIT Center for Coordination Science� Neophytos Iacovou, University of Minnesota� Neophytos Iacovou, University of Minnesota� Mitesh Suchak, MIT Center for Coordination Science� Peter Bergstrom , University of Minnesota� John Riedl , University of Minnesota
Mittwoch, 28. April 2010 14
![Page 15: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/15.jpg)
NetNews
Mittwoch, 28. April 2010 15
![Page 16: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/16.jpg)
Problems of NetNews
Signal to noise ratio is too low
� Splitting bulletin board into newsgroups� Moderated newsgroups� News clients
� Summary of the author and subject line� Display discussion threads together� String search facilities� Kill files
Mittwoch, 28. April 2010 16
![Page 17: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/17.jpg)
Modification to NetNews
Mittwoch, 28. April 2010 17Mittwoch, 28. April 2010 17
3.72
2.61
![Page 18: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/18.jpg)
Predicting Scores
� Score prediction system is robust to certain differences of interpretation of the rating scale� One user rates 3-5 and the other 1-3� One thinks 1 and the other 5 is best score
Mittwoch, 28. April 2010 18
![Page 19: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/19.jpg)
Predicting Scores
� Predictions can be modeled as matrix filling
Item # Ken Lee Meg Nan
1 1 4 2 2
Mittwoch, 28. April 2010 19
1 1 4 2 2
2 5 2 4 4
3 3
4 2 5 5
5 4 1 1
6 ? 2 5
![Page 20: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/20.jpg)
Predicting Scores
� Assign similarities to each of the other people� Compute over articles rated by both� Pearson Correlation Coefficients
� Between -1 and 1
Mittwoch, 28. April 2010 20
LeeKen
LeeKen
LeeKenLeeKen
)])([(),cov(
σσµµ
σσ ⋅−−=
⋅=−
LKELKr
Kenσ = standard deviation of Ken
Kenµ = average of Ken’s ratings
![Page 21: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/21.jpg)
Predicting Scores
� Correlation Coefficients of Ken
User Correlation
Lee -0.8
# Ken Lee Meg Nan
1 1 4 2 2
Mittwoch, 28. April 2010 21
Lee -0.8
Meg +1
Nan 0
1 1 4 2 2
2 5 2 4 4
3 3
4 2 5 5
5 4 1 1
6 ? 2 5
![Page 22: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/22.jpg)
Predicting Scores
� Weighted average of all ratings on article 6� Ken’s prediction is 4.56
( )∑ ⋅− rJ µ
Mittwoch, 28. April 2010 22
( )
∑
∑
∈−
∈−⋅−
+=
RatersKen
RatersKen6
6Prediction
JJ
JJJ
K r
rJK
µµ
![Page 23: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/23.jpg)
Scaling Issues
� Relevant performance measures� Prediction quality� Compute time and disk storage
� Rating is small, but each article may be rated by many � Rating is small, but each article may be rated by many users
� Volume of ratings could exceed volume of news
Mittwoch, 28. April 2010 23
![Page 24: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/24.jpg)
Scaling Issues
� Pre-fetching ratings and pre-computing predictions keeps user time constant
� High computation complexity
� Volume of all ratings may exceed the storage capacity� 100’000 users rate 10 articles per day. 100 bytes are required to
store a rating. 1GB of storage required per 10 days.
Mittwoch, 28. April 2010 24
![Page 25: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/25.jpg)
Cluster Models
Mittwoch, 28. April 2010 25
![Page 26: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/26.jpg)
Cluster Models
� Better online scalability and performance than classical collaborative filtering
� Complex and extensive clustering is run offline
� Prediction quality gets reduced
Mittwoch, 28. April 2010 26
![Page 27: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/27.jpg)
Item-to-Item Collaborative Filtering
Mittwoch, 28. April 2010 27
![Page 28: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/28.jpg)
Item-to-Item Collaborative Filtering
� Amazon.com extensively uses recommendation algorithms� 10’000’000 products and customers
� Result returned in real-time (< 0.5s)� Algorithm must respond immediately to new information
Mittwoch, 28. April 2010 28
![Page 29: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/29.jpg)
Amazon.com
Mittwoch, 28. April 2010 29
![Page 30: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/30.jpg)
Amazon.com
Mittwoch, 28. April 2010 30
![Page 31: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/31.jpg)
Amazon.com
Mittwoch, 28. April 2010 31
![Page 32: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/32.jpg)
Amazon.com
Mittwoch, 28. April 2010 32
![Page 33: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/33.jpg)
How It Works - Offline
� Similar-items table� Calculating similarity between a single product and all
related products� Complexity: O(mn2) - in practice: O(mn)
� m: number of users� m: number of users
� n: number of items
Mittwoch, 28. April 2010 33
![Page 34: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/34.jpg)
How It Works - Online
� Given a similar-items table� Find all similar items to each of the users ratings and
purchases� Aggregate those items� Recommend most popular and correlated items� Number of users has no effect on performance
Mittwoch, 28. April 2010 34
![Page 35: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/35.jpg)
General difficulties
� Cold start� Self-fulfilling prophecy� Recommendations for groups� Evaluation of recommendation systems� Evaluation of recommendation systems
Mittwoch, 28. April 2010 35
![Page 36: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/36.jpg)
Conclusion
� Effective form of targeted marketing
� Mostly used in e-commerce business� Mostly used in e-commerce business� But can always be used when signal to noise ratio is too low
Mittwoch, 28. April 2010 36
![Page 37: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/37.jpg)
Questions?
Mittwoch, 28. April 2010 37
![Page 38: Presentation by Alex Hugger - DISCO Correlation Coefficients Between -1 and 1 Mittwoch, 28. April 2010 20 Ken Lee Ken Lee Ken Lee Ken Lee ... Mostly used in e -commerce business](https://reader031.fdocuments.in/reader031/viewer/2022030422/5aaa37e47f8b9a81188db0ee/html5/thumbnails/38.jpg)
References
� GroupLens: An Open Architecture for Collaborative Filtering of NetNews
� Published 1994
� Paul Resnick, MIT Center for Coordination Science� Neophytos Iacovou, University of Minnesota� Neophytos Iacovou, University of Minnesota� Mitesh Suchak, MIT Center for Coordination Science� Peter Bergstrom , University of Minnesota� John Riedl , University of Minnesota
� Amazon.com Recommendations� Published 2003
� Greg Linden� Brent Smith� Jeremy York
Mittwoch, 28. April 2010 38