Movie vs movie

download Movie vs movie

of 213

  • date post

    13-Jan-2015
  • Category

    Technology

  • view

    804
  • download

    0

Embed Size (px)

description

What are your top ten favorite movies of all time? This is a very difficult question. But why? Irmak Sirer explains the challenges of measuring how much we like movies, books, songs, or products; combining insights from diverse sources like the Netflix Prize, Duncan Watts' social experiments, or the beginnings of Facebook. The better we get at measuring and ranking levels of enjoyment, the better we can customize websites, sort search results, find other people with similar tastes, and recommend products, so can we overcome these challenges? Drumroll... Yes, we can.

Transcript of Movie vs movie

  • 1. Irmak Sirermovievsmovie.datasco.pe

2. Howmuch dowelike things? 3. AGE 7 Oh cool. Pretty good. Space and stuff. 4. AGE 14 Omigod Omigod Omigod. Epic masterpiece is epic!!!!1! I'm in love with Leia. 5. AGE 17 WTF? 6. AGE 30 When you think about it, it's not that good. 7. AGE 30 When you think about it, it's not that good. Ah, who am I kidding? It's amazing. I'm still in love with Leia. 8. I mean... look at her. 9. What determines how much I like a movie? 10. What determines how much I like a movie?Is my reaction to a movie / book / song predictable? 11. How much will I like The Book of Eli? 12. 2006 Cinematch1 billion user ratings55,000 movies 13. Cinematch I have a soulmate in tasteIrmak 14. Cinematch I have a soulmate in tasteIrmakFrrmack 15. Cinematch I have a soulmate in taste Watched the same moviesIrmakFrrmack 16. Cinematch I have a soulmate in taste Watched the same movies Gave the exact same ratingsIrmakFrrmack 17. Cinematch I have a soulmate in taste Watched the same movies Gave the exact same ratings Except The Book of EliIrmakFrrmack 18. Cinematch I have a soulmate in tasteFrrmack watched The Book of EliIrmakFrrmack 19. Cinematch I have a soulmate in tasteOh man, it wasIrmakFrrmack 20. Cinematch I have a soulmate in tasteOh man, it was FANTASTIC!IrmakFrrmack 21. Cinematch I have a soulmate in tasteOh man, it was FANTASTIC! PredictIrmakFrrmack 22. No perfect soulmates in real lifeIrmak 23. No perfect soulmates in real lifeAlmost soulmate 1Irmak 24. No perfect soulmates in real lifeAlmost soulmate 1IrmakAlmost soulmate 2 25. No perfect soulmates in real lifeAlmost soulmate 1IrmakAlmost soulmate 3Almost soulmate 2 26. No perfect soulmates in real lifeAlmost soulmate 1IrmakAlmost soulmate 2Almost soulmate 3Almost soulmate 4 27. No perfect soulmates in real life87% soulmateIrmak74% soulmate82% soulmate95% soulmate 28. No perfect soulmates in real lifeIrmak 29. No perfect soulmates in real lifeIrmak 30. Cinematch Works well for movies that everybody rates 31. Cinematch Quite bad with movies that only few people rate 32. Cinematch Some movies are especially difficult to predict Biggest error source: popular but weird15% of all errors from ONE movie 33. Trivial: Mean score of everyone 34. Trivial: Mean score of everyone Error: (RMSE)1.0540 stars 35. Trivial: Mean score of everyone Error: (RMSE)1.0540 starsCinematch Error: (RMSE)0.9525 stars 36. Trivial: Mean score of everyone Error: (RMSE)1.0540 stars 9.6%Cinematch Error: (RMSE)0.9525 stars 37. Trivial: Mean score of everyone Error: (RMSE)1.0540 stars 9.6%Cinematch Error: (RMSE)0.9525 starsBetter rankings Better recommendations 38. Trivial: Mean score of everyone Error: (RMSE)1.0540 stars 9.6%Cinematch Error: (RMSE)0.9525 starsBetter rankings Better recommendations + 8.6% + 1200% people watch top recommendationBigChaos Netflix Prize Report 39. Cinematch Error:0.9525 stars 40. Cinematch Error:0.9525 stars$1,000,000 for a 10% improvement2006 41. Cinematch Error:0.9525 starsBring it down to: Error:0.8563 stars $1,000,000 for a 10% improvement2006 42. BellKors Pragmatic Chaos 43. How did they do it? 44. How did they do it? 45. How did they do it? Before: Solid assumptions You have a certain taste. Your taste dictates a hidden rating for Book of Eli. When you watch it, this rating is revealed to you. 46. How did they do it? Before: Solid assumptionsG N O R WYou have a certain taste.Your taste dictates a hidden rating for Book of Eli. When you watch it, this rating is revealed to you. 47. How did they do it? After: Your rating changes with time. 48. How did they do it? After: Your rating changes with time. It depends on... 49. How did they do it? After: Your rating changes with time. It depends on... how many you rated that day your average rating for the day which movies you rated on this day shown Netflix prediction 50. Trivial: Mean score of everyone Error:1.0540 starsCinematch Error:0.9525 starsY. Koren, The BellKor Solution to the Netflix Grand Prize. 2009 51. Trivial: Mean score of everyone Error:1.0540 starsCinematch Error:0.9525 starsYour time dependent rating tendenciesY. Koren, The BellKor Solution to the Netflix Grand Prize. 2009 52. Trivial: Mean score of everyone Error:1.0540 starsCinematch Error:0.9525 starsYour time dependent rating tendencies Error: 0.9278 starsY. Koren, The BellKor Solution to the Netflix Grand Prize. 2009 53. Trivial: Mean score of everyone Error:1.0540 starsCinematch Error:0.9525 stars 12.0%Your time dependent rating tendencies Error: 0.9278 starsY. Koren, The BellKor Solution to the Netflix Grand Prize. 2009 54. Trivial: Mean score of everyone Error:1.0540 starsCinematch Error:0.9525 stars 12.0%Your time dependent rating tendencies Error: 0.9278 stars without looking at which movies you like/hate! Y. Koren, The BellKor Solution to the Netflix Grand Prize. 2009 55. What does this suggest? 56. What does this suggest? We cannot compare a movie with all others we've seen. 57. What does this suggest? We cannot compare a movie with all others we've seen. We compare it to a limited set. 58. What does this suggest? We cannot compare a movie with all others we've seen. We compare it to a limited set. Liking (real time & remembered) depends on time and mood. 59. What does this suggest? We cannot compare a movie with all others we've seen. We compare it to a limited set. Liking (real time & remembered) depends on time and mood. Other people's opinions affect our own (followers / hipsters) 60. What does this suggest? We cannot compare Book of Eli with all movies we've seen. We compare it to a limited set. Liking (real time & remembered) depends on time and mood. Other people's opinions affect our own (followers / hipsters) 61. An experiment Music Lab: A website for downloading music 62. An experiment Same website: Music download and ratingM.J. Salganik, P.S. Dodds, D.J. Watts. Science, 311:854-856, 2006 63. An experiment Music Lab: A website for downloading music Alternative A: Other people's ratings invisible 64. An experiment Music Lab: A website for downloading music Alternative A: Other people's ratings invisibleMore or less equal ratings 65. An experiment Music Lab: A website for downloading music Alternative A: Other people's ratings invisibleAlternative B: All ratings visibleMore or less equal ratings 66. An experiment Music Lab: A website for downloading music Alternative A: Other people's ratings invisibleAlternative B: All ratings visibleMore or less equal ratingsSeveral songs snowball in popularity 67. An experiment Music Lab: A website for downloading music Alternative A: Other people's ratings invisibleAlternative B: All ratings visibleMore or less equal ratingsSeveral songs snowball in popularity It's different songs for each trial 68. Social influence plays a big part in determining hits and misses 69. Problems with rating movies We cannot compare a movie with all others we've seen. We compare it to a limited set. Liking (real time & remembered) depends on time and mood. Other people's opinions affect our own. 70. Degree of liking is sensitive and vagueAmazing!Tuesday 3amTotal garbageSunday 12pm 71. Degree of liking is sensitive and vagueLiking (real time & remembered) depends on time and mood. Other people's opinions affect our own. 72. Degree of liking is sensitive and vagueDependent on many other environmental factors besides our taste 73. Degree of liking is sensitive and vague We cannot compare a movie with all others we've seen. We compare it to a limited set. 74. Degree of liking is sensitive and vagueDifficult to describe accurately and consistently with a number 75. Predicting aside, can I even reliably rate & rank movies Ive seen in terms of enjoyment? 76. What are your top twenty movies?IrmakFrrmack 77. What are your top twenty movies?Well UmmmIrmakFrrmack 78. What are your top twenty movies?Well Ummm I like Star Wars.IrmakFrrmack 79. Degree of liking is sensitive and vagueCant we do something about this? 80. Degree of liking is sensitive and vague 81. Enjoyment from a movie is very high dimensional information 82. Enjoyment from a movie is very high dimensional informationRating means projecting this onto a single dimension 83. ? 84. But sometimes you just want to do the best projection you canWhat is my top twenty? 85. Degree of liking is sensitive and vague We cannot compare a movie with all others we've seen. We compare it to a limited set. 86. Trying to rate Star Wars 87. Trying to rate Star Wars 88. Trying to rate Star Wars 1 Map enjoyment to a specific scale 89. Trying to rate Star Wars 1 Map enjoyment to a specific scale 90. Trying to rate Star Wars 1 Map enjoyment to a specific scale 91. Trying to rate Star Wars 2 rating ose corresponding cho king for this degree of li 92. Trying to rate Star Wars But we cannot keep this entire history of enjoyment in mind 93. Trying to rate Star Wars But we cannot keep this entire history of enjoyment in mind We fuzzily remember a small subset 94. Trying to rate Star Wars But we cannot keep this entire history of enjoyment in mind We fuzzily remember a small subset We map based on this subset 95. Trying to rate Star Wars But we cannot keep this entire history of enjoyment in mind We fuzzily remember a small subset We map based on this subset 96. SAMPLING 97. BIASED SAMPLING 98. Tuesday 99. Tuesday 100. Friday 101. Friday 102. Degree of liking is sensitive and vagueCant we do something about this? 103. We can certainly handle single comparisons? 104. We can certainly handle single comparisons 105. We can certainly handle single comparisonsless vague 106. We can certainly handle single comparisonslittle information 107. I can manually compare it with all others 108. And find exactly where it belongsJo n e righ