Search & Recommendation: Birds of a Feather?
-
Upload
toine-bogers -
Category
Technology
-
view
315 -
download
2
description
Transcript of Search & Recommendation: Birds of a Feather?
![Page 1: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/1.jpg)
Search & Recommendation: Birds of a Feather?
Toine Bogers
Aalborg University CopenhagenCopenhagen, Denmark
‘Mind the Gap ’14’ workshop @ iConference 2014, BerlinMarch 4, 2014
![Page 2: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/2.jpg)
Outline
• Introduction
• Search vs. recommendation
- Use case
- Algorithms & evaluation
- Trends
• Conclusions
2
![Page 3: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/3.jpg)
3
![Page 4: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/4.jpg)
Success of search engines
• Search engines have had a huge impact on the information economy
- Academia
‣ Vibrant & growing research community with many dedicated conferences and journals
‣ Evaluation initiatives like TREC were shown to have a great impact on the performance of Web search engines
- Industry
‣ Google → ~13 billion USD in profit in 2013
4
![Page 5: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/5.jpg)
Amazon.com
![Page 6: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/6.jpg)
Success of recommender systems
• Recommender systems have seen a meteoric rise to success in past two decades
- Academia
‣ From specialized workshops to dedicated conference and journals
- Industry
‣ Amazon → 35% sales from recommendations
‣ Netflix → 75% of what its users watch comes from recommendations
‣ Google News → recommendations generate 38% more click-through
6
![Page 7: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/7.jpg)
Different perspectives?
• Search and recommendation are commonly treated as different (but related) research areas
• Search perspective → recommendation is a special type of search problem
- Smaller research community with few dedicated venues
- Dedicated sessions at major IR conferences
• Recommendation perspective → field of its own
- Rapidly growing research community with s
- Strong industry support
- Separate data sets, experimental protocol, and evaluation 7
![Page 8: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/8.jpg)
....but are they really that different?
• Looking at search and recommendation in isolation can be counter-productive in many situations!
• Three aspects of where both fields are (growing) close(r)
- Use cases
- Algorithms & evaluation
- Trends
8
![Page 9: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/9.jpg)
Use cases
![Page 10: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/10.jpg)
Comparing use cases
• What are the characteristics of the information access paradigms?
- What problem are they trying to solve?
- What do we know about what the user wants?
- What do we know about the user?
- How do we know we have solved the user’s problem?
10
![Page 11: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/11.jpg)
Comparing definitions
11
“A recommender system is software that provides suggestions
to users on which items could be of use to them.”— Ricci et al. (2011)
“Information retrieval (IR) is finding material of an
unstructured nature that satisfies an information
need from within large collections.”— Manning et al. (2008)
![Page 12: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/12.jpg)
Search characteristics
• Information need
- Explicit representation of user’s information need as a query (and occasionally a description or narrative)
‣ Typically at Taylor’s last two stages
• Knowledge about the user
- User characteristics traditionally abstracted away
- More focus on the user in recent years (e.g., search history)
12
Taylor’s four stages 1. Visceral2. Conscious3. Formalized4. Compromised
![Page 13: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/13.jpg)
Search characteristics
• Matching criteria
- Relevance
‣ Assessment of perceived topicality, pertinence, usefulness or utility of an information source by an actor or algorithm with reference to a task at a given point in time
- Relevance is a multi-dimensional concept → many different flavors!
‣ Topical relevance most common interpretation
‣ Textual similarity used as a proxy for topical relevance
- See Borlund (2003) for a comprehensive overview of relevance in IR
13
Saracevic’s categories• Algorithmic relevance • Topical relevance• Temporal relevance• Situational relevance
![Page 14: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/14.jpg)
Recommendation characteristics
• Information need
- Implicit representation of user’s information need as a the user’s profile
‣ Typically at Taylor’s first two stages
• Knowledge about the user
- User profile representing the user’s interests
- Usage patterns, past interactions with the system, requirements
• Matching criteria
- Interest / Usefulness14
Taylor’s four stages 1. Visceral2. Conscious3. Formalized4. Compromised
![Page 15: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/15.jpg)
15User profile
No user profile
Explicit need
Implicit needWeb search
Classic IRPopularity-
based methods
Information filtering
Recommendation ?
Browsing
![Page 16: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/16.jpg)
Search & recommendation form a continuum
16
Search
• Search (“Show me all books about X”)
• Focused recommendation (“Show me interesting books about X!”)
• Recommendation (“Show me interesting books!”)
Recommendation Focused recommendation
![Page 17: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/17.jpg)
LibraryThing forum topic
![Page 18: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/18.jpg)
How prevalent is focused recommendation?
• Is there evidence for such a continuum?
- Search engines see millions of pure search requests every day
- Netflix and Amazon profit immensely from pure recommendation scenarios
- But how prevalent are these focused recommendation requests?
• Possible explanations for underrepresentation
- Perhaps we are looking in the wrong places?
- Interfaces offer little support for entering complex requests
18
![Page 19: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/19.jpg)
INEX Social Book Search track
• Track running at INEX from 2011-2014 on book search
- Amazon/LibraryThing collection
‣ 2.8 million book metadata records
‣ Mix of metadata from Amazon, Librarything, Library of Congress, and British Library
- Realistic book requests & information needs from LibraryThing fora
‣ Highly varied set of requests that touch upon topics, genres, authors, engagment, reading level, personal preferences, etc.
19
![Page 20: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/20.jpg)
Annotated LT topic
20
Group name
Topic title
Narrative
Recommended books
![Page 21: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/21.jpg)
INEX Social Book Search track
• Track running at INEX from 2011-2014 on book search
- Amazon/LibraryThing collection
‣ 2.8 million book metadata records
‣ Mix of metadata from Amazon, Librarything, Library of Congress, and British Library
- Realistic book requests & information needs from LibraryThing fora
‣ Highly varied set of requests that touch upon topics, genres, authors, engagment, reading level, personal preferences, etc.
‣ Collected & annotated 944 book requests from the LibraryThing fora
- Relevance judgments
‣ Member suggestions (Suggestions made by other Librarything members)
‣ Reading behavior (Has the original requester added any suggestions afterwards?)21
![Page 22: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/22.jpg)
• Eight LIS students annotated all requests on relevance aspects
Relevance aspects %
Accessibility 16
Content 74
Engagement 23
Familiarity 36
Known-item 21
Metadata 28
Novelty 4
Socio-cultural 14
Relevance aspects of book requests
220 10 20 30 40 50 60 70 80
![Page 23: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/23.jpg)
Continuum of search & recommendation
• How common are the different types of information needs?
23
Familiarity No familiarity
ContentFocused
recommendation(260 requests)
Search(338 topics)
No content Recommendation(66 topics)
Context(78 topics)
Sign up at https://inex.mmci.uni-saarland.de/tracks/books/!
![Page 24: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/24.jpg)
Not just true for the book domain!
24
![Page 25: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/25.jpg)
What’s next?
• Focused recommendation deserves more attention!
- Combines aspects of search and recommendation
• Open questions
- How can we best address focused recommendation requests?
‣ Likely to require a combination of both search and recommendation approaches
‣ Early indications from INEX track that a combination indeed works best
- How can we support expressing these complex needs through the UI?
25
![Page 26: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/26.jpg)
Algorithms & evaluation
![Page 27: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/27.jpg)
Algorithms & evaluation
• Past decade has seen combination & mutual inspiration
- Both fields have borrowed techniques & metrics from each other
- Dedicated workshops & events
‣ CARR 2011-2014
‣ BARR 2013
‣ Mind The Gap 2014
27
![Page 28: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/28.jpg)
Recommender systems → IR
• Collaborative filtering
- Automates the process of word-of-mouth recommendations by looking for unseen items among other users with similar interests
• Used in IR for
- Collaborative search
‣ I-SPY search engine by Smyth et al. (2004)
- Query suggestion
- Improving 'More like this' functionality
28
![Page 29: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/29.jpg)
IR → Recommender systems
• Recommender systems has borrowed from many different fields
- Artificial Intelligence (ML, CBR), IR, Natural Language Processing
• Inspiration from IR
- Algorithms
‣ TF·IDF weighting scheme for CF (Breese et al., 1998)
‣ Query expansion for recommender systems (Formosa et al., 2013)
‣ Probability ranking principle in recommender systems (Wang et al., 2006)
‣ Language modeling for recommender systems (Bellojin et al., 2013)
- Evaluation
‣ Increasing use of nDCG (and MAP) as metrics for ranked list recommendation
29
![Page 30: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/30.jpg)
Trends
![Page 31: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/31.jpg)
Context
• Incorporating contextual information into the search/recommendation process
• Search
- IRiX workshop (2004-2005)
- CARR workshop (2011-2014)
- TREC Contextual Suggestion (2012-2013)
• Recommendation
- CARS workshop (2009-2012)
- CAMRA workshop (2010-2011)
- CARR workshop (2011-2014)31
![Page 32: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/32.jpg)
Diversity
• Ensuring a diverse range of relevant results/recommendations
• Search
- IDR workshop (2009)
- DDR workshop (2011-2012)
- Many publications addressing diversity in search results
• Recommendation
- DiveRS workshop (2011)
- Many publications addressing diversity in recommender systems
32
![Page 33: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/33.jpg)
Privacy
• Protecting user privacy when generating results/recommendations or releasing data sets
- Hot topic in the aftermath of release of AOL and Netflix data sets
- Many papers on how to (de-)anonymize of recommendation data sets and search logs
• Search
- PIR workshop (2014)
• Recommendation
- RESSON workshop (2013)
33
![Page 34: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/34.jpg)
Conclusions
![Page 35: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/35.jpg)
Conclusions
• Search & recommendation form an information access continuum
- Pure search & recommendation needs are addressed well by the respective research fields
- But many other information needs fall through the cracks!
‣ Need to look at the whole range of information needs
‣ Both in terms of algorithms and interface design
• Search & recommendation are already moving closer together
- Exchange of algorithms & techniques
- Shared evaluation metrics
- Similar research trends
• A continuum of requests requires a continuum of solutions! 35
![Page 36: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/36.jpg)
Questions? Comments? Suggestions?
36
![Page 37: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/37.jpg)
Backup slides
37
![Page 38: Search & Recommendation: Birds of a Feather?](https://reader034.fdocuments.in/reader034/viewer/2022051818/54b817964a795955308b4876/html5/thumbnails/38.jpg)
Example requests
38
CONTEXT REQUESTI've just finished my undergraduate work, and as I float into the real world, I find myself missing books--and recommendations for books--in a serious way. So, those of you in a similar state (and those of you who simply love reading, and sharing): have any books that you find essential for living? I'll post what I've been reading, and you can as well...I'm especially interested in books that are a little older, a little less known, and more prone to flying under the radar. I read almost everything as well, a sentiment I'm sure most of you are familiar with.
SEARCH REQUESTlooking for heroine oriented love triangle romances, any recommendations appreciated.
RECOMMENDATION REQUESTJust read and reviewed Moon in the Water: Reflections on an Aging Parent. I wonder if other early readers have recommendations for similar pieces...this makes me want to go back and read The Summer of the Great-Grandmother by Madeline L'Engle. I glossed through it the first time, but now that I am closer to that stage of life I wonder if it will have more meaning.