Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social...
Transcript of Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social...
![Page 1: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/1.jpg)
Natural Search User Interfaces
Prof. Marti Hearst UC Berkeley
March/April , 2012
Book full text freely available at: http://searchuserinterfaces.com
![Page 2: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/2.jpg)
What works well in search now?
![Page 3: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/3.jpg)
3
Faceted Navigation
![Page 4: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/4.jpg)
4
Real-Time Suggestions
http://www.imamuseum.org/ http://netflix.com
![Page 5: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/5.jpg)
Forecasting the Future
First: What are the larger trends?
In technology? In society?
Next: Project out from these.
![Page 6: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/6.jpg)
6
Preferences for Audio / Video / Touch
Preferences for Social Interaction
Preferences for Natural Language
Statistical Analysis of Enormous Collections Of Behavioral and Other Data
Advances in UI Design
Wide adoption of social media & user-generated content
“Natural” Interfaces
![Page 7: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/7.jpg)
Trend: More Natural Queries
![Page 8: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/8.jpg)
8
Trend: Longer, more natural queries
§ The research suggests people prefer to state their information need rather than use keywords. § But after first using a search engine they quickly learned that
full questions resulted in failure.
![Page 9: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/9.jpg)
9
Trend: Longer, more natural queries
§ The research suggests people prefer to state their information need rather than use keywords. § But after first using a search engine they quickly learned that
full questions resulted in failure.
§ Average query length continues to increase § In 2010 vs 2009, searches of 5-8 words were up 10%, while 1-2
word searches were down.
![Page 10: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/10.jpg)
10
Trend: Longer, more natural queries
§ Social Question Answering Sites:
§ Information worded as questions increasing available § with the questions that the audience really wants the
answers to, and
§ written in the language the audience wants to use.
§ AND with advanced user interface design.
![Page 11: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/11.jpg)
11
Long Queries Aided by Advanced User Interface Design
![Page 12: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/12.jpg)
12
A recent example: keywords failed
![Page 13: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/13.jpg)
13
Reworded as I would have said it:
![Page 14: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/14.jpg)
14
Got an answer!
![Page 15: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/15.jpg)
15
Trend: More Natural Queries
§ Blend two ideas:
§ “sloppy commands”
§ predictions based on user behavior data
§ This is subtly and steadily increasing in sophistication across many interfaces
![Page 16: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/16.jpg)
16
Sloppy Commands + Rich Data
![Page 17: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/17.jpg)
17
Sloppy Commands + Rich Data
![Page 18: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/18.jpg)
18
Sloppy Commands + Rich Data
![Page 19: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/19.jpg)
19
![Page 20: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/20.jpg)
http://www.flickr.com/photos/malingering/272277668/sizes/m/in/photostream/
Trend: Spoken Input
![Page 21: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/21.jpg)
21
Why Spoken Input?
§ Phone-based devices widely used § Naturally accepts spoken input
§ Difficult to type on
§ Touch screen interaction increasingly popular § Also difficult to type on
§ Speech recognition technology is improving § Huge volumes of training data is now available
§ What are the impediments?
![Page 22: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/22.jpg)
22
We need a “cone of silence”
![Page 23: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/23.jpg)
23
Alternative text entry
swype.com Gesture search, Li 2010
![Page 24: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/24.jpg)
24
Speaking leads to conversation
§ Dialogue is a long-time dream of AI
§ We’re getting closer with a combination of § Massive behavioral data
§ Intense machine learning research
§ Advanced user interface design
§ Real-time contextual information
![Page 25: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/25.jpg)
25
No Longer a Future Trend: Dialogue
§ SIRI came out of the DARPA CALO project
![Page 26: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/26.jpg)
26
![Page 27: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/27.jpg)
27
Novels Movies
Textbooks Video lectures
Web news text Web news videos
Marketing text Marketing podcosts
Screenshot tutorials Video tutorials
Cultural Preferences
![Page 28: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/28.jpg)
28
![Page 29: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/29.jpg)
Trend: Social Search
People are Social; Computers are Lonely.
Don’t Personalize Search, Socialize it!
![Page 30: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/30.jpg)
30
Social Search
Implicit: Suggestions generated as a side-effect of search activity.
Asking: Communicating directly with others.
Collaborative: Working with other people on a search task.
Explicit: knowledge accumulating via the deliberate contributions of many.
![Page 31: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/31.jpg)
31
Social Search: Explicit Recommendations
§ “Crowdsourcing” for explicit recommendations § Previous generation
§ Digg, StumbleUpon
§ Delicious, Furl
§ Google’s SearchWiki (now defunct)
§ Open Directory
§ Current happenings § Blekko
§ Localmind
§ Google Social
![Page 32: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/32.jpg)
32
![Page 33: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/33.jpg)
33
Social Search: Seeing what people you know have seen § Yahoo MyWeb, circa 2006
![Page 34: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/34.jpg)
34
Google’s Social Search, 2012
![Page 35: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/35.jpg)
35
Social Search: Asking for Answers What do people ask of their social networks?
Type % Example
Recommendation 29%
Building a new playlist – any ideas for good running songs?
Opinion 22%
I am wondering if I should buy the Kitchen-Aid ice cream maker?
Factual 17%
Anyone know a way to put Excel charts into LaTeX?
Rhetorical 14%
Why are men so stupid?
Invitation 9% Who wants to go to Navya Lounge this evening?
Favor 4% Need a babysitter in a big way tonight… anyone??
Social connection 3% I am hiring in my team. Do you know anyone who would be interested?
Offer 1% Could any of my friends use boys size 4 jeans?
Morris et al., CHI 2010
![Page 36: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/36.jpg)
36
Context-Aware Mobile Search
http://www.localmind.com/
![Page 37: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/37.jpg)
37
Social Search: People Collaborating
Pickens et al., SIGIR 2008
![Page 38: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/38.jpg)
38
Social Search: People Collaborating
Pickens et al., SIGIR 2008
![Page 39: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/39.jpg)
39
Social Search: People Collaborating
Jetter et al., CHI 2011
![Page 40: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/40.jpg)
40
Social Search: Asking for Answers Asking experts in a social network
Richardson and White, WWW 2011
![Page 41: Natural Search User Interfacespeople.ischool.berkeley.edu/~hearst/talks/upitt.pdf · 35 Social Search: Asking for Answers What do people ask of their social networks? Type % Example](https://reader033.fdocuments.in/reader033/viewer/2022053013/5f10347b7e708231d447f5e4/html5/thumbnails/41.jpg)
41
Summary
§ As CS gets more sophisticated, we can build search interfaces that allow people to interact more naturally: § More language-like queries
§ Speaking & viewing rather than typing & reading
§ More able to interact with other people while doing search tasks
§ More able to use the knowledge in peoples’ heads.