HCIL Symposium: Time for Events
description
Transcript of HCIL Symposium: Time for Events
![Page 1: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/1.jpg)
time for events telling the world’s stories from social media
Mor Naaman Rutgers SC&I & Mahaya, Inc.
@informor
![Page 2: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/2.jpg)
revolution take II
![Page 3: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/3.jpg)
a new archive
![Page 4: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/4.jpg)
needs new methods
![Page 5: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/5.jpg)
social"media"information"lab
![Page 6: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/6.jpg)
our work qu
alita
tive
quan
titat
ive
syst
ems
motivations,!practices
large scale quant, data mining
tools, services, !and prototypes
![Page 7: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/7.jpg)
people, together
![Page 8: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/8.jpg)
radiohead
![Page 9: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/9.jpg)
byobw
![Page 10: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/10.jpg)
pepper spray
![Page 11: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/11.jpg)
tahrir
![Page 12: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/12.jpg)
outside lands festival
![Page 13: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/13.jpg)
![Page 14: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/14.jpg)
![Page 15: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/15.jpg)
![Page 16: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/16.jpg)
organize the world’s memories
![Page 17: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/17.jpg)
objectives de
tect
iden
tify
orga
nize
![Page 18: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/18.jpg)
objectives de
tect
ICWSM 2011a JASIST 2011 WebDB 2009 SIGIR 2007
![Page 19: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/19.jpg)
objectives
iden
tify
WSDM 2012 ICWSM 2011b WSDM 2010
![Page 20: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/20.jpg)
objectives
orga
nize
ICMR 2012 CHI 2012
CSCW 2012 MTAP 2012 VAST 2010
WWW 2009
![Page 21: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/21.jpg)
today de
tect
iden
tify
orga
nize
Vox!SRSR!Multiplayer
![Page 22: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/22.jpg)
Vox Civitas hig
hligh
ts
SRSR
Multiplayer
![Page 23: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/23.jpg)
![Page 24: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/24.jpg)
[with postdoctoral fellow Nick Diakopoulos]
research questions how can (Twitter) content contributed around large-scale broadcast news events inform journalistic inquiry? what kinds of insights and analyses are enabled through visual analytic tools?
![Page 25: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/25.jpg)
designing for journalism divergent points of view newsworthiness: surprising, unusual, extremes of positive / negative
![Page 26: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/26.jpg)
supporting analysis direct attention to relevant information automatic content analysis for filtering – relevance – uniqueness / novelty – sentiment – keyword extraction
![Page 27: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/27.jpg)
![Page 28: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/28.jpg)
![Page 29: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/29.jpg)
how to evaluate? directly evaluate the output of the algorithms (quantitative) deep, extensive evaluation of users’ interaction with the system (qualitative)
read more: Olsen (UIST ’07) Naaman (MTAP ’12)
![Page 30: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/30.jpg)
Vox evaluation goals • How effective for generating story ideas? • What kind of insights/analysis are supported? • Shortcomings and how features are used?
![Page 31: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/31.jpg)
Vox evaluation: framing • “develop two story pitches for the event” • open-ended questionnaires, content analysis • 18 participants
![Page 32: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/32.jpg)
Vox Civitas hig
hligh
ts
SRSR
Multiplayer
VAST 2010
![Page 33: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/33.jpg)
research question how can we help a journalists identify reliable, knowledgeable sources for remote breaking news events?
[with postdoctoral fellows Nick Diakopoulos, Mummun De Choudhury]
![Page 34: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/34.jpg)
supporting analysis eyewitness detection network embeddedness user “type” classifier location embeddedness …
![Page 35: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/35.jpg)
![Page 36: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/36.jpg)
evaluation “technological inquiry” with working journalists not: “how our tools worked” yes: “how fits into journalistic needs, practices”
![Page 37: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/37.jpg)
Vox Civitas hig
hligh
ts
SRSR
Multiplayer
VAST 2010
CHI 2012 CSCW 2012
![Page 38: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/38.jpg)
what the hell?
[with: Lyndon Kennedy, Dan Ellis, Kai Su]
![Page 39: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/39.jpg)
![Page 40: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/40.jpg)
![Page 41: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/41.jpg)
![Page 42: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/42.jpg)
![Page 43: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/43.jpg)
supporting analysis extract the signal from people’s attention: find overlapping moments compute and rank scenes extract scene descriptors
![Page 44: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/44.jpg)
audio fingerprinting
Wang et al. (ISMIR ’03)
![Page 45: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/45.jpg)
a story of two clips
![Page 46: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/46.jpg)
a story of two clips
0:00
0:00 3:14
2:32
![Page 47: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/47.jpg)
a story of two clips
0:00
0:00 0:18
2:32
3:32
![Page 48: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/48.jpg)
a story of n clips
time
![Page 49: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/49.jpg)
clips => scenes
time Happy Birthday, Birthday
Higher Ground Encore
![Page 50: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/50.jpg)
![Page 51: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/51.jpg)
evaluation deployment scenario/task:
Decide whether to attend a show
![Page 52: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/52.jpg)
Vox Civitas hig
hligh
ts
SRSR
Multiplayer
VAST 2010
CHI 2012 CSCW 2012
NM&S 2012 ICMR 2012 MTAP 2012
WWW 2009
![Page 53: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/53.jpg)
![Page 54: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/54.jpg)
towards better models of large-scale human attention
![Page 55: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/55.jpg)
experience
Her story allows us to see what was lost, [and] gained, in the political, economic and social transformations of the 18th and 19th centuries.
![Page 56: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/56.jpg)
a new archive
![Page 57: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/57.jpg)
PUZPNO[Z°H[)**°ZJHSL
YouTubL-SPJkr
WorK7YLssTwP[[Lr
Hypotheses and
research questions
Researcher°L_WSVYLZ°KH[HEXPLORE
*VKLK°Ka[H°MVY°HUHS`ZPZ
9LZLHYJOLY°YLX\LZ[Z�HUUV[H[PVUZANALYZE
3HYNL�ZJHSL�Kata
9LZLHYJOLY°KLMPULZ°PU[LYLZ[COLLECT
SOCRATES fut
ure
work
CityBeat
![Page 58: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/58.jpg)
PUZPNO[Z°H[)**°ZJHSL
YouTubL-SPJkr
WorK7YLssTwP[[Lr
Hypotheses and
research questions
Researcher°L_WSVYLZ°KH[HEXPLORE
*VKLK°Ka[H°MVY°HUHS`ZPZ
9LZLHYJOLY°YLX\LZ[Z�HUUV[H[PVUZANALYZE
3HYNL�ZJHSL�Kata
9LZLHYJOLY°KLMPULZ°PU[LYLZ[COLLECT
SOCRATES
![Page 59: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/59.jpg)
CityBeat
Everywhere where there is an interaction between a place, a time, and an expenditure of energy, there is rhythm. - Henri Lefebvre
![Page 60: HCIL Symposium: Time for Events](https://reader033.fdocuments.in/reader033/viewer/2022051514/5496e7c1b47959604d8b50c6/html5/thumbnails/60.jpg)
Luis Gravano Hila Becker Nick Diakopoulos Kai Su Dan Ellis Munmun de Choudhury Tarikh Korula …
thanks