Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller
description
Transcript of Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller
![Page 1: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/1.jpg)
Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller
![Page 2: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/2.jpg)
4:1
Ratio of “Understanding Users” papersto “Systems, Tools, Architectures and Infrastructure” papers submitted to the Interaction Beyond the Individual track at CHI 2011.
![Page 3: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/3.jpg)
Trouble: Exponential GrowthYour usage data is not really compelling because only a small fraction of Facebook is using the application. Worse, your numbers aren’t growing in anything like an exponential fashion.
– CHI metareviewer, paraphrased
![Page 4: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/4.jpg)
Suggestion: Exponential GrowthSeparate evaluation of spread from steady-state.
Which claim is the paper making?
![Page 5: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/5.jpg)
Trouble: Snowball SamplingThe authors’ choice of study method – snowball sampling their system by advertising within their own social network – potentially leads to serious problems with validity.– CHI metareviewer, paraphrased
![Page 6: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/6.jpg)
Suggestion: Snowball SamplingSnowballing is inevitable in social systems. It is fundamental to how they operate.
![Page 7: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/7.jpg)
![Page 8: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/8.jpg)
NoveltyBetween a Rock and a Hard Science
![Page 9: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/9.jpg)
sociotechnical
![Page 10: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/10.jpg)
sociotechnicalstudiersbuilders
![Page 11: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/11.jpg)
sociotechnicalstudiersbuildersFatal Flaw Fallacy [Olsen]Ecological validity at the cost of internal validity
[Ackerman 2000], [Barkhuus and Rode 2007], [Chi 2009], [Greenberg and Buxton 2008], [Kaye and Sengers 2007], [Landay 2009], [Lieberman 2003], [Olsen 2007], [Zhai 2003]
![Page 12: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/12.jpg)
sociotechnicalstudiersbuilders
Show us elegant complexity.(simple ideas that enable complex scenarios)
That’s it? What is possible now that wasn’t before?Nothing — but focus on emergent social activity.
Can you add multitouch?Not using IE8.
We let people type messages up to 140 characters.
![Page 13: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/13.jpg)
socio technicalstudiers builders
Build a technically interesting system (that is hard to spread or evaluate), or
Simplify to a system with socially interesting outcomes (that builders find less novel).
![Page 14: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/14.jpg)
Build a technically interesting system (that is hard to spread or evaluate), or
Simplify to a system with socially interesting outcomes (that builders find less novel).
The contribution needs to take one strong stance or another. Either it describes a novel system or a novel social interaction. If it’s a system, then I question the novelty. If it’s a social interaction, it needs more development.
– CHI metareviewer, paraphrased
![Page 15: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/15.jpg)
Create a shared understandingof research contributions
![Page 16: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/16.jpg)
social technicalNew forms of social interaction
Shared organizational memory [Ackerman 1994]Designs that impact social interactions
Increasing online contribution [Beenen et al. 2004]
Enable fluent social interaction in a new domainSocially translucent systems [Erickson and Kellogg 2000]
![Page 17: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/17.jpg)
social technicalDesigns collecting or powered by social
dataWikidashboard [Suh et al. 2008]; sense.us [Heer et al. 2007]Algorithms to coordinate crowds or derive signal from social data
Collaborative Filtering [Resnick et al. 1994]; Iterate-and-Vote [Little et al. 2010]
Platforms and infrastructuresTurKit [Little et al. 2010]
![Page 18: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/18.jpg)
social technicalPaired contributions can increase each
others’ value
×ManyEyes
[Viégas et al. 2007]
![Page 19: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/19.jpg)
In conclusion introduction:What are our millennium challenges? What is our relationship with industry
and walled gardens?How can (and should) we evolve
our standards of proof?
![Page 20: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/20.jpg)
Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller
![Page 21: Michael S. Bernstein, Mark S. Ackerman, Ed H. Chi, Robert C. Miller](https://reader036.fdocuments.in/reader036/viewer/2022062305/568162a2550346895dd31bce/html5/thumbnails/21.jpg)