Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction...
Transcript of Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction...
![Page 2: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/2.jpg)
2
![Page 3: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/3.jpg)
3
Problem Frontier
Difficulty
Building Architecture and Construction
Limits of Materials
Limits of Cognition and Coordination
Software Architecture and Construction
Early Days of Computing
![Page 4: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/4.jpg)
4
Problem Frontier Now
Difficulty
Building Architecture and Construction
Limits of Materials
Limits of Cognition and Coordination
Software Architecture and Construction
Computing Today
![Page 5: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/5.jpg)
5
Problem Frontier Now
Difficulty
Building Architecture and Construction
Limits of Materials
Limits of Cognition and Coordination
Software Architecture and Construction
Q: What’s a good design? A: One people can understand.
Q: What’s a good architecture? A: One that a bunch of people can understand in the same way.
![Page 6: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/6.jpg)
6
Increasing Attention to Human Factors
Amrit, C., Daneva, M., & Damian, D. (2014). Information and Software Technology 56 (2014) 1537–1542
![Page 7: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/7.jpg)
7
LDA SVD SVM Etc.
There’s not much chemistry going on here!
Jim Likes to mix things up, put them on alcohol flame See if they catch fire or (YES!) explode Knows nothing, cares nothing about chemistry
![Page 8: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/8.jpg)
8 Marcus, G. & Davis, E. Eight (No, Nine!) Problems with Big Data. New York Times, April 6, 2014.
![Page 9: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/9.jpg)
Photo: I, MikeGogulski
This may be very useful. This is not science.
![Page 10: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/10.jpg)
10
Medical Research Analogy • Bleeding common medical practice • Late 18th century • Francois Joseph Victor Broussais
• Promoted bleeding of “affected organ” • Pierre-Charles-Alexandre Louis
• Actual data collection about outcomes • Bleeding is not such a great idea
• Clinical trial is important, is not enough! • Nature of disease processes
• Empiricism in software engineering: “clinical trial” • How do we progress better than trial and error?
![Page 11: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/11.jpg)
11
Takeaways, Part 1 • Theories must take account of the primary constraints
• Cognition, communication, organizations
• Data mining, machine learning, prediction models don’t further our understanding of the phenomenon
• Clinical trials – seeing if a given technique works – does not build understanding
• What we really need: • Theories spanning human behavior (from individual to
community) and software • Empirical tests of hypotheses derived from theories
![Page 12: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/12.jpg)
12
Context: Three Promising Theories
• Transparency • Signaling • Collective intelligence
![Page 13: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/13.jpg)
13
Transparency and Signaling
• Transparency • “accurate observability, of an organization’s low-level
activities, routines, behaviors, output, and performance”*
+ Politics, finance, government, workplace + Performing in front of an audience + Accountability, coordination - May hurt creativity and streamlining - Information overload
*Bernstein, E. S. (2012). The transparency paradox a role for privacy in organizational learning and operational control. Administrative Science Quarterly, 57(2), 181-216.
![Page 14: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/14.jpg)
14
GitHub: Transparency
• Open source hosting environment • 8 million users, 16 million repositories • Social media functionality • Transparency
![Page 15: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/15.jpg)
Example: Information Overload
![Page 16: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/16.jpg)
16
![Page 17: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/17.jpg)
17
![Page 18: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/18.jpg)
18
![Page 19: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/19.jpg)
19
Transparency and Signaling
• Signals • Original idea from evolutionary biology • Visible clues that imply hidden quality • Types of signals
• Assessment: visible clue cannot be produced without hidden quality
• Conventional: meaning is agreed upon, will continue to exist only if enforced by norms
![Page 20: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/20.jpg)
20
Stotting as Honest Signal
![Page 21: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/21.jpg)
21
Avoid Colorful Snakes
![Page 22: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/22.jpg)
22
Avoid Colorful Snakes
![Page 23: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/23.jpg)
23
Conventional Signals
![Page 24: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/24.jpg)
24
Conventional Signals – Trustworthy?
CareerExcuse.com
![Page 25: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/25.jpg)
25
![Page 26: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/26.jpg)
26
Norms, Enforcement
![Page 27: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/27.jpg)
27
GitHub Signals
• Hiring, evaluating people • Deciding what to pay attention to • Deciding what to use • Deciding where to contribute • Deciding what contributions to accept
![Page 28: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/28.jpg)
28
Early Results
![Page 29: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/29.jpg)
29
Signaling Takeaways
• A way to make sense of information-rich environment
• Theory creates expectations about how various signals can work • How is signal produced? • How easy/hard is it to evaluate? • What norms influence how it is used?
![Page 30: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/30.jpg)
30
Collective Intelligence
• c exists! • Groups perform well on one task tend tend
to perform well on others • This effect is much stronger than average
or highest intelligence in group
![Page 31: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/31.jpg)
31
Evidence for c
Woolley, A. W., Chabris, C.F., Pentland, A., Hashmi, N., & Malonge, T.W. (2010). Evidence for a Collective Intelligence Factor in the Performance of Human Groups. Science, 330, Oct. 2010, 686-688.
c is predicted by • Social sensitivity • Equality of participation • Proportion of women
![Page 32: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/32.jpg)
32
Collective Intelligence Genome
Malone, T.W., Laubacher, R., & Dellarocas, C. (2010). The collective intelligence genome. MIT Sloan Management Review, 51(3), pp. 20-31.
![Page 33: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/33.jpg)
33
Basic Genes
• What • Create • Decide
• Who • Hierarchy • Crowd
• Why • Money • Love • Glory
• How • Collection • Contest • Collaboration • Group decision • Individual decision
Create
Decide
![Page 34: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/34.jpg)
![Page 35: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/35.jpg)
35
Collective Intelligence Takeaways
• Understanding the interplay among • Structure/process • Incentives • Staffing • Goal
• Effective collaboration systems can be designed
![Page 36: Theories of Contextcsd-ws.github.io/CSD_2014_Keynote.pdf · Building Architecture and Construction Limits of Materials Limits of Cognition and Coordination Software Architecture and](https://reader036.fdocuments.in/reader036/viewer/2022063008/5fbe8fd44f8b583ce8152322/html5/thumbnails/36.jpg)
Q&A Genome Create Crowd
Collaborate Love & Glory