CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

39
CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions

Transcript of CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

Page 1: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova

Module 2 :

Analyzing group interactions

Page 2: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 2 P. Dillenbourg & N. Nova

Structural Roles

Functional Roles

Page 3: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 3 P. Dillenbourg & N. Nova

Engineering approach Scientific approach

Experiments

Problems

Suggestions

Design

Improved

System

Experiment

Results

Hypothesis

Knowledge

Experiment

CSCW C

ourse

Project 2 CSCW

Course

Project 1

• Awareness of changes on light duration• Beep if chat input•…

Prototype-

testing cycle

Hypothethis

testing

Page 4: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 4 P. Dillenbourg & N. Nova

Scientific approach

Experiment

Results

Hypothesis

Experiment

CSCW Course

Project 1

D1: Qualitative analysis of task

distribution

D2: Quantitative comparison of task

performance

D3: Qualitative and quantitative dialogue

analysis

Experimental research covers a

variety of data analysis methods

Log Files

Results Results

Project 1 Report

Page 5: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 5 P. Dillenbourg & N. Nova

Scientific approach

Experiment

Hypothesis

Experiment

CSCW Course

Project 1

D2: Quantitative comparison of task

performance

Log Files

Results

Inferential Statistics:

Group A has a performance

7.2% below group B, is that a

real effect or random variation?

Page 6: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 6 P. Dillenbourg & N. Nova

Scientific approach

Experiment

Hypothesis

Experiment

CSCW Course

Project 1

D1: Qualitative analysis of task

distribution

Log Files

Results

30.11.2004

Page 7: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 7 P. Dillenbourg & N. Nova

Deliverable 1 30.11.04 Scientific approach

Experiment

Hypothesis

Experiment

D1: Qualitative analysis of task

distribution

Log Files

Results

Condition SCondition F

Pair 1

Pair 2

Pair 3

Pair 4

Pair 5

Pair 6

Explanation & Results

Page 8: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 8 P. Dillenbourg & N. Nova

How does a team organize its collaborative process ?

Self OrganisationFormal Organisation

DescriptiveDescriptive

“How do they collaborate?”

PrescriptivePrescriptive

“How they should collaborate!”

WORKFLOWS

(module 1)

Social Network

Analysis

( module 2)

Page 9: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 9 P. Dillenbourg & N. Nova

Messages sent

Pierre Patrick

Patrick Jean

Pierre Marc

Jean Patrick

Lucie Jean

Jean Pierre

Pierre Lucie

Lucie Jean

Jean Lucie

Lucie Patrick

Pierre Patrick Jean Lucie Marc

Pierre 0 1 0 1 1

Patrick 0 0 1 0 0

Jean 1 1 0 1 0

Lucie 0 1 2 0 0

Marc 0 0 0 0 0

Row i sent message to column j

Simple count of interactions

Page 10: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 10 P. Dillenbourg & N. Nova

Messages sent + rating

Pierre Patrick +

Patrick Jean -

Pierre Marc +

Jean Patrick -

Lucie Jean +

Jean Pierre -

Pierre Lucie -

Lucie Jean +

Jean Lucie +

Lucie Patrick -

Pierre Patrick Jean Lucie Marc

Pierre 0 +1 0 -1 +1

Patrick 0 0 -1 0 0

Jean -1 -1 0 +1 0

Lucie 0 -1 +2 0 0

Marc 0 0 0 0 0

Row i sent message to column jColumn j rated message sent by row i

Weigthed count of interactions

Page 11: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 11 P. Dillenbourg & N. Nova

Pierre Patrick Jean Lucie Marc

Pierre 0 1 1 1 1

Patrick 1 0 0 0 0

Jean 1 0 0 0 0

Lucie 1 0 0 0 0

Marc 1 0 0 0 0

Network Graph

Pierre

JeanPatrick

Lucie Mark

Pierre Patrick Jean Lucie Marc

Pierre 0 1 0 0 1

Patrick 1 0 1 0 0

Jean 0 1 0 1 0

Lucie 0 0 1 0 1

Marc 1 0 0 1 0

Pierre

JeanPatrick

Lucie

Mark

Star Graph

Circle Graph

Page 12: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 12 P. Dillenbourg & N. Nova

Pierre Patrick Jean Lucie Marc

Pierre 0 1 1 1 5

Patrick 1 0 0 0 0

Jean 1 0 0 0 0

Lucie 1 0 0 0 0

Marc 5 0 0 0 0

Network Representations

Pierre

JeanPatrick

Lucie Mark

Pierre Patrick Jean Lucie Marc

Pierre 0 1 0 0 5

Patrick 1 0 1 0 0

Jean 0 1 0 1 0

Lucie 0 0 1 0 1

Marc 5 0 0 1 0

Pierre

JeanPatrick

Lucie

Mark

Star Graph

Circle Graph

Page 13: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 13 P. Dillenbourg & N. Nova

Pierre Patrick Jean Lucie Marc

Pierre 0 1 1 1 5

Patrick 1 0 0 0 0

Jean 1 0 0 0 0

Lucie 1 0 0 0 0

Marc 5 0 0 0 0

Network Representation

Pierre

JeanPatrick

Lucie

Mark

Pierre Patrick Jean Lucie Marc

Pierre 0 1 0 0 5

Patrick 1 0 1 0 0

Jean 0 1 0 1 0

Lucie 0 0 1 0 1

Marc 5 0 0 1 0

Pierre

JeanPatrick

LucieMark

Star Graph

Circle Graph

Page 14: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 14 P. Dillenbourg & N. Nova

Pierre Patrick Jean Lucie Marc

Pierre 0 1 0 1 1

Patrick 0 0 1 0 0

Jean 1 1 0 1 0

Lucie 0 1 2 0 0

Marc 0 0 0 0 0

Row i sent message to column j

Simple count of interactions

Pierre

Patrick

Lucie

Mark

Jean

Page 15: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 15 P. Dillenbourg & N. Nova

Pierre Patrick Jean Lucie Marc

Pierre 0 1 0 1 1

Patrick 0 0 1 0 0

Jean 1 1 0 1 0

Lucie 0 1 2 0 0

Marc 0 0 0 0 0

Simple count of interactions

In-degree Out-degree

Pierre 1 3

Patrick 3 1

Jean 3 3

Lucie 2 3

Marc 1 0

In-degree Out-degree

Isolate 0 0

Transmitter 0 >0

Receiver >0 0

Carrier >0 >0

Type of Nodes (Hage & HArary 1983)

Centrality index (prestige, proeminence, ….)

Page 16: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 16 P. Dillenbourg & N. Nova

Row i sent message to column j

Weithed count of interactions

Pierre

Patrick

Lucie

Mark

Jean

Pierre Patrick Jean Lucie Marc

Pierre 0 +1 0 -1 +1

Patrick 0 0 -1 0 0

Jean -1 -1 0 +1 0

Lucie 0 -1 +2 0 0

Marc 0 0 0 0 0

Page 17: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 17 P. Dillenbourg & N. Nova

Specific software:

UCINET http://www.analytictech.com/ucinet.htm

Plus 100 others http://www.sfu.ca/~insna/INSNA/soft_inf.html

Nice tutorial : http://faculty.ucr.edu/~hanneman/SOC157/NETTEXT.PDF

Page 18: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 18 P. Dillenbourg & N. Nova

Social interactions data

Matrix of distances among individuals (groups)

Visual Representation

Social Network Analysis

Multidimensional Scaling

Page 19: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 19 P. Dillenbourg & N. Nova

Social interactions data

Matrix of distances among individuals (groups)

Visual Representation

Social Network Analysis

Multidimensional Scaling

X posted message to Y

X is chatting with Y

Y rates X’s message as value V (reputation systems, roadforum,…)

X would like to spend holidays with Y

X read Y’s blog or journal (EPFL)

X has downloaded Y’s solution

X has borrowed same book as Y

(EPFL)

X has bought same book as Y (amazon)

X has read the same page web as Y (social navigation)

Page 20: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 20 P. Dillenbourg & N. Nova

Sustaining Collaboration within a Learning Communityin Flexible Engineering Education

Anh Vu Nguyen, Denis Gillet, Stephane Sire, EPFLhttp://elearning.epfl.ch/publications/eJournalEdMedia2004.pdf

clique

Page 21: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 21 P. Dillenbourg & N. Nova

Social interactions data

Matrix of distances among individuals (groups)

Visual Representation

Social Network Analysis

Multidimensional Scaling

Page 22: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 22 P. Dillenbourg & N. Nova

Page 23: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 23 P. Dillenbourg & N. Nova

Judith Donath, Karrie Karahalios and Fernanda Viégas

MIT Media Lab

Page 24: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 24 P. Dillenbourg & N. Nova

Social Network Fragmentshttp://smg.media.mit.edu/projects/SocialNetworkFragments

friends

school

world

website

Page 25: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 25 P. Dillenbourg & N. Nova

TEC

FA:

Vis

ualiz

ing

On

-Lin

e C

om

mu

nit

ies

Page 26: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 26 P. Dillenbourg & N. Nova

Visualizing On-Line Communities

Page 27: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 27 P. Dillenbourg & N. Nova

A Model of Human Crowd Behavior: Group Inter-Relationship and Collision Detection Analysis*

S. R. Musse and D. ThalmannComputer Graphics Lab (LIG), EPFL

Computer Animation and Simulations '97, Proc. Eurographics workshop, Budapest, Springer

Verlag, Wien 1997, pp. 39-51

http://ligwww.epfl.ch/~thalmann/papers.dir/crowds.pdf

Page 28: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 28 P. Dillenbourg & N. Nova

Visualizing Pairs with SNA??

Pierre Lucie

Page 29: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 29 P. Dillenbourg & N. Nova

How does a team organize its collaborative process ?

Self OrganisationFormal Organisation

DescriptiveDescriptive

“How do they collaborate?”

PrescriptivePrescriptive

“How they should collaborate!”

WORKFLOWS

(module 1)

Social Network

Analysis

( module 2)

Page 30: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 30 P. Dillenbourg & N. Nova

How does a team organize its collaborative process ?

DescriptiveDescriptive

“How do they collaborate?”

PrescriptivePrescriptive

“How they should collaborate!”

scal

e

Semi-Structured Communication Interfaces

YOUR PROJECT

Workflows Social Network Analysis

Standards, norms, rules, laws,….

Culture, leadership, social change

2

20

200

2000

20000

Page 31: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 31 P. Dillenbourg & N. Nova

Jermann & Dillenbourg (CRAFT EPFL)

Group self-regulation: Socio-Cognitive Mirrors

Page 32: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 32 P. Dillenbourg & N. Nova

Social interactions data

Analysing Task Distribution

Visual Representation

X tune light L, parameter P

X posted message

…By hand

By hand

Simulation LOG FILES

Page 33: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 33 P. Dillenbourg & N. Nova

Deliverable 1 30.11.04 Scientific approach

Experiment

Hypothesis

Experiment

D1: Qualitative analysis of task

distribution

Log Files

Results

Condition SCondition F

Pair 1

Pair 2

Pair 3

Pair 4

Pair 5

Pair 6

Explanation & Results

Page 34: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 34 P. Dillenbourg & N. Nova

Tâche: un sujet fait A et B, l’autre fait C et D

Concurrent: les deux sujets font A, B, C et D

Rôle: un sujet fait A, B, C et D

A B C D

S1

S2

Page 35: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 35 P. Dillenbourg & N. Nova

A B C D

Intersections S2 s’occupe de A et BS1 s’occupe de C et D

Page 36: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 36 P. Dillenbourg & N. Nova

« Grace » « Dan »Performance

Tem

ps

Réglages

Messages

Temp de composition

Page 37: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 37 P. Dillenbourg & N. Nova

Page 38: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 38 P. Dillenbourg & N. Nova

Réglages: chaque sujets’occupe de deux intersections

Plans: un sujet planifie les changementsconcernant toutes les intersections

Page 39: CSCW – Module 2 – Page 1 P. Dillenbourg & N. Nova Module 2 : Analyzing group interactions.

CSCW – Module 2 – Page 39 P. Dillenbourg & N. Nova

Part 1. Groupware Analysis26.10.2004 1. Coordinating teamwork: Workflows

02.11.2004 1. Coordinating teamwork: Workflows Running four experiments

09.11.2004 2. Analyzing group interaction

+ explaining log files structure

16.11.2004 Inferential statistics (P. Jermann)CO172

23.11.2004 Building a graphical representations of group interactions

D2: Group representation

30.11.2004

07.12.2004