Www.amiproject.org Quantifying the Impact of Meeting Technology AMI Community of Interest Workshop...

ww

w.a

mip

roje

ct.o

rg

Quantifying the Impact Quantifying the Impact of Meeting Technologyof Meeting Technology

AMI Community of Interest WorkshopAmsterdam, September 11/12, 2007

ww

w.a

mip

roje

ct.o

rg

Wilfried Post September 11/12 2007 2

MotivationMotivation

• We’re studying how organizations are adapting to change• Environment• Technology

• Our studies suit the needs of any particular client• Depending on the specifics of the organization, large or small

• Within AMI, we study human interaction within teams• Doing a particular task, in this case doing a design project• How may multimodal technologies leads to better projects?• How do particular tools (meeting browsers) really contribute?

• We need to determine the effect of new ways of working• We: researchers, corporate decision makers, politicians etc.• What: changes at the individual, team and organizational level • Why: to deal with environmental and technological opportunities

ww

w.a

mip

roje

ct.o

rg


Quantifying impact in AMIQuantifying impact in AMI

Environment

Organization

Task

Team

Individual

Method

Means

Meet

Act

DocumentPrepare

Process

Outcome

ww

w.a

mip

roje

ct.o

rg


Experimental Paradigm: Experimental Paradigm: Design ProjectDesign Project

MarketEnvironment

(simulated)

Organization(simulated)

Project Team(real live)

Personalcoach

Training Service Business

developer

Head Department

Time to market

FashionSpending capacity

ProjectManager

MarketingExpert

User interface designer

Industrialdesigner

ww

w.a

mip

roje

ct.o

rg


Scenario:Scenario:Designing a remote controlDesigning a remote control

ww

w.a

mip

roje

ct.o

rg


No Meeting Browser

Experimental conditions: Experimental conditions: meeting browser variantsmeeting browser variants

State-of-the-art Browser

End-of-AMI Meeting Browser After-AMI Meeting Browser

ww

w.a

mip

roje

ct.o

rg


Semi-automaticSemi-automaticdata collectiondata collection

• 120 subjects• 30 teams• 4 conditions• 2 countries

ww

w.a

mip

roje

ct.o

rg


MeasurementsMeasurements

3,5

4

4,5

5

5,5

6

6,5

1 2 3 4

Condition

Sc

ore

(m

in=

1, m

ax=

7)

Outcome satisfaction

Team satisfaction

Team efficiency

Team effectiveness

Work pace

Process satisfaction

Information processing

• Individual characteristics• Workload

• Team factors• Leadership• Supporting behavior• Cohesiveness

• Project measures• Process• Outcome

• Usability measures0

10

20

30

40

50

60

70

80

90

100

110

120

130

140

150

1 2 3 4

Measurement

Me

nta

l eff

ort

Mental effort

3

3,5

4

4,5

5

1 2 3 4Condition

Sco

re

(min

=1, m

ax=7

)

Effectiveness

Efficiency

Satisfaction

ww

w.a

mip

roje

ct.o

rg


Next step: Next step: organizational levelorganizational level

meet

act

documentprepare

meet

act

documentprepare

meet

act

documentprepare

ww

w.a

mip

roje

ct.o

rg


Application scenariosApplication scenarios

• Directing your product development

• Convincing your client

ww

w.a

mip

roje

ct.o

rg


ww

w.a

mip

roje

ct.o

rg


How can AMI contribute?How can AMI contribute?

meet

act

documentprepare

Goalorientation

Agendamanagement

Leadershipsupport

RecordingBrowsing

Workloadbalancing

Alerting/contacting

Monitoringavailability

ww

w.a

mip

roje

ct.o

rg


Shared InformationShared Information

ww

w.a

mip

roje

ct.o

rg


Real Reaction

Product Specification We put fashion in electronics

R R Introduction Banana Remote Control. Our target-group is actually everybody. For the elderly and children we made it a easy to use and find. For the target group in between 18-45 it is a bit fashionable.

Functions and working This Remote Control will make it easier for the user to zap while watching the tv. It feel easy and good in the hand, so it will prevent the user havig RSI. Also the Banana Remote Control is very colorful, so it is not easy to not see it between the pillows at the couchÉ The volume buttons are placed at the side of the Banana Remote Control, which also has the function to prevent the user having RSI.

Components and look-and-feel The Banana Remote Control is made of rubber. This material is very flexible, so it fits in short and big hands. The form of Banana Remote Control looks like a banana of course. Because of the double curved form it will fit every hand. Besides the yellow color of the Remote Control itself it has purple buttons and 2 green buttons (on/off buttons). All together it has a fruity and fashionable look!

User interface The purple round buttons are also made of rubber. This material is very flexible. The volume and switch buttons are placed at the side of the remote control.

Costs 18,50. But we sell it for 30,-.

The market Our target-group is actually everybody. For the elderly and children we made it a easy to use and find. For the target group in between 18-45 it is a bit fashionable.

Project OutcomeProject Outcome

ww

w.a

mip

roje

ct.o

rg


ww

w.a

mip

roje

ct.o

rg


When What How Individual characteristics Before the experiment Background, experience Questionnaire Spatial orientation Test Memory Test Team and project measures During the meeting Behavior Subjective observation After the meeting Dominance 7 pt scale

Info processing 4 items Leadership 4 items Process satisfaction 3 items Cohesiveness 5 items Work pace 4 items Communication 4 items Supporting behavior 8 items Effectiveness 4 items Efficiency 7 items Outcome satisfaction 5 items Team satisfaction 2 items

Project experience 3 questions Analysis afterwards Info transfer # shared info

Info outcome # correctly applied info Quality product Multiple Expert Assessment

Usability measures Before getting a gist Mental effort 150 pt scale During getting a gist Use of browser Logging Behavior Subjective observation After getting a gist Browser usability Questionnaire Mental effort 150 pt scale During preparation Use of browser Logging

Behavior Subjective observation After preparation Browser usability Questionnaire Mental effort 150 pt scale During meeting Use of browser Logging

Behavior Subjective observation After the meeting Browser usability Questionnaire Mental effort 150 pt scale Usability browser Questionnaire

Meeting room of the future Questionnaire

Www.amiproject.org Quantifying the Impact of Meeting Technology AMI Community of Interest Workshop...

Documents

Transcript of Www.amiproject.org Quantifying the Impact of Meeting Technology AMI Community of Interest Workshop...