Design Tools forDesign Tools for Variations and...

44
stanford hci group / 2007 Design Tools for Design Tools for Variations and Alternatives Björn Hartmann (bjoern@cs stanford edu) Björn Hartmann (bjoern@cs.stanford. edu) http://hci.stanford.edu stanford · 1 August 2007

Transcript of Design Tools forDesign Tools for Variations and...

Page 1: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

stanford hci group / 2007

Design Tools forDesign Tools for Variations and Alternatives

Björn Hartmann (bjoern@cs stanford edu)Björn Hartmann ([email protected])

http://hci.stanford.edustanford · 1 August 2007

Page 2: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

“The best way to have a good idea is to have lots of ideas ”lots of ideas.

-Linus Pauling

2

Page 3: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Prototypes for the Mi f

3

Microsoft mouseFrom Moggridge, Designing Interactions, Ch2

Page 4: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

“ a designer that pitched only one idea would…a designer that pitched only one idea would probably be fired. I'd say 5 is an entry point for an early formal review (distilled fromfor an early formal review (distilled from 100's). Oh, and if you are pushing one particular design you will be found out andparticular design you will be found out, and also fired.”

Alistair Hamilton, quoted in Tohidi et al CHI 2006Tohidi et al. , CHI 2006

4

Page 5: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

5

Page 6: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

CounterpointCounterpoint

“You have to let an idea run and proceedYou have to let an idea run and proceed with it to be convinced… of course you criticize it and you may leave it and startcriticize it and you may leave it and start again with something new, but it is not a question of options it is always a linearquestion of options, it is always a linear process.” - Santiago Calatrava,

quoted in Lawson, 1997

6

Page 7: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

7calatrava.com

Page 8: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Multiplicity matters, p ybut how?

Page 9: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Why and how do alternatives matter?Why and how do alternatives matter?

To support creative actionTo support creative actionCreativity is non-sequential, bouncy – tools need to support working with alternatives to getneed to support working with alternatives to get out of the way; “near-term experimentation”(Terry)p ( y)

For exploration:“Mapping the territory” (Lawson)Mapping the territory (Lawson)“…to understand the range of [products] that might evolve” (Gaver)might evolve (Gaver)

9

Page 10: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Why and how do alternatives matter?Why and how do alternatives matter?

For justification: design rationaleFor justification: design rationaleTo get more information from 3rd parties:

During critiqueDuring testing (Tohidi, CHI06)During client meetings (Lawson)

10

Page 11: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

11

Tohidi et al, CHI 2006

Page 12: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Tohidi et al HypothesesTohidi et al., HypothesesH1: Participants will rate designs lower when all alternativesH1: Participants will rate designs lower when all alternatives are seen, compared to when they see only one.

H2: Participants exposed to alternative designs will be less pressured to be positive, expressing fewer positive comments than those who only see onecomments than those who only see one.

H3: Participants who see alternative designs will provide p g pmore suggestions for improvement compared to those who only see one.

Page 13: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Disentangling DefinitionsDisentangling Definitions

Alternatives: offer choice; pertain to theAlternatives: offer choice; pertain to the design problem domain

Variations: changes to a common base; pertain to the implementation domain

Iterations: Instances of the same solution at different points of revision (from Terry)different points of revision (from Terry)

13

Page 14: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

What tools are out there andWhat tools are out there, and what problems do they solve?p y

Design Galleries (Marks, SIGGRAPH 97)Sid Vi & P ll l Pi (T & )SideViews & Parallel Pies (Terry, 2002 & 04)Subjunctive Interfaces (Lunzer, various)Linked Editing (Toomim, VL/HCC 2004)

14

Page 15: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Design Galleries (DG)Design Galleries (DG)

Domain: graphics rendering; simulation ofDomain: graphics rendering; simulation of physical phenomena (light transport, particle systems) with lots of parameterssystems) with lots of parametersCharacteristics:

h lHigh computational cost(can’t do realtime adjustment)U tifi bl t t litiUnquantifiable output qualities (need human judge)

Page 16: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Design Galleries (DG)Design Galleries (DG)

Given formal description ofGiven formal description of input vector (set of parameters to tweak)

th d t t t t ( d i i l ti )method to create output (rendering, simulation)output vector (relevant qualities of image)ddistance metric

generate space-spanning set of variationswith maximum dispersion along with a UI for structured browsing of solutions

16

Page 17: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering
Page 18: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering
Page 19: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering
Page 20: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Side Views & Parallel PiesSide Views & Parallel Pies

Domain: 2D graphic design (still images)Domain: 2D graphic design (still images)“What If Tools” for ill-defined problemsGet beyond Single State Document ModelA bag of tricks to support trying out multiple alternatives in parallel:

Fast previewsMultiple previewsMake previews stick persistent & composable

20

Page 21: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Side View

Parameter Spectrum

Page 22: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Parallel Pie

T t lTerry et al, CHI 2004

Page 23: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Subjunctive InterfacesSubjunctive Interfaces

Domain: Information retrieval (e g booking aDomain: Information retrieval (e.g., booking a flight) P bl t k i l t d iProblem: tasks require many related queries, but only single requests are supportedIdea:

Multiple scenarios can co-exist (e.g., alternative input values)User can view scenarios side-by-sideUser can adjust scenarios in parallel

Page 24: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Lunzer, 2004

Page 25: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Lunzer, 2004

Page 26: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Clip Connect Clone

Page 27: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Linked EditingLinked Editing

Domain: programmingDomain: programmingProblem: code clones:tedious to edit, unobservable inconsistencies, overhead to , ,maintain, hard to understand…

However, “programmers will write duplicated code — let’s support the practice and mitigate its disadvantages.”Idea: clones are linked together in editor, similarities and differences visualized, editing possible in parallel or individuallypossible in parallel or individually

Page 28: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Linked EditingLinked Editing

28

Toomim, VL/HCC 2004

Page 29: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

TunablesTunables

Domain: multimedia programming in ProcessingDomain: multimedia programming in ProcessingProblem: parameter values have to be set at compile time whose effect can only be observed atcompile time whose effect can only be observed at runtimeExamples: rendering style, cv color trackingp g y , gIdea: from source code, automatically generate control interface to let programmers change p g gparameters at runtime; record changes and re-integrate found parameters into source

Page 30: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

“Enlightened trial and error outperforms theEnlightened trial and error outperforms the planning of flawless intellect.”

- David Kelley, quoted in Winograd, 2006

30

Page 31: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Tunables VideoTunables Video

31

Page 32: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Pilot Study FeedbackPilot Study Feedback

Physical spatially multiplexed controlPhysical, spatially multiplexed control interface is a big win in terms of attention and parallel controland parallel controlWanted support for parameter variation, as

ll lt ti ti thwell as alternative execution paths

32

Page 33: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

33

Page 34: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

DiscussionDiscussion

DG Side Views Tohidi study Tunables:DG, Side Views, Tohidi study, Tunables: Human provides “goodness” ratingThi t i t ti h thThings get interesting when there are multiple variations of multiple parametersDo you show alternatives in parallel or in sequence?Time to effect changes matters (next slide)

34

Page 35: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Real-time adjustment (Tunables, SideViews) requires immediate feedbackfrom application

35

o app cat o

Page 36: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

If real-time feedback is not possible, pre-compute and select from options

Page 37: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Where is the opportunity?Where is the opportunity?

Neither DG nor Side Views nor SubjunctiveNeither DG nor Side Views nor Subjunctive Interfaces have interactive artifacts at their core they are based on “documents”core – they are based on documentsRelationship of input to output is that of a

i li t f db k tpipeline, not a feedback system

37

Page 38: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Defining how the “transitions” of interactionDefining how the transitions of interaction design happen is still programmingLi k d diti i b t d b t l b tLinked editing is about code, but only about code as text, not about what happens when itit runs

38

Page 39: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Tangent: Coding as PerformanceTangent: Coding as Performance

ExamplesExamples:ChucK/Audicle (Ge Wang, Princeton, now CCRMA)CCRMA)Impromptuhtt //h k t /2007/05/22/ i Whil tEhttp://hackety.org/2007/05/22/runningWhilstEditing.html (mov)

39

Page 40: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

On-the-fly programmingOn-the-fly programming

On the fly programming (or live coding) is aOn-the-fly programming (or live coding) is a style of programming in which the programmer/performer/composerprogrammer/performer/composer augments and modifies the program while it is running without stopping or restarting inis running, without stopping or restarting, in order to assert expressive, programmable control for performance composition andcontrol for performance, composition, and experimentation at run-time.

40

Page 41: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

41

Page 42: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

Where do People matter?Aimed at Lone

Aimed at Performer+ Do people provide Do people create parameter Do people create Input‐Lone 

DesignerPerformer+Audience

Do people provide real‐time input?

Do people create parameter values?

Do people create Input‐>Output mapping?

Design Galleries x No ‐ Document (3D world)

No; Algorithm does No; expert programs it

Side Views x No ‐Document (Image) Mixed  Mixed ‐ library implements i iti lprimitives; people compose

Playing a Synthesizer

x Human Performance Yes No (set in hardware)

Laptop Live x No ‐ Document (Score) Yes Yes (Beforehand)Laptop Live Performance

x No  Document (Score) Yes Yes (Beforehand)

"Chucking" x No ‐Document (code) Yes Yes (Live)Tunables for Interaction Design

x x Mixed: Document+Human Performance

Yes Yes (Beforehand)

Performance

Tohidi & Buxton Study

x Yes? Paper prototype no; separate implementations

Page 43: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

When are alternatives…

CREATEDCREATEDDesign Time "Release" Time

me

D Design Tim

Exploration by Designer X

VIEWE D

e" Tim

e

V

"Release Client Presentation Participatory Design

Page 44: Design Tools forDesign Tools for Variations and Alternativesgraphics.stanford.edu/~bjoern/talks/2007-08-01-variations-alternatives-stanford.pdfAug 01, 2007  · xExamppgy,les: rendering

stanford hci group / 2007

htt //h i t f d dhttp://hci.stanford.edu

http://hci.stanford.edu