Off the Page Into the Wild: Designing For the Internet of Things

5/12/14

OFF THE PAGE, INTO THE WILD DESIGNING FOR THE INTERNET OF THINGS !!!DAVID SHERWIN | @CHANGEORDER JENNIFER DUNNAM | @JDUNNAM !!HOW DESIGN CONFERENCE 2014

THIS IS WHAT WE’RE FAMOUS FOR

THIS IS WHAT WE DO NOW

WE <3 IoT!4

Image&Credit:&h.p://www.marke4ngtechblog.com/the:internet:of:things/

http://www.marketingtechblog.com/the-internet-of-things/

SESSION OVERVIEW

WHAT IS THE IoT? TOOLS WE USE

1. ECOSYSTEMS 2. BEHAVIORS 3. STORIES

WRAP UP Q&A

!13

WHAT IS THE IoT?

IT’S MORE THAN SIMPLY SMART OBJECTS

Image&Credit:&h.p://veni4sm.blogspot.com/2013/05/the:internet:of:things.html

IT’S A WORLD OF CONNECTED THINGS

http://venitism.blogspot.com/2013/05/the-internet-of-things.html

THE ‘PHYSICAL GRAPH’ IS STARTING TO TAKE SHAPE

THERE’S SO MUCH MORE THAN MEETS THE EYE

BENEATH THE SURFACE LIES A NEW DOMAIN FOR DESIGN

!21

LET’SPRETEND TO BE THE IoT

DEVICE COMMUNICATION AND DATA SHARING IS FUNDAMENTAL TO THE INTERNET OF THINGS

DEVICES WITHIN THE INTERNET OF THINGS HAVE DIFFERENT CAPABILITIES

smart&objectCARGPS & location services

PORTABLE SPEAKERWi-Fi triangulation

THERMOSTATTemperature, humidity

TABLETAccelerometer, GPS & location services, Wi-Fi triangulation, camera

SMARTPHONEAccelerometer, GPS & location services, Wi-Fi triangulation, camera

FITNESS BANDAccelerometer, heart rate, sleep patterns

SMART TVCamera

LAPTOPWi-Fi triangulation, camera

CARGPS & location services






SMART TVCamera


smart&object&with&cloud&connec3vity

!24

THERE ARE 10 TABLES IN THE ROOM THAT ARE LABELED AS SMART OBJECTS

shoe&pedometer

wrist&sensor

skin&sensor

heart&monitor

home&thermostat

smart&pillow

smart&weigh&scale

smart&alarm&clock

smart&refrigerator

smart&pill&bo:le

pa3ent doctor

!25

EACH OF THESE TABLES HAS A BEACH BALL TO REPRESENT A BIT OF COLLECTED DATA

shoe&pedometer

heart&monitor

home&thermostat

smart&pillow

smart&scale

smart&alarm&clock

smart&refrigerator

smart&pill&bo:le

pa3ent doctor

wrist&sensor

skin&sensor

!26

THERE ARE FOUR TABLES LABELED AS CLOUD OBJECTS WITHIN THE ROOM

shoe&pedometer

heart&monitor

home&thermostat

smart&pillow

smart&scale

smart&alarm&clock

smart&refrigerator

smart&pill&bo:le

pa3ent doctor

cloud cloud cloud cloud

wrist&sensor

skin&sensor

!27

pa3ent doctor

HOW COULD A DOCTOR & PATIENT LEVERAGE DATA FROM SMART OBJECTS?

!28

STEP 1: WRITE A BIT OF INFORMATION ON THE BEACH BALL TO DESCRIBE SOMETHING YOU COULD SENSE ABOUT A PERSON’S HEALTH

smart&pillow

Irregular sleep

patterns during past

week

2 MINUTES

!29

STEP 2: SEND THAT INFORMATION TO THE CLOSEST CLOUD

cloudsmart&pillow

Irregular sleep


week

1 MINUTE

!30

STEP 3: FROM THE CLOUD, SEND THE INFORMATION BALL UP TO THE FRONT FOR THE DOCTOR TO REVIEW

cloud

doctor

Irregular sleep


week

1 MINUTE

THE INTERNET OF THINGS IS HERE TO STAY

Image&Credit:&h.p://www.psC.com/2014/03/internet:of:things:infographic.html#!MsfBf

http://www.psfk.com/2014/03/internet-of-things-infographic.html#!MsfBf

!33

YIKES

HUMAN SYSTEMS OF COMMUNICATION ARE BEING INFLUENCED BY THE DISTRIBUTED COMMUNICATION INHERENT TO THE INTERNET

SCARY?

!35

WE NO LONGER LIVE IN A DISCONNECTED WORLD

!36

UBIQUITOUS, FLEXIBLE COMPUTING IS A NORM

Image&Credit:&h.p://blogs.cisco.com/ioe/cisco:iox:an:applica4on:enablement:framework:for:the:internet:of:things/

http://blogs.cisco.com/ioe/cisco-iox-an-application-enablement-framework-for-the-internet-of-things/

COMMUNICATION & COLLABORATION ACCELERATES

Image&Credit:&h.p://bryansmith1138.com/2014/01/30/column:get:off:your:cell:phones/

http://bryansmith1138.com/2014/01/30/column-get-off-your-cell-phones/

THE IoT CAN EMPOWERHUMANS IN WAYSTHAT INCREASE THE QUALITY OF HOW WE LIVE THEIR LIVES

NOT SCARY

DESIGNERS AREUNIQUELY POSITIONEDAND SKILLED TOMAKE THE IoTHUMAN CENTERED

INSPIRING, IMHO

TOOLSWE USE

!41

GRAB THIS WORKSHEET

!42

CLIENT CHALLENGE:

YOUR CLIENT HAS HIRED YOU TO DESIGN A NEW MUSIC APPLICATION THAT IS ABLE TO DETECT PEOPLE’S ROUTINES AND PLAY MUSIC ACCORDINGLY.

!43

CLIENT CHALLENGE:

THE APPLICATION CAN READ DATA FROM ANY DEVICE THEY ARE USING TO MAKE THAT POSSIBLE.

TOOLS WE USE !

1. ECOSYSTEMS

!44

!45

SIGNAL VIA WIREINVENTED BY

SOEMMERING & CAMPILLO

IMPLEMENTEDBY COOKE & OTHERS

IT USED TO BE SO SIMPLE…

POINT A

POINT B

!47

ACK

!48

X10000000000000000000

!49

“THIS S%@T IS COMPLICATED.”— ME

!50

TOOL 1: ECOSYSTEM MAPPING

!51

1. LIST YOUR ENTITIES

DEVICES WHAT DEVICESWILL BE USED BY THOSE PEOPLE AND ACCESS OR TRANSMIT DATA?

SERVICES WHAT APPS AND SERVICES ARE PEOPLE USING ON THIS DEVICE?

PEOPLE WHO IS USING DEVICES IN YOUR ECOSYSTEM?

!52

1. LIST YOUR ENTITIES

PEOPLE PERSONA 1PERSONA 2PERSONA 3PERSONA 4 …?

DEVICES SMARTPHONETABLETLAPTOP/PCSMART TVTHERMOSTATAUDIO SPEAKERFITNESS BANDCAR …?

SERVICES STREAMING MEDIA CLOUD LOCKERINTERNET RADIO SOCIAL MEDIA …?

!53PERSONA

2. SELECT A PERSONA

!54PERSONA

Joanna is a 37-year-old nurse that works in a hospital emergency room in Sioux Falls, Idaho. She lives in a three bedroom house, where she

takes care of her four-year-old daughter and cat.

Joanna’s needs around music enjoyment include making sure the music she plays at home is kid-safe,

discovering new high-energy songs for when she exercises, and staying awake when driving home.

!55







SMART TVCamera


WE LIKE TO ARRANGE THEM BY FREQUENCY OF ACCESS.

3. PLACE THE DEVICES

!56







SMART TVCamera


DEVICES AND ENVIRONMENTAL SENSORS PROVIDE IMPORTANT DATA TO YOU.

4. IDENTIFY SENSORS

!57







SMART TVCamera


CLOUD LOCKER (i.e. iTunes Match)

STREAMING MUSIC LIBRARY (i.e. Spotify)

INTERNET RADIO (i.e. Pandora)

SOCIAL NETWORKS (i.e. Facebook, Twitter)

5. LIST AVAILABLE SERVICES

!58







SMART TVCamera






6. DRAW THE RELATIONSHIPS

!59

DOING THIS TAKES TIME. BUT IT SERVES AS YOUR FOUNDATION FOR THE ENTIRE IoT DESIGN PROCESS.

AND IT KEEPS THINGS LIKE THIS FROM HAPPENING

!61

TOOLS WE USE !

1. ECOSYSTEMS 2. BEHAVIORS

“DESIGNERS NEED TO BE AT THE FRONT END OF THE SENSOR TRANSITION, SO THEY CAN HUMANIZE IT.”

— TIMOTHY MOREY, AVP OF STRATEGY, FROG

!62

OUR THINGS GROW SMARTER EVERY DAY

WITH THIS INTELLIGENCE COMES A NEW LANGUAGE FOR COMMUNICATION

BEHAVIORS AND RELATIONSHIPS MUST BE DESIGNED

THE WHOLE WILL BE GREATER THAN THE SUM OF ITS PARTS

TOOL 2:DESCRIBING BEHAVIORS

GET NETWORKED. (WE MEAN: FIND A PARTNER.)

!70

GRAB THIS WORKSHEET

CONNECTED SYSTEMS ARE INTELLIGENT (BUT COMPLEX)







SMART TVCamera






THIS COMPLEXITY CAN BE MANAGED THROUGH DESIGN

1. Pick what device would serve as Joanna’s primary touchpoint for controlling her music-listening experience.

2. Identify how Joanna would communicate with that object.

3. List out what data could be passed along to her secondary devices.

4. Outline ideas for how a secondary device would use that data.

When designing for the Internet of Things, we repeat this process for all devices.

•"voice"command"•"hand"gestures"•"facial"recogni4on

•"mood"/"temperament"•"music"selec4on

•"con4nue"the"music"currently"playing"in"car"•"play"music"selec4on"that"aligns"with"her"current"mood

!79

TOOLS WE USE !

1. ECOSYSTEMS 2. BEHAVIORS 3. STORIES

!80

STORIES HELP US ENVISIONTOUCHPOINTS IN AN ECOSYSTEM FROM UNIQUE POINTS OF VIEW

!81

STORIES HELP US ENVISIONTOUCHPOINTS IN AN ECOSYSTEM FROM UNIQUE POINTS OF VIEWTOUCHPOINTS ARE THE INTERFACE BETWEEN PEOPLE & WHAT’S DESIGNED

POINTS OF VIEW ILLUMINATE A PARTICULAR CHARACTER’S PERSPECTIVE—OR PROVIDE A HOLISTIC VIEW OF THE ECOSYSTEM ITSELF

!82

STORIES HELP US ENVISIONTOUCHPOINTS IN AN ECOSYSTEM FROM MULTIPLE POINTS OF VIEW







SMART TVCamera


!83

THIS IS TOO ABSTRACT

!84

EACH STORY YOU CREATEIS A SLICE OF A SYSTEMATICIoT SOLUTION.

!85

EACH STORY YOU CREATEIS A SLICE OF A SYSTEMATICIoT SOLUTION.

!87

STORIES WORK BEST WHEN THEY CONTAIN DETAILS THAT EXPLAIN WHY CHARACTERS CHOOSE TO ACT.

!88


WHAT IS THEIR MOTIVATION?

!89


WHAT IS THEIR MOTIVATION? WHAT CONFLICT IS BEING RESOLVED?

!90

WHO IS LOOKING AT THIS?

!91

HOW DOES THIS HELP THEM?

TOOL 3:CREATINGSTORIES

!93

GRAB THIS WORKSHEET

!94

THIS IS THE MOST FUN & FAMILIAR PART OF THE PROCESS

!95

WHO IS IN THE STORY? WHERE DO THEY GO? WHEN DO THEY GO THERE? WHAT DO THEY DO? WITH WHAT DEVICES? WHY?

1. WHAT HAPPENS?

!96

2. DESCRIBE HOW

SKETCH OF KEY

MOMENT

Front of Index Card: Try to visually capture character,

time, place, and occasion.

Back of Index Card: Write down what happens, on what devices,

and using what data.

DESCRIBE WHAT

HAPPENS

!97

Joanna"starts"dancing"with"her"daughter."The"TV"sees"the"ac4vity"and"instructs"the"thermostat"to"start"cooling"the"room.

When"driving"home,"Joanna"hears"a"song"she"likes"on"the"radio."She"tells"her"car"to"add"the"song"to"her"exercise"playlist.

Joanna"tells"the"television"to"switch"music"channels"to"children’s"music"and"transfer"to"the"portable"speaker.

smart"TV"+"thermostat car"+"fitness"band smart"TV"+"portable"speaker

data"about"music"type"and"ac4vity"level data"about"the"song"and"data"about"Joanna’s"playlists

data"about"music"type"and"user"type

WRAP UP

THE TECHNOLOGY TO BUILD THE IoT IS ALREADY HERE

Image&Credit:&h.p://djokic.org/internet:of:things/

http://djokic.org/internet-of-things/

OUR OBJECTS WILL SOON TALK, LEARN, AND COORDINATE ON OUR BEHALF

DESIGNERS ARE KEY FOR HUMANIZING THE IoT EXPERIENCE

!107

WITH NEW TECHNOLOGY COMES NEW EXPECTATIONS FROM USERS

“IN THE INTERNET WORLD, IF YOU’RE DOING THE SAME THING YOU WERE DOING 6 MONTHS AGO, YOU’RE DOING SOMETHING WRONG.”

— BRUCE FEILER

!108

!109

Jennifer Dunnam [email protected] @jdunnam jenniferdunnam.com

David Sherwin [email protected] @changeorder davidsherwin.com

THANK YOU! AND LET US KNOW HOW YOU USE THESE TOOLS IN YOUR WORK. !GET THIS DECK AT SLIDESHARE.NET/FROGDESIGN

See you on Thursday? 3:00–3:30 PM: Signing Creative Workshop & Success by Design 4:30–5:30 PM: “Creating Creative Superteams”

mailto:[email protected]

http://slideshare.net/frogdesign

Off the Page Into the Wild: Designing For the Internet of Things

Design

Transcript of Off the Page Into the Wild: Designing For the Internet of Things