Off the Page Into the Wild: Designing For the Internet of Things

5/12/14

OFF THE PAGE, INTO THE WILD DESIGNING FOR THE INTERNET OF THINGS !!!DAVID SHERWIN | @CHANGEORDER JENNIFER DUNNAM | @JDUNNAM !!HOW DESIGN CONFERENCE 2014

THIS IS WHAT WE’RE FAMOUS FOR

THIS IS WHAT WE DO NOW

WE <3 IoT!4

Image&Credit:&h.p://www.marke4ngtechblog.com/the:internet:of:things/

SESSION OVERVIEW

WHAT IS THE IoT? TOOLS WE USE

1. ECOSYSTEMS 2. BEHAVIORS 3. STORIES

WRAP UP Q&A

WHAT IS THE IoT?

IT’S MORE THAN SIMPLY SMART OBJECTS

Image&Credit:&h.p://veni4sm.blogspot.com/2013/05/the:internet:of:things.html

IT’S A WORLD OF CONNECTED THINGS

THE ‘PHYSICAL GRAPH’ IS STARTING TO TAKE SHAPE

THERE’S SO MUCH MORE THAN MEETS THE EYE

BENEATH THE SURFACE LIES A NEW DOMAIN FOR DESIGN

LET’SPRETEND TO BE THE IoT

DEVICE COMMUNICATION AND DATA SHARING IS FUNDAMENTAL TO THE INTERNET OF THINGS

DEVICES WITHIN THE INTERNET OF THINGS HAVE DIFFERENT CAPABILITIES

smart&objectCARGPS & location services

PORTABLE SPEAKERWi-Fi triangulation

THERMOSTATTemperature, humidity

TABLETAccelerometer, GPS & location services, Wi-Fi triangulation, camera

SMARTPHONEAccelerometer, GPS & location services, Wi-Fi triangulation, camera

FITNESS BANDAccelerometer, heart rate, sleep patterns

SMART TVCamera

LAPTOPWi-Fi triangulation, camera

CARGPS & location services

SMART TVCamera

smart&object&with&cloud&connec3vity

THERE ARE 10 TABLES IN THE ROOM THAT ARE LABELED AS SMART OBJECTS

shoe&pedometer

wrist&sensor

skin&sensor

heart&monitor

home&thermostat

smart&pillow

smart&weigh&scale

smart&alarm&clock

smart&refrigerator

smart&pill&bo:le

pa3ent doctor

EACH OF THESE TABLES HAS A BEACH BALL TO REPRESENT A BIT OF COLLECTED DATA

shoe&pedometer

heart&monitor

home&thermostat

smart&pillow

smart&scale

smart&alarm&clock

smart&refrigerator

smart&pill&bo:le

pa3ent doctor

wrist&sensor

skin&sensor

THERE ARE FOUR TABLES LABELED AS CLOUD OBJECTS WITHIN THE ROOM

shoe&pedometer

heart&monitor

home&thermostat

smart&pillow

smart&scale

smart&alarm&clock

smart&refrigerator

smart&pill&bo:le

pa3ent doctor

cloud cloud cloud cloud

wrist&sensor

skin&sensor

pa3ent doctor

HOW COULD A DOCTOR & PATIENT LEVERAGE DATA FROM SMART OBJECTS?

STEP 1: WRITE A BIT OF INFORMATION ON THE BEACH BALL TO DESCRIBE SOMETHING YOU COULD SENSE ABOUT A PERSON’S HEALTH

smart&pillow

Irregular sleep

patterns during past

2 MINUTES

STEP 2: SEND THAT INFORMATION TO THE CLOSEST CLOUD

cloudsmart&pillow

Irregular sleep

1 MINUTE

STEP 3: FROM THE CLOUD, SEND THE INFORMATION BALL UP TO THE FRONT FOR THE DOCTOR TO REVIEW

doctor

Irregular sleep

1 MINUTE

THE INTERNET OF THINGS IS HERE TO STAY

Image&Credit:&h.p://www.psC.com/2014/03/internet:of:things:infographic.html#!MsfBf

HUMAN SYSTEMS OF COMMUNICATION ARE BEING INFLUENCED BY THE DISTRIBUTED COMMUNICATION INHERENT TO THE INTERNET

SCARY?

WE NO LONGER LIVE IN A DISCONNECTED WORLD

UBIQUITOUS, FLEXIBLE COMPUTING IS A NORM

Image&Credit:&h.p://blogs.cisco.com/ioe/cisco:iox:an:applica4on:enablement:framework:for:the:internet:of:things/

COMMUNICATION & COLLABORATION ACCELERATES

Image&Credit:&h.p://bryansmith1138.com/2014/01/30/column:get:off:your:cell:phones/

THE IoT CAN EMPOWERHUMANS IN WAYSTHAT INCREASE THE QUALITY OF HOW WE LIVE THEIR LIVES

NOT SCARY

DESIGNERS AREUNIQUELY POSITIONEDAND SKILLED TOMAKE THE IoTHUMAN CENTERED

INSPIRING, IMHO

TOOLSWE USE

GRAB THIS WORKSHEET

CLIENT CHALLENGE:

YOUR CLIENT HAS HIRED YOU TO DESIGN A NEW MUSIC APPLICATION THAT IS ABLE TO DETECT PEOPLE’S ROUTINES AND PLAY MUSIC ACCORDINGLY.

CLIENT CHALLENGE:

THE APPLICATION CAN READ DATA FROM ANY DEVICE THEY ARE USING TO MAKE THAT POSSIBLE.

TOOLS WE USE !

1. ECOSYSTEMS

SIGNAL VIA WIREINVENTED BY

SOEMMERING & CAMPILLO

IMPLEMENTEDBY COOKE & OTHERS

IT USED TO BE SO SIMPLE…

POINT A

POINT B

X10000000000000000000

“THIS S%@T IS COMPLICATED.”— ME

TOOL 1: ECOSYSTEM MAPPING

1. LIST YOUR ENTITIES

DEVICES WHAT DEVICESWILL BE USED BY THOSE PEOPLE AND ACCESS OR TRANSMIT DATA?

SERVICES WHAT APPS AND SERVICES ARE PEOPLE USING ON THIS DEVICE?

PEOPLE WHO IS USING DEVICES IN YOUR ECOSYSTEM?

1. LIST YOUR ENTITIES

PEOPLE PERSONA 1PERSONA 2PERSONA 3PERSONA 4 …?

DEVICES SMARTPHONETABLETLAPTOP/PCSMART TVTHERMOSTATAUDIO SPEAKERFITNESS BANDCAR …?

SERVICES STREAMING MEDIA CLOUD LOCKERINTERNET RADIO SOCIAL MEDIA …?

!53PERSONA

2. SELECT A PERSONA

!54PERSONA

Joanna is a 37-year-old nurse that works in a hospital emergency room in Sioux Falls, Idaho. She lives in a three bedroom house, where she

takes care of her four-year-old daughter and cat.

Joanna’s needs around music enjoyment include making sure the music she plays at home is kid-safe,

discovering new high-energy songs for when she exercises, and staying awake when driving home.

SMART TVCamera

WE LIKE TO ARRANGE THEM BY FREQUENCY OF ACCESS.

3. PLACE THE DEVICES

SMART TVCamera

DEVICES AND ENVIRONMENTAL SENSORS PROVIDE IMPORTANT DATA TO YOU.

4. IDENTIFY SENSORS

SMART TVCamera

CLOUD LOCKER (i.e. iTunes Match)

STREAMING MUSIC LIBRARY (i.e. Spotify)

INTERNET RADIO (i.e. Pandora)

SOCIAL NETWORKS (i.e. Facebook, Twitter)

5. LIST AVAILABLE SERVICES

SMART TVCamera

6. DRAW THE RELATIONSHIPS

DOING THIS TAKES TIME. BUT IT SERVES AS YOUR FOUNDATION FOR THE ENTIRE IoT DESIGN PROCESS.

AND IT KEEPS THINGS LIKE THIS FROM HAPPENING

TOOLS WE USE !

1. ECOSYSTEMS 2. BEHAVIORS

“DESIGNERS NEED TO BE AT THE FRONT END OF THE SENSOR TRANSITION, SO THEY CAN HUMANIZE IT.”

— TIMOTHY MOREY, AVP OF STRATEGY, FROG

OUR THINGS GROW SMARTER EVERY DAY

WITH THIS INTELLIGENCE COMES A NEW LANGUAGE FOR COMMUNICATION

BEHAVIORS AND RELATIONSHIPS MUST BE DESIGNED

THE WHOLE WILL BE GREATER THAN THE SUM OF ITS PARTS

TOOL 2:DESCRIBING BEHAVIORS

GET NETWORKED. (WE MEAN: FIND A PARTNER.)

GRAB THIS WORKSHEET

CONNECTED SYSTEMS ARE INTELLIGENT (BUT COMPLEX)

SMART TVCamera

THIS COMPLEXITY CAN BE MANAGED THROUGH DESIGN

1. Pick what device would serve as Joanna’s primary touchpoint for controlling her music-listening experience.

2. Identify how Joanna would communicate with that object.

3. List out what data could be passed along to her secondary devices.

4. Outline ideas for how a secondary device would use that data.

When designing for the Internet of Things, we repeat this process for all devices.

•"voice"command"•"hand"gestures"•"facial"recogni4on

•"mood"/"temperament"•"music"selec4on

•"con4nue"the"music"currently"playing"in"car"•"play"music"selec4on"that"aligns"with"her"current"mood

TOOLS WE USE !

1. ECOSYSTEMS 2. BEHAVIORS 3. STORIES

STORIES HELP US ENVISIONTOUCHPOINTS IN AN ECOSYSTEM FROM UNIQUE POINTS OF VIEW

STORIES HELP US ENVISIONTOUCHPOINTS IN AN ECOSYSTEM FROM UNIQUE POINTS OF VIEWTOUCHPOINTS ARE THE INTERFACE BETWEEN PEOPLE & WHAT’S DESIGNED

POINTS OF VIEW ILLUMINATE A PARTICULAR CHARACTER’S PERSPECTIVE—OR PROVIDE A HOLISTIC VIEW OF THE ECOSYSTEM ITSELF

STORIES HELP US ENVISIONTOUCHPOINTS IN AN ECOSYSTEM FROM MULTIPLE POINTS OF VIEW

SMART TVCamera

THIS IS TOO ABSTRACT

EACH STORY YOU CREATEIS A SLICE OF A SYSTEMATICIoT SOLUTION.

STORIES WORK BEST WHEN THEY CONTAIN DETAILS THAT EXPLAIN WHY CHARACTERS CHOOSE TO ACT.

WHAT IS THEIR MOTIVATION?

STORIES WORK BEST WHEN THEY CONTAIN DETAILS THAT EXPLAIN WHY CHARACTERS CHOOSE TO ACT.

WHAT IS THEIR MOTIVATION? WHAT CONFLICT IS BEING RESOLVED?

WHO IS LOOKING AT THIS?

HOW DOES THIS HELP THEM?

TOOL 3:CREATINGSTORIES

GRAB THIS WORKSHEET

THIS IS THE MOST FUN & FAMILIAR PART OF THE PROCESS

WHO IS IN THE STORY? WHERE DO THEY GO? WHEN DO THEY GO THERE? WHAT DO THEY DO? WITH WHAT DEVICES? WHY?

1. WHAT HAPPENS?

2. DESCRIBE HOW

SKETCH OF KEY

MOMENT

Front of Index Card: Try to visually capture character,

time, place, and occasion.

Back of Index Card: Write down what happens, on what devices,

and using what data.

DESCRIBE WHAT

HAPPENS

Joanna"starts"dancing"with"her"daughter."The"TV"sees"the"ac4vity"and"instructs"the"thermostat"to"start"cooling"the"room.

When"driving"home,"Joanna"hears"a"song"she"likes"on"the"radio."She"tells"her"car"to"add"the"song"to"her"exercise"playlist.

Joanna"tells"the"television"to"switch"music"channels"to"children’s"music"and"transfer"to"the"portable"speaker.

smart"TV"+"thermostat car"+"fitness"band smart"TV"+"portable"speaker

data"about"music"type"and"ac4vity"level data"about"the"song"and"data"about"Joanna’s"playlists

data"about"music"type"and"user"type

WRAP UP

THE TECHNOLOGY TO BUILD THE IoT IS ALREADY HERE

Image&Credit:&h.p://djokic.org/internet:of:things/

OUR OBJECTS WILL SOON TALK, LEARN, AND COORDINATE ON OUR BEHALF

DESIGNERS ARE KEY FOR HUMANIZING THE IoT EXPERIENCE

WITH NEW TECHNOLOGY COMES NEW EXPECTATIONS FROM USERS

“IN THE INTERNET WORLD, IF YOU’RE DOING THE SAME THING YOU WERE DOING 6 MONTHS AGO, YOU’RE DOING SOMETHING WRONG.”

— BRUCE FEILER

Jennifer Dunnam jennifer.dunnam@frogdesign.com @jdunnam jenniferdunnam.com

David Sherwin david.sherwin@frogdesign.com @changeorder davidsherwin.com

THANK YOU! AND LET US KNOW HOW YOU USE THESE TOOLS IN YOUR WORK. !GET THIS DECK AT SLIDESHARE.NET/FROGDESIGN

See you on Thursday? 3:00–3:30 PM: Signing Creative Workshop & Success by Design 4:30–5:30 PM: “Creating Creative Superteams”

Off the Page Into the Wild: Designing For the Internet of Things

Design

Transcript of Off the Page Into the Wild: Designing For the Internet of Things

January-March 2013 Wild Things

Kids and Other Wild Things

Where the Wild Things Are: Designing for Pollinators

Wild Things at School

Wild things pancakes

Designing robots in the wild

Unicorns and Other Wild Things

Attracting Wild Things! - extension.unl.edu

June 2013 Wild Things

Wild Things - June 2011

April 2010 Wild Things

Designing Internet Of Things

Where the Wild Things Aren't

September/October Wild Things

April-May 2014 Wild Things

Zest - Wild Things

April 2012 Wild Things

Wild Things Feb - Mar 2011

Wild Things Tactical

January-March 2014 Wild Things