Wearable Computing - High-Low Techhighlowtech.org/publications/buechley_Pervasive_08.pdf ·...

4
12 PERVASIVE computing Published by the IEEE CS 1536-1268/08/$25.00 © 2008 IEEE Wearable Computing Editor: Paul Lukowicz University of Passau [email protected] The LilyPad Arduino: Toward Wearable Engineering for Everyone Leah Buechley and Michael Eisenberg E lectronic textiles, or e-textiles, are an increasingly important part of wearable computing, helping to make pervasive devices truly wearable. These soft, fabric-based computers can func- tion as lovely embodiments of Mark Weiser’s vision of ubiquitous comput- ing: providing useful functionality while disappearing discreetly into the fabric of our clothing. E-textiles also give new, expressive materials to fashion designers, textile designers, and artists, and garments stemming from these disciplines usu- ally employ technology in visible and dramatic style. Integrating computer science, electrical engineering, textile design, and fashion design, e-textiles cross unusual boundaries, appeal to a broad spectrum of people, and pro- vide novel opportunities for creative experimentation both in engineering and design. Moreover, e-textiles are cutting- edge technologies that capture people’s imagination in unusual ways. (What other emerging pervasive technology has Vogue magazine featured?) Our work aims to capitalize on these unique features by providing a toolkit that empowers novices to design, engineer, and build their own e-textiles. THE LILYPAD ARDUINO Researchers, designers, students, and hobbyists can use the LilyPad Arduino construction kit to build soft, wearable computers. Figure 1 illustrates the most recent version of the kit—a commer- cially available product that we devel- oped in collaboration with SparkFun Electronics. It contains a main board, which runs on 2.7 5.5 V and comprises an ATmega168V microcontroller, a reset switch, an indicator LED, 16 Kbytes of pro- gram memory, an 8-MHz processor, a 10-bit analog-to-digital converter, and 20 I/O pins, including 6 analog inputs and 6 pulse-width modulation (PWM) outputs; a 5 V power supply—with one AAA battery, an on/off switch, an indica- tor LED, and an NCP 1400 DC-DC step-up converter, and capable of supplying a maximum of 100 mA; a speaker; a vibrating coin-cell pager motor; an accelerometer with an ADXL330 3-axis acceleration sensor, +/ 3 g in each direction, and an analog output of 0 3 V; an ambient light sensor, with an ana- log output of 0 5 V; and an RGB LED. To build an e-textile, the user sews modules together. The “petals” on each flower-like module can be sewn through with conductive thread that creates both physical and electrical connections, attaching components to a design’s back- ground fabric and providing buses for power and data transmissions between pieces. The user can program the micro- controller in C with the popular open source, free, and relatively user-friendly Arduino programming environment, downloading programs to the board via a USB-to-serial adapter. We based the commercial kit shown in figure 1 on the research prototypes we developed at the Craft Technology Lab. Although the commercial version uses traditional, hard printed circuit boards (PCBs), we based our research proto- types on soft, laser-cut fabric PCBs—a technology we developed that lets us implement complex circuitry on cloth. Figure 2 shows a close-up of a fabric- based LilyPad microcontroller module sewn into a dance costume we made. In this version, the stitching goes directly through the PCB’s conductive fabric, and embedded sensors control computer- generated music and lighting. (In the commercial version, holes in the petals allow for a similar kind of sewing.) Table 1 describes several other de- vices that people have built with the kit. Our motivation in developing the LilyPad Arduino was to build an acces- sible yet powerful and open-ended toolkit. We strove to develop a system roughly analogous to the popular Lego Mindstorms kit that introduces people to robotics. We wanted to create a medium that could engage a variety of people in creative experimentation with computing and electronics while teach- ing them basic skills in these areas. To evaluate our kit, we conducted user studies that have interesting implica- Authorized licensed use limited to: MIT Libraries. Downloaded on March 28,2010 at 09:54:29 EDT from IEEE Xplore. Restrictions apply.

Transcript of Wearable Computing - High-Low Techhighlowtech.org/publications/buechley_Pervasive_08.pdf ·...

Page 1: Wearable Computing - High-Low Techhighlowtech.org/publications/buechley_Pervasive_08.pdf · Wearable Computing Editor: ... pervasive devices truly wearable. These soft, fabric-based

12 PERVASIVE computing Published by the IEEE CS 1536-1268/08/$25.00 © 2008 IEEE

Wearable ComputingEditor: Paul Lukowicz University of Passau [email protected]

The LilyPad Arduino: Toward Wearable Engineering for EveryoneLeah Buechley and Michael Eisenberg

E lectronic textiles, or e-textiles, are an increasingly important part of

wearable computing, helping to make pervasive devices truly wearable. These soft, fabric-based computers can func-tion as lovely embodiments of Mark Weiser’s vision of ubiquitous comput-ing: providing useful functionality while disappearing discreetly into the fabric of our clothing.

E-textiles also give new, expressive materials to fashion designers, textile designers, and artists, and garments stemming from these disciplines usu-ally employ technology in visible and dramatic style. Integrating computer science, electrical engineering, textile design, and fashion design, e-textiles cross unusual boundaries, appeal to a broad spectrum of people, and pro-vide novel opportunities for creative experimentation both in engineering and design.

Moreover, e-textiles are cutting-edge technologies that capture people’s imagination in unusual ways. (What other emerging pervasive technology has Vogue magazine featured?) Our work aims to capitalize on these unique features by providing a toolkit that empowers novices to design, engineer, and build their own e-textiles.

THE LILYPAD ARDUINOResearchers, designers, students, and hobbyists can use the LilyPad Arduino construction kit to build soft, wearable computers. Figure 1 illustrates the most

recent version of the kit—a commer-cially available product that we devel-oped in collaboration with SparkFun Electronics. It contains

a main board, which runs on 2.7 5.5 V and comprises an ATmega168V microcontroller, a reset switch, an indicator LED, 16 Kbytes of pro-gram memory, an 8-MHz processor, a 10-bit analog-to-digital converter, and 20 I/O pins, including 6 analog inputs and 6 pulse-width modulation (PWM) outputs;a 5 V power supply—with one AAA battery, an on/off switch, an indica-tor LED, and an NCP 1400 DC-DC step-up converter, and capable of supplying a maximum of 100 mA; a speaker;a vibrating coin-cell pager motor;an accelerometer with an ADXL330 3-axis acceleration sensor, +/ 3 g in each direction, and an analog output of 0 3 V;an ambient light sensor, with an ana-log output of 0 5 V; andan RGB LED.

To build an e-textile, the user sews modules together. The “petals” on each flower-like module can be sewn through with conductive thread that creates both physical and electrical connections, attaching components to a design’s back-ground fabric and providing buses for power and data transmissions between pieces. The user can program the micro-

•••

controller in C with the popular open source, free, and relatively user-friendly Arduino programming environment, downloading programs to the board via a USB-to-serial adapter.

We based the commercial kit shown in figure 1 on the research prototypes we developed at the Craft Technology Lab. Although the commercial version uses traditional, hard printed circuit boards (PCBs), we based our research proto-types on soft, laser-cut fabric PCBs—a technology we developed that lets us implement complex circuitry on cloth.

Figure 2 shows a close-up of a fabric-based LilyPad microcontroller module sewn into a dance costume we made. In this version, the stitching goes directly through the PCB’s conductive fabric, and embedded sensors control computer- generated music and lighting. (In the commercial version, holes in the petals allow for a similar kind of sewing.)

Table 1 describes several other de-vices that people have built with the kit.

Our motivation in developing the LilyPad Arduino was to build an acces-sible yet powerful and open-ended toolkit. We strove to develop a system roughly analogous to the popular Lego Mindstorms kit that introduces people to robotics. We wanted to create a medium that could engage a variety of people in creative experimentation with computing and electronics while teach-ing them basic skills in these areas. To evaluate our kit, we conducted user studies that have interesting implica-

Authorized licensed use limited to: MIT Libraries. Downloaded on March 28,2010 at 09:54:29 EDT from IEEE Xplore. Restrictions apply.

Page 2: Wearable Computing - High-Low Techhighlowtech.org/publications/buechley_Pervasive_08.pdf · Wearable Computing Editor: ... pervasive devices truly wearable. These soft, fabric-based

APRIL–JUNE 2008 PERVASIVE computing 13

tions for pervasive computing, engi-neering education, and the technology world more broadly.

USER STUDIESSo far we’ve conducted six user studies where people of various ages and back-grounds used versions of the LilyPad Arduino to build their own wearables. Each study was in the format of a work-shop titled “Learn to Build Your Own Electronic Fashion” and had a simi-lar structure. At each session’s start, participants—most of whom had no previous programming or electronics experience—were introduced to these topics as well as to sewing techniques. Then, under an instructor’s guidance, they designed and built a wearable. Each workshop culminated in a fash-ion show or exhibition that let the par-ticipants show off their work to friends and family. Figure 3 shows pictures from two workshops: in figure 3a, two girls work on their designs, while in fig-ure 3b, two teenagers have fun with a project during an exhibition party. A

touch-sensitive shirt—built by the girl in figure 3b—makes silly noises when someone squeezes her waist.

We taught three workshops to middle and high school students (ages 10 to 17) in school or after-school settings. In each case, the workshop was listed in a course catalog and students signed up

voluntarily. We taught the other three workshops to a mixture of teenagers and adults whom we invited.

The workshops provided us with set-tings that we used to iteratively improve our kit design and develop an e-textile course curriculum. In our final two classes, having developed a stable class

(b)(a)

Reset switch

1/tx

UART bootloaderprogramming header (plugs

into USB serial adapter)

Analoginput

PWM: Pulse-width modulationUART: Universal asynchronous receiver/transmitter

SPI programming

header

ATmega168V

Status LEDblinks on reset

0/rx a5a4

a3

a2

a1

a0

13

12

10

PWMPWM 11

987

PWM

5

6 PWM

+

4

3 PWM

2

Figure 1. The LilyPad Arduino kit. (a) The microcontroller is in the center. From the bottom going clockwise: power supply, speaker, vibrating motor, accelerometer, light sensor, and RGB LED. (b) Diagram of the microcontroller module.

Figure 2. A textile-based LilyPad Arduino module.

Authorized licensed use limited to: MIT Libraries. Downloaded on March 28,2010 at 09:54:29 EDT from IEEE Xplore. Restrictions apply.

Page 3: Wearable Computing - High-Low Techhighlowtech.org/publications/buechley_Pervasive_08.pdf · Wearable Computing Editor: ... pervasive devices truly wearable. These soft, fabric-based

14 PERVASIVE computing www.computer.org/pervasive

WEARABLE COMPUTING

WEARABLE COMPUTING

structure and usable kit, we began to investigate more complex issues. We were particularly interested in motiva-tional and affective issues: who chooses to participate in our courses, why they choose to do so, whether they become engaged in the experience, and what, if any, lasting impact participating in a workshop has on them.

Although our studies are preliminary, the results are suggestive and interest-ing. First, in the three workshops in which participants were (self-selected) middle and high school students, 25 out of 31 attendees were young women. In a remarkable reversal of traditional patterns, we were able to consistently attract overwhelming female majorities

to what is essentially an embedded com-puting course. What’s more, many of the students (though not all) expressed passionate interest and engagement in the class. Here is a sample of positive feedback from four students that we collected from surveys and an unsolic-ited email:

[The class] was amazingly fun, I learned a lot, and we get a really cool garment out of the class!

[I would be interested in taking another class in electronic fashion] because you make something that has technology but it still has the design aspect.

I think electronic fashions would be cool presents.

My friends thought my hat [was] sooooooo cool … so I’m just sending you an email to say I loved your camp so much!

Our data also indicates that the exper-ience might have been an empowering and motivating one for some students. In the last workshop, five out of eight students who completed post-surveys reported that they’d be interested in tak-ing future classes in electronics or com-puter science as a result of their experi-ence, and one 15 year old wrote in a survey that she’d probably take future classes in computer science because “I thought programming would be a lot harder than it really is.”

T hese results point the way toward interesting avenues for future inves-

tigation. E-textiles might well serve as an introduction to longer-term inter-est in computing and engineering. But beyond this, e-textiles might ultimately produce a sea change in the ways that students perceive computation and technology. After all, it wasn’t so long ago when computers were room-sized

(b)(a)

Figure 3. Students at work during our user studies. (a) Two students work on their e-textile designs. (b) Students have fun with the wearables they built.

TABLE 1 Devices built with the LilyPad Arduino.

Description Components Creator, setting

Touch-sensitive shirt; makes silly sounds when it is touched in certain places.

Main board, power supply, speaker, skin resistance sensors built from conductive fabric

A 17-year-old girl, during an electronic-fashion workshop

Police hat that makes siren noises when a switch is pressed.

Main board, power supply, speaker, switch

A 10-year-old boy, during an electronic-fashion workshop

Fortune-telling shirt; when the wearer touches a button, the shirt answers a question by randomly lighting up an LED next to a phrase like “Most definitely.”

Main board, power supply, LEDs, switch

A professional teacher, during an electronic-fashion workshop

Neural network quilt with squares that can be snapped together with different “weight” strips to form a simple neural network; LEDs show which neurons are firing.

Several main boards, LEDs, resistors

Graduate students, during an embedded-computing course

A hat that keeps its wearer awake: when the wearer’s head falls to his chest, vibrating motors shake and speakers chime to keep him awake.

Main board, power supply, accelerometer, vibrating motors, speaker

A graduate student, during a physical-computing course

Authorized licensed use limited to: MIT Libraries. Downloaded on March 28,2010 at 09:54:29 EDT from IEEE Xplore. Restrictions apply.

Page 4: Wearable Computing - High-Low Techhighlowtech.org/publications/buechley_Pervasive_08.pdf · Wearable Computing Editor: ... pervasive devices truly wearable. These soft, fabric-based

APRIL–JUNE 2008 PERVASIVE computing 15

WEARABLE COMPUTING

“giant brains” and available only to a few elite practitioners in academia, government, and industry. Computing is certainly more widespread and acces-sible today; but as a field of study, it can still seem unnecessarily exclusive and daunting to the hobbyist or begin-ner. The image of the obsessive, reclu-sive hacker does have an idiosyncratic appeal; but at the same time, it conjures echoes of the removed fraternity of technicians from the earlier era.

E-textiles present an alternative look at computation—pervasive, soft, flir-tatious, playful, theatrical. We can at least imagine such a style of computa-tional design as an enticement to chil-dren or teenagers who would otherwise feel that technology is only for passive consumption. Our possibly utopian hope is that e-textile design can, over time, become a means through which hobbyists, craftspeople, and (perhaps most powerfully) children can become technologically fluent—and can express themselves creatively as well.

ACKNOWLEDGMENTS

We thank the US National Science Foundation for

funding this research under grant EIA-0326054.

Leah Buechley is a postdoc-

toral researcher in the Craft

Technology Group and the

Computer Science Depart-

ment at the University of

Colorado at Boulder. Con-

tact her at Leah.Buechley@

colorado.edu.

Michael Eisenberg is an

associate professor in the

Department of Computer

Science and the Institute of

Cognitive Science at the Uni-

versity of Colorado at Boul-

der. Contact him at duck@

cs.colorado.edu.

EXECUTIVE COMMITTEE

President: Rangachar Kasturi*President-Elect: Susan K. (Kathy) Land,

CSDP;* Past President: Michael R.Williams;* VP, Electronic Products & Ser-vices: George V. Cybenko (1ST VP);* Sec-retary: Michel Israel (2ND VP);* VP, Chap-ters Activities: Antonio Doria;† VP,Educational Activities: Stephen B. Seid-man;† VP, Publications: Sorel Reisman;†VP, Standards Activities: John W. Walz;†VP, Technical & Conference Activities:Joseph R. Bumblis;† Treasurer: Donald F.Shafer;* 2008–2009 IEEE Division VDirector: Deborah M. Cooper;†2007–2008 IEEE Division VIII Director:Thomas W. Williams;† 2008 IEEE DivisionVIII Director-Elect: Stephen L. Diamond;†Computer Editor in Chief: Carl K. Chang†

* voting member of the Board of Governors† nonvoting member of the Board of Governors

BOARD OF GOVERNORS

Term Expiring 2008: Richard H. Eckhouse;James D. Isaak; James Moore, CSDP; GaryMcGraw; Robert H. Sloan; Makoto Takiza-wa; Stephanie M. White

Term Expiring 2009: Van L. Eden; RobertDupuis; Frank E. Ferrante; Roger U. Fujii;Ann Q. Gates, CSDP; Juan E. Gilbert; DonF. Shafer

Term Expiring 2010: André Ivanov; PhillipA. Laplante; Itaru Mimura; Jon G. Rokne;Christina M. Schober; Ann E.K. Sobel; Jef-frey M. Voas

Next Board Meeting:16 May 2008, Las Vegas, NV, USA

EXECUTIVE STAFF

Executive Director: Angela R. Burgess; Direc-tor, Governance, & Associate ExecutiveDirector: Anne Marie Kelly; Associate Pub-lisher: Dick Price; Director, MembershipDevelopment: Violet S. Doan; Director,Finance & Accounting: John Miller; Direc-tor, Information Technology & Services:Neal Linson

COMPUTER SOCIETY OFFICESWashington Office. 1828 L St. N.W., Suite

1202, Washington, D.C. 20036-5104Phone: +1 202 371 0101Fax: +1 202 728 9614Email: [email protected]

Los Alamitos Office. 10662 Los VaquerosCircle, Los Alamitos, CA 90720-1314Phone: +1 714 821 8380Email: [email protected] & Publication Orders: Phone: +1 800 272 6657Fax: +1 714 821 4641Email: [email protected]

Asia/Pacific Office. Watanabe Building, 1-4-2Minami-Aoyama, Minato-ku, Tokyo 107-0062, JapanPhone: +81 3 3408 3118Fax: +81 3 3408 3553Email: [email protected]

IEEE OFFICERSPresident: Lewis M. Terman; President-

Elect: John R. Vig; Past President: LeahH. Jamieson; Executive Director & COO:Jeffry W. Raynes; Secretary: Barry L.Shoop; Treasurer: David G. Green; VP,Educational Activities: Evangelia Micheli-Tzanakou; VP, Publication Services &Products: John Baillieul; VP, Membership& Geographic Activities: Joseph V. Lillie;VP, Standards Association Board ofGovernors: George W. Arnold; VP,Technical Activities: J. Roberto B.deMarca; IEEE Division V Director:Deborah M. Cooper; IEEE Division VIIIDirector: Thomas W. Williams; President,IEEE-USA: Russell J. Lefevre

PURPOSE: The IEEE Computer Society is the world’s largest association of computingprofessionals and is the leading provider of technical information in the field.

MEMBERSHIP: Members receive the monthly magazine Computer, discounts, andopportunities to serve (all activities are led by volunteer members). Membership isopen to all IEEE members, affiliate society members, and others interested in thecomputer field.

COMPUTER SOCIETY WEB SITE: www.computer.orgOMBUDSMAN: Call the IEEE Member Services toll-free number, +1 800 678 4333 (US) or

+1 732 981 0060 (international), or email [email protected].

revised 3 Mar. 2008

Authorized licensed use limited to: MIT Libraries. Downloaded on March 28,2010 at 09:54:29 EDT from IEEE Xplore. Restrictions apply.