NASA Internship Final Report

Johnson Space Center 1 August 25, 2013

Wearable Technology

Amanda Watson

NASA CENTER

Major: Computer Science and Mathematics

Intern Summer Session

Date: 26 JUL 13

https://ntrs.nasa.gov/search.jsp?R=20140000961 2018-06-27T21:50:26+00:00Z

NASA Internship Final Report

Johnson Space Center 2 August 25, 2013

Wearable Technology

Amanda Watson Drury University, Taylor Lake Village, TX, 77586

Abstract Wearable technology projects, to be useful, in the future, must be seamlessly integrated with the

Flight Deck of the Future (F.F). The lab contains mockups of space vehicle cockpits, habitat living quarters, and workstations equipped with novel user interfaces. The Flight Deck of the Future is one element of the Integrated Power, Avionics, and Software (IPAS) facility, which, to a large extent, manages the F.F network and data systems. To date, integration with the Flight Deck of the Future has been limited by a lack of tools and understanding of the Flight Deck of the Future data handling systems. To remedy this problem it will be necessary to learn how data is managed in the Flight Deck of the Future and to develop tools or interfaces that enable easy integration of WEAR Lab and EV3 products into the Flight Deck of the Future mockups. This capability is critical to future prototype integration, evaluation, and demonstration. This will provide the ability for WEAR Lab products, EV3 human interface prototypes, and technologies from other JSC organizations to be evaluated and tested while in the Flight Deck of the Future. All WEAR Lab products must be integrated with the interface that will connect them to the Flight Deck of the Future. The WEAR Lab products will primarily be programmed in Arduino. Arduino will be used for the development of wearable controls and a tactile communication garment. Arduino will also be used in creating wearable methane detection and warning system.

Nomenclature Ω = ohm, unit of electrical resistance JSC = Johnson Space Center, a NASA sight in Houston, Texas EV3 = A division of Electronics Aviation dealing with Human Interface IPAS = Integrated Power, Avionics, and Software facility, where the Flight Deck of the Future is F.F = Flight Deck of the Future, test lab in the IPAS facility WEAR = Wearable Electronics Application and Research Arduino = Programming Language based in C that runs the Arduino circuit boards TX = Pin on the Arduino1 board and Xbee breakout board used for transmitting data RX = Pin on the Arduino board and Xbee breakout board used for receiving data VCC = Positive-voltage supply GND = Negative-voltage supply JST = Japan Solderless Terminals, used to integrate the lithium ion battery

I. Introduction Wearable technology combines the functionality of electronics with the convenience of fabrics and

clothing. Putting electronics on the body and making devices hands free will allow for higher efficiency, more productivity, and improvements in safety. Many challenges result from combining traditionally rigid electronics with the soft and flexible fabrics. Along with the technical challenges that stem from producing flexible and wearable electronics, wearable technology is a very vast field with many areas of expertise. There is a need for future collaboration between specialists so that new and more advanced devices can be created.

II. Manufacturing Process To successfully integrate circuits into the garments, a specific manufacturing process is used. All circuits

should be implemented off of the garment before trying to integrate them. First the circuit should be laid out on the desktop, diagramed, and programmed. After a diagram of the circuit is created, the circuit should be modified so that no wires cross. Conductive thread should not overlap in a circuit as the different threads are exposed and could cross signals. Then the circuit should be sewn onto the garment, testing the components as they are sewn in. Once all components are working, bind all of the edges and do not leave unnecessary conductive threads exposed.

Johnson Sp

ThPro Minconductismall ananalog inthread th

T

connect VCC pinArduinoLilyPad boards inconnect ArduinoLilyPad XBee brpredefin

Wmove whencomputer.

Xrequire a laintegrate inXbee radio

Figure 2. mounLilypa

breako

pace Center

he basic circuii board, a Xbeeive thread to co

nd light circuit bnputs. The pinshrough the thro

ca

Li

pA

o construct thethe battery to t

n on the Arduin Pro Mini boarXBee breakoun the circuit shthe TX and RX board, use theXBee breakou

reakout board sed RX and TX

Wireless commun using a garmThese method

Xbee radios arearge breakout bnto the garmenos are the simp

Xbee radio nted on a ad Xbee out board

Figure

t to be used in e radio2, a lithionnect the comboard that has s are through h

ough hole and t

connect to powand GND.

Xbee ra

LilyPad XBee integration into

power, groundArduino Pro M

e circuit, use a the circuit and no Pro Mini bord. When switcut board to the Vhould be powerX pins on the Le Software Seriut board shouldshould connect

X pins but if the

IV. Wirelunication is im

ment. There are s are Xbee rad

e large and bulkboard. The larg

nt as it is easierlest to integrat

e 1. The Basic C

NASA Inte

3

III. Themost WEAR L

ium ion batterymponents. The A

fourteen digitahole solder pointying it off or s

wer and ground

dios allow for breakout board

o a garment sim

, TX, and RX tMini Board and

lithium ion batturn the circuit

oard. Then connched on, this wVCC on the Arred. To connectLilyPad XBee bial library to ded connect to thet to the TX on tey are in use w

less Communmportant in wea

two commonlyios and Blueto

ky when compge breakout boar to sew throughe and if you pr

Circuit this is the

ernship Final R

3

e Basic CircuLab products uy, JST connectoArduino Pro Mal input/output nts which allowsoldering it. Th

d through the pi

wireless commd4 has power remple. A LilyPa

to power the bothe computer.

ttery as a powet on and off. Cnect the groun

will provide powrduino Pro Mint the wireless cbreakout boardefine these twoe RX on the Arthe Arduino Pr

while reprogram

nication arable technoloy used wirelessoth.

pared to the othard makes the h the solder porovide them wi

e base for the oth

Report

uit uses an Arduinoor and switch,

Mini Board3 is apins and eight

ws for wrappinhe board must

ins labeled VC

munication fromegulation and ead XBee breako

oard and provi

er source and aConnect the pownd from the JSTwer to the boarni board and thcommunicationd to two digitalo digital pins asrduino Pro Minro Mini board.

mming the boar

ogy because it is communicati

her methods anXbee radio eas

oints and arounith a power sou

her circuits desc

Augu

o and a t ng

CC

m the garment easy to sew to out board must

ide communica

a JST connectower from the JST connector to rd. Next conneche “-” to the grn feature of thel pins. When prs a TX and a Rni board. The RThe Arduino P

rd, an error wil

is important toion methods fr

nd they also sier to

nd the board. urce the

Figure

cribed in the pap

ust 25, 2013

to the computetabs to make t be connected

ation between t

or and switch toST connector tthe GND pin oct the “+” on thround. Now alle Xbee radio, rogramming th

RX. The TX onRX on the LilyPro Mini boardll be thrown.

have freedomom a device to

1. Arduino Proboard

per.

Figure 2. Xbee rradio is used in forearm sleeves

accelerome

er. A

d to

the

o to the on the he l

he n the yPad d has

m to o a

o Mini

radio This all of the s but the eter

NASA Internship Final Report

Johnson Space Center 4 August 25, 2013

radios will immediately connect with each other.

Bluetooth chips are small and flat and the breakout boards are small and linear making them easier to integrate. Each Bluetooth device, when connected to the computer needs its own virtual serial port. To use multiple Bluetooth chips concurrently, the user must open each serial port separately, this can become very time consuming. Bluetooth

chips also frequently disconnect from the computer and are not very reliable.

V. Wearable Controls To pursue research in wearable technology, a first step is to explore the methods and mechanisms of basic

electronic structures integrated into garments. Four different controls to pursue are buttons, pressure sensors, capacitive touch sensors, and an accelerometer. These controls were chosen because they are all available in the lab and they can all be used to perform the same tasks. The controls can be used to interact with applications on the computer. Each control presents its own advantages, disadvantages, and complications. To easily test the controls and allow the user comfortably change between the control garments, the electronics will be integrated into forearm sleeves.

Figure 4. The 4 Wearable Controls from right to left, they are the Buttons Control, the Pressure Sensor Control, the Capacitive Touch Sensor Control and the Accelerometer Control

A. Buttons Buttons are the most widely used and familiar of the controls.

Buttons can be implemented on separate pins or if the buttons have varying resistances, in parallel. A parallel circuit of buttons will use a single analog pin and ground, while individual buttons will each need their own digital ports and can share a ground. The string of buttons used in the garment is Fibretronics Lite Keypad5. These buttons are encased in a soft rubber which allows for more flexibility when integrated into the forearm sleeve. The buttons are also lightweight so that the user will not be affected by the weight. When pressed the buttons provide the user with tactile and auditory feedback.

Figure 3. Bluetooth device This chip is used in the accelerometer forearm sleeve

Figure 5. Fibretronics Lite Keypad these are the buttons integrated into the button forearm sleeve

Johnson Sp

Thpressed wiwith the strthe middlethe differen

Figure 6. B

B. PressuPr

seamless inof pressureup a pressuthreshold t

the variablpower and

resistor con1023. To svalue and ointegratingBut with itthese instanconcurrent

pace Center

he Fibretronicsll output a diffring of buttons, where the butnt resistances a

Buttons Circuit D

ure Sensor ressure sensorsntegration into e which gives ture sensor as a the sensor will

To read a value pressure sensthe other to gr

nnect, connect et up a pressuronce the value

g the pressure st sensing pressunces, a safety ptly be activatin

s Lite Keypad ferent resistancs and a resistorttons and the reand can interpr

Diagram

s are flexible, tthe forearm sl

the pressure senon and off butregister on.

ue from the varsor and a resistround. In the m

to an analog inre sensor as an exceeds the th

sensor, it can beure, errors and pressure sensorg the safety pre

NASA Inte

5

is set up so thace. To integrate. Connect one esistor connectret the buttons

thin, and lightwleeve. Pressurensor more functton, set a thres

riable pressure tor. Connect on

middle, where th

nput pin. The aon/off button,

hreshold the dee put onto any mishaps could

r is integrated. essure sensor.

F

ernship Final R

5

at the 5 buttonse this control inside of the voltt, connect to anseparately.

weight which ae sensors can dectionality then shold, that once

sensor, create ne side of the vhe variable pre

analog pin willset a thresholdvice will registlayer within th

d stem from accTo be able to u

Figure 7. Button

Report

s are in a parallnto a forearm stage divider ton analog input

allow for almosetect varying djust on and offe the value exc

a voltage dividvoltage divideressure sensor a

l read a value fd or the pressurter on. When he garment, as cidental activause the other p

ns circuit integr

Augu

lel circuit. Eacsleeve, create ao power and thepin. The analo

st degrees f. To set ceeds that

der with r to and the

from 0 to re sensor

it does not neeation of the senpressure sensor

rated into fabri

Fig

ust 25, 2013

ch button, whena voltage dividee other to grounog input pin wi

ed direct contansors. To try to rs the user mus

ic

gure 7. Pressure

n er nd. In ll read

act. limit

st

e Sensor

Johnson Sp

Figure 8. P

C. CapaciC

itself is mamade into conductiveeasily sinctouch sensCapacitiveerrors and integrated.sensor

Ccapacitive design suchdesign is cthe conducwill be a dtouch sensaccount for

before the when the c

pace Center

ressure Sensor

itive Touch Seapacitive touch

ade of a soft flevarying shapes

e thread. Thesee the conductivors are most ap

e touch sensors mishaps that c To be able to

onductive thretouch sensor. Th that there areovered the use

ctive thread capigital pin that ror will be connr an electrostat

sense pin. Thiscircuit is compl

Diagram

ensor h sensors can bexible materials and designs. Te sensors do nove fabric or emppropriate wherun the risk of

could stem fromuse the other p

ead can be embThe conductivee two separate er will have compacitive touch registers a highnected to powetic shock, a res

s pin will regislete.

NASA Inte

6

be made with e, it can be integThe sensor cant provide any a

mbroidery has aen a force cannf a conductive m accidental acpressure sensor

broidered or sewe thread shouldsides. When thmpleted the cirsensor, a sense

h or low value. er and the othersistor of about

ster the change

ernship Final R

6

either conductivgrated seamlesn either be madauditory feedbaa different textunot be applied omaterial touch

ctivation of thers the user mus

wn into a garmd be embroiderhe entire condurcuit. To constre will be used.

One side of thr connected to 1000 ohms sho

in voltage from

Fi

Report

ve thread or cossly into the forde with conducack but the useure then the noor no force is nhing the sensorse sensors, a safest concurrently

ment to create ared or sewn in uctive thread ruct a circuit foThe sense pin

he capacitive sense pin. To

ould be placed

m high to low

igure 9. Pressur

Augu

onductive fabrirearm sleeve. T

ctive fabric or eer will be able onconductive faneeded to contrs and activatin

fety capacitive tbe activating t

a a

or

re sensor circui

Figure Capaci

ust 25, 2013

ic. Since the seThis control caembroidered wto locate the se

fabric. Capacitirol a garment. g. To try to limtouch sensor isthe safety pres

it integrated int

10. Embroideritive Touch Sen

ensor an be with ensor ive

mit s sure

to fabric

red nsor

Johnson Sp

CTo read a vWhen the sreceive pinchange in tconductivesense and rresistor betsensitivity larger resissensor to aresponse tiresistor of

pace Center

Figure

onductive fabrvalue from the send pin changn’s state changethe capacitancee thread shouldreceive pins. Ttween the sendof the sensor;

stor can activatactivate throughime then the larabout 1000 oh

11. Embroidere

ric can be sewncapacitive tou

ges to a new staes. Count is ane of the sensor.

d be sewn arounThe setup of thid pin and the rethe smaller reste while inchesh other layers orger resistors.

hms should be p

Figure 12. C

NASA Inte

7

ed Capacitive To

n into a garmenuch sensor, a seate, a counter bn arbitrary unit . To integrate tnd the edges ofis circuit will reeceive pin. Adjsistors will requs away from abof fabric. The sTo account fo

placed before t

Conductive Fabr

ernship Final R

7

ouch Sensor Diag

nt to create a caend pin and a rebegins and contbut it allows th

the fabric with f the fabric andequire a 100 kiusting this resiuire touching t

bsolute touch. Tsmaller sensorsr an electrostatthe receive pin

ric Capacitive T

Report

gram

apacitive toucheceive pin willtinues to counthe user to readthe electronics

d then connecteilohm – 50 meistor changes ththe sensor whilThis would allos have a much tic shock, anot.

Touch Sensor D

Augu

h sensor. l be used. t until the

d a s ed to gohm he le the ow the faster

ther

Diagram

Fig

ust 25, 2013

gure 12. Conducttive Fabric

Johnson Sp

D. AcceleA

The hardwoutputs yawcan be derimeasure thforearm sle

the wrist dthe left. Gintuitive an

TThe contro

A. Phone A

and then hFor the acwould endthe actions

B. Cautio Th

The user wspecified obuttons antop 4 buttowould movdemo woua sequence

pace Center

rometer Accelerometers ware is small an

w, pitch, and roived. For the te

he movement oeeve. The mov

own, turning thGesture control nd least tiring m

o test each of tols were rated o

Call Answering a phhang up the phcelerometer, tu

d the phone cals that happened

Figure

on and Warninhe second demwould be askeorder to be ab

nd sensors, theons. For the accve the paddle uld prove that th

e of buttons.

are hands freend light but notoll. From thoseest interfaces itof a forearm sinvement used are

he wrist to the should be studmovements to u

the four wearaon their ease of

hone call was thone. For the burning the wrill. This demo wd on the interfa

e 14. Phone Dem

ng Alarm mo was a cautio

d to hit a sequble to deactivase actions woucelerometer, pountil the alarmhe user can eas

NASA Inte

e devices that ret flexible. This e values many t was importannce it was imple pointing the w

right, and turndied to discoveruse.

VI.able controls’ af use, functiona

the first and simbuttons and senst to the left wwould prove thace.

mo

on and warninguence of butto

ate the alarm. uld be mappedointing the wri

m was turned osily remember

ernship Final R

8

ely on movemeaccelerometer different gestu

nt to be able to lemented in a wrist up, point

ning the wrist tor the most

Testing ability to compality, and accur

mplest demo. Tnsors, these acwould answer that the user ca

g alarm. ons in a For the d to the st down

off. This and use

Figure 1

Report

ent. r ures

ting

o

plete common tracy.

The user woulctions would bthe phone call

an easily associ

Figure 13. A

5. Alarm Demo

Augu

task four test i

ld be asked to e mapped to twl and turning tiate the button

Accelerometer

o

ust 25, 2013

interfaces were

answer a phonwo separate buthe wrist to thens or movemen

with Bluetooth

e built.

ne call uttons. e right nt with

attachment

Johnson Sp

C. Naviga Th

asked to nthe paper sensors, thacceleromePointing thwrist rightwould moveasily reme

D. Space I Th

shoot at inwill not fintop 3 buttothe ship rig

Owere not abways of kemore breatthem.

Eto activate.buttons alsdemos andfeedback wsafety shouwere easy

pace Center

ation he third demoavigate the paairplane are u

hese actions woeter, pointing he wrist downt would move ve the airplaneember a specif

Invaders he fourth dem

nvaders. This dnish the demo ons. For the acght and turning

Overall the layoble to reach all

eeping the electthable in the fu

ach wearable c. The circuit deso produced tacd troubleshootinwas preferable.uld be moved tto find on the g

o was a navigper airplane to

up, down, righould be mappethe wrist up

n would move the airplane r

left. This demfied set of keys

mo was a spacedemo places a t

in the time coccelerometer, pg the wrist left w

out of the contrl of the buttonstronics covered

uture. However

control had its esign for the buctile and auditong. The pressu Attempting toto allow those wgarment becau

NASA Inte

9

gation task. Tho the thrash. Tht and left. Fored to the top 4would move the airplane d

right, and turnmo would prove

and can use th

e invaders gamtime limit on t

onstraints. For pointing the wrwould move th

VII. Cols on the fores and sensors. Td and hidden shr the design of

own set of prouttons was simory feedback wure sensors wero hold the safetwith smaller hase of the differ

Figure 17. S

ernship Final R

9

he user would The movementsr the buttons a4 buttons. For

the airplane down, turning ning the wrist e that the user hose keys easil

me. The user wthe user, so thathe buttons anrist up would she ship left.

Conclusion arm sleeves neThe forearm slhould be explothe forearm sle

s and cons. Thmple and the flewhen pressed wre easy to use aty sensor whileands to be ablerences in fabric

Space Invaders

Report

d be s of and the up. the left can ly.

would be askedat if the contro

nd sensors, thesshoot, turning

eeded to be chaeeves in gener

ored. The foreaeeve kept peop

he buttons wereexibility integrawhich was helpfand very well ine using the othee to access it eac. They were a

Demo

Augu

d to move a shols are not simpse actions wouthe wrist to th

anged. Users wral were uncomarm sleeves shople from feeling

e small and reqated well into tful when workntegrated but ter sensor was aasier. The capaalso more effici

Figure 16. N

ust 25, 2013

hip right and leple to learn, th

uld be mapped he right would

with smaller hanmfortable and nould be smallerg the electronic

quired a lot of fthe garment. Thking through thactile and audia challenge. Thacitive touch seient then the ot

avigation Demo

eft and he user

to the d move

nds new r and cs in

force he

he itory he ensors ther

o

NASA Internship Final Report

Johnson Space Center 10 August 25, 2013

controls as they do not need pressure to be activated. The accelerometer was useful for all of the tasks but after working with it for a period of time, it would become tiring.

For future integration into garments a combination of these controls would create a more efficient and functional garment. A form of tactile feedback such as small vibrating motors should be integrated so that the user knows when they have activated a sensor. This would also be useful for troubleshooting which components in the system are working and which components are not working. Overall proving that these different wearable controls are functional and knowing the advantages and disadvantages will be very beneficial to the WEAR Lab in its future research and design projects.

Acknowledgements Amanda Watson would like to thank Cory Simon for mentoring her throughout her entire internship and

supplying her with all of the equipment she needed to complete her projects. He was an outstanding and helpful mentor. Mary Berglund for sewing and designing the garments. Traci Thomason for supplying her with the necessary information about the various controls to complete her projects. She also would like to thank John Burczak, Patricia Conway, and Doris Weber for making this internship possible through support and funding. She would also like to thank her professors at Drury University who encouraged her to work through all forms of challenges and puzzles and, finally, she would like to thank her family, without whom none of this would be possible.

References 1 “Arduino” Arduino Team, http://www.arduino.cc/en/ 2 “XBee® 802.15.4Device connectivity using multipoint wireless networks”, Digi, http://www.joystiq.com/2010/06/19/kinect-how-it-works-from-the-company-behind-the-tech/ Overlay 3 “Arduino Pro Mini”, Arduino Team, http://arduino.cc/en/Main/ArduinoBoardProMini 4 ”Lilypad Xbee Breakout Board”, Sparkfun Electronics, https://www.sparkfun.com/products/8937 5 ”Lite Keypad, Fibretronics Ltd, http://fibretronic.com/connectedwear/KP24G