7/29/2019 Eye Tap Technology

1/8

Eye Tat

S t ev e M a n nma nn @ eecg . t o ron to , edu

James Fungf un g ja @ eecg . t o ron to , edu

EC E D e p a r t m e n t , U n i v e r s i t y o f To ro n t o ,To ro n t o, O n t a r i o , C a n a d a

Eric Mon crieffer i cm @ eecg . t o ron to , edu

The resu l t s o f ac tua l f i e l d t es ts" o f a new c lass o f Person a l Imag in g sys t ems , t he El ec t ron i cN e w s G a t h e r i n g W e a r C o m p ( E N G w e a r ) , a r e p r e s e n t e d . T h e s e in c o r p o r a te E y e T a p T e ch -no logy t o cause t he eye i t se l f t o f un c t i on as i f i t were a c amera , a nd t o a l l ow the eye t o bew i r e l e s s l y t a p p e d o u t o f a n d t a p p e d i nt o, c a p t u r i n g e x a c t ly w h a t t he u s e r i s v i e w in g . T h i sb r i n g s t h e p o i n t o f v i e w o f t he c a m e r a t o th e s a m e p o i n t a s t h e u s e r ' s e ye , a n d a l s o a l l o w sthe user t o a l l ow o thers t o w i re l ess l y mod i f y h i s / her percep t i on o f v i sua l rea li ty . Imag es t husc a p t u r e d a r e s i m u l t a n e o u s l y s e n t a n d r e c e i v e d l iv e t o a n d f r o m t h e in t e r n e t u s i n g IP - o v e r -w i r e l e s s t e c hn o l og y . T h i s n o v e l a p p l ic a t i o n o f w i r e le s s te c h n o l o g y e m p o w e r s r e p o r te r s :E N G w e a r s y s t e m s a l l o w f o r a g r e a t d e gr e e o f m o b il it y , a n d a r e c o n s t a n tl y o p e r a t i o n a l a n drecord ing t o a c i rcu lar bu f f er a l l owing t he repor t er t o never 'm i ss a sho t ' .

I . I n t r o d u c t i o nTh e " W e a ra b l e W i re l e s s W e b c a m " [1 ] w a s u s e dfo r e lec t ron ic news ga ther ing in 1994 , and int h e p ro d u c t i o n o f t h e f i r s t o n l i n e v i d e o d o c u -m e n t a ry , r u n n i n g a l m o s t c o n t i n u o u s l y f ro m 1 9 9 4to 1996 [2 ] . Du r ing tha t t ime, spec i f i c new s-w o r t h y e v e n t s , s u c h a s t h e Ea s t C a m p u s F i r e(h t t p : / / w e a rc a m .o rg / e a s t c a m p u s f i r e . h t m ) a n d t h eEd g e r t o n H o u s e F l o o d w e re r e p o r t e d i n r e a l t i m e .A l l o f t h e s e e v e n t s , ( i n c l u d in g m a t e r i a l c o v e re d i no t h e r m e d i a s u c h a s n e w s p a p e r a n d t e l e v i s i o n ) w e reg a t h e re d s e r e n d i p i t o u s l y , h a v i n g s i m p l y b e e n i n t h ef i g h t p la c e a t t h e f i g h t t i m e , b y c o i n c i d e n c e . M a k i n gu s e o f a m a t e u r r a d i o w i t h w i r e l e s s c o m m u n i c a t i o n s ,i m a g e s w e r e t r a ns m i t te d f r o m d a y - t o - d a y t r a v el s i nt h e c o n t e x t o f o rd i n a ry l i v in g .

Th e t r a n s m i t t e d v i d e o c a p t u r e d a f i r s t - p e r s o n p e r -spec t ive , in wh ic h the appara tus o f the inven t ion e f -f e c t i v e l y c a u s e d t h e e y e i t s e l f to f u n c t i o n a s i f i t w e rea c a m e ra . T h i s u n i q u e p e r s p e c t iv e a l l o w e d t h e w e a re rt o c a p t u r e im a g e s o f a m o re n a t u r a l s o r t - - e v e ry p e r -s o n i n h i s o r h e r o w n e l e m e n t , w i t h o u t t h e d i s t u rb i n gi n f l u e n c e a c a m e ra m i g h t h a v e o n t h e s u b j e c t m a t t er .

S e v e ra l n e w a p p l i c a t i o n s o f t h e w i r e l e s s Ey e Ta pt e c h n o l o g y h a v e r e c e n t l y b e e n e x p l o re d i n fu r t h e r d e -ta il , wi th pos i t ive resu l t s . On e o f these new de-v e l o p m e n t s i s t h e EN G w e a r p ro j e c t , w h i c h e x p l o re dW i re l e s s Ey e T a p t e c h n o l o g y a s i t r e l a t e s to E l e c t ro n i cN e w s G a t h e r i n g . C a r r i e d o u t b y M a n n a n d h is s tu -

*Thanks to Kodak, DEC , ClearNET, and NSE RC for a ssisfngwith this project.

d e n t s d u r i n g o r i e n t a t i o n w e e k a t t h e U n i v e r s i t y o fTo ro n t o , t h e p ro j e c t a l l o w e d t h e Ey e Ta p c y b o rg s t ot r a n s m i t i m a g e s f ro m t h e e v e n t s a n d c e l e b ra t i o n s l iv eto the g roup ' s we bs i te . Th is p rov ides a h in t o f thep o t e n ti a l o f th i s te c h n o l o g y t o e m p o w e r t h e c o m m o np e r s o n t o r e p o r t o n h i s o w n l i fe , a n d t o s h o w t h e w o r l dt h e d a i l y e v e n t s i n e a c h o f o u r l iv e s w h i c h a r e n e w s -w o r t h y .

Th e EN G w e a r p ro j e c t r e l i e d o n s e v e ra l w e l l -e s t a b li s h e d p i e c e s o f t e c h n o l o g y , a n d i n t ro d u c e d s e v -e r a l n e w o n e s t o t h e f i e l d o f EN G . Th i s paper re-views s o m e o f t h e b a s i c t e c h n o l o g i e s , Ey e Ta p a n dW e a rC o m p , a n d i n t ro d u c e s t h e n e w a p p l i c a t i o n o fE l e c t ro n i c N e w s G a t h e r i n g t o t h e f i e l d o f P e r s o n a lIm a g i n g , s h o w i n g h o w i t e m e rg e s d i r e c t l y f ro m fu n -d a m e n t a l c h a ra c t e r is i t cs o f Ey e Ta p t e c h n o lo g y . Th eab i l i ty to documen t everyday l i fe i s ava i lab le to thew e a re r w i t h a l m o s t n o fu r t h e r m e n t a l a d j u s tm e n t , a n dh a s t h e p o t e n t i a l t o c h a n g e t h e v e ry w a y w e i n t e r a c tas ind iv idua l s in soc ie ty , as wel l as wi th in emerg ingm e d i a .

I I . B a c k g r o u n dE N G w e a r s y s t e m s a re c o m p r i s e d o f th r e e m a j o r c o m -p o n e n t s: 1 ) Ey e Ta p Te c h n o l o g y , 2 ) W e a rC o m p , a n d3 ) W i re le s s C o m m u n i c a t i o n s .II.A . E y e T a p T e c h n o l o g yEy e Ta p t e c h n o l o g y a l l o w s t h e u s e r ' s e y e t o fu n c t i o na s a c a m e ra . R a y s o f li g h t e n te r i n g t h e e y e a r e a b -so rbed and quan t i f i ed . T h is quan t i f i ed fo rm o f v i sua l

19obile Computing and Com munications Review, Volum e 3, Num ber 4

7/29/2019 Eye Tap Technology

2/8

LEFTMOST ~ ///RIGHTMO STRAY OF LIGH T~ / RAYOFLIGHT

I ) I I S C R E E N/ EYE/ RIGHTMOSTRAY OFcO\O ~'LEFT M O ST VIRTUAL IGHT4...~O RAY OFVIRTUALLIGHT

F i g u r e 1: A d i v e r t e r e m b o d i m e n t o f t h e r e a l i t y -mediator: A d i v e r t e r ( i n t h i s c a s e , a d o u b l e - s i d e dmi r ro r ) d i ver t s i ncom i ng r a ys o f l i gh t t o a cam era ,w h i l e a t t h e s a m e t i m e p r o v i d i n g t h e e y e w i t h a v i e wo f a t e l e v i s io n s c r e e n , c o n n e c t e d t o t h e w e a r a b l e c o m -p u t e r s y s t e m . T h e t e le v i s i o n s c r e e n a p p e a r s b a c k -w a r d s t o t h e e y e , b u t s i n c e t h e c o m p u t e r c a p t u r e s ab a c k w a r d s s t r ea m o f i m a g e s ( th e c a m e r a ' s v i e w o f th ewo r l d i s a l so t h rough a mi r ro r ) , d i sp l ay o f tha t v i de os t r eam wi l l c r ea t e an i l lu s i on o f t r anspa rency t ha t isn o t b a c k w a r d s . T y p i c a l ly , s u c h a n a p p a r a t u s m a y o p -e r a te w i t h p h o t o q u a n t i g r a p h i c i m a g e p r o c e s s i n g c a p a -bi l i ty [3] .i n fo r m a t io n c a n t h e n b e p r o c e s s e d b y a W e a r C o m p ,w i t h i n f o r m a t i o n a d d e d ( a u g m e n t e d r e a l it y ) , r e m o v e d( d i m i n i s h e d r e a l i t y ) o r r e p l a c e d ( m e d i a t e d r e a li ty , o fw h i c h a u g m e n t e d a n d d i m i n i s h e d r e a l i t i e s a r e s p e -c i a l c a s e s ) . T h e f i lt e r ed v e r s i o n o f th e l i g h t (m e d i -a t ed l igh t ) i s t hen r ed i sp l aye d t o t he wearer . I f t hei n f o r m a t i o n i s a l l o w e d t o p a s s u n a l t e r e d , E y e T a p e s -s e n t i a ll y f u n c t i o n s t o r e p l a c e a p o r t io n o f t h e w e a r e r ' sv i s u al f i e ld o f v i e w w i t h e x a c t l y t h e s a m e s u b j e c t m a t -t er . I n th i s c a s e , t h e W e a r C o m p c a p t u r e s e x a c t l y w h a tt h e u s e r s e e s , a n d t h e a p p a r a t u s m e r e l y f u n c t i o n s a s av i e w f in d e r . O f c o u r s e , v a r i o u s " v i s u a l f il te r s " , w h i c ha r e s i m p l y c o m p u t e r p r o g r a m s , c a n b e i n s e r t e d i n t ot h e v i s u a l r e a l i t y s t r e a m t o m e d i a t e t h e w e a r e r ' s v i -sua l percep t i on .

T h e E N G w e a r s y s t e m s u s e d i n t h i s p r o j e c t w e r eb a s e d o n t h e 4 5 d e g r e e d i v e r t e r i m p l e m e n t a t i o nof t he Eye Ta p p r i nc i p le , as i ll u s t r a t ed i n F i g . 1 .T h i s e m b o d i m e n t w a s c h o s e n f o r it s e a s e o f i m -p l e m e n t a t i o n , a n d i s t h e f o r m u s e d i n th e t e a c h -i n g o f th e P e r s o n a l C y b e r n e t i c s c o u r s e ( E C E 1 7 6 6 ,h t t p : // w e a r c a m . o r g / e c e 1 7 6 6 . h t m l ) a t t h e U n i v e r s i t y o fT o r o n t o .

W h i l e a p h o t o g r a p h e r o r c a m e r a m a n m u s t l o o k i nt o2 0

t h e v i ew f i n d e r o f h is o r h e r c a m e r a , E N G w e a r r e -p o r t e r s n e e d o n l y l o o k a t t h e s u b j e c t m a t t e r i n q u e s -t io n , a s s u r e d t h a t t h e i m a g e i s c a p t u r e d j u s t a s t h e y a r ev i ew i ng i t , s i nce one o f t he i r eye s - funct ions as bo t h t hev i e w f i n d e r a n d c a m e r a .

W h e n t h e m e d i a t e d a r e a i s s m a l l e r t h a n t h e t o t a lf i e ld o f v i e w o f t h e r e p o r te r ' s e y e , s o m e s o r t o f v i -s u a l c u e i s u s e d t o i n d i c a t e t h e a r e a c a p t u r e d b y t h eE y e T a p . I n t h e s e s y s t e m s , t h o u g h i m a g e s c o u l d b ecap t u red i n fu l l co l ou r , t he v i r t ua l l i gh t genera t ed wasm o n o c h r o m e g r e e n . T h u s , t h e m e d i a t e d f ie l d o f t h ew e a r e r ' s v i s i o n a p p e a r e d a s a c o m b i n a t i o n o f w h a tw a s n o r m a l l y s e e n f r o m t h e i r u n t a p p e d e y e , a n d am o n o c h r o m e g r e e n v e r s i o n f r o m t h e i r t a p p e d e y e . I nt h e s e c a s e s , t h e E y e T a p s f n n c t i o n e d a s v i e w f i n d e r s ,wi t h t he r epo r t e r se t t i ng her gaze such t ha t she over -l a y e d t h e m e d i a t e d v e r s i o n o f re a l i ty a t o p t h e s u b j e c tm a t t e r s h e w i s h e d t o c a p t u r e . I t w a s f o u n d t h a t r e -p o r t e r s n a t u r a l l y t e n d e d t o p l a c e t h e m e d i a t i o n z o n eo v e r t h e s u b j e c t m a t t e r o f i n t e re s t , s o t h a t t h e c a m e r af u n c t i o n e d a s a tr u e e x t e n s io n o f th e m i n d a n d b o d y ,o f t e n b e i n g o p e r a b l e w i t h o u t c o n s c i o u s t h o u g h t o r e f -for t .

S i n c e r a y s o f l i g h t i n t h e m e d i a t e d f i e l d o f v i e wa r e c o l l in e a r w i t h r a y s o f l ig h t e n t e r in g t h e E y e T a pd e v i c e , E N G w e a r s y s t e m s a r e s u i t a b l e f o r l o n g t e r mu s e . C o n v e n t i o n a l v i e w f i n d e r s o n te l e v i s io n c a m e r a so f t e n h a v e f i e ld s o f v i e w w h i c h d o n o t m a t c h t h e u s e r ' se y e ' s f ie l d o f vi ew . T h u s , w h i l e a c a m e r a m a n m a ye x p e r i e n c e d i s o r i e n t a t i o n w h e n w a l k i n g a n d f i l m i n gf o r l o n g p e r i o d s o f t i m e l o o k i n g t h r o u g h a v i e w f in d e r,a n E N G w e a r r e p o r t e r c a n u s e t h e ir s y s t e m c o n s ta n t lyw i t h o u t e x p e r i e n c i n g t h e d i s o r i e n t i n g e f f e c t s a s s o c i -a t e d w i t h n o n - c o l l i n e a r v i e w f in d e r s.

I I . B . W e a r C o m pA s m e n t i o n e d a b o v e , i n c o m i n g l i g h t i s p a s s e d i n aq u a n ti f ie d f o r m th r o u g h a W e a r C o m p . A W e a r C o m phas t h ree def i n i ng charac t e r i s t i cs :

. Within the personal space of the wearerA W e a r C o m p i s r e c o g n i z e d b y o t h e r s a s b e i n gw i t h i n t h e p e r s o n a l s p a c e o f t h e w e a r e r , j u s t a sc l o t h e s , s h o e s , b e l l y b a g s , o r a p u r s e w o u l d b e r e -g a m e d . T h i s a l lo w s f or E N G w e a r t o b e a m o r ec o v e r t , u b i q u i t o u s f o r m o f n e w s g a t h e r in g e q u i p -m e n t s in c e , w h i le o n e m a y b e a s k e d t o p u t d o w na bag o r a camera , i t i s l es s o f t en t ha t one i s r e -q u e s t e d t o re m o v e o n e ' s s h ir t o r W e a r C o m p .

2. Interactional ConstancyW e a r C o m p s a r e c o n s t a n t l y i n s i d e t h e f e e d b a c k

Mobile Computing and Communications Review, Volume 3, Number 4

7/29/2019 Eye Tap Technology

3/8

loop of the wearer's consciousness. The com-puter is inextricably set between the user andthe world; it is a filter which is always opera-tional. There is no need to look at it; infbrmationvital to everyday life is always being presentedwhether or not traditional computing tasks are inprogress. This leads to a literally transparent userinterface.

dividual to act as reporter, cameraman, and transmit-ter, while giving her more mobility than a traditionalmedia team. Furthermore, ENGwear reporters are af-forded the opportunity to observe the scene from theperspective of an eye witness. The interference causedby the presence of a news team is greatly reduced, ifnot removed, with the use of EyeTap technology.

. O p e r a t i o n a l C o n s t a n c yWearComps are constantly in operation,and constantly presenting information to theuser. All informat ion within and entering theWearComp/human feedback loop is captured,processed, preserved and presented. This modeof constant operation contrasts with traditionalmedia such as a broadcast cameras, which mustbe held up to the eye when the cameramanwishes to film.A benefit of operational constancy is the de-creased likelihood of ever "missing the shot."Images captured by the WearComp are placedin a circular buffer. Such a buffer is constantlyupdated, but continues to hold all the images upto a few minutes or hours into the past. Whena significant event occurs, one can be assured itis captured, so long as the reporter sees it him-self. Thus, even though the wearer may not betransmitting at the time a critical event occured,the images can still be retrieved from the bufferand transmitted. In this sense, no time or effortneeds to be expended to ready a camera and placesubject matter in the viewfinder. Whereas theconventional cameraman must make a consciouseffort to record images, ENGwear reporters, bywitnessing events, record them.

I I.C . W i r e l e s s C o m m u n i c a t i o n s L i n kWhen a WearComp and EyeTap are coupled withwireless communications, the ENGwear system be-comes a highly mobile news gathering device.Most traditional news media relies on the re-porter/cameraman team. Additionally, the team car-ries with it a large array of broadcasting equipmentsuch as cameras, microphones, tape, cables, and, forlive broadcasts, a satellite feed mounted on a newsvan. This equipment overhead affords them the ca-pability to capture high quality images and sound, butin an obtrusive and cumbersome manner.

The ENGwear project, by comparison, required notrucks, no satellites, and very little broadcasting in-frastructure. An ENGwear system empowers an in-Mobi l e Comput ing and Communica t ions Rev i ew, Volume 3 ,

In contrast with broadcast television equipment,which is designed to produce high quality full mo-tion video, ENGwear systems capture events as a se-quence of still images, or as video from which individ-ual flames can be easily extracted. The rate of imagetransmission and the image resolution can be chosenbased on the nature of the event being reported on. Forinstance, in some cases, it may be desirable to trans-nfit several high resolution images over the span of afew minutes, while in others, it may be desirable tocapture an event in a more live capacity, transmittinglower resolution pictures at 30 frames per second. TheENGwear system allows the user to make a tradeoffbetween frame rate and image resolution. This trade-off can also be made after the data is transmitted (e.g.by the viewer of the event combining multiple im-ages into a Photoquantigraphic Image Composite de-scribed below). The desired resolution and frame rateis also determined, to some extent, by the capacity ofthe wireless connection to transmit images.

When the ENGwear project was conducted, it wasfound that these factors resulted in a reporting styleconsisting of data that could be rendered as video, oras a sequence of extremely high resolution still im-ages, potraying an event. Even when images capturedencompassed a limited field of view, and were individ-ually of low resolution, multiple images could laterbe combined into a single, large composite called aPhotoquantigraphic Image Composite (PIC). The re-sult was a single, high resolution image made up ofa sequence of individual low resolution images seam-lessly integrated with one another using the VideoOr-bits algorithm developed by Mann [4]. This provideda means to capture larger, more expressive still imageswith video cameras.

Most of the live footage, however, consisted of se-quences of still images which captured events as theyoccured. This sort of video journal lay somewherebetween traditional print media, which gives few, butvery descriptive images of an event, and live video.

N um be r 4 ..... ...... 21

7/29/2019 Eye Tap Technology

4/8

I II . T h e E d g e r t o n i a n i m a g e s e -q u e n c e i n E N G w e a r s y s t e m sS u c h i m a g e s e q u e n c e s a r e Ed g e r t o n i a n i n n a t u r e , r e -f l e c t i n g a fu n d a m e n t a l p r i n c i p l e o f Ey e Ta p o p e ra -t io n . T ra d i t i o n a l i m a g e s e q u e n c e c o m p re s s i o n , s u c ha s M P E G , i s b a s e d o n p ro c e s s i n g f r a m e s o f v i d e o a s ac o n t i n u u m . Th e i n t e g r it y o f m o t i o n i s o f t e n r e g a rd e da s b e i n g m o re i m p o r t a n t t h a n, o r a t l e a s t a s i m p o r t a n ta s t h e i n t e g r it y o f e a c h i n d i v i d u a l f r a m e o f t h e i m a g es e q u e n c e . H o w e v e r , i t c a n b e a rg u e d t h a t t e m p o ra li n t e g r i ty i s n o t a l w a y s o f t h e u t m o s t i m p o r t a n c e , a n dc a n , i n f a c t , o f t e n b e s a c r i f i c e d , w i t h g o o d r e a s o n .

I II .A . E d g e r t o n i a n v e r s u s N y q u i s tt h i n k i n gC o n s i d e r t h e v e ry t y p i c a l s i t u a t i o n w h e n t h e f l a m era t e o f a p i c t u r e a c q u i s i t i o n p ro c e s s v a s t l y e x c e e d st h e f l a m e r a t e a t w h i c h i t is p o s s i b le t o s e n d p i c t u r e so f s a t i s f a c to ry q u a l i t y o v e r a g iv e n b a n d w i d t h - l i m i t e dc o m m u n i c a t i o n s c h a n n e l . Th i s s i t u a ti o n a r i se s , f o r e x -a m p l e , w i t h W e b b a s e d c a m e ra s , i n c l u d i n g t h e " W e a r -a b l e W i re l e s s W e b c a m ." [5 ]

S u p p o s e , f o r e x a m p l e , t h a t t h e c a m e ra p ro v i d e s 3 0p i c t u r e s p e r s e c o n d , b u t t h e c h a n n e l o n l y a l l o w s u st o s e n d o n e p i c t u r e p e r s e c o n d ( i g n o re fo r t h e m o -m e n t t h e f a c t t h a t w e c a n t r a d e s p a t i a l r e s o l u t i o n ,t e m p o ra l r e s o l u t i o n , a n d c o m p re s s i o n q u a l i t y t o a d -j u s t t h e f r a m e r a t e ) . I n o rd e r t o d o w n s a m p l e o u r 3 0p i c t u r e s p e r s e c o n d d o w n t o o n e p i c t u r e p e r s e c o n d ,t h e " N y q u i s t s c h o o l o f t h o u g h t " w o u l d s u g g e s t t h a tw e s h o u l d t e m p o ra l l y l o w p a s s f i l t e r t h e i m a g e s e -q u e n c e , i n o rd e r t o r e m o v e a n y t e m p o ra l f r e q u e n c i e st h at w o u l d e x c e e d t h e N y q u i s t f r e q ue n c y .

To a p p l y t h i s s t a n d a rd " l o w p a s s f i lt e r t h e n d o w n -s a m p l e " a p p ro a c h , w e m i g h t a v e ra g e t o g e t h e r e a c h30 success ive p ic tu res , to ob ta in each ou tpu t p ic tu re .Th u s f a s t m o v i n g o b j e c t s w o u l d b e b l u r r e d t o p r e v e n ttempora l a l i as ing .

W e m i g h t b e t e m p t e d t o t h i n k t h a t t h i s b l u r r i n g i sd e s i r a b l e , g i v e n t e m p o ra l a l i a s i n g t h a t w o u l d o t h e r -w i s e r e s u lt . H o w e v e r , c i n e m a t o g ra p h e r s a n d o t h e r sw h o p ro d u c e m o t i o n p i c t u r e s o f t e n d i s r e g a rd c o n c e p t sl i k e t e m p o ra l a l i a s in g . M o s t n o ta b l y , H a ro l d E . Ed g e r -t o n , t h e i n v e n t o r o f t h e e l e c t ro n i c f la s h , w h o i s k n o w nfo r h is m o v i e s o f h i g h s p e e d e v e n t s in w h i c h o b j e c t sa r e " f ro z e n " i n t i m e , h a s p ro d u c e d m o v i e s a n d o t h e ra r t if a c t s t h a t d e fy a n y a v o i d a n c e o f t e m p o ra l a l ia s i ng .Ed g e r t o n ' s m o v i e s p ro v i d e u s w i t h a t e m p o ra l s a m -p l i n g t h a t i s m o re l i k e a D i r a c c o m b (d o w n s a m p l i n go f r e a l i ty ) t h a n a l o w p a s s f i l t e r e d a n d t h e n d o w n s a m -p l e d v e r s i o n o f r e a l i ty .22

R e t u r n i n g to t h e e x a m p l e o f d o w n s a m p i n g f r o m 3 0f r a m e s p e r s e c o n d t o o n e f r a m e p e r s e c o n d , a n Ed g e r -t o n i a n t h i n k e r w o u l d l i k e l y a d v o c a t e s i m p l y t a k i n g e v -e ry 3 0 t h f r a m e f ro m t h e o r i g i n a l s e q u e n c e , a n d t h ro w -ing a l l the o thers away .

T h e E d g e r t o n i a n d o w n s a m p l i n g p h i l o s o p h y g i v e sr i s e t o i m a g e s e q u e n c e s i n w h i c h p ro p e l l e r b l a d e so r w a g o n w h e e l s p o k e s a p p e a r t o s p i n b a c k w a rd s o rs t a n d s ti ll . Th e N y q u i s t p h i l o s o p h y g i v e s r i s e t o im -a g e s e q u e n c e s i n w h i c h t h e p ro p e l l e r b l a d e s o r w a g o nw h e e l s p o k e s w o u l d v i s u a l l y d i s ap p e a r .

W e b e l i e v e t h a t i t i s p r e f e r a b l e t h a t t h e p ro p e l l e rb l a d e s a n d w a g o n w h e e l s p o k e s a p p e a r t o s p i n b a c k -ward s , o r s t and s t i ll , ra ther than v i sua l ly d i sappear . Int h e c o n t e x t o f EN G w e a r , i t is p r e f e r a b l e t o h a v e a s e -r i e s o f c r i s p w e l l -d e f i n e d " s n a p s h o t s " o f r e a li t y , r a t h e rt h a n t h e b l u r o f im a g e s t h a t o n e w o u l d g e t b y fo l l o w -ing the an t ia l i as ing approach o f t rad i t iona l s igna l p ro -c e s s i n g .

P e r s o n a l e x p e r i e n c e w i t h Ey e Ta p v i d e o t e n d s t ol e a d t o a m o re i n t i m a t e u n d e r s t a n d i n g o f h o w t h ew o r l d l o o k s t h ro u g h W e b -b a s e d v i d e o , r a t h e r t h a nt r a d i ti o n a l p h o t o g ra p h i c m e d i a . O n t hi s s y s t e m , i tw a s p o s s i b l e t o c h o o s e f ro m a m o n g v a r i o u s c o m b i -n a t i o n s o f Ed g e r t o n i a n a n d N y q u i s t s a m p l i n g s t r a t e -g i e s . I t w a s fo u n d t h a t e x p e r i e n c i n g t h e w o r l d t h ro u g h" Ed g e r t o n i a n e y e s " w a s g e n e ra l l y p r e f e r a b l e t o t h eN y q u i s t a p p ro a c h .I II .B . F r a m e s v e r s u s r o w s , c o l u m n s , a n dp i x e l sTh e re i s a t r e n d n o w t o w a rd p ro c e s s i n g s e q u e n c e s o fi m a g e s a s s p a t io t e m p o ra l v o l u m e s , e . g . a s a f u n c t i o nf ( x , y , t ) . W i t h i n t h i s c o n c e p t u a l f r a m e w o rk , m o t i o np i c t u r e s a r e tr e a t e d a s s ta t ic 3 d v o l u m e s o f d a t a. S o -c a l l e d s p a t i o t e m p o r a l f i l te r s h ( x , y , t ) a r e app l ied tot h e s e s p a t i o t e m p o ra l v o l u m e s f ( x , y , t ) .

H o w e v e r , th i s u n i f i e d t r e a t m e n t o f t h e t h r e e d i m e n -s i o n s (d i s c r e ti z e d to ro w , c o l u m n , a n d f r a m e n u m b e r )i g n o re s t h e f a c t t h a t t h e t i m e d i m e n s i o n h a s a m u c hd i f f e r e n t i n t u it i v e m e a n i n g t h a n t h e o t h e r t w o . A p a r tf r o m t h e p r o g re s s iv e ( f o r w a r d - o n l y ) d i r ec t io n o f t i m e ,t h e r e i s t h e m o re i m p o r t a n t f a c t ( e v e n fo r s t o r e d i m -age seque nces ) tha t a snapsho t in t im e (e .g . a st i llp i c t u r e s e l e c t e d f ro m t h e s e q u e n c e ) o f t e n h a s i m m e -d i a t e m e a n i n g t o t h e h u m a n o b s e rv e r . A s i n g l e ro wo f p i x e l s a c ro s s a p i c t u re , o r a s i n g l e c o l u m n o f p i x e lsd o w n a p i c t u r e d o n o t g e n e ra l l y h a v e s i m i l a r s i g n i f i -c a n c e t o t h e h u m a n o b s e rv e r. L i k e w i s e a s i n g le p i x e lm e a n s l i t t l e t o t h e h u m a n o b s e rv e r i n t h e a b s e n c e o fs u r ro u n d i n g p i x e ls .

N o t w i t h s t a n d i n g t h e i r u t il it y , s l i c e s o f t h e fo rmMobile Com puting and Communications Review, Volume 3, Numb er 4

7/29/2019 Eye Tap Technology

5/8

f ( z , ~ ) o r o f t h e f o r m f ( ~ , ~ ) a r e o f te n co n f u s in g a tbes t , compared to the s t i l l p ic tu re f ( z , y ) w h i c h r e -m a i n s a s a n e x t r a c t i o n f ro m a p i c t u r e s e q u e n c e t h a t isf a r m o re m e a n i n g fu l t o a t y p i c a l h u m a n o b s e rv e r .

Th u s w e b e l i e v e t h a t d o w n s a m p l i n g a c ro s s ro w so r d o w n c o l u m n s o f a n i m a g e s h o u l d b e p r e c e e d e db y l o w p a s s f i l t e ri n g , w h e re a s t e m p o ra l d o w n s a m p l i n gshou ld no t .

Th e re i s t h e r e fo re a s p e c i a l s i g n i f i c a n c e to t h e n o -t i o n o f a " s n a p s h o t i n t i m e " a n d t h e p ro c e s s i n g, s t or -age , t ransmiss ion , e tc . , o f a mot ion p ic tu re as a se -q u e n c e o f s u c h " s n a p s h o t s" . Th e r e l a t i o n sh i p b e t w e e ni n d i v id u a l s h a rp l y d e f i n e d f r a m e s o f a n " E d g e r t o n i a n "s e q u e n c e o f p i c t u r e s g a v e r i s e t o t h e d e v e l o p m e n t o fa n e w f r a m e w o rk fo r t r a n s m i t t in g i m a g e s a c ro s s th ew i r e l e s s l in k s u s e d i n t h e EN G w e a r p ro j e c t .I II .C . P i c t u r e T r a n s f e r P r o t o c o l ( P T P )W h e n a p p l y i n g d a t a c o m p re s s i o n t o a s t r e a m o f i n d i -v i d u a l p i c t u r e s t h a t w i l l b e v i e w e d i n r e a l t i m e ( fo r e x -a m p l e i n v i d e o c o n fe r e n c i n g , s u c h a s t h e f i r s t - p e r s o n -p e r s p e c t i v e v i d e o c o n f e r e n c i n g o f t h e w e a r a b l e E y eTap dev ice) , i t i s he lp fu l to t ake in to acc oun t the man -n e r i n w h i c h t h e d a t a w i l l b e s e n t .

M o s t n o t a b l y , p i c t u r e s a r e t y p i c a l l y s e n t o v e r ap a c k e t - b a s e d c o m m u n i c a t io n s c h a nn e l . F o r e x a m p l e ,W e a r a b l e W i r el e ss W e b c a m u s e d t h e A X 2 5 A m a t e u rR a d i o p ro t o c o l . A c c o rd i n g l y , p a c k e t s t y p i c a ll y e i th e rar r ive in tac t o r a re co rrup t . Packe t s tha t a re co rrup t ,t r a d it i o n al l y , w o u l d b e r e - s e n t .

A n i n t e r es t i n g a p p ro a c h i s t o p ro v i d e d a t a c o m p re s -s i o n o n a p e r - i m a g e b a s is , a n d t o v a ry t h e d e g re e o fc o m p re s s i o n s o t h a t t h e s i z e o f e a c h p i c t u r e i n t h ei m a g e s e q u e n c e i s e x a c t l y e q u a l t o t h e l e n g t h o f o n epacket .

To g e t h e r w i t h th e p r i o r a s s u m p t i o n ( t h a t i m a g e s a r ea c q u i r e d a t a r a t e t h a t e x c e e d s t h e c h a n n e l c a p a c i ty ) ,i t w i l l g e n e ra l l y b e t r u e t h a t b y t h e t i m e w e k n o w t h a ta p a c k e t (w h i c h i s a c o m p l e t e p i c t u r e ) i s c o r ru p t a tt h e r e c e i v e r , t h e r e w i l l h a v e a l r e a d y b e e n a c q u i r e d an e w e r p i c tu r e t h a n t h e o n e t h a t w a s s e nt . S u p p o s e , f o re x a m p l e , t h e ro u n d t r i p t i m e (R TT) i s 1 0 0 m s (w h i c hi s equa l to the t ime i t t akes to genera te th ree p ic tu res ),t h e r e w o u l d b e l i t tl e s e n s e i n r e - s e n d i n g a p i c t u r e t h a tw a s t a k e n t h r e e p i c t u r e s a g o .

Th e c o m m o n l y a r i s in g s i t u a ti o n i n w h i c h p i c tu r e sa r e c a p t u r e d a t a r a t e t h a t e x c e e d s t h e R TT s u g g e s t st h a t t h e r e w i l l a l w a y s b e n e w e r p i c t u r e i n fo rm a t i o na t t h e t r a n s m i t s i t e t h a n w h a t w o u l d b e r e - s e n t i n t h ee v e n t o f a l o s t p a c k e t.

Th i s a p p ro a c h fo rm s t h e b a s i s f o r t h e p ro p o s e d" P i c t u r e T ra n s f e r P ro t o c o l " (P TP ) . I n p a r ti c u la r , P TPMobile Computing and Communications Review, Volume 3, Numb er

i s based on the idea o f t rea t ing each "snapsh o t" int ime as a s ing le en t i ty , in i so la t ion , and compress ingi t in to a s ing le packe t , so tha t i t wi l l have e i ther a r -r ived in i ts en t i f i ty o r no t a r r ive d a t a ll (and ther efo rebe d i scarded) . I t shou ld be c lea r tha t the ph i l i soph ica lu n d e rp i n n i ng s o f P TP a r e c l o s e l y re l a t e d t o t h o s e o fEd g e r t o n i a n d o w n s a m p l i n g .

I II .D . B e s t c a s e i m a g i n g a n d f e a r o ff u n c t i o n a l i t y

A d i rec t resu l t o f Edger ton ian sampl ing i s tha t a s in -g l e p i c tu r e f ro m a p i c t u r e s e q u e n c e h a s a h i g h d e g re eo f r e l e v a n c e a n d m e a n i n g e v e n w h e n i t i s ta k e n i n i s o-lat ion.

S imi la r ly , a d i rec t resu l t o f PTP i s tha t a s ing lep a c k e t f r o m a p a c k e t s e q u e n c e h a s a h i g h d e g re e o fr e l e v a n c e a n d m e a n i n g e v e n w h e n i t i s t a k e n i n i so l a-t i o n ( fo r e x a m p l e w h e n t h e p a c k e t s b e fo re a n d a f t e r ith a v e b e e n c o r ru p t e d ).

I t is t h e r e fo re a p p a re n t t h a t i f a s y s t e m w e re h i g h l yunre l i ab le , to the ex ten t tha t p ic tu res cou ld on ly bet ransmi t ted occas iona l ly , and unpred ic tab ly , then theEd g e r t o n i a n s a m p l in g c o m b i n e d w i t h P TP w o u l d p ro -v i d e a s y s t e m t h a t w o u l d d e g ra d e g r a c e fu ll y .

In d e e d , i f w e w e re t o r a n d o m l y s e l e c t j u s t a f e wf ra m e s f ro m o n e o f H a ro l d Ed g e r t o n ' s m o t i o n p i c -t u re s , w e w o u l d l i k e l y h a v e a g o o d s u m m a ry o f t h em o t i o n p i c t u r e, s i n c e a n y g i v e n f r a m e w o u l d p ro v i d eu s w i t h a s h a rp p i c t u r e i n w h i c h s u b j e c t m a t t e r o f i n -t e r e st c o u l d b e c l e a r l y d i s c e rn e d . L i k e w i s e , i f w e w e ret o r a n d o m l y s e l e c t a f e w p a c k e t s f ro m a s t r e a m o ft h o u s a n d s o f pa c k e t s o f P TR w e w o u l d h a v e d a t a th a tw o u l d p ro v i d e a m u c h m o re m e a n i n g fu l i n t e rp r e t a t io nt o t h e h u m a n o b s e rv e r t h a n i f a l l w e h a d w a s r a n d o m l ys e l e c t e d p a c k e t s f ro m a n M P E G s e q u e n c e .

I II .E . E N G w e a r a s P e r s o n a l S a f e t y D e -v i c eA c c o rd i n g l y , a n o b j e c t o f t h e P e r s o n a l Im a g i n gpro jec t i s to p rov ide a sys tem tha t t ransmi t s p ic tu resi n h a r sh o r h o s ti l e e n v i ro n m e n t s . O n e s u c h a p p l i ca -t i o n o f s u c h a s y s t e m i s t h e P e r s o n a l S a fe t y D e v i c edescr ibed in [6 ].

Th e P e r s o n a l S a fe t y D e v i c e d i f f e r s f ro m o t h e r w i r e -les s da ta t ransmiss ion sys tem s in the sense tha t i t wasd e s i g n e d fo r " B e s t C a s e " o p e ra ti o n . O rd i n a r il y , w i r e -l e ss t r a n s m i s s i on s a r e d e s i g n e d fo r w o r s t c a s e s c e n a r -i os , s u c h a s m i g h t g u a ra n t e e a c e r t a i n m i n i m u m l e v e lo f p e r fo rm a n c e t h ro u g h o u t a l a rg e m e t ro p o l i ta n a r e a .Th e P e r s o n a l S a fe t y D e v i c e , h o w e v e r , i s d e s i g n e d t oo n l y m a k e i t h a rd fo r a n a d v e r s a ry t o g u a ra n t e e t o t a l

4 23

7/29/2019 Eye Tap Technology

6/8

(a) (b)Figure 2 : L ookpain t ings f rom the EN Gw ear pro ject (a) Dur ing the St . George S t reet Carnival , an EN G we arrepor ter obta ined a lookpain t ing of a recent ly f in i shed s t reet pain t ing . The c urv ing gaze of the EN Gw ear repor tercaused the i r regular ly shaped border of th i s image. (b) A seq uence of images captures the S t . Geo rge S t reetCarnival, wi th the EN Gw ear repor ter s tar t ing h i s gaze a t the top of a nearby bui ld ing and panning do wn to s t reetlevel .

24 Mobile Comp uting and Communications Review, Volume 3, Nu mb er 4

7/29/2019 Eye Tap Technology

7/8

n o n p e r f o r m a n c e .I t i s n o t a g o a l o f t h e P e r s o n a l S a f e t y D e v i c e t o

g u a r a n t e e c o n n e c t i v i t y i n t h e p r e s e n c e o f h o s ti l e j a m -mi ng o f t he r ad i o spec t rum , bu t , r a t her , t he goa l i s tomake i t d i f f i cu l t fo r t he adver sary t o guaran t ee t he ab -s e n c e o f c o n n e c ti v it y . T h e r e f o r e , a n o t h e r w i s e p o t e n -t i a l p e r p e t r a t o r o f a c r i m e w o u l d n e v e r b e a b l e t o b ec e r t a i n t h a t t h e w e a r e r ' s d e v i c e w a s n o n - o p e r a t i o n a la n d w o u l d t h e r e f o r e n e e d t o b e o n h i s o r h e r b e s t b e -hav i ou r a t a l l t i mes . Th i s i s t he Fea r o f Func t i ona l i t y( F o F ) m o d e l .

S i n c e t h e r e i s, a n d w o u l d b e , t h e p o s s i b i l i ty o f j u s to n e p a c k e t , w h i c h c o n t a i n s j u s t o n e p i c t u r e , p r o v i d -i n g i n c ri m i n a ti n g e v i d e n c e o f w r o n g d o i n g , a n i n d i vi d -u a l c a n s i m p l y w e a r a p e r s o n a l s a f e t y d e v i c e t o o b t a i np ro t ec t i on f rom cr i mi na l s , as sa i l an t s , and a t t acker s .

T h e p e r s o n a l s a f e t y d e v i c e n e e d n o t w o r k c o n -s t an tl y , bu t, ra t her , mu s t me re l y p resen t c r i mi na l s w i t ht h e p o s s i b i li t y t ha t it c o u l d w o r k s o m e t i m e s . T h i s s c e -n a r io f o r m s t h e b a s i s f o r b e s t - c a s e d e s i g n a s a n a l te r -n a t iv e t o t h e u s u a l w o r s t - c a s e d e s i g n p a r a d i g m .

T h e P e r s o n a l I m a g i n g s y s t e m t h e r e f o r e tr a n s m i t sv i deo , bu t t he des i gn o f t he sys t em i s such t ha t i t w i l l ,a t t he very l eas t , occas i ona l l y t r ansmi t a mean i ng fu ls t i l l image.

E N G w e a r P e r s o n a l I m a g i n g s y s t e m s c an t h u s a ll o wt r a n s m i s s io n f r o m e n v i r o n m e n t s w h e r e t h e r e m a y b eac t i ve r es i s t ance t o news ga t her i ng e f fo r t s . Wi t h fu l l yc o v e r t s y s te m s , i t b e c o m e s p o s s i b l e f o r E N G w e a r r e -po r t e r s t o opera t e wi t h l i t t l e chance o f de t ec t i on f roma r e a s w h e r e o t h e r r e p o r te r s w o u l d s p o t t e d a n d e v i c te d .O n c e tr a n s m i t te d , d e s t r u c t i o n o f t h e i m a g e s b e c o m e sd i f fi c u l t a s i m a g e s a r e d u p l i c a t e d a n d r e t r a n s m i t te d b ys e r v e r s a c r o s s t h e i nt e rn e t. W h i l e v i d e o t a p e s o r p h o -t o g r a p h i c n e g a t i v e s c o u l d b e c o n f i s c a t e d o r d e s tr o y e d ,i m a g e s t r a n s m i t t e d w i r e l e s s l y c a n p r o p o g a t e q u i c k l ya m o n g s t i n t e rn e t s e r v e r s , m a k i n g t h e i r c o n t a i n m e n t o rdes t ruc t i on d i f f icu l t .

T y p i c a l l y t h e w e a r e r ' s j a c k e t f u n c t i o n s a s a l a r g el o w f r e q u e n c y a n t e nn a , p r o v i d i n g t r a n s m i s s i o n c a p a -b i l i t y i n a f r equency band t ha t i s very hard t o s t op .F o r e x a m p l e , t h e 1 0 m e t e r b a n d i s a g o o d c h o i c e b e -c a u s e o f i ts u n p r e d i c t a b l e p e r f o r m a n c e ( o w i n g t o v a r-i o u s " s k i p " p h e n o m e n a , e t c . ) .

IV . T h e E N G w e a r P r o j e c tT w o d if f e r e n t a r c h it e c t u re s w e r e e x p e r i m e n t e d w i t h int h is f ir s t t ri a l o f E N G w e a r s y s t e m s . O n e c o n s i s t e d o fa n I n t e l b a s e d 4 8 6 a r c h i c t u r e , c a p t u r i n g i m a g e s w i t ha c o m m e r c i a l , b l a c k a n d w h i te C C D . T h e s e c o n d s y s -t e m w a s b a s e d o n a 2 7 5 M H z S t r o n g A r m a r c h i t e c -

t u r e w h i c h i n c o r p o r a te d N T S C i n p u t f r o m a b r o a d c a s tqua l i t y , fu l l co l ou r t e l ev i s i on cam era . Bo t h sys t emsc a p t u r e d i m a g e s w i t h t h e 4 5 d e g r e e d i v e r t e r i m p l e -m e n t a t i o n o f t h e E y e T a p s y s t e m .

T h e e x p e r i m e n t l a s t e d f o u r d a y s d u r i n g t h e E n -g i n e e r i n g O r i e n t a t i o n W e e k a t t h e U n i v e r s i t y o fToron t o . I t wa s in t ended t o d i sgu i se t he non-c over te y e t a p d e v i c e s i n E n g i n e e r in g f a c u l t y h a r d h a ts , w h i c hhave a l ong s t and i ng t r ad i ti on o f deco ra t i on by uppery e a r E n g i n e e r i n g s t u de n t s. D e s p i t e t h e fa c t th a t t h eE y e T a p d i v e r t e r s u s e d w e r e l a r g e a n d v i s i b l e , s i n c et h e y w e r e m o u n t e d o n h a r d h a t s, t h e y b l e n d e d i n t o th efes t i v i t i es na tu ra l ly . In t hi s way , t hey were u s ed i n am a n n e r s i m i la r t o t h e s m a l l e r v e r s i o n s o f th e E y e T a pt echno l ogy [4 ] , t o ob t a i n s i mi l a r l y cand i d i n t e r ac t i on .

Jus t as t he work o f a pho t o j ou rna l i s t can be r e -g a r d e d a s a n a r ti s ti c f o r m o f e x p r e s s io n , V i d e o O r b i t sa l l o w s E N G w e a r r e p o r t e r s t o c r e a t e h i g h r e s o l u t i o ne x p r e s s i v e i m a g e s o f t h e ir s u b j e c t m a t te r . T h i s o c -c u r s w h e n a n E N G w e a r r e p o r te r c a p tu r e s a s e q u e n c eo f i m a g e s i n r a p i d s u c c e s s i o n , w h i l e s w e e p i n g h e rgaze across her t o t a l f ie l d o f v i ew. E ssen t i a l ly , t h i s se -que nce cap t u res i n fo rm at i on o f g rea t e r spa t ia l ex t en t,w i t h t h e t e m p o r a l d i f f e r e n c e s b e t w e e n i m a g e s r e m a i n -i n g sm a l l . W h e n m a n y s u c h i m a g e s a r e c o m b i n e d i n toa P h o t o q u a n t i g r a p h i c I m a g e C o m p o s i t e , w h a t r e s u l t si s a h i gh r eso l u t i on l ookpai n t i ng . The sha pe o f t heborde r o f t he l ookpai n t i ng wi l l re f l ec t the gaze o f t hew e a r e r. T h u s , i f t h e w e a r e r c a p t u r e s a s e q u e n c e m o v -i ng t he i r head i n a cu rv i ng m ot i on , so t oo wi l l t he bo r -d e r o f t h e lo o k p a i n t in g h a v e t h e s a m e c u r v i n g m o t i o n .S o m e c o m p e l l i n g l o o k p a i n t i n g s w e r e c a p t u r e d d u r i n gt h e s p a n o f t h e E N G w e a r p r o j e c t , d e p i c t e d in F i g u r e2.

A s l o c a l m e d i a b e c a m e i n t e r e s te d i n th e p r o j e c t , th eE N G w e a r s t u d e n ts f o u n d t h e m s e l v e s p r o v id i n g m e d i ac o v e r a g e o f t h e tr a d it io n a l m e d i a , w h o h a d c o m e t op r o v i d e c o v e r a g e o f t h e E N G w e a r r e p or t e rs . A s o r to f " m e t a - m e d i a " s i tu a t io n r e s u l t e d i n w h i c h t h e n e w sg a th e r e rs b e c a m e n e w s t h e m s e l v es , f o r b o t h E N G -wear and t r ad i t i ona l r epo r t e r s a l i ke .

V . C o n c l u s i o n sE l e c t r o n i c N e w s G a t h e r i n g h a s e m e r g e d a s a n o v e ln e w a p p l i c a ti o n i n th e f ie l d o f P e r s o n a l I m a g i n g .W i r e l e ss c o m m u n i c a t i o n s a n d W e a r C o m p s n o w m a k ea n e w g e n r e o f n e w s g a t h e r in g p o s s i b l e - a n e w s o r to f p h o t o j o u r n a l l y i n g s o m e w h e r e b e t w e e n l i v e t e le v i -s i o n c o v e r a g e a n d n e w s p r i n t , c a p t u r e d f r o m t h e v e r ye y e s th a t w i t n e s s e v e n t s a s t h e y h a p p e n . N e w c a p a -b i l i t e s a r e a f f o r d e d t o E N G w e a r r e p o r t e r s s t e m m i n g

Mobi l e Com put ing and Com munica t ions Rev i ew, Volume 3 , Num ber 4 ....... 25

7/29/2019 Eye Tap Technology

8/8

f r o m t h e E d g e r t o n i a n n a t u re o f W e a r C o m p v i d e o i n -p u t c a p tu r e , b e s t c a s e s c e n a r io mo d e l s , a n d t h e o p -e r a ti o n a l c o n s t a n c y o f W e a r C o mp s . N e w c a p a b i l i ti e si n c lu d e : t h e p o t e n t i a l t o b r o a d c a s t , u s in g P T R f r o ma r ea s u n r e a c h a b l e b y t r a d it i o n a l me d ia t e a ms ; t h e c a-p a b i l it y t o r e c o r d i n a n u n o b t r u s iv e ma n n e r ; t h e a b i l i tyto i n s t an t l y r e c o r d ima g e s a n d r e t r ie v e t h e m f r o m th er e c e n t p a s t i f n e c e ss a r y ; a n d a g r e a te r d e g r e e o f mo -b i li ty . E N G w e a r s y s t e ms r e mo v e t h e re q u i r e m e n t fo re x p e n s iv e v id e o e q u ip m e n t a n d la r g e mo b i l e t r a n s mi t -t e r s , a l l o w in g a n y W e a r C o mp w i th me a g r e c o mp u ta -t i o n a l p o w e r a n d e v e n a l o w b a n d w id th t r a n s mi t t e r t op r o v id e l i v e c o v e r a g e o f e v e n t s - a p r i v l e d g e w h ic hc a n n o w b e a f f o r d e d n o t o n ly t o l a r g e b r o a d c a s t i n gc o r p o r a t io n s , b u t t o c o m m o n in d iv id u a l s. W i th ma n yE N G w e a r s y s t e m s f u n c t i o n a l a n d w o r n d a y - t o - d a yb y p r iv a t e c i ti z e n s , t h e f a c e o f n e w s c o v e r a g e c o u ldb e c h a n g e d d r a s t i c a ll y a s t h e v i e w o f t h e c o m m o n c i t-i z e n c o me s i n c r e a s in g ly i n to f o c u s .

[ 6] S t e v e Ma n n . S m a r t c l o th in g : T h e w e a r a b l e c o m-p u t e r a n d w e a r c a m. Person al Technologies, p a g e s2 1 - 2 7 , M a r c h 1 9 97 . V o lu m e 1, I s s u e 1 .

V I. F u r t h e r i n f o r m a t i o nF o r f u r t h e r i n f o r ma t io n o n t h e l i c e n s in g o f E y e T a pt e c h n o lo g y , e ma i l ma n n @ e e c g . t o r o n to . e d u , a n d c ca d m i n @ e y e t a p . o r g

R e f e r e n c e s[ 1] S . M a n n . ' me d i a t e d r e a l i ty ' . T R 2 6 0 ,

M . I . T . M . L . v i s m o d , C a m b r i d g e , M a s s a c h u se t ts ,h t t p : / /w e a r c a m. o r g /mr . h tm, 1 9 94 .

[2 ] S t e v e M a n n . P e r s o n a l ima g in g a n d l o o k p a in t -i n g a s t o o l s f o r p e r s o n a l d o c u m e n ta r y a n d i n v e s -t i g a ti v e p h o to jo u r n a l i s m . A C M M o b i l e N e t w o r k-ing, 4(1) :2 3-36 , 1999. S pec ia l I ssue on W earableC o m p u t i n g .

[ 3] S . Ma n n . C o m p o s i t i n g mu l t i p l e p i c tu r e s o f t h es a me s c e n e . I n P ro c e e d in g s o f t h e 4 6 th A n n u a lI S & T C o n fe re n c e, p a g e s 5 0 - 5 2 , C a m b r i d g e , M a s -s a c h u s e t ts , Ma y 9 - 1 4 1 9 93 . T h e S o c i e ty o f I ma g -in g S c i e n c e a n d T e c h n o lo g y .

[4 ] S t e v e Ma n n . H u m a n i s t i c i n t e l l i g e n c e /h u ma n i s t i cc o m p u t i n g : ' w e a r c o m p ' as a n e w f r a m e w o r kf o r i n t e l l i g e n t s i g n a l p r o c e s s in g . P ro c e e d in g s o ft h e I E E E , 8 6 ( l l ) : 2 1 2 3 - 2 1 5 1 + c o v e r , N o v 1 9 9 8 .h t t p : / /w e a r c a m. o r g /p r o c i e e e . h tm.

[5] S . M ann. W earable W ire le ss W ebcam , 1994.h t t p : / /w e a r c a m. o r g .

2 6 Mobile Compu ting and Communications Review~Volume 3, N umb er 4