Nuria Oliver, PhDResearcherMicrosoft Research

2

New opportunities for wearablehealth and wellness

continuous monitoring devices

Zillions of gadgets to monitor various physiological and environmental signalsTypically proprietary data transmission protocols Typically capture on-board and off-line processing of the data after downloading to a PCVery difficult if not impossible to combine signals from different gadgetsLack of real-time on-board processing of the information to deliver value to the user

Continuous monitoring and understanding of multiple physiological and environmental signalsFinding correlations between lifestyle and wellness/healthIdentifying trends and deviations from those trendsDeveloping new interesting and fun applicationsEmpowering users

5

6

Audiovox 5600 GSM mobile phone

Alivetec Alive ECG and

Accelerometer sensorBlood oximeter

HealthGear MPTrain

Automatically Monitor and Detect Sleep Apnea Events Music and Physiology-based

Personal Trainer

Real-time, wearable physiological monitoring system on a mobile phonePhysiological sensors wirelessly connected via Bluetooth to a mobile phoneContinuous recording of blood oximetry, heart-rate and plethysmographic signalReal-time analysis and presentation of physiological data to the userUsage scenario: Sleep monitoring and automatic sleep apnea detection

7

Underdiagnosed but common conditionAffects children and adults4% in men and 2% in women (higher for elderly)Untreated causes $3.4 billion of medical costs40 million undiagnosed Americans

Periods of interrupted breathing (apnea) and periods of reduced breathing (hypoapnea)Leads to

Hypoxia, asphyxia and awakeningsIncreased heart-rate, high blood pressureExtreme fatigue, poor concentrationCompromised immune systemCardio/cerebrovascular problems

8

Nocturnal Polysomnography (PSG)In sleep center for 1-2 nightsContinuous, simultaneous multi-channel measurements of 8 physiological signals Very expensive, cumbersome, time consuming, just one sample and subject to manual scoring and human error

Pulse oximetry Useful as screening toolOne simple, light-weight sensor on finger, toe or earlobe

9

10

20 volunteers80% male, ages 25-6530% healthy, 70% with sleep apnea or suspected

Filled out pre-sleep and post-sleep questionnairesWore HealthGear for one or two full nights in their own homes

11

3 long-term (2-3 weeks at a time) sleep studies1 long-term (2.5 months) study with MIT’s PlaceLabInvestigated correlations between quality of sleep and lifestyle factors

Alcohol and caffeine intakeDietExerciseStress levels

15

New hardware board!!More long-term sleep studies(MIT, Univ. Virginia)Study on drivers that have apnea (Univ. Iowa)Study on aircraft pilotsSummits of Canada expedition

18

Audiovox 5600 GSM mobile phone

Alivetec Alive ECG and

Accelerometer sensor

HealthGear MPTrain

Automatically Monitor and Detect Sleep Apnea Events Music and Physiology-based

Personal Trainer

Music ProvidesPacing AdvantageDistractionPositive Mood

Music Positively ImpactsEndurancePerformance PerceptionExertion Perception

19

Target HR zones recovery, weight management, aerobic,anaerobic, over-exertion

Used to measure effort

20

PHR reserve =(maxHR - restHR)*P + PHR reserve =(maxHR - restHR)*P + restHRrestHR

Next Action Module

BPM(t) = Current Heart BPM(t) = Current Heart raterate

SPM(t) = Current paceSPM(t) = Current pace

DBPDBPM(t)M(t)

>0

>0

<0

Slow Slow down down useruser

Keep Keep same same speedspeed

Speed Speed up up

useruserDBPM(t) = DBPM(t) = BPM(t) – Ideal BPM(t)BPM(t) – Ideal BPM(t)

Sensor data (Bluetooth)

Feedback (Music)

Transceiver Mobile phone

Sensors

Digital MusicDatabase

22

23

Runner study with 18 runners to test a few new features of the system

24

Real-time collection and analysis of physiological and environmental signals on a mobile phone (Smartphone)Big opportunity for

Constant monitoring of usersReal-time feedback to usersFinding correlations between lifestyle and health/wellnessIdentifying trends and deviations from those trendsNew applications and services 25

High impact on the societyImproving Quality of Life of UsersAging, chronic disease management, exercise, wellness, entertainment, affective and social computing, disease prevention, pro-active medicine, stress reduction, etc..

26

More informationnuria@microsoft.comhttp://research.microsoft.com/~nuria/healthGear/healthGear.htmhttp://research.microsoft.com/~nuria/MPTrain/MPTrain.htm

© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.

The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after

the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Microsoft Research Faculty Summit 2007