COI WEARABLE SENSORS

BERNARD GRUNDLEHNER

RUBEN DE FRANCISCO

CHRIS VAN HOOF

IMEC INNOVATION PLATFORM

© IMEC 2016

EEGv024-Channel EEG Readout

ASIC

ECGv01-Channel ExG Readout ASIC

EEG v2Complete 8-channel EEG

Acquisition ASIC

ECGv1Analog Signal Processor for ECG

Monitoring

ECGv3Analog Signal Processor for ECG

Monitoring

ECG SoC v1(EEG AFE v2)

Mixed Signal ECG Acquisition ASIC

Active v08-Channel Active Electrode Readout for

EEG

EEG v38-Channel Active Electrode Readout for

EEG

BASIC v0Low-Power Bio-Impedance

Measurement IC

BASIC v1Low-Power Bio-Impedance

Measurement IC

BioDSP (2009)Custom low-power RAM, power

gating, duty-cycled

ULP-SRP (2013)Multi-mode ASIP, Near-VT operation, Fine-grained power domains, Multiple voltage

domains, Dynamic Voltage Frequency Scaling

CoolBIO (2011)Low-voltage logic, level

shifters

Large track record25+ ISSCC publications in bio-medical ICs

Analog MPPT DC/DC Buck Convertor

Energy Aware IC for Piezoelectric Harvestors

MUSEIC v1 (2014)ECG+ETI (3x), BIOZ,

ARM,128kB, accelerators

MEGIC (2015): SOC+PMICECG+ETI, BIOZ, GSR, PPG, LED drivers, ARM,128kB, accelerators

3

HISTORY OF IC DESIGN AT IMEC

© IMEC 2016

42016 / IMEC © IMEC 2016

LOW POWER | HIGHLY MINIATURIZED | MEDICAL GRADE

Sensors in Information out

MULTI SENSOR IC MIXED-SIGNAL PLATFORM

imec MUSEICIndustries smallest and most power efficient sensor hub

© IMEC 2016

GENERIC HARDWARE

PLATFORMS FOR MULTISENSOR APPLICATIONS

BIO-IMPEDANCE

POSTURE

ACTIVITY

HEART RATE

HEART RATE VARIABILITY

PHOTOPLETHYSMOGRAPHY

© IMEC 2016

INTEGRATION INTO DEDICATED FORM FACTORS, SUCH AS HEALTH PATCH

VALIDATED IN CLINICAL PILOT STUDIES

The Center of Innovation (COI) Program

The Center of Innovation (COI) ProgramThree visions of COI STREAM (The society in 10 years ahead that we want to create)

Vision 1

Secure sustainability as a country advanced in its aging population and

declining birth rateSmart Life Care, Ageless Society

Key concepts (function)Medical health, Mental health,Motivation, Sports, Food, Ties⇒ Realization of happiness

Vision 2

Vision 3

Create a living environment with a high Quality of life as a prosperous and

reputable countrySmart Japan

Establish a sustainable societywith vitality

Active Sustainability

Key concepts (function)勘 ( intuition)ing thinking, Active thinking, Serendipity, Six senses ⇒ Innovative thinking

method

Key concepts (function)(Personalization, Resilience,

Sustainability, Functionalization, Flexibility) - Waste

⇒ Development of a durable town

for centuries

Change People

Change Society

The Center of Innovation (COI) Program

The Center of Innovation (COI) ProgramThree visions of COI STREAM (The society in 10 years ahead that we want to create)

Vision 1

Secure sustainability as a country advanced in its aging population and

declining birth rateSmart Life Care, Ageless Society

Key concepts (function)Medical health, Mental health,Motivation, Sports, Food, Ties⇒ Realization of happiness

Vision 2

Vision 3

Create a living environment with a high Quality of life as a prosperous and

reputable country

Smart Japan

Establish a sustainable societywith vitality

Active Sustainability

Key concepts (function)勘 ( intuition)ing thinking, Active thinking, Serendipity, Six senses ⇒ Innovative thinking

method

Key concepts (function)(Personalization, Resilience,

Sustainability, Functionalization, Flexibility) - Waste

⇒ Development of a durable town

for centuries

Change People

Change Society

Osaka Univ.Hiroshima Univ.Tokyo Inst TechTokyo Univ. Arts

Hokkaido Univ.Hirosaki Univ.Tohoku Univ.Univ. TokyoRitsumeikanKyoto Univ.

Yamagata Univ.Keio Univ.Kanazawa Inst TechUniv. TokyoShinsyu Univ.Nagoya Univ.Kyusyu Univ.

Super Nippon-jinrepresents those who can

always fulfill their potential

Happy SocietyWhere each and every Super Nippon-jin can maximize their potential and enjoy

their life to the fullest

Brain networks

Community networks

Activation by group with the communication quality improved

Further activation of brain by eliminating stress

Education

Childhood

Adulthood

“The Self-Empowerment Society where people can fulfill their potential”

public scene private sceneActivation sceneCreate a living space where stress will be eliminated and motivation be encouraged

Status Detec-

tion

Provision of activation method

Further activation

Evaluation of activation

level

Health

parent-child communication

Sports

Sympathetic Robot

At home

School Education

Business/Community

In motionAt school

Brain managementVisualizationand activation

AfterBefore

in a stressful situation －

Stress detection

in a activated situation＋

Exercise for brain activation

Direct stimuli

Brain music

112016 / IMEC © IMEC 2016

Companies(26) Panasonic(leading company), imec International, Hitachi, DAIKIN, YAMAHA, SYOWA DENKO, SEMEDAIN, KANEKA, MEKTRON, MEDHINET, Quantum Biosystems, ORGANO, etc

Univ. and Research Institute(14)

Osaka Univ., Kanazawa Univ., CiNet, Univ. Tokyo, National Cardiovascular Center, Institute of Telecommunications Engineers, Kinki Univ., etc

Grouping Development theme(14) Partners(40)

Status detection

Stress maker of tear fluid, blood serum, and breath Osaka Univ.(MED, ISIR), NCC, MEDHINET, PanasonicCortisol detection by TOF MS Osaka Univ.(FOS), MSI. TOKYOBacterial flora Osaka Univ.(ISIR), Fine

Brain mechanism

Brain function imaging (7T fMRI) CiNet, Osaka Univ.(ISIR), PanasonicGMN(Gene Matched Network) theory Osaka Univ.(BIO), Hitachi

Imperceptible sensing

DNA sequencer Osaka Univ.(ISIR), Quantum BiosystemsWearable sensor Osaka Univ.(ISIR), Kanazawa Univ., imecWearable sensor technologies(printing, packaging, patch-type EEG sensor)

Osaka Univ.(ISIR), SYOWA DENKO, KANEKA, SEMEDAIN, KONICA, MEKTRON, Panasonic

Activation method

Activation of community(education, sports)by GMN approach

Osaka Univ.(MED, Child, Sports), Hokkaido Univ. Doshisya Univ., Hitachi

Activation by deep sleeping Osaka Univ.(Child, ISIR), CiNet, DAIKIN, YAMAHA

Activation by music Osaka Univ.(ISIR), CiNet, Tokyo City Univ., ITE, imec, Brains

Immunity up by hydrogen generation in the intestine

Osaka Univ.(MED, ISIR), NISSHIN KASEI, SHINKO, ORGANO

tDCS stimulation Osaka Univ.(MED), Kanazawa Univ. Hamamatsu MED,KANSAI MED, imec

Kanazawa satellite Upbringing autism child by brain personality Kanazawa Univ., Osaka Univ.(ENG), Univ. Tokyo, PＦU

Osaka Univ. COI theme and our partners

122016 / IMEC © IMEC 2016

Companies(26) Panasonic(leading company), imec International, Hitachi, DAIKIN, YAMAHA, SYOWA DENKO, SEMEDAIN, KANEKA, MEKTRON, MEDHINET, Quantum Biosystems, ORGANO, etc

Univ. and Research Institute(14)

Osaka Univ., Kanazawa Univ., CiNet, Univ. Tokyo, National Cardiovascular Center, Institute of Telecommunications Engineers, Kinki Univ., etc

Grouping Development theme(14) Partners(40)

Status detection

Stress maker of tear fluid, blood serum, and breath Osaka Univ.(MED, ISIR), NCC, MEDHINET, PanasonicCortisol detection by TOF MS Osaka Univ.(FOS), MSI. TOKYOBacterial flora Osaka Univ.(ISIR), Fine

Brain mechanism

Brain function imaging (7T fMRI) CiNet, Osaka Univ.(ISIR), PanasonicGMN(Gene Matched Network) theory Osaka Univ.(BIO), Hitachi

Imperceptible sensing

DNA sequencer Osaka Univ.(ISIR), Quantum BiosystemsWearable sensor Osaka Univ.(ISIR), Kanazawa Univ., imecWearable sensor technologies(printing, packaging, patch-type EEG sensor)

Osaka Univ.(ISIR), SYOWA DENKO, KANEKA, SEMEDAIN, KONICA, MEKTRON, Panasonic

Activation method

Activation of community(education, sports)by GMN approach

Osaka Univ.(MED, Child, Sports), Hokkaido Univ. Doshisya Univ., Hitachi

Activation by deep sleeping Osaka Univ.(Child, ISIR), CiNet, DAIKIN, YAMAHA

Activation by music Osaka Univ.(ISIR), CiNet, Tokyo City Univ., ITE, imec, Brains

Immunity up by hydrogen generation in the intestine

Osaka Univ.(MED, ISIR), NISSHIN KASEI, SHINKO, ORGANO

tDCS stimulation Osaka Univ.(MED), Kanazawa Univ. Hamamatsu MED,KANSAI MED, imec

Kanazawa satellite Upbringing autism child by brain personality Kanazawa Univ., Osaka Univ.(ENG), Univ. Tokyo, PＦU

Osaka Univ. COI theme and our partners

© IMEC 2016

3 DEVICES FOR 3 FIELDS OF APPLICATION

1) Wristband for measuring GSR (Galvanic Skin Response) and skin temperaturereflecting autonomic nervous system responses, emotional responses

2) ECG patch for very precise detection of heart beatsheart rate variability reflecting ANS modulation, emotional responses,

sleep

3) Easy to use EEG headset for measuring brain wavesmeasuring sleep quality, emotions and responses of the central nervous

systemto auditory and visual stimulation

© IMEC 2016

3 DEVICES FOR 3 FIELDS OF APPLICATION

1) Wristband for measuring GSR (Galvanic Skin Response) and skin temperature> 7 days autonomy, comfortable to wear, large dynamic range

2) ECG patch for very precise detection of heart beats> 7 days autonomy, comfortable for wide range of skin types

3) Easy to use EEG headset for measuring brain wavesEasy to put on, medical grade signal quality

▸ Synchronized acquisition of all devices▸ Smart phone interface for monitoring data and

controlling devices

© IMEC 2016

Brain music▸ EEG headset▸ GSR band▸ ECG patch

Psychiatry▸ EEG headset▸ GSR band▸ ECG patch

Sleep research▸ ECG patch▸ GSR band

3 DEVICES FOR 3 FIELDS OF APPLICATION

© IMEC 2016

3 DEVICES FOR 3 FIELDS OF APPLICATION

IMEC WEARABLE SENSORS | MARCH 14, 2016 | ANNUAL CONFERENCE | OSAKA UNIVERSITY

EEG headset ECG patch GSR wristband

Disposable patch

Reusable electronics

can be controlled from an Android smart phone, tablet P

182016 / IMEC © IMEC 2016

GSR WristbandAccurate recording of GSR,3D acceleration and skin temperature for 7 days without charging.

From prof. Kikuchi, Kanazawa Univ.

Use case: managing depression ▸ Diary:

• Patient is sent home with sensor for 1 week or longer

• Mood changes are logged▸ Treatment:

• Finding correlates between life style and mood swings

192016 / IMEC © IMEC 2016

Enabling to measure human activities, skin temperature, skin conductance for long days(10 days)

GSR WristbandAccurate recording of GSR,3D acceleration and skin temperature for 7 days without charging.

Skin temperature measurement

24 hours

Acceleration measurement

24時間

1日目2日目・・・・9日目

Sleep

Skin conductance measurement

24時間

Temp.

From prof. Kikuchi, Kanazawa Univ.

202016 / IMEC © IMEC 2016

体動

の周

波（

Hz)

desk work

Standingwork

walking running steps

Comparison among vehicles

Human activities evaluation by GSR frequency analyses（frequency analyses per 5 seconds)

→ time axis

Comparison among various works

Quite active around 2H

z！

Limited expressShirasagi

City busShinkansen(700series)

212016 / IMEC © IMEC 2016

FFT per 6 min➡ extraction of 2Hｚ power

Change in 2Hz

Divided per 6 min period1st day2nd day・・・・9th day

Activities are found to be around 2HzContinuous acceleration measurementfor 9 days

24 hours

1st day2nd day・・・・9th daySleep

From prof. Kikuchi, Kanazawa Univ. Data analyses of 9 days continuous acceleration measurement

222016 / IMEC © IMEC 2016

Time series extraction of9 days continuous 2Hz power

24hours

2HzPower値

Sleeping timeClearly seen ! Wake

morning

occu

rrenc

e fr

equn

cey

per 6

min

.

weak ← exercise → strong→ 強い

Frequency distribution

From prof. Kikuchi, Kanazawa Univ.

FFT per 6 min➡ extraction of 2Hｚ power

Change in 2Hz

Data analyses of 9 days continuous acceleration measurement

232016 / IMEC © IMEC 2016

Log

occu

rrenc

e fre

quen

cy p

er 6

min

weak ← exercise intensity → strong

As for distribution of occurrence frequency of exercise intensity per day, strong linear relation can be seen through 9 days by logarithmic transformationFrom now on, this analysis (including body temperature, skin conductance) will be considered whether can be handled as the objective index of depression disease

Δ

From prof. Kikuchi, Kanazawa Univ. Data analyses of 9 days continuous acceleration measurement

Thank you for attention