USE OF KINECT IN A SMART HOME

Francisco (Paco) Flórez Revuelta

20 de julio de

2009

Kinect for Life

4th October

2012

RoViTRobot Vision Team

Fra

ncis

co

Fló

rez R

evu

elta

–4

th O

cto

be

r, 2

01

2 –

Kin

gsto

n U

pon

Th

am

es

Interacting with a smart home

MetalTIC – Smart Home: Collaboration with FEMPA

(Federation of Metal-working Companies at the

Province of Alicante – Spain)

Fra

ncis

co

Fló

rez R

evu

elta

–4

th O

cto

be

r, 2

01

2 –

Kin

gsto

n U

pon

Th

am

es

Interacting with a smart home

MetalTIC – Smart Home: Collaboration with FEMPA

(Federation of Metal-working Companies at the

Province of Alicante – Spain)

Fra

ncis

co

Fló

rez R

evu

elta

–4

th O

cto

be

r, 2

01

2 –

Kin

gsto

n U

pon

Th

am

es

Multimodal Interaction

Pointing gesture to select the device

Voice to give the order

Use of multiple kinects with overlapping views

Problem due to interferences between kinects

Fra

ncis

co

Fló

rez R

evu

elta

–4

th O

cto

be

r, 2

01

2 –

Kin

gsto

n U

pon

Th

am

es

caring4U - A study on people activity in private spaces:

towards a multisensor network that meets privacy

requirements

European Project – Marie Curie Intra-European

Fellowship

Objectives:

Study, design and development of a distributed vision

system for human motion analysis in a private

environment

Development of appropriate techniques for maintaining

the privacy of the individuals being monitored

Integration of the vision system with other sensors

forming a perceptual, unobtrusive and interoperable

network

Integration and validation of the system in a

smart home environment:

Fra

ncis

co

Fló

rez R

evu

elta

–4

th O

cto

be

r, 2

01

2 –

Kin

gsto

n U

pon

Th

am

es

caring4U - A study on people activity in private spaces:

towards a multisensor network that meets privacy

requirements

Camera 1

Detection of moving

people and objects

Behaviour

analysis

Person

identification

Tracking of people

and objects

Privacy

Dynamic information/knowledge fusion

Behaviour analysis

Information/knowledge

from other

environmental sensors

Camera n

Detection of moving

people and objects

Behaviour

analysis

Person

identification

Tracking of people

and objects

Privacy

Privacy

EVENT

Environment information

Camera parameters

Behaviour modelling

People database

Object database

...

Alarm

Fra

ncis

co

Fló

rez R

evu

elta

–4

th O

cto

be

r, 2

01

2 –

Kin

gsto

n U

pon

Th

am

es

Human action recognition

Use of Microsoft Research MSRAction3D Dataset:

20 action types, 10 subjects, each subject performs each

action 2 or 3 times

Not all the joints are of interest evolutionary

algorithm to determine the discriminative joints

Fra

ncis

co

Fló

rez R

evu

elta

–4

th O

cto

be

r, 2

01

2 –

Kin

gsto

n U

pon

Th

am

es

Human activity recognition –

Ambient Assisted Living

Use of Microsoft Research MSRDailyActivity3D

Dataset:

16 activities types, 10 subjects, each subject performs

each action 2 (one standing, one sitting):

Fall detection:

Determine the most important joints to detect falls

Record a dataset

Fra

ncis

co

Fló

rez R

evu

elta

–4

th O

cto

be

r, 2

01

2 –

Kin

gsto

n U

pon

Th

am

es

BREATHE - Platform for self-assessment

and efficient management for informal

caregivers

Project selected by the European Commission –

Ambient Assisted Living Joint Programme (call 5)

Francisco (Paco) Flórez Revuelta

F.Florez@kington.ac.uk

http://rovit.kingston.ac.uk

20 de julio de

2009

Kinect for Life

4th October

2012

RoViTRobot Vision Team