Trends and Roadmapping in AAL

The AALIANCE RoadmapFilippo CavalloEl t i E i PhD

p

Electronic Engineer – PhDPost Doctoral Researcher

ARTS LabS l S i S t'A P l S t'A V ldScuola Superiore Sant'Anna - Polo Sant'Anna ValderaViale Rinaldo Piaggio, 3456025 Pontedera, Pisa - ITALYhttp://www-arts.sssup.it

Phone: +39 050 883474Fax: +39 050 883101E-mail: f.cavallo@sssup.it

Outline

Background

AALIANCE project

Roadmap and trend Main domains

E bli T h l i Enabling Technologies

ConclusionsConclusions

Outline

Background

AALIANCE projectAALIANCE project

Roadmap and trend Main domains Enabling Technologies

Conclusions

Background New European population projections has recently underlined that the number of

elderly persons will quickly increase*.

The fiscal impact of ageing will be substantial in almost all European Member States through two main channels**:States through two main channels : Pension (public expenditure increase up to 5% GDP) Health care and long-term care (public expenditure increase up to 1.5% GDP)

* European population projections for 2008-2060, published by the European Office for Statistics.** Report on the impact of ageing populations on public spending”, Council of the European Union, 2006.

Aging population scenario A growing number of older people living alone and in

need of (intensive) care.

An ageing workforce An ageing workforce.

A rapid growth in the number of persons with physicaldisabilities.

More financially well-appointed and wealthy seniorcitizens ready to enjoy their third age and to spendmoney on products securing and enhancing wealth,safety, security and not forgetting entertainment andcommunications needs.

ICT-enabled assisted living

ICT-enabled assisted living and innovative technological developments can reallyprovide aims and improvements:

Quality of life, autonomy, participation in social life, skills and the employabilityof older peopleof older people.

Home assistance for Patients. Caregivers.

Domiciliary assistance for slowing down the course of the illness (not earlyhospitalization).p )

Reduction of welfare costs (nursing home costs three time the domiciliary one).

Outline

Background

AALIANCE project

Roadmap and trend Main domains Enabling Technologies

Conclusions

AALIANCE Project

FACTS on AALIANCE - The European Ambient Assisted Living Innovation Alliance

FP7 Coordination action (CA)THEME ICT-1-7.1 ICT and Aging

Duration: 01/2008 – 12/2009

Partners: 14

Volume: 1 646 170 €Volume: 1.646.170 €EC Contribution: 1.070.000 €

WP2 Scuola Superiore Sant’Anna PisaWP2 - Scuola Superiore Sant Anna, PisaAAL Roadmap publishedAAL Strategic Research Agenda

h // li / bli /d / li d /http://www.aaliance.eu/public/documents/aaliance-roadmap/

Partners

Outline

Background

AALIANCE project

Roadmap and trend Main domains Main domains Enabling Technologies

Conclusions

Ambient Assisted Living context “Ambient Assisted Living” (AAL) denotes concepts, products and services that

interlink and improve new technologies and social systems, with the aim ofh i th lit f lif f ll l i ll t f th i lienhancing the quality of life for all people in all stages of their lives.

AAL could be best translated as “intelligent systems of a specific assistance for aAAL could be best translated as intelligent systems of a specific assistance for abetter and safer life in the home environment”.

More in AAL Surrounding

Social activityS i l I i

Dependency from: Habits

Social Interaction Hobbies Inclusion

Life style Needs Pathologies

Work ability Mobility Learning

g Evolution of illness Psycho-Social conditions

Learning

Primary StakeholdersU

Tertiary StakeholdersO i ti l i d d i-Users

-Caregivers- Organization supplying goods and services

UsersQuaternary Stakeholders- Organization analyzing the economical and legal context of AAL

Secondary Stakeholders-Organization offering services

AAL domains and technologies AAL application domains

• @ home/mobile (person-centric) Health rehabilitation care

Main functions and enabling technologies Sensing Health, rehabilitation, care

Safety and security Activity management / cognitive support Autonomy / physical support

Sensing New sensors Sensor networks

Reasoningy p y pp Person-centric services

• @ community Mobility

Reasoning Ontologies Event stream processing Probabilistic reasoningy

Social Inclusion Entertainment and Leisure

• @ work

Probabilistic reasoning

Acting New actuators Home robots and mechatronic devices@

Collaboration, cooperation Presence/process awareness Aware and ubiquitous workplaces

Home robots and mechatronic devices

Interacting Multimodal, natural, persuasive interfaces

C i i Communicating New protocols and standards for

communication network

From Domotics to Ambient Intelligence (AmI) to Ambient Assisted Living (AAL): evolution driven by technology convergence

• Digital CONVERGENCE in communications market (mobile + iDTV + Broadband Internet) enable UBIQUITOUS ACCESS

• CONVERGENCE in home and environment control technologies enable AWARENESS• Distributed embedded intelligence (software agents)

O t d d f h t ti (KNX UP P )

Tele-monitoringTele care

Tele-rehabilitation UbiRob-supported cognitive autonomy

• Open standards for home automation (KNX, UPnP,…)

• Emerging standards for low-power

wireless communication (ZigBee, BT)

• CONVERGENCE between AAL

eGov’t,eCommerce

Tele-care

Tele-medicine

Biorobotics

Biorobotics for care, h lth d t

Ubiquitous robotics

• CONVERGENCE between AAL technologies and Robotic Technologies enable UBIQUITOUS ROBOTICS FOR AUTONOMY

Aware Home technologies

health and autonomy

smart homedistributed intelligence

• NEW APPLICATIONS AND SERVICES (tele-monitoring, -care and -rehabilitation, cognitive support to daily living,

)

Ambient intelligence

BAN - Wearable sensing and computing

g

Software agents

Events stream processing

…)

multi-standard connectivity

Interactive DTVMobile Broadband

communication connectivity

Outline

Background

AALIANCE project

Roadmap and trends

Main domains Enabling Technologies

Conclusions

The domains in AAL

AAL4PersonAgeing well (@home, @mobile)

PERSONAL AUTONOMY AND WELL-BEING

AAL in the CommunityAgeing well in one’s social environment

PARTICIPATION

AAL in the Community

AAL@W kAgeing well in one’s working environmentACTIVE AND PRODUCTIVE AGEING

AAL@Work

ACTIVE AND PRODUCTIVE AGEING

AAL for persons(at home, on the move)

Health, rehabilitation and care Personal and home safety and securityP l i iPersonal activity management Biorobotic systems and AALPerson-centred services

AAL4persons: Health, Rehab, Care

Person-centered health management

Tele-monitoring and self-management of chronic diseases Tele-monitoring of health parameters – sensors and connectivityTele monitoring of health parameters sensors and connectivity Wearable and implantable multisensor platforms – power management

Support for caregivers and care providers Teleconsultation, from A/V to tele-presence + 3D A.R. Vital data acquisition and transmission Remote actuators

AAL4persons: Personal and home safety and security

Safety/security against external threats Distributed sensor networks & service centres, self-configuration

Safety against falls and other accidents Wearable and mixed environment/wearable sensors; integration vision + inertial +

localization (indoor/outdoor) + situation interpretation; implantable sensors, integration with smart orthoses (new materials)

Personal activity management sensors and systems for indoor localization and monitoring; ontologies and user models - activity models for activity recognition and

Personal activity management

monitoring and for cognitive support; ubiquitous audio-video-data communication; multi-channel stimulation;u t c a e st u at o ; ubiquitous/pervasive sensing and computing + pervasive communication =

Internet of Things; event streams processing and probabilistic reasoning event streams processing and probabilistic reasoning.

AAL4persons: Biorobotic systems and AAL

AAL4persons: Biorobotic systems and AAL

AAL4persons: Person-centred services

New generation technologies and technology enabled services for: Shopping

Remote shopping, “missing product” services, assisted shopping in the shop environment (smart shopping cart and shelves, ...)

Feeding Feeding Smart cookers, lids and pots and pans, with sensors Smart meal cooking and delivery services Assisted feeding and drinking devices

Personal care Self health managementSelf health management Autonomous dressing/undressing Personal hygiene + safety in the restroom

AAL in the communityySocial inclusion Entertainment and leisureMobility

AAL in the community: Social inclusion

Participation in the community life Accessing informationg Physical access to services and activities

increasing remote access to events and services;developing local mobility networks of minibuses which move the elderly and disabled developing local mobility networks of minibuses which move the elderly and disabled from their homes to the location of services and events;

designing systems that move individuals autonomously to the desired location

Creativity, hobbies, sports

Cultural and experience exchange

AAL in the community: Entertainment and leisure

Commercial/Augmented thought-provoking games

Vi t l i ti t t d i Virtual navigation tests and exercises

Executive functions tests and exercises

Augmented toys

Interreality gamesy g

Augmented Reality games

T h l d ff t h Technology convergence and effect on research

AAL in the community: Entertainment and leisure

Cognitive

“Internet of things”objects have a digital

identity and intelligenceCognitive sciences

Single-function

Advanced Computer games

identity and intelligence

Interreality (Pervasive & AR) GamesSingle function

brain training games

“ecological” games

TODAYcommercial

AR) Gamesreal-world objects into

the game TODAYresearchTODAY

researchecological games

embedding Cognitive training

3R (Reality orientation, Reminiscence, Remotivation), Mid/Long term

Occupational Therapy cognitive training and assessment embedded (as a

game) in everyday life through interreality

Mid/Long term research

y

AAL in the community: Mobility

Supporting pedestrian mobility; Public transport Biorobotic systems for mobility support 4G mobile telephony From satellite to ubiquitous (indoor and outdoor) 4G mobile telephony, From satellite to ubiquitous (indoor and outdoor)

geolocalisation, Advanced web-based services and digital mapping, Near-field communication and wireless sensor networks

use of web-based technologies to supply on-trip information in a variety of formats at h t bil d i i hi l t t ti thome, to mobile devices, in vehicles, at stations, etc.

Ambient-Assisted Driving Priority of vehicle-based autonomous systems:

ESP (Electronic Stability Program);ESP (Electronic Stability Program);blind-spot monitoring;adaptive head lights;obstacle & collision warning;

P i it f i f t t l t d t Priority of infrastructure-related systems:eCall;extended environmental information;RTTI (Real-time Travel and Traffic Information);dynamic traffic management;local danger warning;speed alert.

AAL at workWorkplace accessibility and comfortWorkplace accessibility and comfortActive support to work tasksSafety and health @ worky @

AAL@work: Workplace accessibility and comfort

Active ergonomy: individual and shared workplaces are self-configurable, based on workers’ physical and sensorial g , p ycharacteristics and to their preferences

Dynamic, self-adapting and configuring HMI/HCI

Smart environments interacting with biorobotic support to mobility (wheelchairs and beyond)

AAL@work: Active support to working tasks

Robotic co-workers -> biorobotics 4 Autonomy/QoL Robotic co workers > biorobotics 4 Autonomy/QoL

Task monitoring and cognitive support Task monitoring and cognitive support Simpler than @home: working tasks are usually more structured than

everyday life tasks

Work planning support (smart agenda, integrated with AAL environments and “dust” intelligence)

AAL@work: safety and health at work

Ubiquitous sensing + accurate models for safer worker-machine interaction

Combined monitoring of physiological and environmental t f h lthparameters for health

In case of exposition to chemical agents In case of chronic conditions or other risk factors (cardiopulmonary,In case of chronic conditions or other risk factors (cardiopulmonary,

metabolic, musculo-skeletal)

l l i i d i d i Stress level monitoring and proactive reduction

AA d i i AA-driving

Outline

Background

AALIANCE project

Roadmap and trends Main domains

Enabling Technologies

Conclusions

Enabling technologies and functions

1. Sensingg2. Reasoning3. Acting3. Acting4. Interacting5. Communicating5. Communicating

htt // lihttp://www.aaliance.eu

Sensing (1) In AAL applications, sensing is expected to take place in anything and anywhere:

in- or on-body, in- or on- appliances or in the environment (home, outdoors, invehicles public spaces etc ) In AAL it is better to refer to “smart sensor”vehicles, public spaces, etc.). In AAL it is better to refer to smart sensor .

1) MEMS-based miniaturized and low-cost sensor.

2) DNA-sensors for measuring genetic diseases and/or genetically modified food.

3) Sensor communication systems based on advanced mobile communication protocols.

4) MEMS sensors for food and health care applications.

5) Miniaturized energy supplies for integration in self-contained sensors.

6) Lab-on-a-chip sensing (e. g. capillary separation and optical detection).

7) Motion-control and collision-avoidance (microwave sensors).

8) Ultra-small biosensors with implanted components in medical or other applications.

9) Biosensors for various applications.

10) MEMS devices based on polymer materials.

Sensing (2)

Short term (2013) Mid term (2020) Long term (2025)

Se •Heartbeat Detection – ultra-sensitive accelerometers •Invasive peripheral neural interfaces •Biologically humanensors

Heartbeat Detection ultra sensitive accelerometers•Non-invasive peripheral neural interfaces•Internet-connected sensors and actuators – SODA, Mulle3 etc•Universal Positioning – Galileo / GPS / MPS / WLAN / UWB / i l t il t ti

Invasive peripheral neural interfaces•Non-invasive cortical interfaces•Camera with object detection, classification and recognition•End-to-end, close-loop systems from

t t d d t l i

Biologically human inspired sensors•Biologically inspired sensor-actuator integration

UWB / signal space trilateration•Location technologies for in-door navigation•Sensors for indoor localization•Adaptive sensors and actuators•Item identification – RFID (standalone, bracelet-worn),

sensors, actuators and data analysis

NFC, BT, ShotCode•Super low power sensors•Sensors for human state detection

Pro •Advanced signals and image processing for detection •Advanced pattern recognition ocessing

•Algorithms for better signal filtering•Advanced methods for position detection of persons;•Video-motion analysis •Video-motion prediction •Context Acquisition and Use

•Sensor data aggregation and fusion from different sensors •Reliable classification of relevant situations from sensor signals and context informationq

•Valid and reliable techniques for the specific physiological signal;

Powe

•Energy scavenging and management •Endless power to mobile sensors, actuators and processors er

(wireless/battery)

Reasoning (1)

A core function of AAL systems is the conclusion of knowledge about the activitiesof the user and the current situation in this environment from low-level sensor data(d il i i i d i i i i ’ id d l(daily activities and situations, emergency situations, user’s mid-term and long-termbehavior). Sensor fusion aspects.

E i i Motion:Emergency situations:1) Helplessness/lying on the floor2) Indicators of falls3) Motionlessness4) C i i l l i i l

Motion:1) Occupancy of rooms2) Locomotion3) Quality and quantity of motion.

4) Critical values in vital parameters.

Activities of daily living:1) Sleeping2) T il

Vital parameters:1) Pulse rate2) Respiration rate3) Blood pressure2) Toilet usage

3) Personal hygiene4) Preparation of meals.

P h i l b h i

3) Blood pressure4) Body weight.

Psychosocial behavior:1) Going out2) Meeting people3) Communication.

Reasoning (2)

Acting (1) - Rehabilitation

Mechatronic technologies for AAL, including operative robot, wearable robot for rehabilitation and assistive purposes.

T h l i l h Technological changes: Human musculoskeletal actuators (artificial muscles) Models for control

Acting (2) – Robotic interaction

Neural Machine interfaces for actuating mechatronic devices Invasive methods (cortex, spinal cord, peripheral nerves, muscles, etc…) Non Invasive methods (needles, cuff in tissues, etc…) Surface methods (EMG, EEG, etc…)

Technological changes: Brain Computer Interface (BCI) Brain Computer Interface (BCI)

Acting (3) – Internet-connected sensor and actuators

The integration of sensors and the Internet presents some issues that can fully exploit the capabilities of WSNs.

Pervasive distribution of intelligence and sensing throughout the home environment

Technological changes: Internet of Things Internet of Things

Acting (4) – Robotic appliances

Personal robots are being investigated also as robotic appliances.

Acting (5) – Companion robot

Adaptive Robotic Servant in Intelligent Homes. Objectives in this application area are identified as: time saving in daily repetitive work; having a companion and a servant/assistant; personal robots adaptation to individual needs;pe so a obots adaptat o to d v dua eeds; exercising robots; medical support;

hi hi h t b i i d reaching high acceptance by inexperienced users; 24-hour service in household environments; robots in environments dangerous to humans; mobility; incremental development of robots.

Interacting

Human beings and machines will be surrounded by intelligent interfaces supported by computing and networking technology in everyday objects.

Timeline Topic

2010-2015 Common generic interface standards. Toolkits. Living labs.

User initiative, adaptable interfaces

Local (touch) screen-based

Context-awareness of predefined factors

Standalone products (including mobile phones)

2015-2020 Mixed initiative, self-adaptive interfaces, p

Rich interaction through distributed objects. Gestures.

Learning

Products networked inside homeProducts networked inside home

2020-2025 Avatar robots, brain-computer interfaces

Social + emotional awareness

Communicating (1)

In AAL System infrastructures are becoming pervasive, with an increasing numberof distributed devices that can communicate between themselves as well as with

li d icentralized services.

Network Context

Public areaD ti

Local or home

P l b d

Domotics

Personal or body

Connectivity and protocols Data Exchange Understanding data Dynamic composition of systems and services

Communicating (2)

Internet of ThingsService Era

Internet of PeopleCommunication Era

Internet of PresenceVirtual Presence Era

20302010 - 2030 1900 - 2010 2030

Outline

Background

AALIANCE project

Roadmap and trends Main domains

E bli T h l i Enabling Technologies

Concl sions Conclusions

Conclusions

Necessity to:C i d i b h i i d Cooperation and synergies between research organizations, end-userorganizations and industries for an excellent development of products andservices.

Provide a framework for stakeholders, led by industry, in order to defineresearch and development priorities

Improve the collaboration within the AAL value chain in Europe Reinforce the position of European providers of AAL solutions in a global

context

Work ith primary users: patients and caregi ers to foc s on real needs Work with primary users: patients and caregivers to focus on real needs.

Funds and investment for innovation.

Next step: a Strategic Research Agenda for AAL in Europe

Future Scenarios and Products identification

Roadmapping enabling technologies, products and scenarios, identifying challenges

PrioritizingEU policies and

SRA

A comprehensive action plan addressing challenges in the Prioritizing

challengesEU policies and strategic objectives

g gframework of the existing EU instruments for Research and Innovation support (FP7, AAL JP, ICT PSP)ICT-PSP)

End

Questions?

Filippo CavalloElectronic Engineer PhDElectronic Engineer – PhDPost Doctoral Researcher

ARTS LabScuola Superiore Sant'Anna Polo Sant'Anna ValderaScuola Superiore Sant Anna - Polo Sant Anna ValderaViale Rinaldo Piaggio, 3456025 Pontedera, Pisa - ITALYhttp://www-arts.sssup.it

Phone: +39 050 883474Fax: +39 050 883101E-mail: f.cavallo@sssup.it****************************************************************************************************************************************************