Affective Categorization Using Contact-less Based...
Transcript of Affective Categorization Using Contact-less Based...
![Page 1: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/1.jpg)
Affective Categorization Using Contact-less Based Accelerometers
March 26—29, 2018 | Silicon Valley | #GTC18www.gputechconf.com
Speaker:Refael ShamirFounder and CEO of Letos
![Page 2: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/2.jpg)
Motivation– Driver monitoring in the new age
Background and Definitions– First steps to understanding Affect Categorization
Technology Review– Facial Expressions
– Eye Tracking
– Voice Recognition
– Wearable Monitoring– EEG, ECG, GSR, PPG…
– Sentiment Analysis
Current State of the Art – Gap and Challenges
Introducing Letos – How, When and Where
Presentation Outline
![Page 3: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/3.jpg)
Misconception?
![Page 4: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/4.jpg)
Motivation– Driver monitoring in the new age
Background and Definitions– First steps to understanding Affect Categorization
Technology Review– Facial Expressions
– Eye Tracking
– Voice Recognition
– Wearable Monitoring– EEG, ECG, GSR, PPG…
– Sentiment Analysis
Current State of the Art – Gap and Challenges
Introducing Letos – How, When and Where
Presentation Outline
![Page 5: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/5.jpg)
Motivation
![Page 6: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/6.jpg)
Motivation
‒ There is a growing debate on the tracking of in-cabin
monitoring (e.g. tracking alertness)
‒ Using gaze estimation is only part of the solution
‒ Keeping eyes on the road, does not proclaim
alertness level with a good confidence
‒ Need to track engagement level of the driver at all times
![Page 7: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/7.jpg)
Motivation– Driver monitoring in the new age
Background and Definitions– First steps to understanding Affect Categorization
Technology Review– Facial Expressions
– Eye Tracking
– Voice Recognition
– Wearable Monitoring– EEG, ECG, GSR, PPG…
– Sentiment Analysis
Current State of the Art – Gap and Challenges
Introducing Letos – How, When and Where
Presentation Outline
![Page 8: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/8.jpg)
Background and Definitions
![Page 9: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/9.jpg)
Background and Definitions – Cnt’d
Affective Computing: Picard first introduced the
term “affective computing” in 1995, as a mean to
evaluate different emotions, or expressions, from a
computer perspective
Affective Computing
(MIT Press); Rosalind
W. Picard, 1997
![Page 10: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/10.jpg)
Arousal (Y-axis) – Indicates excitement/engagement level
Valence (X-axis) – Indicates pleasure/comfort level
The Dimensional Affective State Model
PositiveNegative
Low
High
I
IIIII
IVANGER
SADNESS
FEAR
JOY
SURPRISE
DISGUST
RELIEF
I
II
IIIIV
IV???
![Page 11: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/11.jpg)
Motivation– Driver monitoring in the new age
Background and Definitions– First steps to understanding Affect Categorization
Technology Review– Facial Expressions
– Eye Tracking
– Voice Recognition
– Wearable Monitoring– EEG, ECG, GSR, PPG…
– Sentiment Analysis
Current State of the Art – Gap and Challenges
Introducing Letos – How, When and Where
Presentation Outline
![Page 12: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/12.jpg)
Tools for Evaluating Affective States
![Page 13: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/13.jpg)
Suggested Prototype for Auto-Classification
Pre-Processing
& Object Detection
Feature Extraction
Input Source
Post-Processing
Training Model
Feature Selection
ClassifierOutput
![Page 14: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/14.jpg)
![Page 15: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/15.jpg)
Ekman’s Model
Paul Ekman argues that there are 6 basic facial expressions
which are uniquely distinguished from one another, that have
a relationship with an emotional state (Ekman, 1972)
These set of emotions, according to Ekman, are being
expressed across humans, regardless of age, gender, race, or
culture
![Page 16: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/16.jpg)
Facial Expressions
36 21
![Page 17: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/17.jpg)
Feature Extraction for Affect Classification
Geometric Features
– Detecting the face (shape/size)
– Detect cue points (lips, eyebrow)
→ Categorize emotions based on
relative position to the face
Appearance Based
– Detecting the face (shape/size)
– Texture layering (filters)
→ Categorize emotions based on
extracted feature type
![Page 18: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/18.jpg)
Technology Analysis
Capturing the duration of the emotion 0.5 – 4 seconds
Positive and negative differentiation
Spontaneous reaction (faking?)
Evaluating intensity level (arousal)
ValencePositiveNegative
Confi
dence
Can still be solved using a camera!
![Page 19: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/19.jpg)
Human Eye
Pupil
Iris
Eyelashes
Eyebrows
Sclera
Eyelids
![Page 20: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/20.jpg)
How Sherlock Does It
https://www.youtube.com/v/-bBHT158E0s?start=107&end=128
![Page 21: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/21.jpg)
Pupillary Response - Explained
2mm
8mm
During rest, the eye’s pupil usually constricts,
due to parasympathetic activity
When presenting a stimuli, the eye’s pupil
tends to dilate, due to sympathetic activity
(Bradley, Miccoli, Escrig, & Lang, 2008)
![Page 22: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/22.jpg)
References and Further Reading
1.Li and Jain. Handbook of Face Recognition, 2nd Edition. New
York: Springer, 2011. Print
2.R. Cowie, E. Douglas Cowie, N. Tsapatsoulis, S. Kollias, W.
Fellenz, and J. G. Taylor. “Emotion Recognition in Human
Computer Interaction”. IEEE Signal Processing Magazine, 18
(2001): 32-80. Print
3.Open source tool: “Free and open source face recognition with deepneural networks”. OpenFace. GitHub (accessed February, 2018)
![Page 23: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/23.jpg)
![Page 24: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/24.jpg)
Human Speech – Overview
‒ Speech is basically a stream of words spoken in a
particular way
‒ In order to differentiate between different syllables
the vocal cords vibrates, and sound is sequentially
being filtered through the mouth and nose
‒ In general, speech is carried over an
anchor frequency (which varies within
different scenarios). This is often
abbreviated as ‘F0’
https://www.youtube.com/watch?v=yxxRAHVtafI
![Page 25: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/25.jpg)
Speech Recognition - Background
Human speech can be modeled through differentiating what
is being transmitted during the message, and what is its
intended affect
Primary Secondary
“This upsets me”
“That’s so funny”
“I’m so happy”
![Page 26: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/26.jpg)
Feature Extraction for Affect Classification
Pitch:
Usually, compared to the
base frequency F0Voice/Volume Level:
Higher levels might
indicate anger or fear
Speaking rate:
Can indicate speaker’s
confidence levelGenerally, voice indicates merely arousal level
![Page 27: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/27.jpg)
Speech to Text
Source: https://hacks.mozilla.org/2017/11/a-journey-to-10-word-error-rate/
![Page 28: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/28.jpg)
meaningopportunity
marketmarket market
communication
Business business
smilingdedication
financialsuccessful
ambitious
development
emp
loym
ent
corp
ora
tio
n
chal
len
ge
wo
rkin
g
nav
igat
ion
motivationcon
fere
nce
ind
ivid
ual
con
nec
tio
nen
terp
rise
cust
om
ers
prosperitycomplexitycompetitorcollective
unemployment
information
technology
partners
concentrationagreement
skyscraperdecisionsideas
determinationconcentrationat
trac
tive ch
alle
nge
dif
fere
nt
attr
acti
ve
attr
acti
veco
nfi
den
t
wo
men
con
tem
po
rary
determination
team
copy
corp
ora
tio
n
individualassociateassistance
computation
dep
ress
ion
complexitycomplexity inspire
professionalinteraction
adversity
beginning
Business women
Business man
complexity
smil
ing
sele
ctiv
ecu
sto
mer
s
road
En
trep
ren
eur
org
aniz
atio
n
par
tner
ship
per
spec
tive
effe
ctiv
e
per
sist
ence
inve
stm
ent
![Page 29: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/29.jpg)
Sentiment Orientation
Sentiment (or text) analysis can basically infer positive and
negative – i.e. valence – opinions which people express eitherthrough voice or in writing
![Page 30: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/30.jpg)
Not So Fast...
‒ Not all expressions have a single meaning• e.g. ”That’s so funny” – positive sentence; different meaning with
use of tone (sarcasm)
Intensity: Rating:
WEAK MEDIUM HIGH
Good Wonderful Amazing
Bad Poor Terrible
![Page 31: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/31.jpg)
Linguistics as a mean for Classifying Emotions
Guidelines:
“This upsets me”
“That’s so funny”
“I’m happy that you’re here”
Intensifier
Usage of bad language[Cursing, Insulting, Blaming, etc.]
![Page 32: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/32.jpg)
References and Further Reading
1. Johar, Swati. Emotion, Affect and Personality in Speech. Springer, 2016. Print
2. R. Cowie, E. Douglas Cowie, N. Tsapatsoulis, S. Kollias, W. Fellenz, and J. G. Taylor. “Emotion Recognition in Human Computer Interaction”. IEEE Signal Processing Magazine, 18 (2001): 32-80. Print
3. Open source tool:https://sourceforge.net/projects/openart/. Open source project named openEAR(originated at TUM)
4. Knowledge center: http://sentic.net (Accessed on March, 2018)
![Page 33: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/33.jpg)
![Page 34: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/34.jpg)
Different Types of Monitoring
![Page 35: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/35.jpg)
Autonomous Nervous System (ANS)
Source: Hemmings, H., Pharmacology and Physiology for Anesthesia: Foundations and Clinical Application. Saunders, 2013
Sympathetic“fight-or-flight”
Parasympathetic“rest and digest”
![Page 36: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/36.jpg)
ANS – Continued
Sympathetic Nervous System activity:
Parasympathetic Nervous System activity:
![Page 37: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/37.jpg)
Human Heart
![Page 38: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/38.jpg)
Heart Rate Measurement
A person heart rate can be extracted through either an ECG,or a PPG (usually smart watches nowadays)
![Page 39: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/39.jpg)
Heart Rate Variability
‒ Heart rate variability (HRV) is the variation of consecutive beat-
to-beat (b2b) intervals
‒ It indicates the heart's ability to respond to stimuli such as
breathing, exercise, stress, diseases or sleep
‒ Decreased with SNS; Increased with Parasympathetic
![Page 40: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/40.jpg)
Presentation Outline Technology Overview
– Companies; Market; Use Cases
Background and Definitions– First steps to understanding Affect Categorization
Technology Review– Facial Expressions
– Voice Recognition
– Wearable Monitoring Devices– EEG, ECG, GSR, PPG…
– Sentiment Analysis
Current State of the Art – Gap and Challenges
Introducing Letos – How, When and Where
![Page 41: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/41.jpg)
Current State of the Art
NEGATIVE NEUTRAL POSITIVE
Currently, most commercial products gives merely a differentiation between Positive and Negative emotions
SADNESSANGER
MISERYCALM
JOY
HAPPINESS
ENTHUSIASM
STRESS!
![Page 42: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/42.jpg)
Challenges
Self Assessment: Multi-Modal Approach:
Spontaneous;
Unobtrusive
Awareness
![Page 43: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/43.jpg)
Presentation Outline Technology Overview
– Companies; Market; Use Cases
Background and Definitions– First steps to understanding Affect Categorization
Technology Review– Facial Expressions
– Voice Recognition
– Wearable Monitoring Devices– EEG, ECG, GSR, PPG…
– Sentiment Analysis
Current State of the Art – Gap and Challenges
Introducing Letos – How, When and Where
![Page 44: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/44.jpg)
![Page 45: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/45.jpg)
Recognizing anonymously user emotional
reaction within different scenarios
![Page 46: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/46.jpg)
Solution
Advanced Machine Learning techniques for performing affective classification based on physiological signals
5 Emotional States
ML/DL for Classifying
Emotional States
Complete Anonymity
![Page 47: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/47.jpg)
Product
![Page 48: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/48.jpg)
Product – Features
Heart Rate; Heart Rate
Variability
Respiration Rate
Contact-less single
sensor solutionMEMS
1 Sample/Second
Wireless
Communication
![Page 49: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/49.jpg)
Demonstration
![Page 50: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/50.jpg)
Demonstration
Respiration Rate
Heart Rate
![Page 51: Affective Categorization Using Contact-less Based ...on-demand.gputechconf.com/gtc/2018/presentation/s8352-affective... · Affective Categorization Using Contact-less Based Accelerometers](https://reader031.fdocuments.in/reader031/viewer/2022041017/5eca92ba5e535d103864364a/html5/thumbnails/51.jpg)
Ballistocardiography
Ballistocardiography is a non-invasive method based on the
measurement of the body motion generated by the ejection of
the blood at each cardiac cycle. It is one of the many methods
relying on detection of cardiac and cardiovascular-related
mechanical motions, such as phonocardiography,
apexcardiography, seismocardiography, kinetocardiography to
list just a few.
http://people.csail.mit.edu/balakg/pulsefromheadmotion.html