Erica Warp (EMOTIV) State of Mind - BCIs and How They Will Enhance the Human Experience

12
ERICA WARP. EMOTIV. @emotiv

Transcript of Erica Warp (EMOTIV) State of Mind - BCIs and How They Will Enhance the Human Experience

Erica Warp. EMOTIV.

Erica Warp. EMOTIV.@emotiv

Principal NeuroscientistThank you brains

OUR REMARKABLE BRAIN(video: Glass Brain Project)

How we experienceControl centerPowerful

- - - - - Visualization of real activity from human brainElectrical pulses + chemical forms of communication = medium by which we experience our whole worldSensesMemories vividEmotions rich

Brain is also control center for our actionshooked up to muscles, by sending commands to these muscles allows us to Move through worldManipulate objects - dexterityAnd communicate with others - language

human brain has evolved to do all thisMost complex object and incredibly adaptable, powerful

- - - - - - -The human brain also seems special in the amount of energy that it uses. Although it weighs only two percent of the body, it alone consumes 25 percent of all the energy that your body requires to run per day. That's 500 calories out of a total of 2,000 calories, just to keep your brain working. And again, far higher ratio than any other mammal.Its also much bigger than it should be according to typical mammalian body size, to brain weight ratios. So, its much larger than it should be and uses far more energy than it should.Pretty special. Yet we still dont know why (?). Were amazed by what it can achieve and wonder at its full potential.

Glass Brain Project add ref

WHAT IF3lbs of pure potential

What IfWhat need

- - - - - - What if we extend the power of human brain even further beyond the limits of its biology using tech?Like using our brains to directly control things other than just our muscles?What if the world we experienced reflected our current mood or was even designed to change our mood?What if we could optimize our indiv brains to be more productive, healthier and less stressed?

To do these things, need tech that record brain activity in daily lifeNeed to be able to decode what this activity meansNeed devices that are comfortable and affordable

- - - - - - -

Experience the world through our brain

BehaviorResponse to inputsExternal (sensory) or internal (memory, thoughts)Conscious or unconscious

Reality we experience in brain is virtual tooDerived from electrical pulses in brainNot the actual stuff Brain builds mental model of world it is a modelOur reality = brains interpretation of world based on electrical pulses gets from our senses

As grow up beh rep get more complex and diverseTech enables us to grow that rep even moreInside out?Can say something about evolution (time) here too?

Do not need to rely on what evolution has given us biologigallyLimit becomes more about our imagination, esp with possibilities enabled by VR/AR

- - - - - - -Why is the human brain so special?What does the human brain have that no other brain does?It was previously thought based on very little evidence that all (mammalian) brains were made the same with a number of neurons that was always proportional to the size of the brain

3lbs of pure potential

Neuro tech in labs and hospitalslimitations out of contexte.g. EEGdefinelimitations> Companies

- - - - - - Tech for measuring brain activity like MRI and EEG has been around for a whileDesigned originally for use in hospital or lab, great for those purposesBut have limitations especially when taken out of these contexts

For example, EEG electroencephalographyMeasures voltage fluctuations of the brain noninvasively through the scalp

Medical and research grade devices, like one shown here get great signals from lots of channels BUTCan take hours to set up, uncomfortableCost 10s thousands of dollarsAnd person wearing them is stuck in one place since they are wired up to computer

need to take this tech out of the lab has borne several companies developing mobile and wearable solutions.

Emotiv ;-)$, mobility, easy > broadenNew researchers> democratize neuro, learn newPerformance metrics> New applications

- - - - - - - -Most notably EMOTIV of course ;)

Price points in the 100s, mobility and ease of use > tech broadened the usage of EEG

Researchers with smaller budgets or in remote and developing areas or that want to track brain activity of people outside of a lab setting can use these devices> democratizing neuroscience research, learn new things about brain

Completely new applications for EEG are also being exploredSeveral based around emotional and performance metrics that come in our softwareSuch as algorithms that automatically detect stress, focus and engagement levels in real time

Building programs for improved learningValidating meditation and mindfulness practicesTraining for improved cognitive performance

>community of 1000s devsJosh Carr- - - - - - - -Easy access to high quality brain data has spawned a powerful community of 1000s of developers doing some pretty cool things with the tech

This video by IBM shows Josh Carr of their Bluemix group demonstrating a fun application of Emotivs mental commands function

[Play video] 2:30 if cut

Yes, you can control robots with your mind

A complex machine

Complex machine at center of existenceHigh impactTalk about other apps

- - - - - - - -By being able to tap into this complex machine that really is at the center of our existenceThere is an incredible amount that can be done with high impact on our lives

Like to take most of rest of time talk about some of things can do with techSpecific examples of applications that have already been developed or on the near horizon

- - - - - - - An incredibly complex machine that on first glance appears to have been constructed by unskilled labor. And one that sits at the very center of our existence.The applications would seem limitless and you can start to imagine how this may be applied to both augmented and virtual reality. But lets quickly examine the the three main areas of focus for EEG:

Use case #1: Brain Data

New researchNormal brainBig experimentsMassive bank of data>learn, improveYOUAbnormal

- - - - - - - -First thing, can use tech for new kinds of neuroscience research

Usually get scan due to accident, disease, or if college student taking part in scientific experiment in labMore accessible devices > record normal brains and in new environments

With 10s 1000s of usersResearchers have potential to to run exp on large numbers of subjects at a time quite easilyEven you can explore own brain activity

Massive bank of brain data, broadening demographicDuring different activities e.g. at work, exercising, meditating, listening to music, talking to friendsuncover new thingsmore understand > optimize performance, increase creativity, improve health and wellbeing

Can learn more about YOUR specific brainLearn what activities reduce our stress, what time of day most focused, what food makes us least fatigued

Knowing normal can help identify abnormalRecognize early markers of cognitive decline, Alzheimers +, intervene earlier and more effectively

- - - - - - - It might not be too bold to state that what we are able to measure is the truth In real time we are tracking activity associated with normal or abnormal activityAdd realtime feedback to behavioral and predictive analytics and the data we received from he use and experience of AR/VR can go towards constantly developing better and more targeted experiences.What we can learn can improve work conditions, game play even entertainment sequences. It can be used for many applications outside of AR/VR and can go towards extending our understanding of the human brain via a massive bank of high quality data.

Always courting its potential to achieve is always the potential to fail.Our research, has largely been driven by our desire to understand more about its failures. Searching for markers and hopefully cures for diseases such as Alzheimers and Parkinsons, schizophrenia. Looking for cognitive, behavioral, environmental and dietary influences.

Identifying early markers for abnormal brain activity that might lead to temporary or permanent dysfunction

Use case #2: Passive Input & Control

Use in real timeMusic, photosVR/ARemotions, difficultyFeedback > adaptable, optimizeSafety, BMW, TSA, med

- - - - - - -Because that data is being recorded in real time it can also be used in real time.Change things in environ that experiencingGuide our behavior

Music services Spotify, iTunes, feed in brain data in real time and play music that matches your mood or designed to change your mood; feed up new artists predict your brain will like that never hear of beforeWearable cameras, tag photos with salience

Inside VR/AR - Imagine being able to influence the content you are experiencingYour emotions reflected in the weather of the environment, communicated to others in new waysOr game difficulty adapts to how focused you are

Real time feedback and predictive analytics, constantly improving the experienceBased on what responding to positively or negatively and responding accordinglyfor you whatever you are trying to achieveDeep engagement, deep relaxation, high focus

or perhaps when getting in car, change controls or suggest not drive at all (BMW)Safety monitor fatigue in medical or industrial applications, speed up or slow down production line; TSA rotate on mental state vs time

- - - - - - - - -Being able to identify elements of content we respond positively and negatively to and altering, in real-time, what we are experiencing.From EEG enabled audio equipment that can feed us music to improve our moods and identify artists and songs we may not have previously considered. Vastly augmenting the music experience of streaming services.EEG enabled HMDs that dynamically personalize experiences based on content type, color, audio, pace.Replacing levels in games with an infinite variability based on the gamers emotional responses - focus, stress, engagement.Cognitive marketing, machine learning predictive

passive, e.g. control music playlist or video content, could improve mood and focus and general well being, good for Spotify, iTunes; IoT e.g. hints BMW building helmet measuring mental state and then adjusts motorcycle controls (e.g. distracted, fatigued, make it easier and safer to ride); Accenture IoT, homes, control lighting + VR examples, gaming difficulty as sliding scale, based on cognitive load or focus, engagement, stress, calmer vs more exciting; therapeutic or training modules e.g. training for police or military or industry Explorations into driver behavior and safety - slowing the vehicle during moments of inattention Where fatigue and stress become barriers to performance such as medical and industrial applications, EEG could provide a critical safety net

Use case #3: Active Input & Control

Control machines, bypassMental commandsAppsVR/AR/gaming, controllermusic, artmilitaryAccenture, PhillipswheelchairThink to Speak

- - - - - -As with the example of IBMs control of the BB8 and bringing the force to life, EEG can be used to actively control machines Enabling a New user interface that doesnt require our hands or voiceno muscle, direct

Mental commands function in our softwareTo do this we take a picture of brain for 10 sec when thinking a certain commandThen do pattern recognition When see something similar to that pattern, above a certain threshold, recognize command, use to trigger anything

Various applicationsIoT control lights, TV in home (Accenture/Phillips)The creation of music or art using nothing but brain activitySend messages to others, military, hands doing something elseVR AR other gaming, can replace parts of standard controller, freeing up hands to do something elseRecently first brain-drone race,

Limited motor control:Motion control for Wheelchair, already helping peopleThink to Speak project

- - - - - - - -The same applied to physical objects where VR is the eyes, EEG can provide some aspects of motion control in drones and other devices and vehicles.active Leaves hands free to perform other tasksCan control physical objectsSurgical, industrialCould show video game controller need to be dexterous person to control; could use mental commands, and allows people with limited motor control to play

Augmenting the human experience to create a new mindkind

Kids storiesLimitlessCommunity, futureAnyone = neuroscientistExperience = optimized, personalized for goalsControl machines, improve lives

- - - - - Dragon storySend messages in class to friendsThough not limitless, sure does feel that way sometimes

Excited to see how our community applies these devices to build a future whereAnyone can be a neuroscientistWhere our experience in truly personalized and optimized for our personal goals and our healthAnd where we can harness the power of our brain to control machines in ways that really improve our lives

- - - - - - - -Finally, where we can understand ourselves and each other more fully

As tech enables us to tap into brain with devices that are cheaper and effective, can created augmented experiences that tap into true source of our control and bypasses traditional input devices

CONNECTNew way connect to othersMood fashion, Sensoree; expression and learningGroup meditation, experience what going on in others mindsPool mental resourcesAlso a more connected experience do not just end solipsistically

We can use big data to optimize performance, improve our healthCan make workplace and cars saferAnd can give those hindered by disease or injury the ability to move or speak > Become more aware of emotions and capabilities

The implication is that we can not only connect a HMD to our heads but also to our brains. We can create highly personalized experiences, based on our own rich brain data YoursAnd connected to your community in entirely new ways

Limit becomes more about our imagination, esp with possibilities enabled by VR/AR

I believe through the convergence of the these technologies, we can improve the human experience and create a new mindkind

Creating a new mindkindTech becomes relevant, exciting and highly personalizedIn real time registering what is going onHMDs can make world YOURS

Erica Warp. EMOTIV.@emotiv