160420 NAB VR Summit Lelyveld Finalphiliplelyveld.com/wordpress/wp-content/uploads/... · Source:...
81
1 The Current State of Virtual Reality Phil Lelyveld Entertainment Technology Center @ USC School of Cinematic Arts 4/20/16
Transcript of 160420 NAB VR Summit Lelyveld Finalphiliplelyveld.com/wordpress/wp-content/uploads/... · Source:...
1
The Current State of Virtual Reality
Phil LelyveldEntertainment Technology Center @ USC
School of Cinematic Arts
4/20/16
Founded 1993 by George Lucas
Adamantly neutral•Discussions•Collaborations•Research•Coverage
Agenda
1. The AR – Reality – VR continuum2. Use cases, markets3. Tech; cameras, audio, stitching and distribution4. Story; (visual, audio, UI), experience, social5. Different ways to experience VR; what to build to? 6. Business model(s), ROI7. Skill sets, learning, participating8. In Conclusion
In Augmented Reality, the world that you would normally see if you walked down the aisle without the screen is being augmented – enhanced, supplemented, added to - with additional data and experiences.
In Virtual Reality you are virtually – nearly, almost – but not really there in the grocery store aisle.
RealEnvironment
AugmentedReality(AR)
VirtualReality
Spatial Real World Immersive Virtual World
5
TheAR– Reality– VRContinuum
RealityPlus
RealEnvironment
AugmentedReality(AR)
VirtualReality
Spatial Real World Immersive Virtual World
6
TheAR– Reality– VRContinuum
IntotheStormVRExperience
RealEnvironment
AugmentedReality(AR)
VirtualReality
Spatial Real World Immersive Virtual World
7
TransitionalMixedRealityBlendedReality
TheAR– Reality– VRContinuum
Agenda
1. The AR – Reality – VR continuum2. Use cases, markets3. Tech; cameras, audio, stitching and distribution4. Story; (visual, audio, UI), experience, social5. Different ways to experience VR; what to build to? 6. Business model(s), ROI7. Skill sets, learning, participating8. In Conclusion
Goldman Sachs breaks VR/AR together into
9 markets
1/13/16
2025 Marketbase case
10
AugmentedAndVirtualRealityToHit$150Billion,DisruptingMobileBy2020,Digi-captial,4/15
$30B$120B
0 10 20 30 40 50 60 70
1
2
3
4
5
6
7
8
9
10
11
12
64% Exam items when shopping online62% VR Maps
57% Movies that surround me57% Tech support with all-angle views
55% Watch sports from any angle54% Laptop games that surround me54% VR home office
52% Smartphone games with 360 view52% VR meetings with participants around me
49% Smartphone VR viewer like Google Cardboard48% Sports practice in realistic VR
33% VR dating service
VRactivitiesthatinterestsmartphoneusersworldwide
Source:EricssonConsumerLabs, “10HotConsumerTrends2016,”Dec.8,2016(n=6,649,ages15-69)
Toms Shoes on Abbott Kinney in Venice, CALA Times, 4/10/16
How retail stores are using virtual reality
13
FashionandRetail
StoryExtension
Director Robert Stromberg created a 15-25 minute 3D VR compliment to Ridley Scott’s The Martian
Six Flags and Samsung partner to add VR to roller coasters this summer
16
News
DesMoinesRegisterAddsVRtoNewsReporting
Source:DesMoinesRegisterAddsaBitofVirtualRealitytoNewsReport,WallStreetJournal, 9/22/14
VRFarmincludestext,image,videoNewsstoryrevealedbywandering
17
18
ImmersiveJournalism
TheDisplaced(NewYorkTimesandChrisMilk,VRSE)
WavesofGrace(ChrisMilk,VRSE)
Concertsandevents
19Vantage.TV VRlive-castingfromCoachella2016
Concerts
Sports
213/31/16
RocketLeague– LegendsofGaming
Endomel
TeamsReal
gameplay screens
Compositedgameplay screensSuspended
host
VRTalkShow
TheFooShowguestgamedeveloperstakeyouinsidetheirgames
24
TravelandTourism
HR&Recruiting
GeneralMillsFacilitiestourforjobrecruits
ConsumerEducation
VRQuiz:Whatinfotocaptureafteranaccident.
Agenda
1. The AR – Reality – VR continuum2. Use cases, markets3. Tech; cameras, audio, stitching and distribution4. Story; (visual, audio, UI), experience, social5. Different ways to experience VR; what to build to? 6. Business model(s), ROI7. Skill sets, learning, participating8. In Conclusion
NextVR 3603DRig6RedPro6Kcameras60fps
Jaunt32K(16Kpereye)120fps
28
VRCameras
Algorithmic 3D
Captured 3D
VRCameras(consumermkt.)
Samsung 360
Bublcam from Bubl
Kodak SP360
Ricoh Theta
GiropticNikon KeyMission 360
4fisheyelenses,4mikes,4Koutput, 30secdelay,~$3,600
Orah 4i live-streaming Prosumer VR camera from VideoStitch
31
Stitching
Stitching
FromtalkbyAnrick Bregman
Stitching
StandardVRcamerarigscanhavebuilt-institchingsoftwareFromtalkbyAnrick Bregman
Solvingproblems
Greenscreenhelmetontoheadlesstorso.
Headbouncesdifferentlyfrombody. FromtalkbyAnrick Bregman
35
Wild– TheExperience,VRshortfromFox(ReeseWitherspoon,LauraDern)
Sound
BinauralAudio
3Dio
Ambisonic Audio
TetraMic
37
Wild– TheExperience,VRshortfromFox(ReeseWitherspoon,LauraDern)
SoundAudiobreakdown• Livespatialaudiocapture• Miked audioandspatialpositioning• Audiowithnoposition(musicscore)
Deluxe Launches VR Unit to Facilitate Industrial-Scale Virtual Reality Productions
Deluxeassembledateam ofspecialistsfromboththeworldofvisualeffectsandvideogameproduction.
Variety, 4/11/16
Agenda
1. The AR – Reality – VR continuum2. Use cases, markets3. Tech; cameras, audio, stitching and distribution4. Story; (visual, audio, UI), experience, social5. Different ways to experience VR; what to build to? 6. Business model(s), ROI7. Skill sets, learning, participating8. In Conclusion
Dr.Suess – visuallybusyallaround
HaveareasontodoVR!Whycreate360o ifthereisnothingtoseein270o?
40
41
Camera-capturedVRLockedtocamerapositionTheDirector’sJourney
ComputerRenderedVRFreetowander(Storyworld)
Subtlecoercion
Decision
MixedRealitySphericalcaptureliveandinsertintoCGI
Lytro Cinemalight-fieldcameraCinemaframetoday,volumetricVRinthefuture
Everypixelhascolor,direction,x/y/zpositioninfoEveryobjectcanbeseparatedfromitssurroundings– greenscreen755RAWmegapixel40Kresolution,300FPS, 400Gbpsofdata
TheCameraisYourAudience’sHead!!!
We don’t see shaky-cam when we run
The world doesn’t tilt when we tilt our heads
We see the world differently sitting and standing
45
Presence
IntotheStormVRExperience
SamsungEntrim4DHeadphonesGalvanicVestibularStimulation(GVS)
GVS uses tiny electrical impulses to stimulate your vestibular system into thinking you’re moving when you’re not.
Entrim 4Dhasbeendeclared“safe”,- 1500humanguineapigs,- 30‘movementpatterns’ 3/24/16 Demo at SXSW
LanguageofVR
Content
UserInterface(UI)• Controls• Information
48
HeightenedSenseofEmpathy
HenryOculusStoryStudio
7/28/15
49
HeightenedSenseofEmpathy
3D facial expressions evoke stronger emotionsthan their 2D counterparts
due to the illusion of non-mediationSource: 11/24/15 research from Aalto Univ. & Univ. of Helsinki
“Hunger”(VirtualFoodBank)byNonny delaPena50
Agency
TheultimateVRexperiencewillbeastorythatknowsyouareinthestory.
MarkBolas
You are in a snow stormYou must get warm in 5 minutes or you will die
Audio is a key ‘presence’ componentPlayers ‘feel’ colder as they playYour body moves slower as time goes on
Languagestory telling + engagement design elements
From “Storm” by Andrick Bregman
VirtualRealityBlends
LiveAction
ComputerGenerated
Social
WorldBuilding
54
SocialVRmaybeVR’skillerApp…peoplewanttoshareexperienceswithothers…
BusinessInsider,7/20/15
SocialVR
Facebook'sSocialVRCouldBeTheKillerAppForVirtualReality
SocialVR
Agenda
1. The AR – Reality – VR continuum2. Use cases, markets3. Tech; cameras, audio, stitching and distribution4. Story; (visual, audio, UI), experience, social5. Different ways to experience VR; what to build to?6. Business model(s), ROI7. Skill sets, learning, participating8. In Conclusion
DifferentwaystohaveaVRexperience
MagicWindowCellphone-basedviewer(Cardboard,GearVR)
HeadMountedDisplay(HMD)GroupVR/Location-basedVR
Google Cardboard SDK supports spatial audio
What to build to?
HeadMountedDisplayTechnicalTargets
4K-8Kresolutionpereye
>90framespersecond
<20mseclatency
2200 fieldofview(FOV)
VirtualRealityHMDpriceversusmarketsize
Agenda
1. The AR – Reality – VR continuum2. Use cases, markets3. Tech; cameras, audio, stitching and distribution4. Story; (visual, audio, UI), experience, social5. Different ways to experience VR; what to build to?6. Business model(s), ROI7. Skill sets, learning, participating8. In Conclusion
Research on VR and memory retention needed!•VR appears to trigger strong memory retention•Some people recall VR experiences as real memories
FinancingVR• Budgets– advertisersdon’tseethevalueyet;noinstalledbase,nometrics/ROI
Time Warner and Nielsen Will Study How Virtual Reality Affects the Subconscious
By measuring eye-tracking, facial movement, heart rate and brain activity to better understand how consumers think and feel
at a deeper level
LA-based ImmersvLaunches
Video Advertising Platform for
Virtual Reality Apps
In-VRAdvertising
Stare at an ad to unlock bonus features
VirtualRealityFilmHousePenroseStudiosRaises$8.5Million3/10/16
UTA will work with Secret Locationu to expand its business in both non-traditional and
traditional mediau to advise on its social and digital media strategy
UTA Signs Digital Content Studio Secret Location
Source: Hollywood Reporter, 10/20/15
ww
w.th
evrfu
nd.c
om
Agenda
1. The AR – Reality – VR continuum2. Use cases, markets3. Tech; cameras, audio, stitching and distribution4. Story; (visual, audio, UI), experience, social5. Different ways to experience VR; what to build to?6. Business model(s), ROI7. Skill sets, learning, participating8. In Conclusion
Extend existing production and distribution skills and tech
Learn aboutUI designSpatial audioGame engines and game mechanics
http
://gl
obal
cine
mat
ogra
phy.
com
http://www.virtualrealityla.com
VRLA VROC VRSV VRDC VR__
Agenda
1. The AR – Reality – VR continuum2. Use cases, markets3. Tech; cameras, audio, stitching and distribution4. Story; (visual, audio, UI), experience, social5. Different ways to experience VR; what to build to?6. Business model(s), ROI7. Skill sets, learning, participating8. In Conclusion
Modern era consumer VR is <3 years old
New art form and communication tool
InVRstorytelling,theinherentlimitationsofgamingdon’tapply.WeneedtobringcinematicvisualandaudiocraftspeopleintothisfieldParaphrasedfromconversationwithJacquelineBosnjak,CEO,QDepartment
Consumersbuyexperiences,[email protected]
81
Thank youPhil Lelyveld
Entertainment Technology Center @ USCSchool of Cinematic Arts
