Pipeline Considerations for Character and Story-driven Augmented Reality
-
Upload
augmentedworldexpo -
Category
Technology
-
view
98 -
download
0
Transcript of Pipeline Considerations for Character and Story-driven Augmented Reality
PowerPoint Presentation
Pipeline Considerations for Character and Story-Driven Augmented Reality
Panelists
AR DeveloperAugmented TravelerUnity AR/VR DeveloperAugmented TravelerCo Founder, CTOAugmented Traveler
Introduction
Our work at Augmented Traveler addresses the increasing popularity of AR apps that include rich character-driven stories
A complex pipeline is necessary to manage the production of these apps This panel will discuss the experience of creating a pipeline for PastPort, a time-traveling interactive history AR application
Pipeline Overview
Creative
Maya
Unity
Vuforia
DeploymentIdea
Script development
Location scouting
Storyboards/Concept art
Cast voice actors
Audio (ambient, FX, & music)
UX design/Experience flow
Scene building
Character behaviors & pathing
Prop behaviors & pathing
UI/UX for scene navigationDesign/Build models(characters & props)
Create textures
Rig models
Animate models
Export to Unity
Determine AR targets
Overlays of virtual objects
Create AR behaviors
Tie in to social media backend
Customize for select partners (branding)
Determine distribution with partners
Launch subscription services
Launch customized PastPort services
AR Design Targets, markers, SLAMAR integration
Story concept Its 1499 in Venice Script Audio recordingsScratch & final Narration & dialogueAmbient & effects MusicConceptual Assets
CreativeCharacter designs & costumes 3D models Rigged Models Concept to Final Model Animation
Action designStoryboards Model Choreography Characters/Props Path planning
UIX Design Buttons, widgets, look & flow UI integrationScene design Stand-in scene model
MayaUnityVuforia
Production
Export s master character for a Unity avatarRigging allows the animator to focus on the performanceExport each animation sequence to remix the performance in Unity5
Maya
ModelTexture
Facial BlendShapes
for characters: Mixamo Auto Rigfor props: rig by handCharacter Avatar Exportchar.fbxUnity
Actor Dialogue .wavShot List / Storyboard
Animation SequenceBaked [email protected]
bone rotations/blendShapesstrip controlsRigLeonardoSalaiLeonardos Giant Crossbow
Rigging
Animation
* Export a master character for a Unityavatar we have to plan early for all possible animations* Rigging allowsthe animator (Charles)to focus on theperformance* Exporteach animationsequenceto remix theperformancein Unity its easy to do updates, proxies* Mixamo is a wonderful tool to standardize rigs, animations, and to share motion* The Mixamo AutoControlRig script would not complete, so facial animation had to be a separate process
6
Unity
Mecanimavatarsanimation controlleranimation sequencesanimation events
ScriptsdialogueSync.csscreenplayController.csnavigateTargets.cseventInteraction.cs
.fbxMayameshesjointstexturesblendShapesanimations
Other toolsGoogle DriveTrelloCollaboratePlaymakerSkypeOpen BroadcasterWorld Clock
Scenesenvironmentcharacterspropscameramaterialsphysicsnavmeshaudio sourcesUIVuforia
Screenplay
Unity
Unity balances three interactions: the physical design (Scene), animation and event control (Mecanim), and programming logic (Scripts).fbx is a sure way to publish assets that you mean to publish one envelope to contain many useful thingsUnity has the Asset Store & significant training resources to solve technical problemsEven when using a technical setup, we reference the screenplay and the actors performance, historical researchWe have a team scattered around the world (Los Angeles, China, Italy, Dallas) and cloud tools make it possible7
3D Virtual Objects [Maya / Unity] Leonardo Salai Crossbow
Vuforia Unity plugin package [Download]Import package to UnityAR Components Intermediate Steps
VuforiaAR Camera [in Vuforia Assets]
Target (marker) assets 2D texture: Piazza [Creative] 3D model target (Maya/Unity)
DeploymentAdd developer license [from Vuforia License Manager]Add AR Camera to Unity scene Configure webcam for editor debuggingVuforia Target Manager Upload images Download as Vuforia ImageTarget dbAdd to Unity Position Piazza ImageTarget in scene Connect db to Vuforia ARCameraAdd GameObjects to scene In hierarchy, set as children of Piazza ImageTarget
8
Deployment!
User testing & refinement
Customize for select partners (branding)
Determine distribution with partners
Launch subscription services
Launch customized PastPort services
Thank youaugmentedtraveler.com
Thank You for Attending!