Post on 25-Jul-2020
9/22/2018
1
Session 4301:How Augmented and Virtual Reality Affect SecurityTravis Rothbloom PE
About• Myself
• Security engineer/consultant• Mechanical engineering background
• Live in Brooklyn, NY
• My Company ‐ Arup• Global engineering firm• Security services in
• Electronic systems
• Risk assessment and Operations
• Asset hardening
9/22/2018
2
Presentation Overview
• Design• Smarter building construction with BIM• Coordinated security system plans• Virtually experience a building
• Reality Capture• Laser scanning for site surveying• Preserving the details of a crime scene• 3D Video Surveillance
• Combining Virtual with Actual• Augmenting a building model to a construction site• Viewing past reality capture• Real‐time AR for guards and first responders
Design
9/22/2018
3
The really old way of planning construction
The slightly less old way of planning construction
9/22/2018
4
The slightly less old way of planning security
Camera
Target
9/22/2018
5
The newer way of planning construction
The newer way of planning security
9/22/2018
6
5R –Monitor
10R –Detection
50R –Recognition
120R –Identification
4CIF @ 15m
5MP @ 15m
1.3MP @ 15m
9/22/2018
7
9/22/2018
8
The end result
9/22/2018
9
9/22/2018
10
9/22/2018
11
They’re not getting any simpler…
Reality Capture
9/22/2018
12
How conventional 3D Scanning works Image Credit: Copyright © 2012 ‐ 2016 Streambend, LLC.http://streambend.net/laser‐scanning/
Individual scan preview
9/22/2018
13
Individual scan rotated
Multiple scans registered together
9/22/2018
14
BIM model created from the scan
3D mesh created from the scan
9/22/2018
15
Interactive walkthrough
Viewing the walkthrough in VR
9/22/2018
16
Viewing the walkthrough + BIM model in VR
CCTV view prediction using a mesh
9/22/2018
17
Aerial photogrammetry ©iphonedroneimagery.com
9/22/2018
18
Photogrammetry from smartphone photos
Mixed Reality capture studios ©Microsoft
9/22/2018
19
Real‐time 3D sensing
How do we make use of this?
9/22/2018
20
Combining Virtual with Actual
Augmented Reality takes virtual elements and places them in the real world
9/22/2018
21
Different levels of AR
©edudemic.com
Different levels of AR
©techcrunch.com
9/22/2018
22
Early days of AR
©autodesk.com
DedicatedAR Devices
9/22/2018
23
The hardware
©microsoft.com
The hardware
9/22/2018
24
Simultaneous Localization and Mapping (SLAM)
Area Learning
9/22/2018
25
So how is can this be useful?
SLAM being used for mobile 3D scanning
9/22/2018
26
Placement of objects onto real surfaces
Draw onto real objects and save them in place
9/22/2018
27
Align a BIM model to its corresponding real area
Adding 3D information to the AR user’s vision
9/22/2018
28
Demonstration
Session 4301:How Augmented and Virtual Reality Affect SecurityTravis Rothbloom PE
Please evaluate on the app!