Introduzione allo sviluppo su Hololens - wpc2016.it · Hololens Device –3D Spatial Sound Built-in...

48
PRESENTA Introduzione allo sviluppo su Hololens Marco Dal Pino

Transcript of Introduzione allo sviluppo su Hololens - wpc2016.it · Hololens Device –3D Spatial Sound Built-in...

P R E S E N TA

Introduzione allo sviluppo su Hololens

Marco Dal Pino

• AR/MR/VR what’s the differences?

• Hololens: cos’è

• Dev Platform

• Windows Holographic

www.wpc2016.it – [email protected] - +39 02 365738.11 2

Agenda

AR/MR/VR What’s the differences?

www.wpc2016.it – [email protected] - +39 02 365738.11 3

CPU evolution

2015

2010

2005

1995 5M transistors/chip

160M transistors/chip

1B transistors/chip

71B transistors/chip

(2B chip mobile)

UI Dimensions

Transactional

App = Code +

Markup

Immersive

App GPU

intensive

2D UI

Personal Assistant:Siri, Google Now,

Echo, Cortana

Machine Learning

Machine2Machine

1D UI

Virtual,

Augmented and

Mixing Reality

3D UI

• The area between the two extremes, where both the real and the virtual are mixed, is called mixed reality.

• This in turn is said to consist of both augmented reality, where the virtual augments the real, and augmented virtuality, where the real augments the virtual.

Reality – virtuality continuum

Quiz

AR

AV

VR

Quiz

AR

AV

VR

Quiz

AR

AV

VR

Quiz

AR

AV

VR

Quiz

AR

AV

VR

Quiz

AR

AV

VR

Quiz

AR

AV

VR

Quiz

AR

AV

VR

Recap

Hololens: Cos’è

www.wpc2016.it – [email protected] - +39 02 365738.11 18

Different Devices

“Any sufficiently advanced technology is indistinguishable from magic”

(Arthur C. Clarke)

Magic is in the air

To be a new magician

You have to be a

magician…

… or at least a

good illusionist

Hololens Prototype

Hololens Device - Confort

Hololens Device - Confort

Hololens Device – Sensor Bar

Hololens Device – Sensor Bar

Ambient

Light

Sensor

2MP Photo (2048x1152)/ HD Video Camera (1408x792)

Depth Camera

IR Camera based on Time-Of-Fly

Hands Tracking + Surface reconstruction + Object Position

4 Environment Understanding Camera

Gray Scale Cameras

Create Map of the Room

Hololens Device – Optics

Hololens Device – Optics

IMU

Gyroscope + Magnetometer +

Accelerometer

Fast Position Updates (<10ms )

2 HD 16:9 light engines

Project images on lenses

Holographic Resolution: 2.3M total light points

Holographic Density >2.5k radiants

(light points per radian)

Automatic pupillary distance calibration

See-through holographic lenses (waveguides)

R - G – B Layers

Hololens Device – Internal Hardware

• Memory: 64GB Flash / 2GB RAM

• Processor: Intel Atom x5-Z8100 1.04 GHz 64-bitIntel Airmont (14nm) 4 Logical

• GPU: Intel 8086h, Dedicated Video Memory 114 MB, Shared System Memory 980 MB

• Custom-built Microsoft Holographic Processing Unit (HPU 1.0)

Hololens Device – Internal Hardware

Battery: 16,500 mWh

Weight : 579g

Hololens Device – 3D Spatial Sound

Hololens Device – 3D Spatial Sound

Built-in speakers.

A precise audio experience without

headphones that is immersive, yet won’t

block out the real world.

Spatial sound.

Using a scientific model that characterizes

how the human ear receives sound from a

specific location, Microsoft HoloLens

synthesizes sound so that you can hear

holograms from anywhere in the room.

Dev Platform

www.wpc2016.it – [email protected] - +39 02 365738.11 35

Checklist

5.4.0f3-HTP

Build 10.0.14393.0

• Visual Studio 2015 Update 3 (e seguenti)

• Hololens Emulator

• Unity Hololens Technical Preview

• Vuforia

Dev platform

https://developer.microsoft.com/en-us/windows/holographic/install_the_tools

• 64-bit Windows 10 Pro, Enterprise, or Education

• 64-bit CPU

• CPU with 4 cores (or multiple CPU's with a total of 4 cores)

• 8 GB of RAM or more

• In the BIOS, the following features must be supported and enabled: Hardware-assisted virtualization

Second Level Address Translation (SLAT)

Hardware-based Data Execution Prevention (DEP)

• GPU DirectX 11.0 or later

• WDDM 1.2 driver or later

System Requirements

Holographic Academy

• Input

• Sharing

• Spatial Mapping

• Spatial Sound

• Utilities

• Build

HoloLens Toolkit-Unity

Windows Holographic

www.wpc2016.it – [email protected] - +39 02 365738.11 41

• Wireless VR/MR device

• 2 RealSense for spatial and hands traking

Project Alloy

www.wpc2016.it – [email protected] - +39 02 365738.11 45

Resource

• Tools:

• https://developer.microsoft.com/en-us/windows/holographic/install_the_tools

• HoloToolkit: https://github.com/Microsoft/HoloToolkit-Unity

https://github.com/Microsoft/HoloToolkit-Unity/blob/master/GettingStarted.md

• Holographic Academy https://developer.microsoft.com/en-us/windows/holographic/academy

Q&A

Domande e Risposte

www.wpc2016.it – [email protected] - +39 02 365738.11 46

P R E S E N TA

Thanks!

Marco Dal Pino

Freelance Consultant

Microsoft MVP - Intel Blackbelt & Innovator

@MarcoDalPino

Contatti OverNetEducation

OverNet [email protected]

www.overneteducation.it

Tel. 02 365738

@overnete

www.facebook.com/OverNetEducation

www.linkedin.com/company/overnet-solutionswww.wpc2016.it

www.wpc2016.it – [email protected] - +39 02 365738.11 48