Intel Real Sense, Diversity Meetup by Jamie Tanna

24
Jamie Tanna and Phillip Zissimou, Application Engineers Intel Software and Services Group, Developer Relations Division *Other names and brands may be claimed as the property of others.

Transcript of Intel Real Sense, Diversity Meetup by Jamie Tanna

Jamie Tanna and Phillip Zissimou, Application EngineersIntel Software and Services Group, Developer Relations Division

*Other names and brands may be claimed as the property of others.

Interfaces for computing devices have evolved very little in 30 years

What comes next?2

Introducing Intel® RealSense™

technology A combination of hardware and

software to enable human-computer interaction on a PC.

Uses natural intuitive user interfaces beyond the mouse, keyboard and touch including: Hand and finger tracking Facial analysis Background segmentation Speech recognition Augmented reality 3D scanning and reconstruction

(coming soon**)**Roadmap Notice: All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.

3

4

Intel® RealSense™ SDK for Windows*, (Version 2014, Gold) is now available

What’s New in this SDK• Improved quality and accuracy of core capabilities: hand/finger tracking, facial analysis, speech

recognition and synthesis, background segmentation, and augmented reality

• Added localization for multiple languages

CALL TO ACTION for Developers• Be first in line to build a more immersive experience to your app and take full advantage of Intel®

RealSense™ technologies as systems with Intel® RealSense™ 3D cameras become widespread in the market.

• Reserve Your Intel® RealSense™ Developer Kit now (includes peripheral camera, SDK, and other updates)

intel.com/realsense/sdk*Other names and brands may be claimed as the property of others.

Intel® RealSense™ Technology will change the computing experience for users, creating a more natural and intuitive interface…

5

Intel® RealSense™ Developer Kit 3D cameraGet started developing quickly Peripheral depth camera specifications:

– Full VGA depth resolution

– 1080p RGB camera

– 0.2 – 1.2 meter range1**

– USB 3.0 interface

– Requires Intel® Core™ processor

Reserve Yours Now

1Specific algorithms may have different range and accuracy.**Roadmap Notice: All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.*Other names and brands may be claimed as the property of others. **Range and accuracy may vary based on application.

Intel® RealSense™ SDKfor Windows*, Version 2014 supports Windows 8.1 (64-bit)Windows 7 support coming soon

Download the SDK intel.com/realsense/sdk

What OS and hardware works with Intel® RealSense™ technologies?

6

Intel® RealSense™ SDK for Windows*Create Applications for Intel® RealSense™ 3D Cameras

Integrated inside Ultrabook, 2in1 and AIO

RGB up to 1080p@30FPS Depth up to VGA@60FPS,

HVGA

Intel® Core™ processors support

SDK for Windows now SDK add-on for Android*

coming soon (for different cameras)**

**Roadmap Notice: All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.* Other names and brands may be claimed as the property of others.

7

Current available technology focus on a living-room experience or a sub-set of Intel RealSense technology features, whereas Intel® RealSense™ technology focus on developing for close-range interactions.1

Intel® RealSense™ 3D Camera for Windows*Designed for close-range interactions

20 cm

120 cm

Intel®RealSense™ 3D camera

Intel® RealSense™ SDK for Windows* is your solution for developing close-range interactions

1Specific algorithms may have different range and accuracy.*Other names and brands may be claimed as the property of others.

8

The Intel® RealSense™ 3D CameraShipping on Multiple Form Factors

Ultrabooks™, Notebooks

2in1’s / Convertibles All-in-1’s

Integrated in Systems shipping by end of 2014 and in 2015 from Major OEMs

HandsFaceSpeechEnvironment

9

Intel® RealSense™ SDK for Windows*

Understands 4 basic types of input - Standalone or various permutations

**Roadmap Notice: All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.*Other names and brands may be claimed as the property of others.

10

Intel® RealSense™ SDK for Windows*

Categories of Input Capabilities Features

Hands • Hand and Finger Tracking

• Gesture Recognition

• 22-point Hand and Finger Tracking• Static Poses and Dynamic Gestures

Face • Face Detection and Tracking

• Multiple Face Detection and tracking• 78-point Landmark Detection (facial features)• Face Recognition and Facial Expressions• Emotion Detection• Pulse Estimator (coming soon**)

Speech • Speech Recognition and Synthesis

• Command and Control• Dictation• Text to Speech

Environment • Segmentation• 3D Scanning• Augmented Reality

• Background Segmentation• 3D Object / Face / Room Scanning (coming soon**)• 2D/3D Object Tracking• Scene Perception (coming soon**)

**Roadmap Notice: All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.*Other names and brands may be claimed as the property of others.

11

Intel® RealSense™ Technology Enabling Exciting, Diverse Categories of Applications

Capture and Share Immersive Collaboration/Creation

Interact Naturally

Gaming and PlayLearning and Edutainment

Immersive Collaboration/

Creation• Using the 3D camera, software can

“segment” an environment, allowing an application to remove the background

• With the background removed, developers can create apps ideal for a combination of video chat and collaboration

• Make apps that allow presenters to be overlaid on top of applications, allow two people to share an experience on the web, or for a single person to use this “digital green screen” to create compelling content 12

Interact Naturally

• Use our extensive library of gestures, and facial analysis and speech recognition algorithms to build interfaces that are truly natural

• Leverage our carefully developed user-experience guidelines document to ensure the interfaces you build will delight your customers

13

Gaming and Play

• Differentiate your game with gesture, speech, augmented reality enhanced with depth, facial analysis, and more.

• Use the user’s pulse to determine the stability of a scope. Allow a user to physically move their head to peak around a corner. Use gesture for a lock-picking challenge. The possibilities are tremendous.

14

Capture and Share• Collaborate with scanning/

printing experts, 3D Systems

• Rotate a small object in front of the 3D camera to create a 3D mesh + color

• Developers can import scans from a proprietary 3DS* app or eventually build scanning into their own application

• The model is scan, edit, share. Upload scans to social media, or sent to a 3D printer

15

**Roadmap Notice: All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.* Other names and brands may be claimed as the property of others.

Learning and ‘Edutainment’

• Use augmented reality, powered by Metaio to track 2D or 3D objects and incorporate them into a learning experience.

• Tracking is significantly improved by the 3D camera. Enjoy both enhanced precision and accuracy.

• Interact with stories using both facial/emotion recognition and gesture. Disguise learning as play.

16

17

Intel® RealSense™ SDK for Windows*

Required Hardware A system with a minimum of a 4th generation Intel® Core™ processor including an Intel® RealSense™ 3D camera (or a peripheral camera)

Required OS Microsoft Windows* 8.1 64-bit Desktop ModeMicrosoft Windows 8.1 New UI (Metro) Mode, Windows 7 (coming soon)**Support for Android* coming soon**

Supported Programming Languages

C++, C#, Java, JavaScript

Supported IDE Microsoft* Visual Studio 2010-2013 with service pack 1 or newer

Supported Development Tools

-Microsoft* .NET 4.0 Framework for C# development-Unity* PRO 4.1.0 or later for Unity game development-Processing* 2.1.2 or higher for Processing framework development-Java* JDK 1.7.0_11 or higher for Java development

The Intel® RealSense™ SDK for Windows does not support Intel® RealSense™ Snapshot, support for that is coming soon.****Roadmap Notice: All products, computer systems, dates and figures specified are preliminary based on current expectations, and are subject to change without notice.*Other names and brands may be claimed as the property of others.

Supported Features

18

Intel® RealSense™ SDK for Windows*

Input Device Manager Multiple applications can access data from the camera simultaneously

Multi-Mode Support Support multiple usage modes within a single app (e.g. finger tracking + speech + face tracking) or between apps

Power Management State Apps can manage battery life

Extensible Framework Developers can plug in their own algorithms. New usage modes can be added. New devices can be supported.

Privacy Notification Tool Notifies user when camera is turned on by an app

Additional Features

*Other names and brands may be claimed as the property of others.

19

Web / HTML5Run Intel® RealSense™ technology in a browser

Unity Web Player AppHTML5 / JavaScript

SDK Local Web-Socket Server

Intel® RealSense™ SDK runtime

Operating System

Web Socket Communication127.0.0.1:4181

Internet Browser

Trigger face and gesture events, just like in C# applicationsSwitch to the web player platform for deployment

Gestures and Facial Analysis Unity* Web Player games HTML5 / JavaScript (interactive web sites)

*Other names and brands may be claimed as the property of others.

20

Productivity extension for Unity* gamesAdd Intel® RealSense™ technology to your games

• A set of scripts that provides configurable actions/rules based on the capabilities provided in the SDK.

• Programming: Associate your game objects with the action scripts.

• Programming: Create rules. Associate your game objects with rules.

Drag and drop programming Write less code!

*Other names and brands may be claimed as the property of others.

21

Developer Resource Center Program

intel.com/realsense/sdk

A one-stop shop for all developer needs for Intel® RealSense™ technology

Developer Tools

Tutorials, Demos, Code Samples, Documentation

Community Forums

Hacker Labs, Virtual AE Sessions, Webinars

App Challenges

22

Get Started Now!

Reserve Your Developer Kit now (includes peripheral camera, the latest SDK, and other software updates)

Provided by Intel Free Intel® RealSense™ SDK for Windows, (Version 2014, Gold) Intel® RealSense™ Developer Kit camera available for purchase Huge opportunity to reach customers with integrated 3D camera Works with languages/frameworks/engines developers already use High-level APIs for NUI beginners. Low-level APIs for NUI experts

intel.com/realsense/sdkSeize the Opportunity

INFORMATION IN THIS DOCUMENT IS PROVIDED “AS IS”. NO LICENSE, EXPRESS OR IMPLIED, BY ESTOPPEL OR OTHERWISE, TO ANY INTELLECTUAL PROPERTY RIGHTS IS GRANTED BY THIS DOCUMENT. INTEL ASSUMES NO LIABILITY WHATSOEVER AND INTEL DISCLAIMS ANY EXPRESS OR IMPLIED WARRANTY, RELATING TO THIS INFORMATION INCLUDING LIABILITY OR WARRANTIES RELATING TO FITNESS FOR A PARTICULAR PURPOSE, MERCHANTABILITY, OR INFRINGEMENT OF ANY PATENT, COPYRIGHT OR OTHER INTELLECTUAL PROPERTY RIGHT.

Software and workloads used in performance tests may have been optimized for performance only on Intel microprocessors. Performance tests, such as SYSmark and MobileMark, are measured using specific computer systems, components, software, operations and functions. Any change to any of those factors may cause the results to vary. You should consult other information and performance tests to assist you in fully evaluating your contemplated purchases, including the performance of that product when combined with other products.

Copyright © 2014 , Intel Corporation. All rights reserved. Intel, the Intel logo, Xeon, Core, VTune, Cilk, and RealSense are trademarks of Intel Corporation in the U.S. and other countries.

Optimization Notice

Intel’s compilers may or may not optimize to the same degree for non-Intel microprocessors for optimizations that are not unique to Intel microprocessors. These optimizations include SSE2, SSE3, and SSSE3 instruction sets and other optimizations. Intel does not guarantee the availability, functionality, or effectiveness of any optimization on microprocessors not manufactured by Intel. Microprocessor-dependent optimizations in this product are intended for use with Intel microprocessors. Certain optimizations not specific to Intel microarchitecture are reserved for Intel microprocessors. Please refer to the applicable product User and Reference Guides for more information regarding the specific instruction sets covered by this notice.

Notice revision #20110804

Legal Disclaimer & Optimization Notice

Copyright© 2014, Intel Corporation. All rights reserved. *Other brands and names are the property of their respective owners.

23

24