Introduction to Kinect v2

19
Introduction to Kinect v2 Tsukasa Sugiura @UnaNancyOwen

description

2014/10/04 第25回コンピュータビジョン勉強会@関東 http://connpass.com/event/8082/

Transcript of Introduction to Kinect v2

Page 1: Introduction to Kinect v2

Introduction to Kinect v2

Tsukasa Sugiura

@UnaNancyOwen

Page 2: Introduction to Kinect v2

Self-Introduction

Tsukasa SugiuraMicrosoft MVP for Kinect for Windows

@UnaNancyOwen

http://UnaNancyOwen.com

[email protected]

(July 2014 - June 2015)

Page 3: Introduction to Kinect v2

ワタシハキネクトチョットデキルI can develop Kinect App a little

Page 4: Introduction to Kinect v2

Agenda

What is Kinect v2

Specifications

New Features

Demo

Page 5: Introduction to Kinect v2

Disclaimer

“This is preliminary software and/or hardware and APIs

are preliminary and subject to change.”(Kinect for Windows v2は暫定的なものであり、ソフトウェア、ハードウェア、およびAPIは製品版で変更される可能性があります。)

Page 6: Introduction to Kinect v2

Kinect for Windows v1 Sensor

MULTI-ARRAY MIC MOTORIZED TILT

3D DEPTH SENSORS

RGB CAMERA

Page 7: Introduction to Kinect v2

Kinect for Windows v2 Sensor

MULTI-ARRAY MIC

3D DEPTH SENSOR

( IR Camera + IR Emitters )

RGB CAMERA

Page 8: Introduction to Kinect v2

Kinect for Windows v2 Sensor

Image by iFixit

IR EMITTERS

IR CAMERA

Page 9: Introduction to Kinect v2

Specifications

Kinect for Windows v1 Kinect for Windows v2

Color 640×480 @ 30fps 1920×1080 @ 30fps

Depth 320×240 @ 30fps 512×424 @ 30fps

Sensor Structured Light(PrimeSense Light Coding)

Time of Flight(ToF)

Range 0.8~4.0 m 0.5~4.5 m

Angle of ViewHorizontal / Vertical

57 / 43 degree 70 / 60 degree

Microphone Array ◯ ◯

Page 10: Introduction to Kinect v2

Specifications

Kinect for Windows v1 Kinect for Windows v2

BodyIndex 6 people 6 people

Body 2 people 6 people

Joint 20 joint/people 25 joint/people

Hand State Open / Closed Open / Closed / Lasso

Gesture ☓ ◯

Face ◯

Speech / Beamforming ◯ ◯

Page 11: Introduction to Kinect v2

System / Software Requirements

OS * Windows 8, 8.1, Embedded 8, Embedded 8.1 (x64)

CPU Intel Core i7 3.1GHz (or higher)

RAM 4GB (or more)

GPU * DirectX 11 supported

USB * USB 3.0 (Intel or Renesas Host Controller)

Compiler * Visual Studio 2012, 2013 (Supported Express)

Language Native (C++), Managed (C#,VB.NET), WinRT (C#,HTML)

Other Unity Pro (Add-in), Cinder, openFrameworks (wrapper)

Page 12: Introduction to Kinect v2

System

Kinect for Windows v1 Kinect for Windows v2

PCPC

Page 13: Introduction to Kinect v2

System

Kinect

Driver

Kinect SDK

Application

Kinect

Driver

Kinect SDK

Application

Kinect

Service

Kinect SDK

Application

Kinect SDK

Application

Kinect for Windows v1 Kinect for Windows v2

Page 14: Introduction to Kinect v2

New Features

Joint

Tip (指先), Thumb (親指), Neck (首)の追加 解剖学的に正しいJointの構成

Page 15: Introduction to Kinect v2

New Features

Gesture

機械学習によるジェスチャー認識 (Discrete, Continuous)

識別器を学習するツール”Visual Gesture Builder”

Video by http://youtu.be/-XYoblrnDpg

Page 16: Introduction to Kinect v2

New Features

Face

Bounding Box (囲枠), Rotation (方向), Points (目、鼻、口角)の取得 Activity (動作), Appearance (外観), Expression (表情)の認識

Activity … 目の開閉, 口の開閉, Sensorに正対 Appearance … メガネの有無 Expression … 笑顔

Page 17: Introduction to Kinect v2

New Features

HDFace

顔の3Dモデルを作成するためのデータ 詳細なPoints (1347点), HairColor (髪色), SkinColor (肌色)の取得 モデルのフィッティング

Page 18: Introduction to Kinect v2

Other

Drawing the Point Cloud retrieved from

Kinect v2 using Point Cloud Library

Kinect v2から取得したPoint CloudをPCLを使って描画 PCL All-in-one installerはBlogで配布

Page 19: Introduction to Kinect v2

Reference

Sample Program

Kinect2Sample | GitHubhttps://github.com/UnaNancyOwen/Kinect2Sample

Article Series

Kinect for Windows v2 | Build Insider http://www.buildinsider.net/small/kinectv2cpp

Blog

Kinect | Summary?Bloghttp://unanancyowen.com/?cat=3