Connect with your. Wow! Motorized Tilt RGB Camera 3D Depth Sensors Microphone Array.
-
Upload
kristin-glenn -
Category
Documents
-
view
221 -
download
1
Transcript of Connect with your. Wow! Motorized Tilt RGB Camera 3D Depth Sensors Microphone Array.
BGR32 Format
width in pixels
heig
ht in
pix
els
Stride = Bytes Per Row
= bytes per pixel * width = 4 * width
4 Bytes Per pixel
Byte Array:
Depth dataMax resolution for raw depth data is 640 x 480
2 bytes per pixel of depth data (short)
11011110 pixel pixel pixel
00001 1110101000000 1110101000001
depthInMM = pixel >> DepthImageFrame.PlayerIndexBitmaskWidth
000 000 000
Depth + Player Data500mm 500mm500mm 500mm
2000mm2030mm2010mm2000mm
500mm500mm500mm2500mm
player 1
player 1
player 1 player 1player 1
player 1 player 1
SkeletonStream.Enable();
var player = pixel & DepthImageFrame.PlayerIndexBitmask; 11011110
00001010
skeletonFrame.Skeletons where skeleton.TrackingState == SkeletonTrackingState.Tracked
skeletonFrame.Skeletons
from skeleton in skeletonFrame.Skeletons where skeleton.TrackingState == SkeletonTrackingState.PositionOnly
hand_left
wrist_left
elbow_left
shoulder_left
hand_right
wrist_right
elbow_right
shoulder_right
hip_left
head
hip_right
knee_left knee_right
ankle_rightankle_left
foot_left foot_right
hip center
spine
shoulder_center
Skeleton.Joints[JointType]Joint.Position (X,Y,Z) Skeletons are mirroredX, Y, Z in metersOrigin(0,0,0) = center of camera.
+Z is out +X is to the right+Y is up
CompositesColor
Color
+
+
+
MapDepthFrameToColorFrameMapDepthToColorImagePoint
MapDepthToSkeletonPoint
MapSkeletonPointToColor
MapSkeletonPointToDepth
Echo CancellationEchoCancellationMode: None, CancellationOnly, CancellationAndSuppression
int EchoCancellationSpeakerIndex: Index of speaker to cancel
Audio @!%!#!! Gotchas
Use Microsoft.Speech not System.Speech
Must run in an MTA
AEC SystemModes crash if no speaker output.
Must plug Kinect into Wall
DevicePairGuid / Qualitymetrics = crash
Should run in ThreadMode Priority Highest?
Creative Commons Acknowledgments• Flickr by Ian Lewis• Flickr by major nelson• Flickr by markodesign• Flickr by stephantom• Flickr by Abstract Machine• Flickr By Aixo.co.kr• Flickr By Andresmh• Flickr by Antony Bennison• Flickr by Ars Electronica• Flickr By bm.iphone• Flickr by campuspartymexico• Flickr by Chris Jagers• Flickr By ci_polla Paola Sucato• Flickr by creepyhalloweenimages• Flickr by cvander• Flickr by IMAL.org• Flickr by Institut Douglas• Flickr by Joshua and AmberFlickr by Logon Sakai• Flickr by openexhibits• Flickr by Paul_Clarke
• Flickr by petyr.rahl• Flickr by pt• Flickr by Stilldavid• Flickr by y3rdua• Flickr by yesyesnono• Flickr by yum9me• Flickr by Jeff Howard• Flickr by jhscreenwm• Flickr by Kyle McDonald• Flickr by Morten Rand-Hendriksen• Flickr by Stuart Herbert• Flickr by Visiophone• Flickr by orkomedix• Michael Zöllner and Stephan Huber at the University of Konstanz• Openclip by J_Alves• Openclip by jetxee• Openclip by molumen• Openclip by shokunin• Openclip by Jhnri• Openclip by Machovka• Adafruit image of Hector MartinThanks!!