Unleashing Creativity With the Xbox Kinect

17
Design Engineering Collaborative at UC Berkeley Unleashing Creativity With the Xbox Kinect A Microsoft Mindsumo Challenge Submission By Grant Buster

description

Unleashing Creativity With the Xbox Kinect. A Microsoft Mindsumo Challenge Submission By Grant Buster. Design Engineering Collaborative at UC Berkeley. For this challenge I focused on:. Using the Xbox Kinect to: Create an empowered design tool Promote 3D artistic expression - PowerPoint PPT Presentation

Transcript of Unleashing Creativity With the Xbox Kinect

Page 1: Unleashing Creativity With the Xbox Kinect

Design Engineering Collaborative at UC Berkeley

Unleashing Creativity With the Xbox Kinect

A Microsoft Mindsumo Challenge Submission

By Grant Buster

Page 2: Unleashing Creativity With the Xbox Kinect

For this challenge I focused on:

Using the Xbox Kinect to:Create an empowered design toolPromote 3D artistic expressionMake freeform modeling capable and funRemove limits on creative expression

Design Engineering Collaborative at UC Berkeley

Page 3: Unleashing Creativity With the Xbox Kinect

Traditional sketching is…

BeautifulFreeformLimited to a 2D plane

Design Engineering Collaborative at UC Berkeley

Page 4: Unleashing Creativity With the Xbox Kinect

3D printing pens (3Doodler) are…

Awesome for sketches but cannot make computer models

Design Engineering Collaborative at UC Berkeley

Page 5: Unleashing Creativity With the Xbox Kinect

Current 3D modeling software is great at…

Engineering modelingExtrusionsRotations

Design Engineering Collaborative at UC Berkeley

Page 6: Unleashing Creativity With the Xbox Kinect

Current 3D modeling software is also bad at…

Abstract shapes3D Art

Design Engineering Collaborative at UC Berkeley

Page 7: Unleashing Creativity With the Xbox Kinect

But why limit design of 3 dimensional objects

to a 2 dimensional computer screen?

Design Engineering Collaborative at UC Berkeley

Page 8: Unleashing Creativity With the Xbox Kinect

This is where the Xbox Kinect comes in…

Design Engineering Collaborative at UC Berkeley

Page 9: Unleashing Creativity With the Xbox Kinect

Let’s develop a 3D drawing software.

Design Engineering Collaborative at UC Berkeley

Page 10: Unleashing Creativity With the Xbox Kinect

Design Engineering Collaborative at UC Berkeley

Page 11: Unleashing Creativity With the Xbox Kinect

You could draw anything in 3D using…

Design Engineering Collaborative at UC Berkeley

An Infrared Pen with variable intensity

The Xbox Kinect

A standard computer

Page 12: Unleashing Creativity With the Xbox Kinect

The GUI would be a combination of…

Design Engineering Collaborative at UC Berkeley

Photoshop tools & Solidworks tools

With visual feedback as to where your pen is

Page 13: Unleashing Creativity With the Xbox Kinect

The software would…

Acquire the 3D location of the infrared pen using the Kinect’s stereo imaging.Read the intensity of the infrared signal and translate it to the “brush stroke” weight. Determine the orientation of the pen for ideal brush paths.Correlate the velocity of brush strokes with brush weight. Use the GUI’s user input to apply the specified 2D cross section for the “brush”.Output a 3D model of what the user draws.

Design Engineering Collaborative at UC Berkeley

Page 14: Unleashing Creativity With the Xbox Kinect

This would be a better interface than Leap Motion because…

Leap Motion’s sensor is limited to a 2x2x2 foot cube. The Xbox Kinect can image an entire room.Current Leap Motion software is good at using you hand positions to manipulate, rotate and exhibit current models. From the Leap Motion website: “you can point, wave, reach, and grab. Even pick something up and put it down.” Creating something is a different story…This Kinect software would change the way people create things from scratch in 3D, as opposed to just manipulating them.

Design Engineering Collaborative at UC Berkeley

Page 15: Unleashing Creativity With the Xbox Kinect

This proposed software would fuse the raw creativity of drawing with the

beauty of 3D modeling in a revolutionary new experience. Imagine

play dough for the 21st century.

Design Engineering Collaborative at UC Berkeley

Page 16: Unleashing Creativity With the Xbox Kinect

The Kinect has been used for gaming, robotics, education, and even fitness. I think it’s time to be

used to empower the design community.

Design Engineering Collaborative at UC Berkeley

Page 17: Unleashing Creativity With the Xbox Kinect

Thank you for your consideration!

Design Engineering Collaborative at UC Berkeley