Virtual Me

Team:

Team: TriviaPrepared By:

Menna Hamza MohamedMohamed Hesham FadlMona Abdel Mageed El-KoussyYasmine Shaker Abdel Hameed

Supervised By:Dr. Magda Fayek

AgendaMotion CaptureTracking TechniquesMarket SurveyVirtual MeHigh Level DesignTime PlanTools

Motion Capture

Motion Capture

The process of translating human motion to a digital model

GamesFast AnimationMoviesBio Medical AnalysisVR

Types of Tracking

Facial trackingFull body trackingHand trackingPartial body tracking

Tracking Techniques

1- Mechanical Motion Capture

Exoskeleton, joints connected to angular encoderPros:

No interference, No occlusionReal timeLarge capture range

Cons:Freedom of movement is limitedMechanical failures

2- Magnetic Motion Capture

Magnetic sensors and a constant magnetic field generatorPros:

No optical occlusionSensor orientation is directly given

Cons:External interferenceSmall capture rangeWiring and batteries

3- Optical Motion Capture

Using markers (reflective or emitting)Uses light intensity to determine marker position

Pros:Free movementCapture range

Cons:Optical occlusionExtensive pre-processing and post-processingControlled lighting condition

4- Marker-less Tracking

Using computer visionDetect Humans in the pictureUses techniques to extract motion information from the image

Silhouette detectionJoint detection

Market Survey

PhaseSpace

4:24 impulse cams 20:100 impulse active LEDsPrice: $29,950.00 to $123,950.00Features:

Full body motion tracking (including fingers using gloves)

Nintendo Wii

Accelerometer, optical sensors Gaming systemPrice: $199Limitations:

Can only track the motion of the hand Only useable with the Wii

Sony PS3 EyeWeb CamPrice:

Cam: $34.99 Play station 3: $299.00

Features: Recognizes hand and body movements

Limitations:Officially works only with Sony PS3Low resolution 640x480

Virtual Me

The Virtual Me Approach

A frame work for human motion captureColor based markersArbitrary number of camsDetect major limbs motion and orientationHopefully real time

Sample Application

Virtual GoalA simple game will be used as a demonstrationThe player will defend his goal from multiple ballsLimited translation motion

High Level Design

Camera Interface/ Frame

Sampler

Image Processing Component

Marker DetectorCapture Rate Adjustment

New Capture

Rate

HistoryCurrent Capture

Rate

Constraint Model

Video Feed

Marker Tracking Component

Marker Tracking

Component1

Marker Tracking

Component2

Marker Tracking

Componentk

Merging Component

Pose Constructor

Application

Interpolator

Time Plan

Time Plan

Feb March April May June July

Research&

Design

Basic Components Implementati

on

Midterms

Initial Integrati

on

Adv. Components Implementati

on

Final Integrati

on

Final Exams

Testing& Optimizatio

n

TimelineResearch& Design

Basic Components Implementation

Midterms

Initial Integration

Advanced Components

ImplementationFinal Integration

Final Exams

Feb March April May June July

Expected Time Plan

EndStart

JuneFeb

Research& Design

March

Basic Components

Implementation

April

Midterms

Initial Integration

May

Advanced Components Implementation

Final Integration

Final Exams

Testing& Optimizations

Tools

Development

LanguageC++

ToolsMicrosoft Visual Studio 2008Open CV 2.0

Thank You

Questions?