02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 1

ENEE408G: Capstone Design Project:

Multimedia Signal Processing

Design Project 2:Video Processing

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 2

Today’s Schedule

Introduction to Design Project 2 Check in Digital Camera and Pocket PC Check out PC camera and Pocket PC

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 3

Outline of Design Project 2

Part I : Video Capturing by PC Camera Part II : Motion Estimation and

Compensation Part III: MPEG Video Part IV: Detect Scene Change in Video Part V: Mobile Computing and Pocket PC

Programming Bonus Part I : MPEG-7 Visual Descriptor Bonus Part II: Video Conference

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 4

Part I. Video Capturing by PC Camera

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 5

Pat II. Motion Estimation and Compensation

Inter-Frame Encoder

DCT QuantizationEntropyCoding

Inversequantization

+ DCT

FrameMemory

MotionCompensation

MotionEstimation

+

+

Reconstructed motioncompensated residualestimated

motionvectors

reconstructed motioncompensated

reference frame

MotionCompensated

residual

motioncompensatedmacroblocks

Originalmacroblocks

of pixels

EncodedInterframe_

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 6

ME: Exhaustive Block Matching

Reference Frame Current Frame

R R-1

R

N1

N 2

R-1

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 7

ME: Example

Reference Frame Current Frame

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 8

Exhaustive Block Matching (cont.1)

Demo: http://www.ece.umd.edu/class/enee408g/labs/

labV/Motion_Estimation_v3.exe http://www.ece.umd.edu/class/enee408g/labs/

labV/motion_estimation_3step.exe

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 9

Exhaustive Block Matching (cont.2)

0 2 4 6 8 10 12 14 160

2

4

6

8

10

12

14

16

18

Reference Frame Current Frame Motion Vectors

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 10

Motion Compensation

Estimated frame Residual

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 11

3-step approach

1

11

11

1

1 1

22

2

2 2 2

2

2

3

33

3

3

33

3

1

Search points in step 1

Search points in step 2

Search points in step 3

1

2

3

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 12

Part III.MPEG Video

MPEG-1 Video Use mpgwrite.m and mpgread.m. Tradeoff between bit rate and quality

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 13

Part IV. Detect Scene Change

Cut Scene Change Dissolve Scene Change Wipe Scene Change Multi-scene Change Design scene change detector

Hint: Use statistical characteristics for each frame

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 14

Part V. Pocket PC Programming

Apply what you learned from previous parts and design a simple application related to digital video processing by Microsoft eMbedded Tools for Pocket PC.

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 15

Bonus Part I. MPEG-7 Visual Descriptor

MPEG-7 Texture Descriptor http://nayana.ece.ucsb.edu/M7TextureDemo/Dem

o/client/M7TextureDemo.html

MPEG-7 Shape Descriptor http://

www.ee.surrey.ac.uk/Research/VSSP/imagedb/demo.html

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 16

MPEG-7 Texture Descriptor

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 17

MPEG-7 Shape Descriptor

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 18

Bonus Part II. Video Conference

Experience video conferencing using

Microsoft NetMeeting

Two scenarios:

video conferencing with different image modes

video conferencing with different available

bandwidths Do this part at home

02/17/05 ENEE408G Spring 2005 Multimedia Signal Processing 19

PC Camera / Digital Camera

Digital Camera and Pocket PC Check In PC Camera and Pocket PC Check Out