Domenick Cinalli ECE Department Villanova University

Intelligent Ship Symposium VMonday, May 12, 2003

Metadata Embedding in Metadata Embedding in Compressed UAV VideoCompressed UAV Videovia Digital Watermarkingvia Digital Watermarking

DomenickCinalli

BijanMobasseri

ColinO’Connor

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

AcknowledgmentsAcknowledgments

• This work was supported in part by a grant from the US Air Force Office of Scientific Research. Predator video footage was provided by Mr. Scott Adams of the Air Force Research Lab, Rome, NY.

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

ObjectivesObjectives

• Define Watermarking• Why Watermark?• How to Watermark

– MPEG Introduction• Metadata Embedding System

– Synchronization• Metadata Viewer Application

– Demo

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

What is What is Watermarking?Watermarking?

Ability to insert a signal into a separate carrier signal without adversely affecting the

carrier signal’s perceptual transparency.

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

Watermarked Image Watermarked Image ExampleExample

Langelaar, C., Setyawan, I., and Lagendijk, R., “Watermarking Digital Image and Video Data,” IEEE Signal Processing Magazine, vol. 17, no. 5, pp. 20-46, Sept. 2000.

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

Why Watermark?Why Watermark?

Protection Informative

Copyright Protection Indexing

Fingerprinting Medical Record Storage

Copy Generation Control Data Hiding

Broadcast Monitoring

Data Authentication

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

Variable length code run level

10 (NOTE 2) End of Block

1 s (NOTE 3) 0 1

11 s (NOTE 4) 0 1

011 s 1 1

0100 s 0 2

0101 s 2 1

0010 1 s 0 3

0011 1 s 3 1

0011 0 s 4 1

0001 10 s 1 2

0001 11 s 5 1

0001 01 s 6 1

0001 00 s 7 1

0000 110 s 0 4

0000 100 s 2 2

0000 111 s 8 1

0000 101 s 9 1

MPEG IntroductionMPEG IntroductionTable B-14

MPEG Bitstream

Slice

Macroblock

Block

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

Data hiding in label-Data hiding in label-carrying VLCscarrying VLCs

• Compressed-Domain Scheme• Frame data is encoded into MPEG bitstream

using Variable-Length Codes.• Subset of VLCs, Label-Carrying VLCs, have

least significant bit modified to carry watermark.

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

Label-Carrying VLCsLabel-Carrying VLCs

To classify as a LC-VLC pair, both VLCs must:

1. Share a run-length

2. Differ in level by one

3. Have exactly the same bit-length

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

LC-VLC ExampleLC-VLC Example

VLC Run-Length Level

000000011101 0 12

000000001100 0 13

0 0 0 0 0 0 0 1 1 1 0 1 0 0 0 0 0 0 0 0 1 1 0 0

Insert Label ’11’

1

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

Metadata Metadata Embedding SystemEmbedding System

Embed Extract Display

W W-1

Video

Metadata

v

m

s

v

m

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

MetadataMetadata

• Descriptive Information– Date / Time– Direction– Location

http://www.airforce-technology.com/projects/predator/predator3.html

Video

Metad

ata

SuperS

tream• Why Embed?– Bookkeeping– Efficiency of storage– Ease of display

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

Video – Metadata Video – Metadata SynchronizationSynchronization

• Requirements– Metadata sampling starts simultaneously with recording of video– Metadata is sampled at a constant rate

• Result– Video and metadata are concurrently displayed and maintain

synchronization.

5s 10s 15s 20s 25s

1st Record 2nd Record 3rd Record 4th Record 5th Record 6th Record

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

Metadata Viewer Metadata Viewer ApplicationApplication

• Concurrently display metadata & video

• Graphical User Interface (GUI)

• Abstract technical detail

• Easy-To-Use

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

Metadata Viewer Metadata Viewer DemoDemo

• Predator UAV video (MPEG) & metadata provided by US Air Force

• Java-based– Swing API for GUI– Java Media Framework (JMF) for video

• Watermarking module coded in C

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

SummarySummary

• Implemented LC-VLC Watermarking to insert metadata into Predator UAV MPEG video

• Created an application that abstracts watermarking tasks and extracts embedded data for simultaneous display with video

Intelligent Ship Symposium VMonday, May 12, 2003Domenick Cinalli ECE Department Villanova University

Future WorkFuture Work

• Going beyond proof of concept…– Integrating operational factors– secure embedding– frame content metadata using MPEG-4 – lossless embedding– controlled access to video based on viewer clearance