Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance...

Knowledge Fusion Research WorkshopSt. Michaels, Maryland October 19-22, 2004 KMCOEKMCOE

Surveillance Imagery Over An Agent-Based

Platform

Dr. Willie Thompson, IIDr. Damian Watkins


Agenda

• Overview of Problem Space• Project Motivation & Significance• Project Methodology• Ongoing Work• Future work


Environment Challenges

• Limited Resources– Limited energy, processing, & storage– Very limited bandwidth

• Wireless Communications– Open communication medium– Hidden Terminal Effect, Channel contention, noisy

channel– Monitoring may be difficult w/ security infrastructure

• Tactical Environment– Difficult to characterize normal behavior– Nodes prone to enemy capture– Limited analyst intervention

• Dynamic Environment– Mobile nodes and mobile infrastructure– No single concentration points for traffic analysis


Role within BORG Research

B3A

Imagery DB

Soldier

HighlightsJCDBGIS...

Requirements,Cognitive

Autonomous Fusion and NavigationDistinct Sources

Data Streams

Content Based Messaging System

AFM

RSSRSSRSS...

Advanced Interactions

Story(VS - UMD)

Visualizations

Commander/Analysts

Tactical Operations Center Workstations

Command and Control

Interactive Fusion and NavigationSummary of Source

Website , Vignette, Requirements

Plans

WWWHeterogeneousData sources

Knowledge Engineering,

Cognitive Models,HCI

Java/C++ Sequal Server/Oracle UML Cognitive Models Sun JXTA

AFM


Contributions

• Real-time data management and processing of data streams

• Situational aware and intelligent presentation

• Autonomous and secure agent interaction


Project MethodologyData Source•Server•Camera•Archive


Real Time Video Transmission

• Real Time Transport Protocol• Java Media Framework• Low power, low CPU power, small

form factor devices


Real Time Transport Protocol (RTP)

• Enables steaming media• End-to-end network delivery services• Transport independent( usually

UDP)• Creates sessions between

application• Connectionless protocol


Java Media Framework

• Acquisition, Processing, and Delivery of Time-based media

• Time-> nanosecond precision• Create and manage players w/

multiple RTP sessions• Compatible w/AIFF, AU, AVI, GSM, MIDI,

MPEG, QuickTime, RMF, and WAV formats


Intelligent Agents• Software Program• Agency and intelligence are the

fundamental underlying capabilities • Autonomy – separate process/thread• Intelligence – hard-coded logic,

complex reasoning, learning.• Implemented w/ JAVA


Why use Intelligent Agents?Soldier (Node) Level Detection

AnalysisCommand Level Detection Analysis

•Need an answer quickly•Few data sources•Limited Bandwidth•Solution:

•Autonomous & Intelligent process to gather and display relevant info•Intelligent Agents are autonomous and intelligent

•Have the luxury of time•Abundant Data sources•Bandwidth•Solution:

•Autonomous processes may be used but not necessary


Test Methodology

• Invoke JMF methods within Agent based platform.

• Agent Creates RTP session with data source and/or other agents.

• Analyze Performance of RTP and agent communication over wireless network.


Test ScenarioPeer-to-Peer network

RTP Session1/UDP RTP Session2/UDP

Streaming Source node


Test Platform

Streaming RTP Video Session

flyovervideo150m

Video Source


DATA traffic

• Rendering streaming tends to be slow

• Packet Errors and congestion over wireless network– High broadcast, network management

traffic• Approx. 82% of total traffic

– Large packet sizes for video frames • 1 Mega Byte packet size


Agent BroadcastTraffic


RTP BroadcastTraffic


Shortcomings

• Connectionless RTP– Frames are not guaranteed to arrive– Frames arrive out of order

• Inconsistent multiple RTP sessions• High broadcast overhead

– Network management traffic– Agent Communication overhead


Future Work

• Agent Cooperation– Create and Manage RTP session– Authenticate and secure hosts

• Run RTP over reliable UDP• Construct Representative Environment

– Real MANET environment • TEALAB CTA04• D. Watkins, C. Scott, “Methodology for Evaluating

the Effectiveness of Intrusion Detection in Tactical Mobile Ad-hoc Networks”, IEEE Wireless Communications and Networking Conference 2004.

– Virtual Environment (VMware)


References

• V.S. Subrahmanian, et al, Heterogeneous Agent Systems, MIT Press, 2000

• Java Media Framework, 2.0. Guide: http://java.sun.com/products/java-media/jmf/reference/docs/index.html

• RTP Specification: http://www.faqs.org/rfcs/rfc1889.html


Questions?

Comments?

Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance...

Documents

Transcript of Knowledge Fusion Research Workshop St. Michaels, Maryland October 19-22, 2004 KMCOE Surveillance...