DTI Management of Information LINK Project:

ICONS

Incident reCOgnitioN for surveillance and Security

funded by DTI, EPSRC, Home Office

(March 2000 - March 2003)

Queen Mary Westfield College, University of London

Safehouse Technologies

Heritage Protection

British Telecom

British Airport Authority

The Central Research Issue (Pre-competitive):

Recognition, Searching and Categorising

Spatio-Temporal Events of “Significance”

(Smart Content) in Video Data (on- or off-line)

• “Zero Motion” Detection

– Detecting and searching pre-defined significant events

(spatial and temporal) in a known scene

• “Abnormal Behaviour” Recognition

– Recognition and indexing human activities and temporal

signatures in space and over time

• In Real-Time with limited resources (on PC)

• From all different views• Varying lighting, distance and racial colours

• Under partial and total occlusion

• Multiple subjects of interest

• Fault tolerant to missing frames

Robust Detection and Tracking of Multiple Subjects and their Faces in Real-Time

Trackinghuman presence

Understandingscene layout

Behaviour Profiling and Categorisation

Modelling patterns of activities

Learning behaviour patterns

Behaviour Recognition and Search

Automatic Recognition of Human Gestures for Visually Mediated Interaction

and Intelligent Human-Machine Interface

Other Currently Funded Research Projects

• Gesture Recognition in Visually Mediated Interaction (EPSRC)– Gong, Sherrah

• Advanced Incident Monitoring System (Industry)– Gong, Parkinson, Verity, Ong

• Learning Human Models from Live Video (British Council)– Ong, Gong

• Motion-based Recognition of Face and Behaviour (HEFCE)– Psarrou, Gong, Romdhani, Walter

• Tracking and Segmentation in Virtual Studios (BBC & EPSRC)– Raja, Gong, Paker

• Multi-Camera Data Fusion (Overseas)– Chang, Gong

• Visual Learning in Dynamic Scenes (University of London)– Ng, Lee, Gong

Key References• S. Gong, S. McKenna, A. Psarrou. Dynamic Vision: From Images to Face

Recognition. World Scientific Publishing & Imperial College Press, March 2000.

• S. Gong, A. Psarrou, S. Romdhani. Multi-view Face Appearance Models. Invited article (1999 British Machine Vision Conference Best Scientific Paper Award), Image and Vision Computing, July 2000.

• S. Gong, A. Psarrou and M. Walter. Learning Stochastic Models of Human Behaviour. Invited article, Image and Vision Computing, July 2000 (also in ICCV’99, September 1999, Corfu, Greece).

• E. Ong, S. Gong. Modelling Nonlinear Dynamics of View Transformation: An Application to Tracking 3D Human Skeleton Models in Multiple Views. Invited article, Computer Vision and Image Understanding, October 2000 (also in IEEE Int. Workshop on Modelling People, 1999).

• S. Gong. Understanding head pose and body gestures for visually mediated interaction. Invited talk in IEE Colloquium on Computer Vision for Virtual Human Modelling. 1998, London (also in ECCV’98, Freiburg, Germany).

• S. McKenna, S. Gong. Recognising moving faces. In Wechsler, Philips and Bruce (Eds.) Face Recognition: From Theory to Applications, NATO ASI Series F, Springer-Verlag, July 1998.

• H. Buxton, S. Gong. Visual surveillance in a dynamic and uncertain world. Artificial Intelligence, Invited special volume on computer vision, Vol. 78, October 1995 (also in ICCV’95, June 1995, MIT, USA).