Web Intelligence

Clive BestToulouse

Europe Media Monitor

• 24/7 real time monitoring of 400 on-line media

• Process “live” articles from web sites.• Supports all world languages (Unicode)• Push out News Alerts – SMS, e-Mail Web

syndication.• Automatic breaking news detection

EMM Architecture

Scraper

HTML SimpleHTML

XHTML

RSS(XML)

Clean Tidy

XSLTXalan

Ingestor

Ingestorunicode

cache

RSS

WebPage

filter Alertsystem

Some EMM Features

• Alert detection – “searching the future”– “setting bait” complex keyword combinations

• News trackers – time series event analysis– Crisis indicators

• Long term archive – “searching the past”• True Multi-linguality

– Ability to monitor sites in any country– Search keywords in any language

News Tracking Service

Articles detected – last 12 hours

WAP accessReal-timeUnicodefilter

Political Science

• State cooperation-conflict indices• Early warnings humanitarian disasters• Policy impact assessment

Event CodingZimbabwe

Earth Science Applications

• Earth Quake Alert system– Scraping seismic sites http://dma.jrc.it

• Storm warning Alert system– Scraping meteo sites

• Earth Science real-time portal– Scraping latest data from diverse sites.