Reading Metadata Between the Lines - Searching for Stories, People, Places and More: Presented by...
-
Upload
lucidworks -
Category
Software
-
view
371 -
download
2
Transcript of Reading Metadata Between the Lines - Searching for Stories, People, Places and More: Presented by...
Reading Metadata Between the Lines:
Searching for Stories, People, Places and More
in Television News
Kai Chan Social Sciences Computing
University of California, Los Angeles [email protected]
What?
What We Do with Television News
Make Metadata Searchable
Make Metadata Searchable
cap$on THESE RECALLED CARS ARE AMONG THE MOST POPULAR FOR THE PAST 12 YEARS.
Make Metadata Searchable
cap$on (searchable)
THESE RECALLED CARS ARE AMONG THE MOST POPULAR FOR THE PAST 12 YEARS.
Make Metadata Searchable
metadata
cap$on (searchable)
THESE RECALLED CARS ARE AMONG THE MOST POPULAR FOR THE PAST 12 YEARS.
Make Metadata Searchable
metadata (not searchable)
cap$on (searchable)
THESE RECALLED CARS ARE AMONG THE MOST POPULAR FOR THE PAST 12 YEARS.
Story Segment
Story 1 Story 2
Story Segment
Name Entity Name: John McCain Role: US Senator Party: Republican
Name: Greta Van Susteren Role: Anchor Network: Fox News Channel
Name Entity
NJ Governor: coopera$on from US President “outstanding”, “deserves great credit”
Republican Democrat praise (!)
Non-Verbal Communication
Non-Verbal Communication
On-Screen Text
On-Screen Text
How?
1. Help Users Search
Define Metadata Structure
Tag AQribute Name: Value
AQribute Name: Value
AQribute Name: Value
Start Time End Time
Define Metadata Structure
SEG Type: Headline
Topic: Ebola Scare
Country: US
1:00:00 1:03:00 (story segment)
start $me end $me tag aQributes
Search in Multiple Places
Offer Suggestions
2. Make the Search Happen
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, cap$on)
document
NER_State: Arizona
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, cap$on)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Poli$cs
Define Semantics
+TEXT_Text:“drought” +NER_Role:“Senator” +NER_State:“California”
Query:
Define Semantics
Interpreta$on 1:
“drought”
$me
start end
Role: Senator State: California
start end
Define Semantics
Interpreta$on 2:
“drought”
$me
start end start end
“drought”
Role: Senator State: California
Define Semantics
Interpreta$on 3:
“drought”
$me
start end
Role: Senator State: California
Define Semantics
Interpreta$on 4:
“drought”
$me
start end
Role: Senator State: California
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, cap$on)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Poli$cs
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, cap$on)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Poli$cs
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, cap$on)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Poli$cs
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, cap$on)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Poli$cs
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, cap$on)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Poli$cs
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, cap$on)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Poli$cs
Map to Documents and Fields
SEG_Topic: Ebola Scare
NER_Name: John McCain
NER_Role: Senator
fields
SEG_Type: Headline
(program info, cap$on)
document
NER_State: Arizona
NER_Name: John Chiang
NER_Role: Controller
NER_State: California
SEG_Topic: Drought
SEG_Type: Poli$cs
3. Make the Search Meaningful
Two Levels of Document
program document
tag document
tag document
tag document
1 document = 1 metadata instance
Two Levels of Document
program document
tag document
tag document
tag document
1 document = 1 news program
Two Levels of Document
program document
tag document
tag document
tag document
1. search metadata content
Two Levels of Document
program document
tag document
tag document
tag document
2. lookup program document(s)
Two Levels of Document
program document
tag document
tag document
tag document
3. filter by program informa$on
Two Levels of Document
NER_Role: Senator
NER_State: Arizona
tag document
NER_Role: Senator
tag document tag document
Tag: NER
NER_State: California
Tag: NER Tag: NER
NER_Role: Controller
NER_State: California
match NOT match NOT match
Two Levels of Document
Date
Network
Show
program document
NER_Role: Senator
tag document
Tag: NER
NER_State: California
Filter by Metadata Boundaries
“drought”
$me
start end
“drought” “drought”
Role: Governor State: California
Filter by Metadata Boundaries
... EMERGENCY PLED TO THE STATE OF CALIFORNIA IN MAY TO CONSERVE WATER. >> THIS DROUGHT IS A BIG WAKE-UP CALL, A REMINDER. THE COUPLE SAYS THAT THEY NEED NO REMINDERS. ...
36:18
36:22 36:18 – 36:22 Tag: NER Name: Jerry Brown Role: Governor State: California
36:19
4. Make the Search More Powerful
Proximity Search – Word as Unit
... >> THIS DROUGHT IS A BIG WAKE-UP CALL, A REMINDER. THE COUPLE SAYS THAT THEY NEED NO REMINDERS THEY DO ADMIT THAT THEIR LAWN HAS BECOME A BIT UNSIGHTLY. ...
posi$on 100
posi$on 121
20 words
Proximity Search – Time as Unit
... >> THIS DROUGHT IS A BIG WAKE-UP CALL, A REMINDER. THE COUPLE SAYS THAT THEY NEED NO REMINDERS THEY DO ADMIT THAT THEIR LAWN HAS BECOME A BIT UNSIGHTLY. ...
36:19
36:25
6 s
Make Metadata Searchable
metadata (not searchable)
cap$on (searchable)
THESE RECALLED CARS ARE AMONG THE MOST POPULAR FOR THE PAST 12 YEARS.
Make Metadata Searchable – Accomplished
metadata (now searchable)
cap$on (searchable)
THESE RECALLED CARS ARE AMONG THE MOST POPULAR FOR THE PAST 12 YEARS.
Thank you for coming!
Ques$ons or comments? My e-‐mail: [email protected]
Slides available at: hQp://bit.ly/lsr2014tvnews (or scan this barcode)