PowerPoint Presentation

1

Visual Processing for Social MediaAndrew C. GallagherTsuhan Chen

September 30, 2012 Cornell University

TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAA1What is Social Media?Social media is created by users for users.video imagesaudiotext2

TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAA2What is Visual Processing? Visual Processing extracts information from pictures and video. 3

TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAA34

How it fits togetherSocial ImagesWhat we know about people4Fir theOutline Social Media OverviewVisual Processing OverviewSocial Media Insights Within the ImageSocial Media Insights From Sharing5

TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAA5Outline Social Media OverviewVisual Processing OverviewSocial Media Insights Within the ImageSocial Media Insights From Sharing6

TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAA6Media has always been social7

TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAA

13000-15000 BC, Lascaux, France7Why do we have images? Telling stories, recording events.

These slides show how the accuracy of depiction scenes improves over time, how the process becomes easier, and how it becomes a consumer process

The Empress Theodora with her court. Ravenna, St. Vitale 6th c. Middle AgesSlide by Alexei Efros, CMU

Nuns in Procession. French ms. ca. 1300. Middle AgesSlide by Alexei Efros, CMU

Renaissance

East Doors (1452)North Doors (1424)Lorenzo Ghiberti(1378-1455)

Slide by Alexei Efros, CMUToward Automation

Lens Based Camera Obscura, 1568Slide by Alexei Efros, CMURemoving the Artist

Still Life, Louis Jaques Mande Daguerre, 1837Slide by Alexei Efros, CMUFirst photograph: 1825, Daguerrotpye12Media for the masses13

TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAAGeorge Eastman with the Kodak Camera, introduced 1888

13George Eastman made it so everyone could capture snapshots. The Kodak camera was introduced in Mass Media

Slide by Alexei Efros, CMU

Images and videos now are broadcast to thousands and millions, but generally by a centralized media14Personal Media

Photo by Flickr user bysaikofish: http://www.flickr.com/photos/lou/197198984/And, there were millions of images being viewed by small audiences. 15Social Media until Web 2.0Mass MediaPersonal MediaContent creatorsAudience (viewing public)Content creators(consumer cameras)Audience(friends/family)And, there were millions of images being viewed by small audiences. 16Social Media NowTwitter: 67M usersTop Accounts have > 25M followersFacebook: 955M users Median user has about 100 friendsTwo people are separated by 4.7 degrees YouTube: 72 hours of video uploaded each minute10 years of video are watched each minuteIn 2011, over 1T page viewshttp://www.youtube.com/t/press_statisticshttp://pdf.secdatabase.com/700/0001193125-12-316895.pdfhttp://twittercounter.com/http://arxiv.org/pdf/1111.4570v3.pdf17Social Media Now vs. ThenThen: small audiences or small numbers of content creatorsNow: Everyone is an authorThen: Time delay is commonNow: Nearly real-time sharingAnd, there were millions of images being viewed by small audiences. 18Social Media for Data Mining19

Social MediaWhat we know about peopleWisdom of the Crowds(James Surowieckis 2005): under the right conditions, a crowd of non-experts can lead to decisions that are even smarter than the experts within the crowd20

Live Demo!21

http://tinyurl.com/8jm5qkyLive Demo! (M&Ms)22

http://tinyurl.com/8gssdv9

Google Flu Trends23

(Ginsberg et al., Nature, 2009)

Advantages: Faster than CDC!23Earthquake Sensing(Earthquake Shakes Twitter Users, Sakaki et al., WWW 2010)24

Information in Social Media25

Information in Social MediaTime of capture/uploadCamera make/model and settingsGeo-location Tags of persons/objectsComments/Likes/ViewsInterestingnessPixel Values

26

What Questions can Social Media Help Answer?What is in the picture? Where was a video captured? What candidate will win the election?How many iPhones have been sold? What people were at the event? What book should I buy? What should I name my baby?

27

Outline Social Media OverviewVisual Processing OverviewSocial Media Insights Within the ImageSocial Media Insights From Sharing28

TexPoint fonts used in EMF. Read the TexPoint manual before you delete this box.: AAAA28