LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging...
Transcript of LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging...
![Page 1: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/1.jpg)
L i I t t D tLeveraging Internet DataIM2GPS: Estimating Geographic Information from a Single Image(by James Hays and Alexei Efros)(by James Hays and Alexei Efros)
Adriana KovashkaCS PhD Student
![Page 2: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/2.jpg)
WhWhereis this?is this?
Italy
![Page 3: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/3.jpg)
d thi ?… and this?
Wales
![Page 4: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/4.jpg)
O i f IM2GPSOverview of IM2GPS
Intuition “What is it like?” vs. “What is it?”
Data6 million geo-tagged images from Flickrg gg g
MethodRepresent images in 6 ways, comparep g y , p
ResultEstimated image locationst ated age oca o
![Page 5: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/5.jpg)
R t ti i IM2GPSRepresentations in IM2GPS
Tiny ImagesColor histogramsColor histogramsTexton histogramsLi f tLine featuresGist descriptor with colorGeometric context
![Page 6: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/6.jpg)
IM2GPS R ltIM2GPS Results
Hays 2008
![Page 7: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/7.jpg)
N t th T kNote on the Task
This is not scene categorizationSpecific locations usedSpecific locations used“Urban vs. natural” insufficientCan think of current task as place recognition*Can think of current task as place recognition
![Page 8: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/8.jpg)
D O iDemo Overview
Data50096 images (incl. 237 test images)50096 images (incl. 237 test images)100 most populated cities in the world
RepresentationsRepresentationsGist, color, Tiny Images
C iComparisonK-nn
![Page 9: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/9.jpg)
P dProcedure
Use code by Hays to query/download Flickr images
about 3 daysDownload, modify, run Gist code
about 30 hoursTest
about 6 hours for 7000 images10 min for 237 test images
![Page 10: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/10.jpg)
R t tiRepresentations
Gist (512 dim)Used Torralba’s scene recognition code
Color (32 dim)Computed histograms in L*a*b* color spacep g p4 bins for L, 14 for a and b
Tiny Images (768 dim)y g ( )Resized images to 16x16x3Vectors of color pixelsp
![Page 11: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/11.jpg)
C i M th dComparison Methods
Method OneSim(x, y) = inner product between concatenation of three representations of x and y
Method Two* Sim(x, y) = exp(-distA/σA)*exp(-distB/σB)*exp(-distC/σC) distA = Euclidian distance between representations A of x and yof x and yσA = mean of distances for representation A
![Page 12: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/12.jpg)
N t th C t ti fNote on the Computation of σC t t tiCurrent computation
X – matrix of n-dim features for all m imagesSubtract mean(X) from all rows of XSubtract mean(X) from all rows of XSquare resultSum rowsTake square roots of sumsTake mean of resulting column
Better computationBetter computationAverage of Euclidian distance between i and j for each pair of images (i, j)Computationally very expensive
![Page 13: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/13.jpg)
D t tDataset
Queried for 104 city tags Negative tags to remove duplicates, noiseg g p ,Downloaded images uploaded over 2 weeks50096 images from Flickr (237 test)
6M in IM2GPS (more tags, time)6M in IM2GPS (more tags, time)Disproportionate image set sizes per city!
![Page 14: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/14.jpg)
'Abidjan' [0] 'Chongqing' [37] 'London' [2891] 'RiodeJaneiro' [1135]'Ahmedabad' [3]'Alexandria' [152]'Ankara' [10]'Athens' [213]'Atlanta' [843]
'Dallas' [459]'Delhi' [169]'Detroit' [263]'Dhaka' [55]'Dongguan' [0]
'LosAngeles' [1442]'Madras' [1]'Madrid' [1822]'Manila' [230]'Medellin' [0]
'Riverside' [215]'Riyadh' [1]'Rome' [1328]'Ruhr' [53]'Saigon' [252]Atlanta [843]
'Baghdad' [3]'Bandung' [114]'Bangalore' [477]'Bangkok' [428]'B l ' [2221]
Dongguan [0]'Guadalajara' [71]'Guangzhou' [68]'Guiyang' [0]'Hanoi' [158]'H bi ' [76]
Medellin [0]'Melbourne' [529]'MexicoCity' [59]'Miami' [1280]'Milan' [362]'M t ' [26]
Saigon [252]'SaintPetersburg' [44]'Salvador' [867]'SanFrancisco' [2204]'Santiago' [365]'S P l ' [229]'Barcelona' [2221]
'Beijing' [658]'BeloHorizonte' [3]'Berlin' [1655]'Bogota' [404]
'Harbin' [76]'HoChiMinhCity' [9]'HongKong' [835]'Houston' [461]'Hyderabad' [19]
'Monterrey' [26]'Montreal' [0]'Moscow' [291]'Mumbai' [270]'NYC' [2383]
'SaoPaulo' [229]'Seoul' [364]'Shanghai' [118]'Shenyang' [0]'Shenzhen' [12]g [ ]
'Bombay' [16]'Boston' [1631]'Brasilia' [97]'BuenosAires' [132]'Busan' [0]
y [ ]'Istanbul' [681]'Jakarta' [50]'Johannesburg' [300]'Karachi' [9]'Khartoum' [6]
[ ]'Nagoya' [23]'Nanjing' [17]'NewYorkCity' [483]'Osaka' [222]'Paris' [3052]
[ ]'Singapore' [1118]'Surat' [0]'Sydney' [1541]'Taipei' [546]'Tehran' [19]Busan [0]
'Cairo' [107]'Calcutta' [4]'Chengdu' [225]'Chennai' [114]
Khartoum [6]'Kinshasa' [0]'Kolkata' [91]'KualaLumpur' [56]'Lagos' [25]
Paris [3052]'Philadelphia' [883]'Phoenix' [504]'PortoAlegre' [69]'Pune' [5]
Tehran [19]'Tianjin' [8]'Tokyo' [1992]'Toronto' [2009]'WashingtonDC' [2031]
'Chicago' [2796]'Chittagong' [0]
'Lahore' [8]'Lima' [97]
'Pyongyang' [13]'Recife' [221]
'Wuhan' [18]'Yangon' [3]
![Page 15: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/15.jpg)
BangaloreBangalore
![Page 16: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/16.jpg)
BostonBoston
![Page 17: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/17.jpg)
BostonBoston
![Page 18: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/18.jpg)
CairoCairo
![Page 19: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/19.jpg)
IstanbulIstanbul
![Page 20: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/20.jpg)
LondonLondon
![Page 21: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/21.jpg)
LondonLondon
![Page 22: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/22.jpg)
Los AngelesLos Angeles
![Page 23: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/23.jpg)
MadridMadrid
![Page 24: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/24.jpg)
MilanMilan
![Page 25: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/25.jpg)
MoscowMoscow
![Page 26: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/26.jpg)
MumbaiMumbai
![Page 27: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/27.jpg)
ParisParis
![Page 28: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/28.jpg)
RomeRome
![Page 29: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/29.jpg)
San FranciscoSan Francisco
![Page 30: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/30.jpg)
San FranciscoSan Francisco
![Page 31: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/31.jpg)
Sao PaoloSao Paolo
![Page 32: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/32.jpg)
TokyoTokyo
![Page 33: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/33.jpg)
TokyoTokyo
![Page 34: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/34.jpg)
Query 1 - GreeceQuery 1 Greece
![Page 35: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/35.jpg)
Query 2 - ArizonaQuery 2 Arizona
![Page 36: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/36.jpg)
Query 3 - SwitzerlandQuery 3 Switzerland
![Page 37: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/37.jpg)
O i f R ltOverview of Results
EvaluationPercentage of correct classificationsPercentage of correct classificationsPercentage of top m neighbors within n km of query imageq y gAverage distance of neighbors
TestsTestson 237 test imageson 7000 images from dataseton 7000 images from dataset
![Page 38: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/38.jpg)
Ch f T t I (200k )Chance for Test Images (200km)er
all
kpe
r im
age
ove
Cha
nce
Images 1 to 237
Chance is pretty low for this data.
![Page 39: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/39.jpg)
Ch f T t I ( t’d)Chance for Test Images (cont’d)er
all
knc
e pe
r run
ove
Aver
age
chan
Run number
Chance is pretty low for this data.
![Page 40: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/40.jpg)
T t I % /i 200k M1Test Images, % w/in 200km, M1
0 140.160.180.2
0.060.080.1
0.120.14
% within 200km k=1k=4k=8
00.020.04
Gist Color TinyImages
Gist +Color
Gist +Tiny
Color +Tiny
All
k=8k=12k=16
Images Color TinyImages
TinyImages
Feature Types
Gist seems to perform best with M1.
![Page 41: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/41.jpg)
T t I % /i 200k M2Test Images, % w/in 200km, M2
0 140.160.180.2
0.060.080.1
0.120.14
% within 200km k=1k=4k=8
00.020.04
Gist Color TinyImages
Gist +Color
Gist +Tiny
Color +Tiny
All
k=8k=12k=16
Images Color TinyImages
TinyImages
Feature Types
M2 works worse than M1.
![Page 42: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/42.jpg)
T t I % /i 1000k M1Test Images, % w/in 1000km, M1
0 140.160.180.2
0.060.080.1
0.120.14
% within 1000km k=1k=4k=8
00.020.04
Gist Color TinyImages
Gist +Color
Gist +Tiny
Color +Tiny
All
k=8k=12k=16
Images Color TinyImages
TinyImages
Feature Types
Results are naturally much better with larger distance allowed.
![Page 43: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/43.jpg)
IM2GPS R ltIM2GPS Results
Hays 2008
![Page 44: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/44.jpg)
D t t A M1Dataset, Accuracy, M1
0 160.180.2
0 080.1
0.120.140.16
AccuracyImages 501-4000
00.020.040.060.08
Images 4001-7500
0k=1 k=4 k=8 k=12 k=16
All Feature Types
Results are much better with more test images.
![Page 45: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/45.jpg)
D t t A M2Dataset, Accuracy, M2
0 160.180.2
0 080.1
0.120.140.16
AccuracyImages 501 4000
00.020.040.060.08 Images 501-4000
0k=1 k=4 k=8 k=12 k=16
All Feature Types
M2 performs worse than M1.
![Page 46: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/46.jpg)
D t t % /i 200k M1Dataset, % w/in 200km, M1
0 160.180.2
0.080.1
0.120.140.16
% within 200kmImages 501-4000
00.020.040.06
k 1 k 4 k 8 k 12 k 16
Images 4001-7500
k=1 k=4 k=8 k=12 k=16
All Feature Types
Again, with more test images, results are more similar to the authors’.
![Page 47: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/47.jpg)
D t t % /i 500k M1Dataset, % w/in 500km, M1
0 160.180.2
0.080.1
0.120.140.16
% within 500kmImages 501-4000
00.020.040.06
k 1 k 4 k 8 k 12 k 16
Images 4001-7500
k=1 k=4 k=8 k=12 k=16
All Feature Types
As expected, results improve when larger distance allowed.
![Page 48: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/48.jpg)
D t t % /i 1000k M1Dataset, % w/in 1000km, M1
0 160.180.2
0.080.1
0.120.140.16
% within 1000kmImages 501-4000
00.020.040.06
k=1 k=4 k=8 k=12 k=16
Images 4001-7500
k=1 k=4 k=8 k=12 k=16
All Feature Types
As expected, results improve when larger distance allowed.
![Page 49: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/49.jpg)
SydneySydney
Query Image (Argentina/Paraguay/Brazil)
Cairo
Features: Tiny Images
![Page 50: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/50.jpg)
Chicagog
Query Image (Barcelona)
Toronto
Features: Tiny Images
![Page 51: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/51.jpg)
RecifeRecife
Query Image (Barcelona)
Tokyo
Features: Tiny Images
![Page 52: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/52.jpg)
SydneySydney
S d
Query Image (Nassau, near Havana)
Sydney
Features: Tiny Images
![Page 53: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/53.jpg)
Washington DCWashington DC
Boston
Query Image (Hyderabad)
Features: Tiny Images
![Page 54: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/54.jpg)
Dallas
Query Image (Athens)
Rome
Features: Gist
![Page 55: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/55.jpg)
Rio de JaneiroRio de Janeiro
B l
Query Image (Guatemala)
Barcelona
Features: Gist
![Page 56: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/56.jpg)
BarcelonaBarcelona
B lBarcelona
Query Image (Barcelona)
Features: Gist
![Page 57: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/57.jpg)
ChiChicago
Query Image (Aruba)
Features: GistChicago
![Page 58: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/58.jpg)
Paris
MoscowQuery Image (Florida)
Features: Gist
![Page 59: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/59.jpg)
Los Angeles
Query Image (Iceland)
Melbourne
Features: Gist
![Page 60: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/60.jpg)
TToronto
Query Image (Germany)
Features: Color Toronto
![Page 61: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/61.jpg)
Hays 2008
![Page 62: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/62.jpg)
Hays 2008
![Page 63: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/63.jpg)
Hays 2008
![Page 64: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/64.jpg)
Hays 2008
![Page 65: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/65.jpg)
Hays 2008
![Page 66: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/66.jpg)
Ob tiObservations
The image set is rather difficultSome suggestions are useful in variousSome suggestions are useful in various ways, some are very badScaling might improve results with aScaling might improve results with a differently set σThi h iThis approach requires an enormous dataset to work well!
![Page 67: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/67.jpg)
Di iDiscussion
In what ways are the returned suggestions useful?Can we say the dataset is “noisy”?How can this method be improved?How can this method be improved?
![Page 68: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/68.jpg)
R f d Li kReferences and Links
J. Hays and A. Efros. IM2GPS: Estimating Geographic Information from a Single Image. CVPR 2008. http://graphics.cs.cmu.edu/projects/im2gps/http://graphics.cs.cmu.edu/projects/im2gps/A. Torralba, R. Fergus, and W. Freeman. 80 Million Tiny Images: a Large Dataset for Non-Parametric Object and Scene Recognition PAMI 2008Scene Recognition. PAMI 2008. http://people.csail.mit.edu/torralba/tinyimages/A. Oliva and A. Torralba. Modeling the Shape of the S H li ti R t ti f th S ti lScene: a Holistic Representation of the Spatial Envelope. IJCV 2001. http://people.csail.mit.edu/torralba/code/spatialenvelope/
![Page 69: LiIttDtLeveraging Internet Datagrauman/courses/spring2009/slides/Adriana_demo.pdfLiIttDtLeveraging Internet Data IM2GPS: Estimating Geographic Information from a Single Image (by James](https://reader033.fdocuments.in/reader033/viewer/2022042623/5fb2dafd0240f6552f2aa9cb/html5/thumbnails/69.jpg)
R f d Li k ( t’d)References and Links (cont’d)P. Getreuer. Color Space Converter. Matlab Central. http://www.mathworks.com/matlabcentral/fileexchange/7744Distance Calculation. Meridian World Data.Distance Calculation. Meridian World Data. http://www.meridianworlddata.com/Distance-Calculation.aspOnline Conversion – Unix time conversion. http://www.onlineconversion.com/unix time.htmhttp://www.onlineconversion.com/unix_time.htmA. Mehrtash. demo links. http://users.ece.utexas.edu/~mehrtash/SceneRecognitionDemo/A Kovashka IM2GPS (Hays and Efros) DemoA. Kovashka. IM2GPS (Hays and Efros) Demo. http://www.cs.utexas.edu/~adriana/im2gps_demo.html