A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of...
-
Upload
bridget-fletcher -
Category
Documents
-
view
216 -
download
1
Transcript of A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of...
![Page 1: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/1.jpg)
A Comparison of Zonal Smoothing Techniques
Prof. Chris BrunsdonDept. of Geography
University of [email protected]
![Page 2: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/2.jpg)
Background
Much social science data comes aggregated over irregular spatial zones
Census Wards
Police beat zones
Neighbourhood renewal areas
CDRP Special Areas
![Page 3: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/3.jpg)
Typical Problems
Changing from one set of geographical units to another
Areas of special concern for crime reduction (not the aggregation units used to report crime rates)
Compare crime rates with social data (different aggregation units)
One solution
Convert to surface - re-aggregate to new zones
![Page 4: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/4.jpg)
Factors to Consider
Data Collection
Statistical Issues
Software Issues
Underlying Theory
Diagnostics
Organisational Issues
![Page 5: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/5.jpg)
Background (1)
CAMSTATS web site
Developed at UCL as a consultancy (Muki Hacklay)
Gives public access to crime data - going back to April 2000
Designed so that police officers (or civilians) can update web page in a single button click
Has run without problems or need for advice or intervention
![Page 6: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/6.jpg)
Background (2)
Crime rates are mapped for a number of areal units
Wards
Police Sectors
Neighbourhood Renewal Areas
Special Areas
![Page 7: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/7.jpg)
Approaches
Roughness Penalty
Pycnophylactic Interpolation
Naive Averaging
![Page 8: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/8.jpg)
Form of Problem
Estimate an underlying crime risk surface from zonal data
Continuous version of model:In some approaches only
![Page 9: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/9.jpg)
![Page 10: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/10.jpg)
Discrete Approximation:
This is an over specified regression model.
NB - error term only in some approaches
![Page 11: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/11.jpg)
Over-Specified?
What does this mean?
More variables than observations
Solution is not unique
ie - for a given zone set all pixels to zero, and set one to crime count
set all pixels to 1/n of crime count if n is number of pixels in region
![Page 12: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/12.jpg)
A Discrete roughness penaltyRougness Penalty
In fact there are an infinite number of solutions to equation on earlier slide
Favour those with a lower roughness penalty
c.f. regularization problems
Aim to minimise sum of
squared errors + const. x roughness
Roughness at
![Page 13: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/13.jpg)
This Can be solved by matrix algebra
Contains info relating pixels to zones
Encapsulates ‘total roughness’ for all pixels
Controls roughness penaltyObserved zonal count
X is an indicator matrix showing which pixel is in which zone
![Page 14: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/14.jpg)
Software
Techniques here are not ‘off the shelf’
Statistical/numerical as well as GIS techniques
Here the ‘R’ package used
Statistical programming language
Good graphical support
Open Source (with lots of libraries - including GIS-type support)
![Page 15: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/15.jpg)
![Page 16: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/16.jpg)
Pycnophylactic Interpolation
Similar to Roughness Penalty - but no errors allowed - cf Tobler 1979
Can be solved as a quadratic programming problem
![Page 17: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/17.jpg)
![Page 18: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/18.jpg)
Naive Approach
Assume that the density within each areal unit is constant
![Page 19: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/19.jpg)
![Page 20: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/20.jpg)
HOUSING DENSITY: Is it sensible to assume intensity of household burglaries
is smooth?
![Page 21: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/21.jpg)
Model Modification
Densities can be obtained with David Martin’s SURPOP approach - can apply this modification
to all approaches described earlier
![Page 22: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/22.jpg)
![Page 23: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/23.jpg)
Routine activity Theory
We now assume risk per household is smooth
Perhaps in line with Cohen & Felson’s ROUTINE ACTIVITY THEORY?
Offenders choose targets according to their usual movement patterns
Familiary with a pixel suggests familiarity with its neighbours
But potential targets have to be there as well!
![Page 24: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/24.jpg)
EvaluationCamstats web site (www.met.police.uk/camden/camstats)
Monthly household burglary rates from April 2003 to March 2006
Aggregated over a number of different zones
Models are calibrated by UK census wards (64x64 pixels)
Then tested against two special interest areas
Camden Town / King’s Cross
![Page 25: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/25.jpg)
![Page 26: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/26.jpg)
Results
Method King’s Cross Camden Town
Pycnophylactic (HH) 1.94 2.90
Pycnophylactic 1.60 3.13
Naive (HH) 1.26 3.13
Naive 1.37 3.48
Roughness (HH) 2.05 2.86
Roughness 1.65 3.04Numbers are mean absolute deviations in estimated burglary counts - lowest in red,
runner up in green
![Page 27: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/27.jpg)
Discussion
Is simplest best?
Further findings show simple estimators work best on areas close to the edge of the region, but smoothing based approaches work best further inside the region
![Page 28: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/28.jpg)
![Page 29: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/29.jpg)
![Page 30: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/30.jpg)
Camden Isn’t An ISLAND!
![Page 31: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/31.jpg)
Consequences
Smoothing based approaches ‘borrow information’ from nearby places
cf Toblers First Law of Geography: Everything is related to everything else, but near things are more related than distant things
Because Camden isn’t an island, things are going on beyond the ‘edges’.
But we don’t know what they are!
So we can’t reliably borrow information
So probably simpler methods perform better near the ‘edges’
![Page 32: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/32.jpg)
A real-world problem
In practice organisations sub-divide data geographically
But without data sharing, individual regions appear (at least mathematically) as islands!
![Page 33: A Comparison of Zonal Smoothing Techniques Prof. Chris Brunsdon Dept. of Geography University of Leicester cb179@leicester.ac.uk.](https://reader035.fdocuments.in/reader035/viewer/2022070403/56649f2c5503460f94c47bb4/html5/thumbnails/33.jpg)
Conclusions - Further Work ?
For Camden Town, Roughness Penalty performed best.
For King’s Cross, the Naive method worked best
In both cases, taking household density into account proved best
Edge effects?
Merging predictors?
Further work - kernel based approaches...