Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on...

45
International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Building extraction Dr. Bharat Lohani D t t f Ci il E i i Department of Civil Engineering IIT Kanpur Mr. Rajneesh Singh, M.Tech.

Transcript of Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on...

Page 1: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008.

Building extractionBuilding extraction

Dr. Bharat Lohani D t t f Ci il E i iDepartment of Civil EngineeringIIT Kanpur

Mr. Rajneesh Singh, M.Tech.

Page 2: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Why building extraction?

Update GIS databaseUpdate GIS database3D city modelMap makingMap makingRevenue collectionChange detectionChange detectionDisaster management

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 3: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Where are buildings in the point cloud?

Manual interpretation !

How a computer knows that a group knows that a group of point cloud is actually for a building?

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 4: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Desired outcomePlanPlanHeight3D vector model3D vector model3D vector model with texture

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 5: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Why difficult ?

In LiDAR data no other but geometric In LiDAR data no other but geometric information in the form of sparse pointsGeometry alone can separate from Geometry alone can separate from natural features, e.g., trees but not from the artificial features, e.g., tanks or double decker busThe buildings may be simple and very complexcomplexThere are errors in data

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 6: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Basic concepts…

Height difference wrt local neighborhoodHeight difference wrt local neighborhoodTypical shapes different from natural objectsjMade of planar surfacesDomain knowledge

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 7: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Level of detail

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 8: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Possible approach: Using only laser data

Based on detection of planes Based on detection of planes Edges using plane intersection or height difference in DSMdifference in DSMLimitations of using only LiDAR data

Confusion in trees and buildingsConfusion in grass lands and roadsAs the only criterion of classification is the height or geometry (plane)g y (p )

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 9: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Possible approach: Using laser and Possible approach: Using laser and other data

Aerial imagesAerial imagesSatellite imagesGround plans Ground plans Advantages of both data sets

To eliminate the limitations of laser To eliminate the limitations of laser alone

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 10: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

DSM, BEM and nDSM

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 11: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Approach: Using thresholded nDSM

Generate BEM (DTM)Generate BEM (DTM)Find normalized DSM = DSM – DTMThis normalized DSM shows the variation of only above ground objects as terrain slope has been above ground objects, as terrain slope has been eliminated.Threshold normalized DSM at different heights. The irregular shapes corresponds to trees while The irregular shapes corresponds to trees while regular shapes corresponds to buildings. A process of eliminating trees and retaining buildings leads to finding outlines of buildings leads to finding outlines of buildings.

Morphological operatorsTexture analysis

Find planes and model and group

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Find planes and model and group

Page 12: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Approach: Concept of horizontal profiles

The size and CG location of building will not change much in comparison to other items as we slice upwards

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

items, as we slice upwards.

Page 13: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Building identification by variation in g ysize and location of CG of blobs

+ Domain knowledge, other dataInternational School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

+ Domain knowledge, other data

Page 14: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Approach: ClassificationUsing classification of LiDAR Using classification of LiDAR DSM and spectral dataGenerate nDSMDSM f t th nDSM forms yet another

band along with the spectral data for classificationT di i i t t f To discriminate tree from grass, concrete road from concrete roof…as height is also therealso thereTo discriminate building from tree as thematic information is there

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

information is there

Page 15: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Spectral data: Digital Spectral data: Digital imageConvert spectral data (d l )(digital image) into orthophotograph for registration with the LiDAR data

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 16: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Classification procedurenDSM is considered nDSM is considered as one of the bandsThe CIR band used f d lfrom digital imageISODATA classification used for generating clusters

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 17: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Approach: Using planar surfaces

B ildi d f l fBuildings are made of planar surfacesLocate planes within point cloudIntersect planes to determine edgesUse local height variation to distinguish from non-building planes like roads, grounds etc.

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 18: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Hough transform 2Dy

y mx c= +y

c

x( , )m c Line in Cartesian space

Line in parameter space

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

m

Page 19: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Hough transform 2Dyy

c

1 1( , )x y

xPoint in Cartesian space

1 1c x m y= − +Line in parameter space

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

mLine in parameter space

Page 20: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Hough transform 2Dyy

2 2( , )x y

c

1 1( , )x y

x

c x m y= − +Point in Cartesian space

1 1c x m y= +

2 2c x m y= − +

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

m Line in parameter space

Page 21: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Hough transform 2Dy ( )x yy

2 2( , )x y3 3( , )x y

c

1 1( , )x y

x1 1c x m y= − + Point in Cartesian space

2 2c x m y= − +

3 3c x m y= − +

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

mLine in parameter space

Page 22: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Hough transform 2D

yUsing the above philosophy the parameter space for a set of points will look like:

c

x

So can we use the density in So can we use the density in parameter space to see that for what values of ‘m’ and ‘c’ there is a line.

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

m

Page 23: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Hough transform 2D

yDetermine parameters for all possible neighboring pairs.

c0 5 2 2

x

Populate discretized parameter

0 5 2 2

1 27 4 3

Populate discretized parameter space with the counts of similar ‘m’ and ‘c’.

1 3 1 3

5 2 1 0

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

m

Page 24: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Hough transform 2D

yThreshold the Hough room.

c

x

Locate the point-pairs in Cartesian

27

Locate the point pairs in Cartesian space which have populated the high frequency cell of parameter space.

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

m

Page 25: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Hough transform 3D

Building planes are in 3D space and need to be detected from 3D LiDAR point cloud.

Need to apply Hough transform in 3D

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 26: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Hough transform 3D

LiDAR data for roof top

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 27: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Like the line segments of 2D here triangle is the basic element.

z

c

bx

yc

z ax by c= + +x

Planes in Cartesian space

a b

Plane in parameter space

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Plane in parameter space

Page 28: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

zz

•Create 2D TIN on LiDAR data (x,y)

•Consider height of each vertexz ax by c= + +

x

y

•Determine the parameters (a, b, c)

of all planes.

•Populate the 3D Hough room with

z ax by c= + +c

•Populate the 3D Hough room with

the count, i.e., how many planes

have similar parameters

•Threshold 3D Hough room

a b

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

b

Page 29: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

•The triangles for which parameters

are nearly same and with high

frequency in Hough room

z

cz

x

y

a b

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 30: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Observations

The result is identification of all LiDAR The result is identification of all LiDAR points that form planar surfaces. One Hough room may represent several One Hough room may represent several roof tops…

How is this affected by:The accuracy of dataThe accuracy of dataData density

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 31: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Point classification as planesHough room method classifies LiDAR points as planar Hough room method classifies LiDAR points as planar surfaces.

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 32: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Building modelling

R i d i t t t d l ( i f f Required is to generate a vector model (wireframe of building)

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 33: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Separation of roofs from one major p jplane (one hough room cell)

•Rasterize the points

•Use image processing algorithms 74for blob identification

•Give different IDs to blobs

•Map the blobs back in LiDAR point 24

4

•Map the blobs back in LiDAR point

cloud to give different IDs to

different point groups

2

•Remove smaller <threshold planes

•Merge closer groups

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 34: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Plane edge identification•Rasterize point groups Rasterize point groups

•Morphological closing

•Edge identification

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 35: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Line fitting to edge data points

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 36: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Result

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 37: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 38: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 39: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 40: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 41: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 42: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 43: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Effect of data type on building extraction

lue

Flying height Scan angle

index

va

Acc

ura

cy

A

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Data density

Page 44: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

Other planer approaches…

S t ti i f lSegmentation using surface normalsRANSAC (Random ConcensusS li ) th dSampling) methodOthers…Terrascan uses holes in ground class to locate possible building points

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008

Page 45: Building extractionhome.iitk.ac.in/~blohani/LiDARSchool2008/Downloads/...International School on LiDAR technology, IIT Kanpur, 31 March -4 April 2008. Building extraction Dr. Bharat

ReferencesBreener, C., 2005, Building reconstruction from images and laser scanning , International , , , g g g ,Journal of Applied Earth Observation and Geoinformation, Volume 6, Issues 3-4, March 2005, Pages 187-198Haala, N. and Brenner, C., 1999. Extraction of buildings and trees in urban environments. ISPRS Journal of Photogrammetry and Remote Sensing, 54(2-3): 130-137.Lohani, B. and Singh, R., 2008, Effect of data density, scan angle, and flying height on the o a , a d S g , , 008, ect o data de s ty, sca a g e, a d y g e g t o t eaccuracy of building extraction using LiDAR data, Geo Carto International, Vol. 23, No. 2, April 2008, 81–94Maas, H.-G. and Vosselman, G. (1999). Two algorithms for extracting building models from raw laser altimetry data. LISPS Journal of Photogrammetry and Remote Sensing, 54:153163.Sohn, G. and Dowman, I. (2003). Building extraction using lidar dems and ikonos images. Sohn, G. and Dowman, I. (2003). Building extraction using lidar dems and ikonos images. Proceedings of the ISPRS working group III/3 workshop ‘3-D reconstruction from airborne laserscanner and InSAR data’ Dresden, Germany.Vosselman, G. (2002). Fusion of laser scanning data, maps and aerial photographs for building reconstruction. IEEE International Geoscience and Remote Sensing Symposium and the 24th Canadian Symposium on Remote Sensing, IGARSS’02, Toronto, Canada,.y p g, , , ,Zhan, Q., Molenaar, M., and Tempfli, K. (2002b). Hierarchial image object based structural analysis toward urban land use classification using high-resolution imagery and airborne lidardata. IProceedings of the 3rd international symposium on remote sensing of urban area’s 2002, pages 251–258.

International School on LiDAR Technology, IIT Kanpur, 31 March – 4 April 2008