Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data...
Transcript of Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data...
![Page 1: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/1.jpg)
rrlab.cs.uni-kl.de
Hannan Ejaz KeenRobotics Research Lab
Department of Computer ScienceUniversity of Kaiserslautern, Germany
Automated Elevation Mapping of Unstructured Outdoor Areas
![Page 2: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/2.jpg)
rrlab.cs.uni-kl.de
Motivation
The height of fields - an interesting parameter
Approximation of field height is rather easy on flat fieldsApproximation of field height becomes a problem if the
field has variable elevation
![Page 3: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/3.jpg)
rrlab.cs.uni-kl.de
Goal
Extract precise elevation map of field
![Page 4: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/4.jpg)
rrlab.cs.uni-kl.de
We will discuss…
GPS-IMU Approach
Need of More Data!
Sensors and Data gathering
Implemented Methodology
Preprocessing
Plane Extraction
Scan Transformation
Pointloud Merge and Octomap
Surface Generation
Geotiff Representation
![Page 5: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/5.jpg)
rrlab.cs.uni-kl.de
GPS-IMU Approach
Proposed Sensors IMU Stereo Camera GPS
Localization Fused all three sensors Precise localization Used as such
Mapping Update points at each run
Map based on waypoints only
![Page 6: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/6.jpg)
rrlab.cs.uni-kl.de
Need of More Data!
Less precise map due to limited points Difficult to update points in previously stored geotiff map
Addition of velodyne and stereo data No update required
![Page 7: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/7.jpg)
rrlab.cs.uni-kl.de
Sensors and Data gathering
Data from two different sources i.e. from ground vehicle and octocopter
Multisensor data fusion to construct precise and computationally sound elevation maps
Sensors under consideration are Imu, rtk-gps, stereo camera and velodyne (ground vehicle) Imu, gps, stereo camera (octocopter)
![Page 8: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/8.jpg)
rrlab.cs.uni-kl.de
Implemented Methodology - Steps
Preprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference (GPS
as reference in our case) Point cloud merge using octomaps Fill out the holes in map by cubic spline interpolation GeoTIFF Representation
Preprocessing RANSAC TransformationPoint Cloud
MergeSpline
InterpolationGeoTIFF
Representation
![Page 9: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/9.jpg)
rrlab.cs.uni-kl.de
Preprocessing
Huge variation in point densities in point clouds Measurement errors lead to sparse outliers Nearest neighbor assuming the distribution as gaussian with
mean and standard deviation Dynamic tuneable parameters
![Page 10: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/10.jpg)
rrlab.cs.uni-kl.de
Iterative process to estimate the parameters of mathematical model
Assumption – data comprises of both inliers and outliers Outliers do not fit the model in any circumstances
Plane Extraction - RANSAC
Outline:
1. Choose a small subset of points uniformly at random
2. Fit a model to that subset
3. Find all remaining points that are “close” to the model and reject the rest as
outliers
4. Do this many times and choose the best model
![Page 11: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/11.jpg)
rrlab.cs.uni-kl.de
RANSAC
Source: R. Raguram
![Page 12: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/12.jpg)
rrlab.cs.uni-kl.de
RANSAC
Source: R. Raguram
![Page 13: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/13.jpg)
rrlab.cs.uni-kl.de
RANSAC
Source: R. Raguram
![Page 14: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/14.jpg)
rrlab.cs.uni-kl.de
RANSAC
Source: R. Raguram
![Page 15: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/15.jpg)
rrlab.cs.uni-kl.de
RANSAC
Source: R. Raguram
![Page 16: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/16.jpg)
rrlab.cs.uni-kl.de
RANSAC
Source: R. Raguram
![Page 17: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/17.jpg)
rrlab.cs.uni-kl.de
RANSAC
Source: R. Raguram
![Page 18: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/18.jpg)
rrlab.cs.uni-kl.de
RANSAC
Source: R. Raguram
![Page 19: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/19.jpg)
rrlab.cs.uni-kl.de
RANSAC
Source: R. Raguram
![Page 20: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/20.jpg)
rrlab.cs.uni-kl.de
RANSAC
Source: R. Raguram
![Page 21: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/21.jpg)
rrlab.cs.uni-kl.de
Trees, poles or animals on field are considered as outlier Extraction of field assuming plane model and removing
outliers
Plane Extraction - Results
![Page 22: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/22.jpg)
rrlab.cs.uni-kl.de
Transformation of scan with respect to first scan Orientation of sensors are aligned with GPS 8x fast as compared to Iterative Closest Point - ICP
Scan Transformation
![Page 23: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/23.jpg)
rrlab.cs.uni-kl.de
Scan Transformation
Transformation of scan with respect to first scan Orientation of sensors are aligned with GPS 8x fast as compared to Iterative Closest Point - ICP
![Page 24: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/24.jpg)
rrlab.cs.uni-kl.de
Scan Transformation - Results
Transformation of scan with respect to first scan Orientation of sensors are aligned with GPS 8x fast as compared to Iterative Closest Point - ICP
![Page 25: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/25.jpg)
rrlab.cs.uni-kl.de
Point Cloud merge and Octomap
Scan merge iteratively
Consumes 33Mb memory in one second by a velodyne scan as each scan gives upto 1.39 million points per second
High frequency, approximately 60% redundant points
Sensor uncertainty gives some outliers which are not in every scan
A nearest neighbor caters the problem of redundancy Use of octomap for fast searching and insertion
![Page 26: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/26.jpg)
rrlab.cs.uni-kl.de
Octomap
*A. Hornung,. K.M. Wurm, M. Bennewitz, C. Stachniss, and W. Burgard, "OctoMap: An Efficient Probabilistic 3D Mapping Framework Based
on Octrees" in Autonomous Robots, 2013; DOI: 10.1007/s10514-012-9321-0.
Implements 3d occupancy grid mapping approach C++ Library* Based on Octree Octrees are the extension on Quadtree to three dimensions
![Page 27: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/27.jpg)
rrlab.cs.uni-kl.de
Octomap
*A. Hornung,. K.M. Wurm, M. Bennewitz, C. Stachniss, and W. Burgard, "OctoMap: An Efficient Probabilistic 3D Mapping Framework Based
on Octrees" in Autonomous Robots, 2013; DOI: 10.1007/s10514-012-9321-0.
Implements 3d occupancy grid mapping approach C++ Library* Based on Octree Octrees are the extension on Quadtree to three dimensions
![Page 28: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/28.jpg)
rrlab.cs.uni-kl.de
Point Cloud merge and Octomap (Cont.)
Velodyne-Stereo merge cloud in oct0map representation
![Page 29: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/29.jpg)
rrlab.cs.uni-kl.de
Point Cloud merge and Octomap (Cont.)
GPS Waypoints (green) and Velodyne-Stereo merge cloud (purple)
![Page 30: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/30.jpg)
rrlab.cs.uni-kl.de
Surface Generation
Interpolate the cloud – Cubic BSpline Interpolation Linear combination of control points and BSpline basis
function Local control over the curve Continuous at merging points Continuous first and second derivative where they join First and Second derivatives are equal for merging points
Image Source: http://m2matlabdb.ma.tum.de/download.jsp?MC_ID=7&SC_ID=7&MP_ID=485
![Page 31: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/31.jpg)
rrlab.cs.uni-kl.de
Surface Generation
Pcl library – surface_fitting DGM data having less than 1m accuracy as ground truth 87% of precision
![Page 32: Automated Elevation Mapping of Unstructured Outdoor AreasPreprocessing of stereo and velodyne data Extract plane by Ransac plane model Transform all sensor at a specific frame of reference](https://reader035.fdocuments.in/reader035/viewer/2022081607/5ec6dc44df99ba07f6112af8/html5/thumbnails/32.jpg)
rrlab.cs.uni-kl.de
GeoTIFF Representation
Georeferenced Tagged Image File Format An interchange format for georeferenced raster imagery