Flexible Automated Depalletizing: an Unwrapping Robot to ...
Automated Construction of Environment Models by a Mobile Robot
description
Transcript of Automated Construction of Environment Models by a Mobile Robot
![Page 1: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/1.jpg)
Automated Construction of Environment Models by a
Mobile Robot
Thesis ProposalPaul Blaer
January 5, 2005
![Page 2: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/2.jpg)
Task: Construction of Accurate 3-D models
![Page 3: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/3.jpg)
Task: Construction of Accurate 3-D models
![Page 4: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/4.jpg)
Problem: Manual ConstructionEven with sophisticated tools, many tasks are still accomplished manually:
Planning of scanning locationsTransportation from one scanning location to the next, possibly under adverse conditionsAccurately computing the exact location of the sensor
![Page 5: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/5.jpg)
Approach: Automate the ProcessConstruct a mobile platform that is capable of autonomous localization and navigation. *Given a small amount of initial information about the environment, plan efficient views to model the region. *Use those views to construct a photometrically and geometrically correct model.
![Page 6: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/6.jpg)
Proposed Contributions:An improved 2-D view planning algorithm used for bootstrapping the construction of a complete scene modelA new 3-D voxel-based next-best-view algorithmA topological localization algorithm combining omnidirectional vision and wireless access point signals. Voronoi diagram-based path planner for navigation.A model construction system that fuses the view planning algorithms with the robot’s navigation and control systems.
![Page 7: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/7.jpg)
Large Scale 3-D ModelingLiterature:
1. 3D City Model Construction at Berkeley – Frueh, et al, 2004, 2002
2. Outdoor Map Building at University of Tsukuba – Ohno, et al 2004
3. MIT City Scanning Project – Teller, 1997
4. Klein and Sequeira, 2004, 20005. Nuchter, et al, 2003
![Page 8: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/8.jpg)
View Planning Literature:1. Model Based Methods
• Cowan and Kovesi, 1988• Tarabanis and Tsai, 1992• Tarabanis, et al, 1995• Tarbox and Gottschlich, 1995• Scott, Roth and Rivest, 2001
2. Non-Model Based Methods• Volumetric Methods
– Connolly, 1985– Banta et al, 1995– Massios and Fisher, 1998– Papadopoulos-Organos, 1997– Soucey, et al, 1998
• Surface-Based Methods– Maver and Bajcsy, 1993– Yuan, 1995– Zha, et al, 1997– Pito, 1999– Reed and Allen, 2000– Klein and Sequeira, 2000
• Whaite and Ferrie, 1997
3. Art Gallery Methods• Xie, et al, 1986• Gonzalez-Banos, et al, 1997• Danner and Kavraki, 2000
4. View Planning for Mobile Robots• Gonzalez-Banos, et al, 2000• Grabowski, et al, 2003• Nuchter, et al, 2003
![Page 9: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/9.jpg)
Overview of Our SystemPlatformSteps in Our Method
Initial Modeling StagePlanning the Robot’s PathsLocalization and NavigationAcquiring the ScanFinal Modeling Stage
Testbeds
![Page 10: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/10.jpg)
Overview of Our System:The Platform
GPS
DGPSScanner
Network
Camera
PTUCompass
PC
Sonar
Autonomous Vehicle for Exploration and Navigation in Urban Environments
![Page 11: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/11.jpg)
Overview of Our SystemThe Method:
Initial Modeling StageGoal is to construct an initial model from which we can bootstrap construction of a complete model.Compute a set of views based entirely on a known 2-D representation of the region to be modeled.Compute an efficient set of paths to tour these view points
Final Modeling StageVoxel-based 3-D method to sequentially choose views that fill in gaps in the initial model.
![Page 12: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/12.jpg)
Initial Modeling Stage
Given initial 2-D map of the scene.In this stage, assume that if you see all 2-D edges of the map, you’ve seen all 3-D façades.Solve the planning as a variant of the “Art Gallery” problem.
![Page 13: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/13.jpg)
Initial Modeling Stage
Problems with the “Art Gallery” approach:Traditional geometric approaches assume that the guards can see 360o around with unlimited range, ignoring any constraints of the scanner.A view of the 2-D footprint of an obstacle does not necessarily mean that we have seen the entire façade. There may be interesting 3-D structure above.
![Page 14: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/14.jpg)
Initial Modeling Stage
A randomized algorithm for the 2-D problem:First choose a random set of potential views in the free space
![Page 15: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/15.jpg)
Initial Modeling Stage100 initial samples
![Page 16: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/16.jpg)
Initial Modeling Stage
A randomized algorithm for the 2-D problem:First choose a random set of potential views in the free spaceCompute the visibility of each potential view
![Page 17: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/17.jpg)
Initial Modeling Stage
![Page 18: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/18.jpg)
Initial Modeling Stage
A randomized algorithm for the 2-D problem:First choose a random set of potential views in the free spaceCompute the visibility of each potential viewClip the visibility of each potential view such that the constraints of our scanning system are satisfied.
![Page 19: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/19.jpg)
Initial Modeling Stage
Constraints we have added to the basic randomized algorithm:
Minimum and maximum rangeMaximum grazing angleField of viewOverlap constraint
Scanner
Minimum Range (in our case 1m).
Maximum Range (in our case 100m).
![Page 20: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/20.jpg)
Initial Modeling Stage
Constraints we have added to the basic randomized algorithm:
Minimum and maximum rangeMaximum grazing angleField of viewOverlap constraint
Grazing Angle
![Page 21: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/21.jpg)
Initial Modeling Stage
Constraints we have added to the basic randomized algorithm:
Minimum and maximum rangeMaximum grazing angleField of viewOverlap constraint
![Page 22: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/22.jpg)
Initial Modeling Stage
Constraints we have added to the basic randomized algorithm:
Minimum and maximum rangeMaximum grazing angleField of viewOverlap constraint
![Page 23: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/23.jpg)
Initial Modeling Stage
A randomized algorithm for the 2-D problem:First choose a random set of potential views in the free spaceCompute the visibility of each potential viewClip the visibility of each potential view such that the constraints of our scanning system are satisfied.Choose a approximate minimum subset of the potential views to cover the entire set of 2-D obstacles
![Page 24: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/24.jpg)
Initial Modeling Stage9 chosen view points
![Page 25: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/25.jpg)
Initial Modeling StageA real world example:
![Page 26: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/26.jpg)
Initial Modeling StageA real world example: (1000 initial samples, 42 chosen views, 96% coverage)
![Page 27: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/27.jpg)
Planning the Robot’s PathsGiven a 2-D map of the region, compute “safe” paths for the robot to travel.Keep the robot as far away from the two closest obstacles.Accomplished by generating the generalized Voronoi diagram of the region and traveling along the boundaries of the Voronoi cells.
![Page 28: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/28.jpg)
Planning the Robot’s PathsApproximate the Generalized Voronoi Diagram:
Approximate the polygonal obstacles with discrete points.Compute the Voronoi diagram.Eliminate the edges that are inside obstacles or intersect obstacles.
![Page 29: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/29.jpg)
Planning the Robot’s Paths
![Page 30: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/30.jpg)
Planning the Robot’s PathsApproximate the Generalized Voronoi Diagram:
Approximate the polygonal obstacles with discrete points.Compute the Voronoi diagram.Eliminate the edges that are inside obstacles or intersect obstacles.
Use a shortest path algorithm such as Dijkstra’s algorithm to find paths along the Voronoi graph.
![Page 31: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/31.jpg)
Planning the Robot’s Paths
![Page 32: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/32.jpg)
Planning the Robot’s PathsNeed to generate a tour for the robot to visit all the initially selected view points.This can be treated as a “Traveling Salesman Problem” and solved with any number of approximations.To generate edge weights, we first compute our “safe” Voronoi paths between all viewpoints. We use the lengths of those paths as the edge weights for our graph.
![Page 33: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/33.jpg)
Planning the Robot’s Paths
![Page 34: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/34.jpg)
Localization and NavigationExisting system uses a combination of:
GPSOdometryAttitude SensorFine grained visual localization (Georgiev and Allen, 2004)
Problems:GPS can fail in urban canyonsOdometry is unreliable because of slipping and cumulative errorFine grained visual localization system needs an existing position estimate
![Page 35: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/35.jpg)
Coarse LocalizationCoarse Localization System:
Histogram Matching with Omnidirectional Vision:• Fast• Rotationally-invariant
![Page 36: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/36.jpg)
Coarse LocalizationCoarse Localization System:
Histogram Matching with Omnidirectional Vision:• Fast• Rotationally-invariant
Wireless signal strength of Access PointsUse existing wireless infrastructure to resolve ambiguities in location.Look at the signal strengths to all visible base stations at a given location and compare against database.
![Page 37: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/37.jpg)
Acquiring the Scan
![Page 38: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/38.jpg)
Final Modeling StageThe initial modeling stage will result in an incomplete model:
Undetectable 3-D occlusionsPreviously unknown obstaclesTemporary obstacles
Need a second modeling stage to fill in the holes.
![Page 39: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/39.jpg)
Final Modeling Scan
![Page 40: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/40.jpg)
Final Modeling StageWe store the world as a voxel grid.
For view planning of large scenes the voxels do not need to be small.Initial voxel grid is populated with the scans from the first stage.
• If a voxel has a data point in it, it is marked as seen-occupied.
• Unoccupied voxels along the straight line path from that point back to its scanning location that are marked as seen-empty.
• All other voxels are marked as unseen.
![Page 41: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/41.jpg)
Final Modeling StageWe use the known 2-D footprints of our obstacles to mark the ground plane voxels as occupied or potential scanning locations.
![Page 42: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/42.jpg)
Final Modeling StageFor each unseen voxel that borders on an empty voxel we trace a ray back to all scanning locations.If ray is not occluded by other filled voxels and it satisfies the scanner’s other constraints, that potential viewing location’s counter is incremented.The potential viewing location with the largest count is chosen.A new scan is taken and the process repeats until there are no unseen voxels bordering on empty voxels.
![Page 43: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/43.jpg)
Final Modeling StageAdditional Constraints:
Range constraint – the scanner’s minimum and maximum range is considered. If the ray is outside this range, it is not considered.Overlap constraint – for each view we can also keep track of how many known voxels it can view and require a minimum overlap for registration purposes.Traveling distance constraint – weight more heavily views that are closer to the current position.Grazing angle constraint – this constraint is harder to implement since no surface information is stored.
![Page 44: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/44.jpg)
Final Modeling Stage
![Page 45: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/45.jpg)
Final Modeling Stage
![Page 46: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/46.jpg)
Final Modeling Stage
![Page 47: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/47.jpg)
Final Modeling Stage
Initial View
Next Best View
![Page 48: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/48.jpg)
Testbeds: Columbia Campus
![Page 49: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/49.jpg)
Testbeds: Governor’s Island
![Page 50: Automated Construction of Environment Models by a Mobile Robot](https://reader035.fdocuments.in/reader035/viewer/2022062218/56815ba3550346895dc9a7ed/html5/thumbnails/50.jpg)
Road Map to the Thesis1. A topological localization algorithm – implemented and
tested in complicated outdoor environments (Blaer and Allen, 2002 and 2003).
2. A Voronoi-based path planner – implemented and tested (Allen et al, 2001).
3. An 2-D view planning algorithm for bootstrapping the construction of a complete model – tested on simulated and real world data. Additional constraints and testing are needed.
4. A voxel-based method for choosing next-best views – initial stages of the algorithm have been tested on simulated data.
5. Integrate these algorithms into the robot to build a complete system.