Task Planning and Allocation in Multi-Robot...
Transcript of Task Planning and Allocation in Multi-Robot...
![Page 1: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/1.jpg)
Task Planning and Allocation in Multi-Robot Systems
1
Dylan A. Shell Texas A&M University
![Page 2: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/2.jpg)
How do we achieve fluid cooperative behavior in robot teams?
2
?
![Page 3: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/3.jpg)
The (ancient) history of the ideas
3
1
![Page 4: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/4.jpg)
4
An Early Robot System W. Grey Walter’s Elmer and Elsie (~1950)
![Page 5: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/5.jpg)
Two Multi-Robot Dissertations
L. E. Parker. Heterogeneous Multi-Robot Cooperation. PhD thesis, MIT, January 1994.
5
M. J. Mataric ́. Interaction and Intelligent Behavior. PhD thesis, MIT, May 1994.
![Page 6: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/6.jpg)
L. E. Parker: Heterogeneous Multi-Robot Cooperation
6
ALLIANCE
![Page 7: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/7.jpg)
M. J. Mataric ́: Interaction and Intelligent Behavior
7
Basic (or Basis) Behaviors
![Page 8: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/8.jpg)
8
ParkerMataric`"Nerd Herd"
ALLIANCE
1994
Deliberate,explicit, orintentional
coordinationImplicit
cooperation &self-organization
Taskallocation
Market-basedmethods
OperationsResearchmethods
The figure is superimposed on a pruned version of Augier’s 1801 Arbre Botanique.
![Page 9: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/9.jpg)
9
Nikolaus Correll and Alcherio Martinoli. Towards Multi- Robot Inspection of Industrial Machinery. IEEE Robotics & Automation Magazine, 16(1):103–112, March 2009.
Brennan Sellner, Frederik W. Heger, Laura M. Hiatt, Reid Simmons, and Sanjiv Singh. Coordinated Multi-Agent Teams and Sliding Autonomy for Large-Scale Assembly. Proceedings of the IEEE, 94(7):1425–1444, July 2006.
![Page 10: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/10.jpg)
(Some work falls outside this categorization)
A. Breitenmoser, M. Schwager, J.-C. Metzger, R. Siegwart, and D. Rus. Voronoi coverage of non-convex environments with a group of networked robots. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA’10), pages 4982–4989, Anchorage, Alaska, May 2010.
10
![Page 11: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/11.jpg)
(Some work falls outside this categorization)
P. Stone, G. A. Kaminka, S. Kraus, and J. S. Rosenschein. Ad Hoc Autonomous Agent Teams: Collaboration with- out Pre-Coordination. In Proceedings of the Conference on Artificial Intelligence (AAAI’10), Atlanta, Georgia, July 2010.
11
![Page 12: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/12.jpg)
What is the underlying organizational principle involved?
12
2
![Page 13: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/13.jpg)
13
“Never be so busy as not to think of others.” — Mother Teresa
![Page 14: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/14.jpg)
14
At their heart task planning and allocation methods address a combinatorial problem: !•Who should do what? •What sequence of actions should be performed?
!
![Page 15: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/15.jpg)
Reviews (early)Y. U. Cao, A. S. Fukunaga, and A. B. Kahng. Co-operative Mobile Robotics: Antecedents and Directions. Autonomous Robots, 4:226–234, 1997.
G. Dudek, M. Jenkin, E. Milios, and D. Wilkes. A Taxonomy for Multi-Agent Robotics. Autonomous Robots, 3 (4):375–397, 1996.
L. Iocchi, D. Nardi and M. Salerno. Reactivity and Deliberation: A Survey on Multi-Robot Systems. Lecture Notes in Computer Science Volume 2103, 2001, pp 9-3
15
![Page 16: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/16.jpg)
Reviews (task-allocation)B. P. Gerkey and M. J. Mataric ́. A formal analysis and taxonomy of task allocation in multi-robot systems. International Journal of Robotics Research, 23(9):939– 954, September 2004.
M. B. Dias, R. Zlot, N. Kalra, and A. Stentz. Market-based multirobot coordination: A survey and analysis. Proceedings of the IEEE, 94:1257–1270, 2006.
G. A. Korsah, A. Stentz, and M. B. Dias. A comprehensive taxonomy for multi-robot task allocation. International Journal of Robotics Research, 32(12):1495–1512, 2013.
16
![Page 17: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/17.jpg)
17
!They are largely independent of problem-domain particularities, allowing one hide details involved in the performance of atomic tasks/actions. This form of abstraction allows: !1. formulation of the coordination problem along with a crisp
definition of the assumptions made about low-level robot capabilities;
!2. description of an algorithm for just the coordination aspect; !3. comparison of different algorithms whilst minimizing robot-
specific details that bleed into the comparisons. !
![Page 18: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/18.jpg)
Representative (hypothetical) architecture
18
Information Flow Perspective
![Page 19: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/19.jpg)
Representative (hypothetical) architecture
19
StateEstimator Planner Task
AllocatorTask
Executor
Agent 1
StateEstimator Planner Task
AllocatorTask
Executor
Agent 2
StateEstimator Planner Task
AllocatorTask
Executor
Agent n
...
Sensor Signals and/or Percepts State
Estimator Planner TaskAllocator
TaskExecutor
Control Signalsand Actions
(i) (ii) (iii) (iv)
(a) (b) (c)
Agent n
![Page 20: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/20.jpg)
Representative (hypothetical) architecture
20
StateEstimator Planner Task
AllocatorTask
Executor
Agent 1
StateEstimator Planner Task
AllocatorTask
Executor
Agent 2
StateEstimator Planner Task
AllocatorTask
Executor
Agent n
...
Sensor Signals and/or Percepts State
Estimator Planner TaskAllocator
TaskExecutor
Control Signalsand Actions
(i) (ii) (iii) (iv)
(a) (b) (c)
Agent nStates
![Page 21: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/21.jpg)
Representative (hypothetical) architecture
21
StateEstimator Planner Task
AllocatorTask
Executor
Agent 1
StateEstimator Planner Task
AllocatorTask
Executor
Agent 2
StateEstimator Planner Task
AllocatorTask
Executor
Agent n
...
Sensor Signals and/or Percepts State
Estimator Planner TaskAllocator
TaskExecutor
Control Signalsand Actions
(i) (ii) (iii) (iv)
(a) (b) (c)
Agent nCosts
![Page 22: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/22.jpg)
Representative (hypothetical) architecture
22
StateEstimator Planner Task
AllocatorTask
Executor
Agent 1
StateEstimator Planner Task
AllocatorTask
Executor
Agent 2
StateEstimator Planner Task
AllocatorTask
Executor
Agent n
...
Sensor Signals and/or Percepts State
Estimator Planner TaskAllocator
TaskExecutor
Control Signalsand Actions
(i) (ii) (iii) (iv)
(a) (b) (c)
Agent nAllocation
![Page 23: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/23.jpg)
23
Research Background
Cost matrix Solution with minimized cost
7 4 3
6 8 5
9 4 4
r1
r2
r3
t1 t2 t3
7 4 3
6 8 5
9 4 4
r1
r2
r3
t1 t2 t3
Assignment Problem
Assign every robot to do a unique task, and optimize the overall team performance.
Optimal solution: r1!t3 , r2!t1 , r3!t2
Optimal value: 3+6+4 = 13
![Page 24: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/24.jpg)
244/33
Research Background Challenges in robotics:
• Real time systems: low running time • Possible failures: decentralization • Costly communication: minimal communication • Dynamics involved: adaptive ability • Timeliness: flexibility • Uncertain costs: risk-aversion • …
Centralized Decentralized Distributed
Local centralization
Optimal Assignment: • Fast, optimal solution; • Not robust against failures; • e.g., LP, Hungarian, pseudo-flow
Robotic Task Allocation: • Heuristic, intuitive methods; • Not optimal for solutions; • e.g., market/auction, task swap
Centralized Decentralized /Distributed
![Page 25: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/25.jpg)
25
• Treats n × n assignment as a bigraph (weighted by utilities); • Goal: find a maximally weighted perfect matching; • Technique: search for augmenting paths to augment No. of matched edges.
Each augmenting path requires O(n2), at most n paths, so total time complexity is O(n3).
perfect matching as optimal solution
Bigraph: 2 sets of nodes, 3 types of edges • Matched (assigned): l(ri) + l(tj) = uij!• Unmatched (unassigned): l(ri) + l(tj) > uij!• Candidate (unassigned): l(ri) + l(tj) = uij!
The Hungarian Method:
candidate
mat
ched
Flip edge types
Utility uij maximization
Labeling l(.)!
![Page 26: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/26.jpg)
Representative (hypothetical) architecture
26
StateEstimator Planner Task
AllocatorTask
Executor
Agent 1
StateEstimator Planner Task
AllocatorTask
Executor
Agent 2
StateEstimator Planner Task
AllocatorTask
Executor
Agent n
...
Sensor Signals and/or Percepts State
Estimator Planner TaskAllocator
TaskExecutor
Control Signalsand Actions
(i) (ii) (iii) (iv)
(a) (b) (c)
Agent n Decision Problem
![Page 27: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/27.jpg)
Representative (hypothetical) architecture
27
StateEstimator Planner Task
AllocatorTask
Executor
Agent 1
StateEstimator Planner Task
AllocatorTask
Executor
Agent 2
StateEstimator Planner Task
AllocatorTask
Executor
Agent n
...
Sensor Signals and/or Percepts State
Estimator Planner TaskAllocator
TaskExecutor
Control Signalsand Actions
(i) (ii) (iii) (iv)
(a) (b) (c)
Agent nMulti-Agent Decision Problem
![Page 28: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/28.jpg)
What is the underlying organizational principle involved?
28
2 The traditional engineering methodology of top-down decomposition into sub-systems - Does well in managing design
complexity - Overall optimality unclear
!!!!
![Page 29: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/29.jpg)
What are the research problems and topics we expect for the coming years?
29
3
![Page 30: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/30.jpg)
Heterogeneity
How do we cope with highly heterogeneous systems?
Elements of interrelatedness become much more important in heterogeneous robot systems involving robots with diverse capabilities.
Ex. ASYMTRE line of work by Zhang and Parker
!
30
![Page 31: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/31.jpg)
Utility Estimates
How do we compare utility estimates to realized task performance? How do we use this?
There is a little work on learning algorithms, otherwise this aspect is largely ignored.
!
31
![Page 32: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/32.jpg)
Coordination vs. Competition
How do gain a deeper understanding of cooperative vs. competitive points of view?
Auctions and market-based methods involve a competitive, self-interested point of view. Is this really appropriate?
!
32
![Page 33: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/33.jpg)
Connecting methods
How do we establish connections between the existing methods?
Many methods exist as islands…
!
33
![Page 34: Task Planning and Allocation in Multi-Robot Systemsmultirobotsystems.org/sites/default/files/slides/2015_RSS_MRS_Shel… · Task Planning and Allocation in Multi-Robot Systems 1 Dylan](https://reader036.fdocuments.in/reader036/viewer/2022081615/5fe5375db09f7a411841d241/html5/thumbnails/34.jpg)
Questions
34
?