Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and...
Transcript of Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and...
![Page 1: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/1.jpg)
Natural Computing
Michael [email protected]: 0131 6 517177Informatics Forum 1.42
INFR09038
21/10/2010
Lecture 10: Ant Colony Optimisation
![Page 2: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/2.jpg)
Marco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian.“The Metaphor of the Ant Colony and its Application to Combinatorial Optimization”
Based on theoretical biology work of Jean-Louis Deneubourg (1987) From individual to collective behavior in social insects . Birkhäuser Verlag, Boston.
蚁群算法
![Page 3: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/3.jpg)
Picture from http://www.scs.carleton.ca/~arpwhite/courses/95590Y/notes/SI%20Lecture%203.pdf
![Page 4: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/4.jpg)
Stigmergy in Humans
stigma (mark, sign) +ergon (work, action)
Pie
rre -
Pau
l Gra
s sé
(195
9 )
![Page 5: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/5.jpg)
![Page 6: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/6.jpg)
![Page 7: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/7.jpg)
![Page 8: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/8.jpg)
![Page 9: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/9.jpg)
![Page 10: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/10.jpg)
![Page 11: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/11.jpg)
![Page 12: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/12.jpg)
![Page 13: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/13.jpg)
Applications
● Bus routes, garbage collection, delivery routes
● Machine scheduling: Minimization of transport time for distant production locations
● Feeding of lacquering machines
● Protein folding
● Telecommunication networks: Online optimization
● Personnel placement in airline companies
● Composition of products
![Page 14: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/14.jpg)
![Page 15: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/15.jpg)
![Page 16: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/16.jpg)
![Page 17: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/17.jpg)
?Byung-In Kim & Juyoung Wy Int J Adv Manuf Technol (2010) 50:1145–1152 (this is only the motivating example in this study)
![Page 18: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/18.jpg)
![Page 19: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/19.jpg)
possibly
![Page 20: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/20.jpg)
![Page 21: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/21.jpg)
![Page 22: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/22.jpg)
![Page 23: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/23.jpg)
![Page 24: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/24.jpg)
![Page 25: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/25.jpg)
![Page 26: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/26.jpg)
![Page 27: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/27.jpg)
Best ant laying pheromone (global-best ant or, in some versions of ACO, iteration-best ant) encourage ants to follow the best tour or to search in the neighbourhood of this tour (make sure that τmin>0).
Local updating (the ants lay pheromone as they go along without waiting till end of tour). Can set up the evaporation rate so that local updating “eats away” pheromone, and thus visited edges are seen as less desirable, encourages exploration. (Because the pheromone added is quite small compared with the amount that evaporates.)
Heuristic improvements like 3-opt – not really “ant”-style
“Guided parallel stochastic search in region of best tour” [Dorigo and Gambardella], i.e. assuming a non-deceptive problem.
Some general considerations
![Page 28: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/28.jpg)
Vehicle routing problems
A.E. Rizzoli, · R. Montemanni · E. Lucibello · L.M. Gambardella (2007) Ant colony optimization for real-world vehicle routing problems. Swarm Intelligence 1: 135–151
![Page 29: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/29.jpg)
Vehicle routing problems
E.g. distribute 52000 pallets to 6800 customers over a period of 20 daysDynamic problem: continuously incoming ordersStrategic planning: Finding feasible tours is hard Computing time: 5 min (3h for human operators)More tours required for narrower arrival time windowImplicit knowledge on traffic learned from human operators
A.E. Rizzoli, · R. Montemanni · E. Lucibello · L.M. Gambardella (2007) Ant colony optimization for real-world vehicle routing problems. Swarm Intelligence 1: 135–151
![Page 30: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/30.jpg)
ACO algorithm
loop over antsset of valid solutions
init best-so-far solution
store valid solutionsupdate best-so-far
![Page 31: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/31.jpg)
Robinson EJ, Jackson DE, Holcombe M, Ratnieks FL (2005) Insect communication: 'no entry' signal in ant foraging. Nature. 438:7067, 442.
Abstract: Forager ants lay attractive trail pheromones to guide nestmates to food, but the effectiveness of foraging networks might be improved if pheromones could also be used to repel foragers from unrewarding routes. Here we present empirical evidence for such a negative trail pheromone, deployed by Pharaoh's ants (Monomorium pharaonis) as a 'no entry' signal to mark an unrewarding foraging path. This finding constitutes another example of the sophisticated control mechanisms used in self-organized ant colonies.
Negative pheromones in real ants
![Page 32: Natural Computing - School of · PDF fileMarco Dorigo (1992). Optimization, Learning and Natural Algorithms. Ph.D.Thesis, Politecnico di Milano, Italy, in Italian. “The Metaphor](https://reader031.fdocuments.in/reader031/viewer/2022021818/5aaa85ae7f8b9a81188e1430/html5/thumbnails/32.jpg)
References on Ant Colony Optimization
● M. Dorigo & T. Stützle, Ant Colony Optimization, MIT Press, 2004.
● M. Dorigo & T. Stützle, The Ant Colony Optimization Metaheuristic: Algorithms, Applications, and Advances, Handbook of Metaheuristics, 2002. http://iridia.ulb.ac.be/%7Estuetzle/publications/ACO.ps.gz
● M. Dorigo, Ant Colony Optimization. Scholarpedia, 2007.● T. Stützle and H. H. Hoos, MAX-MIN Ant System. Future Generation
Computer Systems. 16(8):889--914,2000. http://iridia.ulb.ac.be/%7Estuetzle/publications/FGCS.ps.gz