Evolution of Cooperation in Mobile Ad Hoc Networks
description
Transcript of Evolution of Cooperation in Mobile Ad Hoc Networks
![Page 1: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/1.jpg)
Evolution of Cooperation in Mobile Ad Hoc Networks
Jeff Hudack(working with some Italian guy)
![Page 2: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/2.jpg)
Evolutionary Game Theory• Components
– The Game– Interaction Model– Strategy Evolution
• Repeated game play using the interaction model• Strategies evolve according to replicator dynamic
• Widely applicable:– Sociology: interaction among self-interested individuals in society– Biology: evolution of complex ecosystems– Physics: arrangement and interaction of particles– Computer Science: multi-agent systems with self-interested agents
![Page 3: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/3.jpg)
Game
Evolutionary Game Theory
Mobile Ad Hoc Networks
Interaction Model
Strategy Evolution
![Page 4: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/4.jpg)
Prisoners’ Dilemma
• Players choose between cooperation (C) and defection (D)
• Models a situation in which two players may not cooperate for mutual benefit
• B > A > C > D
A, A C, B
B, C D, D
C
C
D
D
![Page 5: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/5.jpg)
PD Example
• Mutual cooperation is beneficial to both agents (certain payoff)
• However, (D, D) is the strong equilibrium strategy
2, 2 0, 3
3, 0 1, 1
C
C
D
D
![Page 6: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/6.jpg)
Mobile Ad Hoc Networks
• Self-interested devices, want– to have their own packets forwarded– to conserve power
• Assumptions– All packets are of the same value and a neighbor
will be punished for not forwarding any of them– Neighbors can be monitored to see their action
and total payoff
![Page 7: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/7.jpg)
Direct vs. Indirect Packets
A DCB
In a purely selfish scenario B does not care about A’s packets and will not punish C if he drops them
To simplify the game we assume that B will punish C for dropping any packets, regardless of origin
![Page 8: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/8.jpg)
Reduced PD (Nowak, May; 1992)
• R = 1, T = b (b > 1), S = P = 0• Single parameter b, the benefit of defection
• (C, C) - all packets forwarded• (D, C), (C, D) - exploitation• (D, D) - packets dropped
1, 1 0, b
b, 0 0, 0
C
C
D
D
![Page 9: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/9.jpg)
Game
Evolutionary Game Theory
Mobile Ad Hoc Networks
Interaction Model
Strategy Evolution
Packet Forwarding
![Page 10: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/10.jpg)
Interaction Model
• Random Geometric Graph– Nodes placed randomly in space– Interact if within (Euclidean) distance r
• Toroidal space to avoid border effects such as– Edge nodes have no packets to forward– Lower degree at edges– Mobility models tend to gather at center
• Agents play all neighbors at each time step
![Page 11: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/11.jpg)
Mobility Model
• Random Waypoint Model– Each agent chooses a destination point at random,
moves towards it– When arrived, choose new waypoint– The most popular mobile ad hoc network
simulation model (but not perfect!)• Parameters– v: velocity of agents – p: pause time (p=0)
![Page 12: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/12.jpg)
Game
Evolutionary Game Theory
Mobile Ad Hoc Networks
Interaction Model
Strategy Evolution
Packet Forwarding
RGG with RWP
![Page 13: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/13.jpg)
Strategy Evolution
• Replication by imitation• Choose a neighbor j at random– If Pi > Pj, do nothing– Otherwise, adopt neighbors strategy with
probability proportionate to how much better they did
![Page 14: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/14.jpg)
Game
Evolutionary Game Theory
Mobile Ad Hoc Networks
Interaction Model
Strategy Evolution
Packet Forwarding
RGG with RWP
Replication by Imitation
![Page 15: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/15.jpg)
Expectations
• Brownian movement keeps agents relatively close to one another
• RWP inherently leads to constant changing of neighbors
• It should be harder for RWP (a more realistic model) to converge to cooperation
![Page 16: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/16.jpg)
Experiments• Parameters
– Fixed: N = 1000, r = 1– Variable: b, ρ = N/L2
• XP1: Density -> % cooperation convergence– Fixed b = 1.1, v = {0.001, 0.01}
• XP2: Comparison of Brownian and RWP models– Link Change Rate (LCR) - frequency of link generations/breaks– Link Duration (LD) - lifespan of links
• XP3: b vs. v -> % cooperation convergence– Fixed ρ = 1.3
![Page 17: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/17.jpg)
XP1: Motivation
• Show the transition of evolution to cooperation w.r.t. density
• Brownian, v=0.01
Meloni, S., Buscarino, A., Fortuna, L., and Frasca, M. (2009). Effects of mobility in a population of prisoner’s dilemma players. pages 1–4.
![Page 18: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/18.jpg)
XP1: Agent Density (v=0.001)
![Page 19: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/19.jpg)
XP1: Interpretation
• Convergence to cooperation is still possible with RWP!
• However, RWP needs slower movement to counteract the volatility of the mobility model
• Is it because the dynamic models are inherently different?
![Page 20: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/20.jpg)
XP2: Motivation
• Brownian model with v = 0.01, σ = 1.3, b = 1.1 always converges to full cooperation
• RWP model with same parameters converges to defection
• RWP model with v = 0.001 has similar behavior as Brownian with v=0.01
• GOAL: Compare the dynamic properties of the mobility models
![Page 21: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/21.jpg)
XP2: Link Change Rate
![Page 22: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/22.jpg)
XP2: Link Duration
![Page 23: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/23.jpg)
XP2: Results
• Brownian (v=0.01)– LCR: 0.033– LD: 122.89
• RWP (v=0.001)– LCR: 0.0037– LD: 1249.8
• Conclusion: Not even close!
![Page 24: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/24.jpg)
XP2: Interpretation
• The LCR and LD are not the reasons for the different behavior
• The must be a different dynamic, guessing something like “edge diversity”
• NEED METRIC: How often are agents that disconnect reconnecting to each other?
![Page 25: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/25.jpg)
XP3: Motivation
• Show the relationship between velocity and the benefit of defection
• In progress! Had to restart due to an error with random seeding giving agents the same waypoint.
![Page 26: Evolution of Cooperation in Mobile Ad Hoc Networks](https://reader035.fdocuments.in/reader035/viewer/2022062501/56816385550346895dd46e09/html5/thumbnails/26.jpg)
Future Work• New mobility models
– Gauss-Markov turning model– Squad-based movement
• New replicator dynamics
• Stochastic PD for direct vs indirect routing
• Pockets of cooperation are no longer collection of individuals, but rather a structure with changing individuals– This may be the “big idea” for dissertation