Community structure in complex networks atCommunity structure in complex networks at different...
Transcript of Community structure in complex networks atCommunity structure in complex networks at different...
![Page 1: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/1.jpg)
Community structure in
complex networks at
different resolution levels
Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain)
Graph-TA 2014
![Page 2: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/2.jpg)
2
Our research team: Alephsys
Details
Dept. Enginyeria Informàtica i Matemàtiques,
Universitat Rovira i Virgili, Tarragona (Spain)
http://deim.urv.cat/~alephsys/
People
Alex Arenas, Sergio Gómez
Manlio De Domenico, Albert Solé, Per Sebastian Skardal
Pau Erola, Clara Granell
Joan Matamalas, José Magaña, Antonio González
Roger Guimerà, Jordi Duch, Sergio Lozano, Albert
Fernández, Javier Borge, etc.
Community structure at different resolution levels
![Page 3: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/3.jpg)
3
Interests: Complex Networks
Structure of complex networks
Community structure
Multiplex networks
Mathematical formalism
Descriptors: centrality, assortativity, etc.
Dynamics on complex networks
Synchronization
Epidemic spreading
Diffusion
Evolutionary games
Interplay between structure and dynamics
Community structure at different resolution levels
![Page 4: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/4.jpg)
4
Complex networks at different scales
Microscale Nodes and links
URV (Tarragona, Spain) email network
Community structure at different resolution levels
Schools
![Page 5: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/5.jpg)
5
Complex networks at different scales
Macroscale Statistical properties
URV (Tarragona, Spain) email network
Community structure at different resolution levels
Schools
![Page 6: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/6.jpg)
6
Complex networks at different scales
Mesoscale Sub-structure
URV (Tarragona, Spain) email network
Community structure at different resolution levels
Schools
![Page 7: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/7.jpg)
7
What are mesoscales?
Sub-structures involving sets of nodes
Communities
Finding communities
Optimization of global quality function, e.g. modularity
Local optimization of communities by growth
Probabilistic and Information-based approaches
Many different clustering algorithms
Set of communities
Partitions
Overlapping communities
Hierarchical structure
Community structure at different resolution levels
![Page 8: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/8.jpg)
8
Finding communities
Optimization of Modularity (Newman & Girvan (2004) Phys Rev E 69, 026113)
More links inside the communities than in a random (null case) network preserving nodes’ strengths
Community structure at different resolution levels
![Page 9: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/9.jpg)
9
Problems with modularity
Unexpected partitions
Zachary karate club:
Q(best) = 0.419790
Four communities found
Two communities expected
Community structure at different resolution levels
![Page 10: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/10.jpg)
10
Problems with modularity
Community structure at different resolution levels
Resolution limit (Fortunato & Barthelemy (2007) PNAS 104, 36)
Modules not separable if internal strength
Km
Km
Km
Km
Km
Km
Km
Km
Km
Km
Kp
Km
Kp
Km
![Page 11: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/11.jpg)
Modularity only gives one mesoscale
11
Why these problems?
Community structure at different resolution levels
Macroscale Microscale Mesoscales
![Page 12: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/12.jpg)
12
Scanning the whole mesoscale
Criteria for the scanning method:
Recovery of macroscale One community formed by all nodes
Recovery of microscale Each node in its own community
Preserve the semantics of Modularity In particular, recovery of modularity mesoscale
Comment:
We do not impose hierarchical mesoscales
Community structure at different resolution levels
![Page 13: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/13.jpg)
13
Scanning the whole mesoscale
How?
For instance, how can we isolate a node?
Community structure at different resolution levels
![Page 14: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/14.jpg)
How?
Tune the resistance of nodes to join communities, adding self-loops
The self-loop increases the internal strength
14
Scanning the whole mesoscale
Community structure at different resolution levels
![Page 15: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/15.jpg)
Multiple resolution method (Arenas, Fernandez & Gómez (2008) New J Phys 10, 053039)
Add a common resistance (self-loop) to all nodes
Optimize modularity
15
Scanning the whole mesoscale
Community structure at different resolution levels
![Page 16: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/16.jpg)
Multiple resolution method (Arenas, Fernandez & Gómez (2008) New J Phys 10, 053039)
Run the resistance in the interval
16
Scanning the whole mesoscale
Community structure at different resolution levels
Macroscale
Smallest positive value which satisfies
Microscale
![Page 17: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/17.jpg)
17
Scanning the whole mesoscale
Multiple resolution method (Arenas, Fernandez & Gómez (2008) New J Phys 10, 053039)
Comments: Topological properties not affected:
Strength distribution
Vertex to vertex correlations
Spectra
Laplacian
Resolution limit skipped
Macroscale and Microscale recovered
Semantics of Modularity preserved
Community structure at different resolution levels
![Page 18: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/18.jpg)
18
Validation
Circle
Community structure at different resolution levels
-1.0 -0.4 0.67 6.0
0.0
Ma
cro
sca
le
Mic
rosca
le
![Page 19: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/19.jpg)
19
Validation
Homogeneous with two hierarchical levels (Arenas, Diaz-Guilera & Perez-Vicente (2006) Phys Rev Lett 96, 114102)
Community structure at different resolution levels
![Page 20: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/20.jpg)
20
Validation
Hierarchical scale-free (Ravasz & Barabasi (2003) Phys Rev E 67, 026112)
Community structure at different resolution levels
![Page 21: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/21.jpg)
21
Validation
Resolution limit (Fortunato & Barthelemy (2007) PNAS 104, 36)
Community structure at different resolution levels
![Page 22: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/22.jpg)
22
Social networks
Zachary karate club (Zachary (1977) J Anthropol Res 33, 452)
Community structure at different resolution levels
![Page 23: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/23.jpg)
23
Social networks
Dolphins (Lusseau et al (2003) Behav Ecol Sociobiol 54, 396)
Community structure at different resolution levels
![Page 24: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/24.jpg)
Merge and split problem (Lancichinetti & Fortunato (2011) Phys Rev E 84, 066122)
Cannot be solved by changing the resolution Modularity is not appropriate if communities of very
different sizes coexist
24
Problems with modularity
Community structure at different resolution levels
Kp
Km
Kp
Kp
Km
Kp
Small cliques merge or large clique splits
![Page 25: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/25.jpg)
Hierarchical multiresolution (Granell, Gómez & Arenas (2012) Int J Bifurcat Chaos 22, 1250171)
Divisive method, generates hierarchy of communities
Based in the optimization of (signed) modularity
No resolution limit problem
No merge and split problem
25
Solution
Community structure at different resolution levels
![Page 26: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/26.jpg)
26
Hierarchical multiresolution
Community structure at different resolution levels
![Page 27: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/27.jpg)
27
Discussion
All community detection (clustering) algorithms
Have an (implicit or explicit) definition of clusters
The “shape” of the clusters and the distribution of sizes
depend on this definition
Have an (implicit or explicit) scale of resolution
A parameter needed to scan all the mesoscale
A rule needed to find the relevant scales of resolution
Have an equivalent to the resolution limit problem
It is possible to build counter-examples of community
structures which cannot be solved by the algorithm
Depending on the network they can be harmless
Community structure at different resolution levels
![Page 28: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/28.jpg)
28
Conclusions
Do not trust algorithms which just give a partition
You need to know how to “tune” the resolution
Analyze the whole mesoscale
Large computing times
Look for the right scales of resolution
Stability, sizes, number of communities, etc.
Resolution limit-like problems may appear
Not always a problem
Try with different algorithms
Consensus communities
Community structure at different resolution levels
![Page 29: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/29.jpg)
29
Community structure at different resolution levels
http://mediterraneanschoolcomplex.net/
![Page 30: Community structure in complex networks atCommunity structure in complex networks at different resolution levels Sergio Gómez Universitat Rovira i Virgili, Tarragona (Spain) Graph-TA](https://reader034.fdocuments.in/reader034/viewer/2022042313/5edcab8ead6a402d66676fb0/html5/thumbnails/30.jpg)
30
Thank you for your attention!
Info
Contact [email protected]
http://deim.urv.cat/~sgomez/
Software: Radatools
http://deim.urv.cat/~sgomez/radatools.php
References
A. Arenas, A. Fernández, S. Gómez,
Analysis of the structure of complex networks at different resolution levels,
New Journal of Physics 10 (2008) 053039
C. Granell, S. Gómez, A. Arenas, Hierarchical multiresolution method to overcome the resolution limit in complex
networks,
Int. Journal of Bifurcation and Chaos 22 (2012) 1250171
Community structure at different resolution levels