Communities and dynamics in social networks
-
Upload
francisco-restivo -
Category
Education
-
view
416 -
download
4
Transcript of Communities and dynamics in social networks
![Page 2: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/2.jpg)
SSIIM, 2015/09/22 2
Topics
• Graphs and social networks• Some metrics• Communities • Dynamics• Fraud• Software • etc
Zachary karate club
![Page 3: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/3.jpg)
SSIIM, 2015/09/22 3
Networks
• Networks are everywhere• Social, biological, financial, etc• Complex networks• Communities reveal properties of networks• Contagion• Controversies
![Page 4: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/4.jpg)
SSIIM, 2015/09/22 4
Euler 1707 - 1783
![Page 5: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/5.jpg)
SSIIM, 2015/09/22 5
![Page 6: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/6.jpg)
SSIIM, 2015/09/22 6
![Page 7: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/7.jpg)
SSIIM, 2015/09/22 7
![Page 8: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/8.jpg)
SSIIM, 2015/09/22 8
![Page 9: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/9.jpg)
SSIIM, 2015/09/22 9
Social networks
• Internet changed everything• Social interactions• Sharing • e-Commerce• Payments• Digital marketing• Political marketing• etc
![Page 10: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/10.jpg)
SSIIM, 2015/09/22 10
![Page 11: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/11.jpg)
SSIIM, 2015/09/22 11
Network growth
![Page 12: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/12.jpg)
SSIIM, 2015/09/22 12
How teens communicate
![Page 13: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/13.jpg)
SSIIM, 2015/09/22 13
![Page 14: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/14.jpg)
SSIIM, 2015/09/22 14
![Page 15: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/15.jpg)
SSIIM, 2015/09/22 15
![Page 16: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/16.jpg)
SSIIM, 2015/09/22 16
Basics of graphs and networks
• G = (V, E)• O(G) = |V| order
• S(G) = |E| size
• A adjacency matrix
• Ki degree of vertex I
• Directed/undirected
![Page 17: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/17.jpg)
SSIIM, 2015/09/22 17
Representation of networks
• Matrixes, graphs, edge lists, etc
A B C D EA 0 1 1 1 0B 1 0 1 0 1C 0 0 0 1 0D 0 1 1 0 0E 1 1 0 0 0
A BA CA DB AB CB EC DD BD CE AE B
![Page 18: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/18.jpg)
SSIIM, 2015/09/22 18
Global metrics
• Number of vertexes 5
• Number of edges 11
• Number of components 1
• Diameter 2
• Density 0.55
![Page 19: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/19.jpg)
SSIIM, 2015/09/22 19
Common Tasks
• Measuring “importance”– Centrality, prestige (incoming links)
• Link prediction• Diffusion modeling– Epidemiological
• Clustering– Blockmodeling, Girvan-Newman, Chinese whisper
• Structure analysis– Motifs, Isomorphisms, etc.
• Visualization/Privacy/etc. from Eytan Adar slides
![Page 20: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/20.jpg)
SSIIM, 2015/09/22 20
Centrality Measures• Degree centrality
– Edges per node (the more, the more important the node)• Closeness centrality
– How close the node is to every other node• Betweenness centrality
– How many shortest paths go through the edge node (communication metaphor)
• Information centrality– All paths to other nodes weighted by path length
• Bibliometric + Internet style– PageRank from Eytan Adar slides
![Page 21: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/21.jpg)
SSIIM, 2015/09/22 21
Champions league Pagerank
![Page 22: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/22.jpg)
SSIIM, 2015/09/22 22
![Page 23: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/23.jpg)
SSIIM, 2015/09/22 23
![Page 24: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/24.jpg)
SSIIM, 2015/09/22 24
Community detection
• Communities and clusters are different • Network data is related to graph properties• Real world data is big
![Page 25: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/25.jpg)
SSIIM, 2015/09/22 25
Community detection algorithms
• Clauset-Newman-Moore• Wakita-Tsurumi• Girvan-Newman• Chinese whispers• Link communities• etc
![Page 26: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/26.jpg)
SSIIM, 2015/09/22 26
Modularity
• Compares number of edges with number of edges of a random network
• Maximize Q is NP-hard
jg,igij ijPijAm21Q
m2jkik
ijP
![Page 27: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/27.jpg)
SSIIM, 2015/09/22 27
Clauset-Newman-Moore
A hierarchical agglomeration algorithm for detecting community structure which is faster than many competing algorithms.Its running time on a network with n vertices and m edges is O(md log n) where d is the depth of the dendrogram describing the community structure.
![Page 28: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/28.jpg)
SSIIM, 2015/09/22 28
![Page 29: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/29.jpg)
SSIIM, 2015/09/22 29
Wakita-Tsurumi
CNM algorithm does not scale well and its use is practically limited to networks whose sizes are up to 500,000 nodes. A simple heuristics that attempts to merge community structures in a balanced manner can dramatically improve community structure analysis.
![Page 30: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/30.jpg)
SSIIM, 2015/09/22 30
![Page 31: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/31.jpg)
SSIIM, 2015/09/22 31
Girvan-Newman
A property that is found in many networks, the property of community structure, in which network nodes are joined together in tightly knit groups, between which there are only looser connections.We propose a method for detecting such communities, built around the idea of using centrality indices to find community boundaries.
![Page 32: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/32.jpg)
SSIIM, 2015/09/22 32
![Page 33: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/33.jpg)
SSIIM, 2015/09/22 33
Chinese whispers [Biemann]
• a
Randomized graph-clustering algorithm, which is time-linear in the number of edges.It can be viewed as a simulation of an agent-based social network.
![Page 34: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/34.jpg)
SSIIM, 2015/09/22 34
Link communities [Ahn et al]
Communities in networks often overlap such that nodes simultaneously belong to several groups. Meanwhile, many networks are known to possess hierarchical organization, where communities are recursively grouped into a hierarchical structure.
![Page 35: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/35.jpg)
SSIIM, 2015/09/22 35
Dynamics
• Networks have a temporal dimension• Interactions – follow, like, share, mention,
retweet, hashtag, etc – occur in sequence• Network properties evolve in time
![Page 36: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/36.jpg)
SSIIM, 2015/09/22 36
Impact of bots
• The use of bots is increasing • In Twitter, one in 20 active accounts are fake• In Facebook, one in 100 active accounts is
estimated to be fake• Better auditing algorithms are needed
![Page 37: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/37.jpg)
SSIIM, 2015/09/22 37
![Page 38: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/38.jpg)
SSIIM, 2015/09/22 38
![Page 39: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/39.jpg)
SSIIM, 2015/09/22 39
Controversies
![Page 40: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/40.jpg)
SSIIM, 2015/09/22 40
Software Tools
• NodeXL• Gephi• NetworkX• Meerkat• netvizz• d3.js• API
![Page 41: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/41.jpg)
SSIIM, 2015/09/22 41
![Page 42: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/42.jpg)
SSIIM, 2015/09/22 42
![Page 43: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/43.jpg)
SSIIM, 2015/09/22 43
![Page 44: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/44.jpg)
SSIIM, 2015/09/22 44
![Page 45: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/45.jpg)
SSIIM, 2015/09/22 45
Datasets
I keep my collection herehttps://sites.google.com/site/frestivo/networked-life/databases
There is another in QuoraWhere can I find large datasets open to the public?
My collection of papers: http://tinyurl.com/qzjp6rg
![Page 46: Communities and dynamics in social networks](https://reader036.fdocuments.in/reader036/viewer/2022062522/587cc3631a28abfa018b4abf/html5/thumbnails/46.jpg)
SSIIM, 2015/09/22 46
Thank you!