+ Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate...
-
Upload
gervase-nash -
Category
Documents
-
view
212 -
download
0
Transcript of + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate...
![Page 1: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/1.jpg)
+
Big Data, Network AnalysisWeek 13
![Page 2: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/2.jpg)
+How is date being used
Predict Presidential Election - Nate Silver – http://adage.com/article/campaign-trail/nate-silver-s-election-predictions-a-win-big-data-york-times/238182/
Predict Pregnancy - Target – http://www.forbes.com/sites/kashmirhill/2012/02/16/how-target-figured-out-a-teen-girl-was-pregnant-before-her-father-did/
![Page 3: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/3.jpg)
+Why Networks?
Why is the role of networks in CS, Info Science, Social Science, Physics, Economics, and Biology expanding?More DataRise of the Web and Social MediaShared vocabulary between (very
different fields)
![Page 4: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/4.jpg)
+Reasoning about Networks
How do we reason about networks? Empirical: Look at large networks and see what we find Mathematical Models: probabilistic, graph theory Algorithms for analyzing graphs
What do we hope to achieve from the networks? Patterns and statistical properties of network data Design principles and models Understand why networks are organized the way they are
(predict behaviors or networked systems)
![Page 5: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/5.jpg)
+Why networks?
Network data is increasingly available:Large on-line computing applications
where data can naturally be represented as a network Online communities: Facebook Communications: Instant
MessengerNews and Social Media: Blogging
Also in systems biology, health, medicine, …
![Page 6: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/6.jpg)
+Networks: Rich Data
a – Internetb – Citation networkc – World Wide Web
d – sexual networke – dating network
![Page 7: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/7.jpg)
+Networks Information networks:
World Wide Web: hyperlinks
Citation Blog
Social networks: Organizational Communication Collaboration Sexual Collaboration
Technological networks: Power grid Airline, road, river Telephone Internet Autonomous systems
![Page 8: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/8.jpg)
+What is Social Network Analysis?
Network analysis is the study of social relations among a set of actors. It is a field of study, not just a method.
“Social network analysis involves theorizing, model building and empirical research focused on uncovering the patterning of links among actors. It is concerned also with uncovering the antecedents and consequences of recurrent patterns.” (Linton Freeman)
![Page 9: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/9.jpg)
+The Network Perspective
People(nodes)
Ties (edges)
![Page 10: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/10.jpg)
+Ties in a social network
Directed or undirected
Simplex or multiplex
Valued or unvalued7
![Page 11: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/11.jpg)
+ What is a Social Network?
A set of dyadic ties, all of the same type, among a set of actorsActors can be persons, organizations,
groupsA tie is an instance of a specific social
relationship
11
![Page 12: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/12.jpg)
+ Network Relations
Among Individuals Kinship Role-based (friend of) Cognitive/Perceptual (knows, aware of) Affiliations Affective (likes, trusts) Communication
Among Organizations Buy from / Sell to Owns shares of Joint ventures
12
![Page 13: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/13.jpg)
+Key Perspectives in Social Network Analysis
Focus on relationships between actors rather than just the attributes of actors.
Interdependent view rather than atomistic (individualist) view of social processes and effects.
Social structure affects substantive outcomes
(which is a philosophical departure from other traditions)
13
![Page 14: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/14.jpg)
+Interdisciplinary Field of Study
Computer Science Designing and understanding complex network
structures
Mathematics, Physics Methods, complex systems analysis
Social Science (Sociology, Social Psychology, Economics) Theories and measurement of social networks,
using networks to understand human behavior
14
![Page 15: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/15.jpg)
+Multiple Levels of Analysis
Individual Level How does individual position in a network
affect various outcomes for the individual?
Systems Level How does the network structure as a whole
affect outcomes for various tasks?
15
![Page 16: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/16.jpg)
+ Network Data Collection
Common Types: Survey Interviews Affiliation/
membership records Behavioral (e.g.,
observation of communication patterns)
Experiments
16
Data obtained through manyeyes and graphed: http://www.esv.org/blog/2007/01/mapping.nt.social.networks
![Page 17: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/17.jpg)
+ Types of Network Data
One mode Two mode
Whole network Egocentric
17
A B
C
A B
School A
![Page 18: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/18.jpg)
+Non-directed versus Directed Graphs
18
A B
C
A B
C
![Page 19: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/19.jpg)
Analyzing Social Networks
A B C D
A - 1 1 1
B 1 - 1 0
C 1 1 - 1
D 1 0 1 -
19
A
DB
C
Simple Adjacency Matrix
![Page 20: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/20.jpg)
+Some Key Principles in Social NetworksDegree
The degree to which actors are connected directly to each other by cohesive bonds
Density The proportion of direct ties in a network relative
to the total number possible
Centrality a group of metrics that aim to quantify the
"importance" or "influence" (in a variety of senses) of a particular node (or group) within a network
20
![Page 21: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/21.jpg)
+ Degree in Social Networks
21
![Page 22: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/22.jpg)
+Density in Social Networks
22
Low Density High Density / Integrated
“Radial” (Valente)
![Page 23: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/23.jpg)
+ Centrality in Social Networks
Degree Centrality
Closeness Centrality
Betweeness Centrality
23
![Page 24: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/24.jpg)
+ Why all of this sudden interest?
The strength of the “Strength of Weak Ties” argument. Granovetter (1973)
Argues that ‘weaker’ peripheral ties build heterogeneous networks, which in turn provide access to new and useful information.
Heterogeneity through weak-ties widely accepted as a “good thing” for communication Access to jobs Access to other opportunities Helps distribute ideas, innovations
24
![Page 25: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/25.jpg)
+Ted Talk
The hidden influence of social networks http://youtu.be/2U-tOghblfE
![Page 26: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/26.jpg)
+Social Networks
http://www.youtube.com/watch?v=5etSid8G6EU
http://www.youtube.com/watch?v=PThAriHjk10&playnext=1&list=PL05CC28C66163B00D&feature=results_main
![Page 27: + Big Data, Network Analysis Week 13. + How is date being used Predict Presidential Election - Nate Silver –](https://reader034.fdocuments.in/reader034/viewer/2022051821/5697bfc21a28abf838ca4d89/html5/thumbnails/27.jpg)
+Slides adapted from:
Jure Leskovec, Stanford CS224W: Social and Information Network Analysis ure Leskovec, Stanford CS224W: Social and Information Network Analysis
http://bit.ly/Y7fALp