Beyond Big Data - AT&T Labs - Statistics...

149
Beyond Big Data Matthew J. Salganik Department of Sociology Princeton University AT&T Research Seminar December 11, 2016

Transcript of Beyond Big Data - AT&T Labs - Statistics...

Page 1: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Beyond Big Data

Matthew J. SalganikDepartment of Sociology

Princeton University

AT&T Research SeminarDecember 11, 2016

Page 2: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Bit by Bit:Social Research in the Digital Age

Social Scientists ←→ Data Scientists

Page 3: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Isn’t computational social science a fad?

No

Page 4: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Isn’t computational social science a fad?

No

Page 5: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

https://commons.wikimedia.org/wiki/File:Gartner_Hype_Cycle.svg

Page 6: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Social Scientists ←→ Data Scientists

Page 7: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

+Readymades Custommades

https://commons.wikimedia.org/wiki/File:Duchamp_Fountaine.jpghttps://commons.wikimedia.org/wiki/File:%27David%27_by_Michelangelo_JBU0001.JPG

Page 8: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

+Readymades Custommades

https://commons.wikimedia.org/wiki/File:Duchamp_Fountaine.jpghttps://commons.wikimedia.org/wiki/File:%27David%27_by_Michelangelo_JBU0001.JPG

Page 9: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

+

Readymades Custommades

https://commons.wikimedia.org/wiki/File:Duchamp_Fountaine.jpghttps://commons.wikimedia.org/wiki/File:%27David%27_by_Michelangelo_JBU0001.JPG

Page 10: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

+Readymades Custommades

https://commons.wikimedia.org/wiki/File:Duchamp_Fountaine.jpghttps://commons.wikimedia.org/wiki/File:%27David%27_by_Michelangelo_JBU0001.JPG

Page 11: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Key abstraction is research design

Page 12: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Four main research designs:

I Observing behavior

I Asking questions

I Running experiments

I Creating mass collaboration

Page 13: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Four main research designs:

I Observing behavior

I Asking questions

I Running experiments

I Creating mass collaboration

Page 14: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Four main research designs:

I Observing behavior

I Asking questions

I Running experiments

I Creating mass collaboration

Page 15: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Four main research designs:

I Observing behavior

I Asking questions

I Running experiments

I Creating mass collaboration

Page 16: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Four main research designs:

I Observing behavior

I Asking questions

I Running experiments

I Creating mass collaboration

Page 17: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Four main research designs:

I Observing behavior

I Asking questions

I Running experiments

I Creating mass collaboration

Page 18: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Four main research designs:

I Observing behavior

I Asking questions

I Running experiments

I Creating mass collaboration

Page 19: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Why should I care about surveys?

Page 20: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Why should I care about surveys

in the age of big data?

Page 21: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 22: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 23: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 24: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 25: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 26: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 27: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 28: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 29: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

I 10 times faster

I 50 times cheaper

Page 30: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

I 10 times faster

I 50 times cheaper

Page 31: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Four main research designs:

I Observing behavior

I Asking questions

I Running experiments

I Creating mass collaboration

Page 32: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Four main research designs:

I Observing behavior

I Asking questions

I Running experiments

I Creating mass collaboration

Page 33: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Research Article

The Constructive, Destructive,and Reconstructive Power ofSocial NormsP. Wesley Schultz,1 Jessica M. Nolan,2 Robert B. Cialdini,3 Noah J. Goldstein,3 and Vladas Griskevicius3

1California State University, San Marcos; 2University of Arkansas; and 3Arizona State University

ABSTRACT—Despite a long tradition of effectiveness inlaboratory tests, normative messages have had mixedsuccess in changing behavior in field contexts, with somestudies showing boomerang effects. To test a theoreticalaccount of this inconsistency, we conducted a field exper-iment in which normative messages were used to promotehousehold energy conservation. As predicted, a descriptivenormative message detailing average neighborhood usageproduced either desirable energy savings or the undesir-able boomerang effect, depending on whether householdswere already consuming at a low or high rate. Also aspredicted, adding an injunctive message (conveying socialapproval or disapproval) eliminated the boomerangeffect. The results offer an explanation for the mixedsuccess of persuasive appeals based on social norms andsuggest how such appeals should be properly crafted.

After several decades of controversy over the role of norms in

predicting behavior, the research has clearly established thatsocial norms not only spur but also guide action in direct and

meaningful ways (Aarts & Dijksterhuis, 2003; Cialdini,Kallgren, & Reno, 1991; Darley & Latane, 1970; Goldstein,Cialdini, & Griskevicius, 2006; Kerr, 1995; Terry & Hogg,

2001). Given this asserted power of social norms, during the pastdecade there has been a surge of programs that have delivered

normative information as a primary tool for changing sociallysignificant behaviors, such as alcohol consumption, drug use,

disordered eating, gambling, littering, and recycling (e.g.,Donaldson, Graham, & Hansen, 1994; Larimer & Neighbors,2003;Neighbors, Larimer,&Lewis, 2004; Schultz, 1999; Schultz,

Tabanico, & Rendon, in press). Such social-norms marketingcampaigns have emerged as an alternative to more traditional

approaches (e.g., information campaigns, moral exhortation, fear-inducing messages) designed to reduce undesirable conduct

(Donaldson, Graham, Piccinin, & Hansen, 1995).The rationale for the social-norms marketing approach is

based on two consistent findings: (a) The majority of individuals

overestimate the prevalence of many undesirable behaviors,such as alcohol use among peers (e.g., Borsari & Carey, 2003;

Prentice & Miller, 1993), and (b) individuals use their percep-tions of peer norms as a standard against which to compare theirown behaviors (e.g., Baer, Stacy, & Larimer, 1991; Clapp &

McDonell, 2000; Perkins & Berkowitz, 1986). Social-normsmarketing campaigns seek to reduce the occurrence of delete-

rious behaviors by correcting targets’ misperceptions regardingthe behaviors’ prevalence. The perception of prevalence is

commonly referred to as the descriptive norm governing a be-havior (Cialdini et al., 1991).Social-norms marketing campaigns have been deemed so full

of promise that nearly half of 746 U.S. colleges and universitiessurveyed by the Harvard School of Public Health in 2002 had

adopted them in some form to combat collegiate binge drinking(Wechsler et al., 2003). However, despite the widespread

adoption of social-norms marketing campaigns, evidence for thesuccess of such programs has been surprisinglymixed. Althoughmany studies appear to confirm the effectiveness of the social

marketing approach (e.g., Agostinelli, Brown, & Miller, 1995;Haines & Spear, 1996; Neighbors et al., 2004), other studies

have failed to produce substantial changes in behavior (e.g.,Clapp, Lange, Russell, Shillington, & Voas, 2003; Granfield,2005; Peeler, Far, Miller, & Brigham, 2000; Russell, Clapp, &

DeJong, 2005;Werch et al., 2000). In fact, some studies indicatethat social-norms marketing campaigns have actually increased

the undesirable behaviors and misperceptions they set out todecrease (e.g., Perkins, Haines, & Rice, 2005; Wechsler et al.,

2003; Werch et al., 2000).

Address correspondence to Wesley Schultz, Department of Psy-chology, California State University, San Marcos, CA 92078, e-mail:[email protected].

PSYCHOLOGICAL SCIENCE

Volume 18—Number 5 429Copyright r 2007 Association for Psychological Science at PRINCETON UNIV LIBRARY on March 30, 2016pss.sagepub.comDownloaded from

Page 34: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Figures from Allcott (2011)

Page 35: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 36: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 37: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Figures from Allcott (2011)

Page 38: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Figures from Allcott (2011)

Page 39: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 40: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 41: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Allcott (2015) “Site selection bias in program evaluation” QuarterlyJournal of Economics.

Page 42: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 43: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 44: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Four main research designs:

I Observing behavior

I Asking questions

I Running experiments

I Creating mass collaboration

Page 45: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Four main research designs:

I Observing behavior

I Asking questions

I Running experiments

I Creating mass collaboration

Page 46: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 47: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

http://dx.doi.org/10.1038/35057062

Page 48: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

!"#$%&'(

!"#$%& ' ()* +,- ' ./ 0&1%$"%2 3,,. ' 44456789:;5<=> )*+

!"#$%" &"'("#)*#+ ,"#-."/ !"#$%&' #( )*'&* )+ %)%,- .&()/#0$&12&(0& 0)(%*#32%&'4 5#%6 , 7,*%#,- -#$% )+ 7&*$)((&-8 9 +2-- -#$% )+0)(%*#32%)*$ ,% &,06 0&(%*& #$ ,:,#-,3-& ,$ ;277-&/&(%,*<=(+)*/,%#)(8>

01*-"1"23 4#/-*-(-" 5$. 6*$%"3*)27 8"/"2.)19 ,"#-". 5$. !"#$%"8"/"2.)1: ?*#0 ;8 ",('&*@?4 ",2*&( A8 "#(%)(@4 B*20& B#**&(@?4C6,' D2$3,2/@?4 A#06,&- C8 E)'<@?4 F&((#+&* B,-'5#(@4G&*# H&:)(@4 G&( H&5,*@4 A#06,&- H)<-&@4 I#--#,/ J#%KL2.6@?4M)&- J2(N&@4 H#,(& O,.&@4 G,%*#(, L,**#$@4 9('*&5 L&,+)*'@4F)6( L)5-,('@4 "#$, G,((@4 F&$$#0, "&6)0KN<@4 M)$#& "&P#(&@4Q,2- A0?5,(@4 G&:#( A0G&*(,(@4 F,/&$A&-'*#/@4 F#-- Q8 A&$#*):@?4C6&* A#*,(',@4 I#--#,/ A)**#$@4 F&*)/& D,<-)*@4C6*#$%#(, M,</)('@4 A,*N M)$&%%#@4 M,-76 ;,(%)$@49('*&5 ;6&*#',(@4 C,**#& ;)2.(&K@4 D#0)-& ;%,(.&RS6)/,((@4D#N)-, ;%)T,():#0@4 9*,:#(' ;23*,/,(#,(@

U H2'-&< I</,(@

;1" &2#+". ,"#-.": F,(& M).&*$V4 F)6( ;2-$%)(V?4M,06,&- 9#($0)2.6V4 ;%&76,( B&0NV4 H,:#' B&(%-&<V4 F)6( B2*%)(V4C6*#$%)76&* C-&&V4 D#.&- C,*%&*V4 9-,( C)2-$)(V4M&3&00, H&,'/,(V4 Q,()$ H&-)2N,$V4 9('*&5 H2(6,/V4=,( H2(6,/V4 M#06,*' H2*3#(V?4 "#$, J*&(06V4 H,**&( O*,+6,/V4;#/)( O*&.)*<V4 S#/ L233,*'V?4 ;&,( L2/76*,<V4 9'*#&((& L2(%V4A,%%6&5 F)(&$V4 C6*#$%#(& "-)<'V4 9/,(', A0A2**,<V4"20< A,%%6&5$V4 ;#/)( A&*0&*V4 ;,*,6 A#-(&V4 F,/&$ C8 A2--#N#(V?49('*&5 A2(.,--V4 M)3&*% Q-2/3V4 A,*N M)$$V4 M,%(, ;6)5(N&&(V

U ;,*,6 ;#/$V

02/1*#+-$# <#*="./*-> !"#$%" &"'("#)*#+ ,"#-".:M)3&*% L8 I,%&*$%)(W?4 M#06,*' G8 I#-$)(W4 ",H&,(, I8 L#--#&*W?4F)6( H8 A0Q6&*$)(W4 A,*0) 98 A,**,W4 ?-,#(& M8 A,*'#$W4"20#(', 98 J2-%)(W4 9$#+ S8 C6#(5,--,W?4 G</3&*-#& L8 Q&7#(W4I,**&( M8 O#$6W4 ;%&76,(#& "8 C6#$$)&W4 A#06,&- C8 I&('-W4G#/ H8 H&-&6,2(%<W4 S*,0#& "8 A#(&*W4 9('*&5 H&-&6,2(%<W4F,$)( B8 G*,/&*W4 "#$, "8 C))NW4 M)3&*% ;8 J2-%)(W4H)2.-,$ "8 F)6($)(W4 Q,%*#0N F8 A#(XW U ;,('*, I8 C-#+%)(W

<& ?@A B$*#- !"#$%" 4#/-*-(-": S*&:)* L,5N#($Y4?-3&*% B*,($0)/3Y4 Q,2- Q*&'N#Y4 Q,2- M#06,*'$)(Y4;,*,6 I&((#(.Y4 S)/ ;-&K,NY4 D)*/,( H)..&%%Y4 F,(RJ,(. C6&(.Y49((& Z-$&(Y4 ;2$,( "20,$Y4 C6*#$%)76&* ?-N#(Y4?'5,*' [3&*3,06&*Y U A,*:#( J*,K#&*Y

62>7$. ,$77"+" $5 C"3*)*#" D(%2# !"#$%" &"'("#)*#+ ,"#-".:M#06,*' 98 O#33$\?4 H)((, A8 A2K(<\4 ;%&:&( ?8 ;06&*&*\4F)6( B8 B)20N\?4 ?*#0, F8 ;)'&*.*&(\4 G#/ C8 I)*-&<\?4 C,%6&*#(& A8M#:&$\4 F,/&$ L8 O)**&--\4 A#06,&- "8 A&%KN&*\4;2$,( "8 D,<-)*]4 M,T2 ;8 G206&*-,7,%#^4 H,:#' "8 D&-$)(4U O&)*.& A8 I&#($%)0N_

84EAF !"#$%*) &)*"#)"/ ,"#-".: `)$6#<2N# ;,N,N#a49$,) J2T#<,/,a4 A,$,6#*, L,%%)*#a4 S&%$2$6# `,',a49%$2$6# S)<)',a4 S,N&6#N) =%)6a4 C6#6,*2 G,5,.)&a4L#'&/# I,%,(,3&a4 `,$2$6# S)%)N#a U S)'' S,<-)*a

!"#$/)$G" 2#3 ,F8& <C8HIJKJ: F&,( I&#$$&(3,06@b4M)-,(' L&#-#.@b4 I#--#,/ ;,2*#(@b4 J*,(0)#$ 9*%#.2&(,:&@b4Q6#-#77& B*)%%#&*@b4 S6)/,$ B*2-$@b4 ?*#0 Q&--&%#&*@b4C,%6&*#(& M)3&*%@b U Q,%*#0N I#(0N&*@b

!;, &"'("#)*#+ ,"#-".: H)2.-,$ M8 ;/#%6@@4"<(( H)20&%%&R;%,//@@4 A,*0 M23&(c&-'@@4 G&#%6 I&#($%)0N@@4L)(. A&# "&&@@ U F)9(( H23)#$@@

?"G2.-%"#- $5 !"#$%" L#27>/*/9 4#/-*-(-" $5 C$7")(72.

6*$-")1#$7$+>: 9('*&d M)$&(%6,-@V4 A,%%6#,$ Q-,%K&*@V4O&*,-' D<,N,%2*,@V4 ;%&+,( S,2'#&(@V U 9('*&,$ M2/7@V

6"*M*#+ !"#$%*)/ 4#/-*-(-"ND(%2# !"#$%" ,"#-".:L2,(/#(. `,(.@W4 F2( `2@W4 F#,( I,(.@W4 O2<,(. L2,(.@Y

U F2( O2@\

C(7-*%"+2O2/" &"'("#)*#+ ,"#-".9 ;1" 4#/-*-(-" 5$. &>/-"%/6*$7$+>: "&*)< L))'@]4 "&& M)5&(@]4 9(27 A,',(@] U ;6#K&( e#(@]

&-2#5$.3 !"#$%" ;")1#$7$+> ,"#-".: M)(,-' I8 H,:#$@^4D,(0< 98 J&'&*$7#&-@^4 98 Q#, 93)-,@^ U A#06,&- F8 Q*)0%)*@^

&-2#5$.3 D(%2# !"#$%" ,"#-".: M#06,*' A8 A<&*$@_4F&*&/< ;06/2%K@_4 A,*N H#0N$)(@_4 F,(& O*#/5))'@_

U H,:#' M8 C)X@_

<#*="./*-> $5 02/1*#+-$# !"#$%" ,"#-".: A,<(,*' P8 Z-$)(@a4M,T#('&* G,2-@a U C6*#$%)76&* M,</)('@a

?"G2.-%"#- $5 C$7")(72. 6*$7$+>9 E"*$ <#*="./*-> &)1$$7 $5C"3*)*#": D)32<)$6# ;6#/#K2Vb4 G,K26#N) G,5,$,N#Vb

U ;6#($&# A#()$6#/,Vb

<#*="./*-> $5 ;"P2/ &$(-1Q"/-".# C"3*)27 ,"#-". 2- ?2772/:O-&( 98 ?:,($V@@4 A,*#, 9%6,(,$#)2V@ U M).&* ;062-%KV@

<#*="./*-> $5 @R721$%2S/ L3=2#)"3 ,"#-". 5$. !"#$%";")1#$7$+>: B*20& 98 M)&VV4 J&(. C6&(VV U L2,1#( Q,(VV

C2P T72#)R 4#/-*-(-" 5$. C$7")(72. !"#"-*)/: F2-#,(& M,/$&*VW4L,($ "&6*,06VW U M#06,*' M&#(6,*'%VW

,$73 &G.*#+ D2.O$. U2O$.2-$.>9 U*-2 L##"#O".+ D2V"# !"#$%","#-".: I8 M#06,*' A0C)/3#&VY4 A&-#$$, '& -, B,$%#'&VY

U D&#-,< H&'6#,VY

!6WX!".%2# 8"/"2.)1 ,"#-." 5$. 6*$-")1#$7$+>:L&-/2% B-)f 0N&*V\4 G-,2$ L)*(#$06&*V\ U O,3*#&-& D)*'$#&NV\

?!"#$%" L#27>/*/ !.$(G Y7*/-"3 *# 27G12O"-*)27 $.3".9 27/$*#)7(3"/ *#3*=*3(27/ 7*/-"3 (#3". $-1". 1"23*#+/Z:M#06, 9.,*5,-,V]4 "8 9*,:#('V]4 F&++*&< 98 B,#-&<V^4 9-&X B,%&/,(V4;&*,c/ B,%K).-)2@4 ?5,( B#*(&<V_4 Q&&* B)*NVa4Wb4 H,(#&- O8 B*)5(@4C6*#$%)76&* B8 B2*.&W@4 ")*&(K) C&*2%%#V_4 L$#2RC62,( C6&(V]4H&,((, C62*06V]4 A#06&-& C-,/7V4 M#06,*' M8 C)7-&<Wb4S)3#,$ H)&*N$Va4Wb4 ;&,( M8 ?''<WV4 ?:,( ?8 ?#06-&*V^4S&**&(0& ;8 J2*&<WW4 F,/&$ O,-,.,(@4 F,/&$ O8 M8 O#-3&*%V4C<*2$ L,*/)(WY4 `)$6#6#'& L,<,$6#K,N#W\4 H,:#' L,2$$-&*W]4L&((#(. L&*/T,N)3V_4 G,*$%&( L)N,/7W^4 I)(6&& F,(.V]4"8 ;%&:&( F)6($)(WV4 S6)/,$ 98 F)(&$WV4 ;#/)( G,$#+W_49*&N G,$7*<KNV_4 ;0)% G&((&'<Wa4 I8 F,/&$ G&(%Yb4 Q,2- G#%%$V]4?2.&(& P8 G))(#(V]4 =,( G)*+W4 H,:#' G2-7WY4 H)*)( ",(0&%Y@4S)'' A8 ")5&YV4 9)#+& A0"<$,.6%W^4 S,*T&# A#NN&-$&(W_4F)6( P8 A)*,(YW4 D#0)-, A2-'&*V_4 P#0%)* F8 Q)--,*,@4C6*#$ Q8 Q)(%#(.YY4 O*&. ;062-&*V]4 F)f *. ;062-%KWb4 O2< ;-,%&*V_49*#,( J8 98 ;/#%Y\4 ?-#, ;%27N,V_4 F)$&76 ;K2$%,N)5N#W_4H,(#&--& S6#&**<RA#&.V]4 F&,( S6#&**<RA#&.V]4 "2N,$ I,.(&*V]4F)6( I,--#$W4 M,</)(' I6&&-&*WY4 9-,( I#--#,/$WY4 `2*# =8 I)-+V]4G&((&%6 L8 I)-+&W^4 ;6#,5RQ<(. `,(.W U M2RJ,(. `&6W@

&)*"#-*[) %2#2+"%"#-: F2-*$#27 D(%2# !"#$%" 8"/"2.)14#/-*-(-"9 <& F2-*$#27 4#/-*-(-"/ $5 D"27-1: J*,(0#$ C)--#($Y]?4A,*N ;8 O2<&*Y]4 F,(& Q&%&*$)(Y]4 9',/ J&-$&(+&-'Y]?U G*#$ 98 I&%%&*$%*,('Y]g @5[)" $5 &)*"#)"9 <& ?"G2.-%"#- $5A#".+>: 9*#$%#'&$ Q,%*#()$Y^g ;1" 0"77)$%" ;.(/-: A#06,&- F8A)*.,(Y_

© 2001 Macmillan Magazines Ltd

Page 49: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

https://doi.org/10.1103/PhysRevLett.114.191803

Page 50: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Conference for Computing in High-Energy and NuclearPhysics (CHEP03), 2003, CHEP-2003-MOLT007, arXiv:physics/0306116.

[28] L. Moneta, K. Belasco, K. S. Cranmer, A. Lazzaro, D.Piparo, G. Schott, W. Verkerke, and M. Wolf, The ROO-

STATS Project, in Proceedings of the 13th InternationalWorkshop on Advanced Computing and Analysis Tech-niques in Physics Research (ACAT2010) (SISSA, 2010),Proc. Sci., ACAT2010 (2010) 057 [arXiv:1009.1003].

[29] K. Cranmer, G. Lewis, L. Moneta, A. Shibata, and W.Verkerke (ROOT), “HISTFACTORY: A tool for creatingstatistical models for use with ROOFIT and ROOSTATS,” Tech.Rep. CERN-OPEN-2012-016, 2012 (http://cds.cern.ch/record/1456844).

[30] ATLAS Collaboration, Electron and photon energy calibra-tion with the ATLAS detector using LHC Run 1 data, Eur.Phys. J. C 74, 3071 (2014).

[31] ATLAS Collaboration, Measurement of the muonreconstruction performance of the ATLAS detector using2011 and 2012 LHC proton-proton collision data, Eur. Phys.J. C 74, 3130 (2014).

[32] CMS Collaboration, Performance of CMS muonreconstruction in pp collision events at

ffiffiffis

p¼ 7 TeV,

J. Instrum. 7, P10002 (2012).[33] CMS Collaboration, Performance of electron reconstruction

and selection with the CMS detector in proton-proton

collisions atffiffiffis

p¼ 8 TeV, arXiv:1502.02701 [J. Instrum.

(to be published)].[34] CMS Collaboration, Performance of photon reconstruction

and identification with the CMS detector in proton-protoncollisions at

ffiffiffis

p¼ 8 TeV, arXiv:1502.02702.

[35] P. D. Dauncey, M. Kenzie, N. Wardle, and G. J. Davies,Handling uncertainties in background shapes: The discreteprofiling method, J. Instrum. 10, P04015 (2015).

[36] ALEPH, DELPHI, L3, OPAL, SLD Collaborations,LEP Electroweak Working Group, and SLD Electroweakand Heavy Flavour Groups, Precision electroweak mea-surements on the Z resonance, Phys. Rep. 427, 257(2006).

[37] ATLAS Collaboration, Observation and measurement ofHiggs boson decays to WW) with the ATLAS detector,arXiv:1412.2641 [Phys. Rev. D (to be published)].

[38] ATLAS Collaboration, Evidence for the Higgs-bosonYukawa coupling to tau leptons with the ATLASdetector, J. High Energy Phys. 04 (2015) 117.

[39] CMS Collaboration, Measurement of Higgs bosonproduction and properties in the WW decay channelwith leptonic final states, J. High Energy Phys. 01 (2014)096.

[40] CMS Collaboration, Evidence for the 125 GeV Higgs bosondecaying to a pair of τ leptons, J. High Energy Phys. 05(2014) 104.

G. Aad,85,† B. Abbott,113,† J. Abdallah,151,† O. Abdinov,11,† R. Aben,107,† M. Abolins,90,† O. S. AbouZeid,158,†

H. Abramowicz,153,† H. Abreu,152,† R. Abreu,30,† Y. Abulaiti,146a,146b,† B. S. Acharya,164a,164b,b,† L. Adamczyk,38a,†

D. L. Adams,25,† J. Adelman,108,† S. Adomeit,100,† T. Adye,131,† A. A. Affolder,74,† T. Agatonovic-Jovin,13,†

J. A. Aguilar-Saavedra,126a,126f,† S. P. Ahlen,22,† F. Ahmadov,65,c,† G. Aielli,133a,133b,† H. Akerstedt,146a,146b,†

T. P. A. Åkesson,81,† G. Akimoto,155,† A. V. Akimov,96,† G. L. Alberghi,20a,20b,† J. Albert,169,† S. Albrand,55,†

M. J. Alconada Verzini,71,† M. Aleksa,30,† I. N. Aleksandrov,65,† C. Alexa,26a,† G. Alexander,153,† T. Alexopoulos,10,†

M. Alhroob,113,† G. Alimonti,91a,† L. Alio,85,† J. Alison,31,† S. P. Alkire,35,† B.M.M. Allbrooke,18,† P. P. Allport,74,†

A. Aloisio,104a,104b,† A. Alonso,36,† F. Alonso,71,† C. Alpigiani,76,† A. Altheimer,35,† B. Alvarez Gonzalez,30,†

D. Álvarez Piqueras,167,† M. G. Alviggi,104a,104b,† B. T. Amadio,15,† K. Amako,66,† Y. Amaral Coutinho,24a,† C. Amelung,23,†

D. Amidei,89,† S. P. Amor Dos Santos,126a,126c,† A. Amorim,126a,126b,† S. Amoroso,48,† N. Amram,153,† G. Amundsen,23,†

C. Anastopoulos,139,† L. S. Ancu,49,† N. Andari,30,† T. Andeen,35,† C. F. Anders,58b,† G. Anders,30,† J. K. Anders,74,†

K. J. Anderson,31,† A. Andreazza,91a,91b,† V. Andrei,58a,† S. Angelidakis,9,† I. Angelozzi,107,† P. Anger,44,† A. Angerami,35,†

F. Anghinolfi,30,† A. V. Anisenkov,109,d,† N. Anjos,12,† A. Annovi,124a,124b,† M. Antonelli,47,† A. Antonov,98,† J. Antos,144b,†

F. Anulli,132a,† M. Aoki,66,† L. Aperio Bella,18,† G. Arabidze,90,† Y. Arai,66,† J. P. Araque,126a,† A. T. H. Arce,45,†

F. A. Arduh,71,† J-F. Arguin,95,† S. Argyropoulos,42,† M. Arik,19a,† A. J. Armbruster,30,† O. Arnaez,30,† V. Arnal,82,†

H. Arnold,48,† M. Arratia,28,† O. Arslan,21,† A. Artamonov,97,† G. Artoni,23,† S. Asai,155,† N. Asbah,42,† A. Ashkenazi,153,†

B. Åsman,146a,146b,† L. Asquith,149,† K. Assamagan,25,† R. Astalos,144a,† M. Atkinson,165,† N. B. Atlay,141,† B. Auerbach,6,†

K. Augsten,128,† M. Aurousseau,145b,† G. Avolio,30,† B. Axen,15,† M. K. Ayoub,117,† G. Azuelos,95,e,† M. A. Baak,30,†

A. E. Baas,58a,† C. Bacci,134a,134b,† H. Bachacou,136,† K. Bachas,154,† M. Backes,30,† M. Backhaus,30,† E. Badescu,26a,†

P. Bagiacchi,132a,132b,† P. Bagnaia,132a,132b,† Y. Bai,33a,† T. Bain,35,† J. T. Baines,131,† O. K. Baker,176,† P. Balek,129,†

T. Balestri,148,† F. Balli,84,† E. Banas,39,† Sw. Banerjee,173,† A. A. E. Bannoura,175,† H. S. Bansil,18,† L. Barak,30,†

S. P. Baranov,96,† E. L. Barberio,88,† D. Barberis,50a,50b,† M. Barbero,85,† T. Barillari,101,† M. Barisonzi,164a,164b,†

T. Barklow,143,† N. Barlow,28,† S. L. Barnes,84,† B.M. Barnett,131,† R.M. Barnett,15,† Z. Barnovska,5,† A. Baroncelli,134a,†

G. Barone,49,† A. J. Barr,120,† F. Barreiro,82,† J. Barreiro Guimarães da Costa,57,† R. Bartoldus,143,† A. E. Barton,72,†

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-9

Page 51: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

P. Bartos,144a,† A. Bassalat,117,† A. Basye,165,† R. L. Bates,53,† S. J. Batista,158,† J. R. Batley,28,† M. Battaglia,137,†

M. Bauce,132a,132b,† F. Bauer,136,† H. S. Bawa,143,f,† J. B. Beacham,111,† M. D. Beattie,72,† T. Beau,80,† P. H. Beauchemin,161,†

R. Beccherle,124a,124b,† P. Bechtle,21,† H. P. Beck,17,g,† K. Becker,120,† M. Becker,83,† S. Becker,100,† M. Beckingham,170,†

C. Becot,117,† A. J. Beddall,19c,† A. Beddall,19c,† V. A. Bednyakov,65,† C. P. Bee,148,† L. J. Beemster,107,† T. A. Beermann,175,†

M. Begel,25,† J. K. Behr,120,† C. Belanger-Champagne,87,† W. H. Bell,49,† G. Bella,153,† L. Bellagamba,20a,† A. Bellerive,29,†

M. Bellomo,86,† K. Belotskiy,98,† O. Beltramello,30,† O. Benary,153,† D. Benchekroun,135a,† M. Bender,100,†

K. Bendtz,146a,146b,† N. Benekos,10,† Y. Benhammou,153,† E. Benhar Noccioli,49,† J. A. Benitez Garcia,159b,†

D. P. Benjamin,45,† J. R. Bensinger,23,† S. Bentvelsen,107,† L. Beresford,120,† M. Beretta,47,† D. Berge,107,†

E. Bergeaas Kuutmann,166,† N. Berger,5,† F. Berghaus,169,† J. Beringer,15,† C. Bernard,22,† N. R. Bernard,86,† C. Bernius,110,†

F. U. Bernlochner,21,† T. Berry,77,† P. Berta,129,† C. Bertella,83,† G. Bertoli,146a,146b,† F. Bertolucci,124a,124b,† C. Bertsche,113,†

D. Bertsche,113,† M. I. Besana,91a,† G. J. Besjes,106,† O. Bessidskaia Bylund,146a,146b,† M. Bessner,42,† N. Besson,136,†

C. Betancourt,48,† S. Bethke,101,† A. J. Bevan,76,† W. Bhimji,46,† R.M. Bianchi,125,† L. Bianchini,23,† M. Bianco,30,†

O. Biebel,100,† S. P. Bieniek,78,† M. Biglietti,134a,† J. Bilbao De Mendizabal,49,† H. Bilokon,47,† M. Bindi,54,† S. Binet,117,†

A. Bingul,19c,† C. Bini,132a,132b,† C.W. Black,150,† J. E. Black,143,† K.M. Black,22,† D. Blackburn,138,† R. E. Blair,6,†

J.-B. Blanchard,136,† J. E. Blanco,77,† T. Blazek,144a,† I. Bloch,42,† C. Blocker,23,† W. Blum,83,a,† U. Blumenschein,54,†

G. J. Bobbink,107,† V. S. Bobrovnikov,109,d,† S. S. Bocchetta,81,† A. Bocci,45,† C. Bock,100,† M. Boehler,48,† J. A. Bogaerts,30,†

A. G. Bogdanchikov,109,† C. Bohm,146a,† V. Boisvert,77,† T. Bold,38a,† V. Boldea,26a,† A. S. Boldyrev,99,† M. Bomben,80,†

M. Bona,76,† M. Boonekamp,136,† A. Borisov,130,† G. Borissov,72,† S. Borroni,42,† J. Bortfeldt,100,† V. Bortolotto,60a–60c,†

K. Bos,107,† D. Boscherini,20a,† M. Bosman,12,† J. Boudreau,125,† J. Bouffard,2,† E. V. Bouhova-Thacker,72,†

D. Boumediene,34,† C. Bourdarios,117,† N. Bousson,114,† A. Boveia,30,† J. Boyd,30,† I. R. Boyko,65,† I. Bozic,13,†

J. Bracinik,18,† A. Brandt,8,† G. Brandt,54,† O. Brandt,58a,† U. Bratzler,156,† B. Brau,86,† J. E. Brau,116,† H.M. Braun,175,a,†

S. F. Brazzale,164a,164c,† K. Brendlinger,122,† A. J. Brennan,88,† L. Brenner,107,† R. Brenner,166,† S. Bressler,172,†

K. Bristow,145c,† T. M. Bristow,46,† D. Britton,53,† D. Britzger,42,† F. M. Brochu,28,† I. Brock,21,† R. Brock,90,† J. Bronner,101,†

G. Brooijmans,35,† T. Brooks,77,† W. K. Brooks,32b,† J. Brosamer,15,† E. Brost,116,† J. Brown,55,†

P. A. Bruckman de Renstrom,39,† D. Bruncko,144b,† R. Bruneliere,48,† A. Bruni,20a,† G. Bruni,20a,† M. Bruschi,20a,†

L. Bryngemark,81,† T. Buanes,14,† Q. Buat,142,† P. Buchholz,141,† A. G. Buckley,53,† S. I. Buda,26a,† I. A. Budagov,65,†

F. Buehrer,48,† L. Bugge,119,† M. K. Bugge,119,† O. Bulekov,98,† D. Bullock,8,† H. Burckhart,30,† S. Burdin,74,†

B. Burghgrave,108,† S. Burke,131,† I. Burmeister,43,† E. Busato,34,† D. Büscher,48,† V. Büscher,83,† P. Bussey,53,†

C. P. Buszello,166,† J. M. Butler,22,† A. I. Butt,3,† C.M. Buttar,53,† J. M. Butterworth,78,† P. Butti,107,† W. Buttinger,25,†

A. Buzatu,53,† R. Buzykaev,109,d,† S. Cabrera Urbán,167,† D. Caforio,128,† V.M. Cairo,37a,37b,† O. Cakir,4a,† P. Calafiura,15,†

A. Calandri,136,† G. Calderini,80,† P. Calfayan,100,† L. P. Caloba,24a,† D. Calvet,34,† S. Calvet,34,† R. Camacho Toro,31,†

S. Camarda,42,† P. Camarri,133a,133b,† D. Cameron,119,† L.M. Caminada,15,† R. Caminal Armadans,12,† S. Campana,30,†

M. Campanelli,78,† A. Campoverde,148,† V. Canale,104a,104b,† A. Canepa,159a,† M. Cano Bret,76,† J. Cantero,82,†

R. Cantrill,126a,† T. Cao,40,† M. D.M. Capeans Garrido,30,† I. Caprini,26a,† M. Caprini,26a,† M. Capua,37a,37b,† R. Caputo,83,†

R. Cardarelli,133a,† T. Carli,30,†G. Carlino,104a,† L. Carminati,91a,91b,† S. Caron,106,† E. Carquin,32a,†G. D. Carrillo-Montoya,8,†

J. R. Carter,28,† J. Carvalho,126a,126c,† D. Casadei,78,† M. P. Casado,12,† M. Casolino,12,† E. Castaneda-Miranda,145b,†

A. Castelli,107,† V. Castillo Gimenez,167,† N. F. Castro,126a,h,† P. Catastini,57,† A. Catinaccio,30,† J. R. Catmore,119,†

A. Cattai,30,† J. Caudron,83,† V. Cavaliere,165,† D. Cavalli,91a,† M. Cavalli-Sforza,12,† V. Cavasinni,124a,124b,†

F. Ceradini,134a,134b,† B. C. Cerio,45,†K. Cerny,129,† A. S. Cerqueira,24b,†A. Cerri,149,† L. Cerrito,76,† F. Cerutti,15,† M. Cerv,30,†

A. Cervelli,17,† S. A. Cetin,19b,† A. Chafaq,135a,† D. Chakraborty,108,† I. Chalupkova,129,† P. Chang,165,† B. Chapleau,87,†

J. D. Chapman,28,† D. G. Charlton,18,† C. C. Chau,158,† C. A. Chavez Barajas,149,† S. Cheatham,152,† A. Chegwidden,90,†

S. Chekanov,6,† S. V. Chekulaev,159a,† G. A. Chelkov,65,i,† M. A. Chelstowska,89,† C. Chen,64,† H. Chen,25,† K. Chen,148,†

L. Chen,33d,j,† S. Chen,33c,† X. Chen,33f,† Y. Chen,67,†H. C. Cheng,89,†Y. Cheng,31,†A. Cheplakov,65,† E. Cheremushkina,130,†

R. Cherkaoui El Moursli,135e,† V. Chernyatin,25,a,† E. Cheu,7,† L. Chevalier,136,† V. Chiarella,47,† J. T. Childers,6,†

G. Chiodini,73a,† A. S. Chisholm,18,† R. T. Chislett,78,† A. Chitan,26a,† M. V. Chizhov,65,† K. Choi,61,† S. Chouridou,9,†

B. K. B. Chow,100,† V. Christodoulou,78,† D. Chromek-Burckhart,30,† M. L. Chu,151,† J. Chudoba,127,† A. J. Chuinard,87,†

J. J. Chwastowski,39,† L. Chytka,115,† G. Ciapetti,132a,132b,† A. K. Ciftci,4a,† D. Cinca,53,† V. Cindro,75,† I. A. Cioara,21,†

A. Ciocio,15,† Z. H. Citron,172,† M. Ciubancan,26a,† A. Clark,49,† B. L. Clark,57,† P. J. Clark,46,† R. N. Clarke,15,†

W. Cleland,125,† C. Clement,146a,146b,† Y. Coadou,85,† M. Cobal,164a,164c,† A. Coccaro,138,† J. Cochran,64,† L. Coffey,23,†

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-10

Page 52: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

J. G. Cogan,143,† B. Cole,35,† S. Cole,108,† A. P. Colijn,107,† J. Collot,55,† T. Colombo,58c,† G. Compostella,101,†

P. Conde Muiño,126a,126b,† E. Coniavitis,48,† S. H. Connell,145b,† I. A. Connelly,77,† S.M. Consonni,91a,91b,† V. Consorti,48,†

S. Constantinescu,26a,† C. Conta,121a,121b,† G. Conti,30,† F. Conventi,104a,k,† M. Cooke,15,† B. D. Cooper,78,†

A.M. Cooper-Sarkar,120,† T. Cornelissen,175,† M. Corradi,20a,† F. Corriveau,87,l,† A. Corso-Radu,163,† A. Cortes-Gonzalez,12,†

G. Cortiana,101,† G. Costa,91a,† M. J. Costa,167,† D. Costanzo,139,† D. Côté,8,† G. Cottin,28,† G. Cowan,77,† B. E. Cox,84,†

K. Cranmer,110,† G. Cree,29,† S. Crépé-Renaudin,55,† F. Crescioli,80,† W.A. Cribbs,146a,146b,† M. Crispin Ortuzar,120,†

M. Cristinziani,21,† V. Croft,106,† G. Crosetti,37a,37b,† T. Cuhadar Donszelmann,139,† J. Cummings,176,† M. Curatolo,47,†

C. Cuthbert,150,† H. Czirr,141,† P. Czodrowski,3,† S. D’Auria,53,† M. D’Onofrio,74,†

M. J. Da Cunha Sargedas De Sousa,126a,126b,† C. Da Via,84,† W. Dabrowski,38a,† A. Dafinca,120,† T. Dai,89,† O. Dale,14,†

F. Dallaire,95,† C. Dallapiccola,86,† M. Dam,36,† J. R. Dandoy,31,† N. P. Dang,48,† A. C. Daniells,18,† M. Danninger,168,†

M. Dano Hoffmann,136,† V. Dao,48,† G. Darbo,50a,† S. Darmora,8,† J. Dassoulas,3,† A. Dattagupta,61,† W. Davey,21,†

C. David,169,† T. Davidek,129,† E. Davies,120,m,† M. Davies,153,† P. Davison,78,† Y. Davygora,58a,† E. Dawe,88,† I. Dawson,139,†

R. K. Daya-Ishmukhametova,86,† K. De,8,† R. de Asmundis,104a,† S. De Castro,20a,20b,† S. De Cecco,80,† N. De Groot,106,†

P. de Jong,107,† H. De la Torre,82,† F. De Lorenzi,64,† L. De Nooij,107,† D. De Pedis,132a,† A. De Salvo,132a,† U. De Sanctis,149,†

A. De Santo,149,† J. B. De Vivie De Regie,117,† W. J. Dearnaley,72,† R. Debbe,25,† C. Debenedetti,137,† D. V. Dedovich,65,†

I. Deigaard,107,† J. Del Peso,82,† T. Del Prete,124a,124b,† D. Delgove,117,† F. Deliot,136,† C.M. Delitzsch,49,† M. Deliyergiyev,75,†

A. Dell’Acqua,30,† L. Dell’Asta,22,† M. Dell’Orso,124a,124b,† M. Della Pietra,104a,k,† D. della Volpe,49,† M. Delmastro,5,†

P. A. Delsart,55,† C. Deluca,107,† D. A. DeMarco,158,† S. Demers,176,† M. Demichev,65,† A. Demilly,80,† S. P. Denisov,130,†

D. Derendarz,39,† J. E. Derkaoui,135d,† F. Derue,80,† P. Dervan,74,† K. Desch,21,† C. Deterre,42,† P. O. Deviveiros,30,†

A. Dewhurst,131,† S. Dhaliwal,107,†A. Di Ciaccio,133a,133b,† L. Di Ciaccio,5,†A. Di Domenico,132a,132b,† C. Di Donato,104a,104b,†

A. Di Girolamo,30,† B. Di Girolamo,30,† A. Di Mattia,152,† B. Di Micco,134a,134b,† R. Di Nardo,47,† A. Di Simone,48,†

R. Di Sipio,158,† D. Di Valentino,29,† C. Diaconu,85,† M. Diamond,158,† F. A. Dias,46,† M. A. Diaz,32a,† E. B. Diehl,89,†

J. Dietrich,16,† S. Diglio,85,† A. Dimitrievska,13,† J. Dingfelder,21,† P. Dita,26a,† S. Dita,26a,† F. Dittus,30,† F. Djama,85,†

T. Djobava,51b,† J. I. Djuvsland,58a,† M. A. B. do Vale,24c,† D. Dobos,30,† M. Dobre,26a,† C. Doglioni,49,† T. Dohmae,155,†

J. Dolejsi,129,† Z. Dolezal,129,† B. A. Dolgoshein,98,a,† M. Donadelli,24d,† S. Donati,124a,124b,† P. Dondero,121a,121b,†

J. Donini,34,† J. Dopke,131,† A. Doria,104a,† M. T. Dova,71,† A. T. Doyle,53,† E. Drechsler,54,† M. Dris,10,† E. Dubreuil,34,†

E. Duchovni,172,† G. Duckeck,100,† O. A. Ducu,26a,85,† D. Duda,175,† A. Dudarev,30,† L. Duflot,117,† L. Duguid,77,†

M. Dührssen,30,† M. Dunford,58a,† H. Duran Yildiz,4a,† M. Düren,52,† A. Durglishvili,51b,† D. Duschinger,44,† M. Dyndal,38a,†

C. Eckardt,42,† K.M. Ecker,101,† R. C. Edgar,89,† W. Edson,2,† N. C. Edwards,46,† W. Ehrenfeld,21,† T. Eifert,30,† G. Eigen,14,†

K. Einsweiler,15,† T. Ekelof,166,† M. El Kacimi,135c,† M. Ellert,166,† S. Elles,5,† F. Ellinghaus,83,† A. A. Elliot,169,† N. Ellis,30,†

J. Elmsheuser,100,† M. Elsing,30,† D. Emeliyanov,131,† Y. Enari,155,† O. C. Endner,83,† M. Endo,118,† R. Engelmann,148,†

J. Erdmann,43,† A. Ereditato,17,† G. Ernis,175,† J. Ernst,2,† M. Ernst,25,† S. Errede,165,† E. Ertel,83,† M. Escalier,117,† H. Esch,43,†

C. Escobar,125,† B. Esposito,47,†A. I. Etienvre,136,† E. Etzion,153,†H. Evans,61,†A. Ezhilov,123,† L. Fabbri,20a,20b,†G. Facini,31,†

R.M. Fakhrutdinov,130,† S. Falciano,132a,† R. J. Falla,78,† J. Faltova,129,† Y. Fang,33a,† M. Fanti,91a,91b,† A. Farbin,8,†

A. Farilla,134a,† T. Farooque,12,† S. Farrell,15,† S. M. Farrington,170,† P. Farthouat,30,† F. Fassi,135e,† P. Fassnacht,30,†

D. Fassouliotis,9,† M. Faucci Giannelli,77,† A. Favareto,50a,50b,† L. Fayard,117,† P. Federic,144a,† O. L. Fedin,123,n,†

W. Fedorko,168,† S. Feigl,30,† L. Feligioni,85,† C. Feng,33d,† E. J. Feng,6,† H. Feng,89,† A. B. Fenyuk,130,†

P. Fernandez Martinez,167,† S. Fernandez Perez,30,† S. Ferrag,53,† J. Ferrando,53,†A. Ferrari,166,† P. Ferrari,107,† R. Ferrari,121a,†

D. E. Ferreira de Lima,53,† A. Ferrer,167,† D. Ferrere,49,† C. Ferretti,89,† A. Ferretto Parodi,50a,50b,† M. Fiascaris,31,†

F. Fiedler,83,† A. Filipčič,75,† M. Filipuzzi,42,† F. Filthaut,106,† M. Fincke-Keeler,169,† K. D. Finelli,150,†

M. C. N. Fiolhais,126a,126c,† L. Fiorini,167,† A. Firan,40,† A. Fischer,2,† C. Fischer,12,† J. Fischer,175,† W. C. Fisher,90,†

E. A. Fitzgerald,23,† M. Flechl,48,† I. Fleck,141,† P. Fleischmann,89,† S. Fleischmann,175,† G. T. Fletcher,139,† G. Fletcher,76,†

T. Flick,175,† A. Floderus,81,† L. R. Flores Castillo,60a,† M. J. Flowerdew,101,† A. Formica,136,† A. Forti,84,† D. Fournier,117,†

H. Fox,72,† S. Fracchia,12,† P. Francavilla,80,† M. Franchini,20a,20b,† D. Francis,30,† L. Franconi,119,† M. Franklin,57,†

M. Fraternali,121a,121b,† D. Freeborn,78,† S. T. French,28,† F. Friedrich,44,† D. Froidevaux,30,† J. A. Frost,120,† C. Fukunaga,156,†

E. Fullana Torregrosa,83,† B. G. Fulsom,143,† J. Fuster,167,† C. Gabaldon,55,† O. Gabizon,175,† A. Gabrielli,20a,20b,†

A. Gabrielli,132a,132b,† S. Gadatsch,107,† S. Gadomski,49,† G. Gagliardi,50a,50b,† P. Gagnon,61,† C. Galea,106,†

B. Galhardo,126a,126c,† E. J. Gallas,120,† B. J. Gallop,131,† P. Gallus,128,† G. Galster,36,† K. K. Gan,111,† J. Gao,33b,85,† Y. Gao,46,†

Y. S. Gao,143,f,† F. M. Garay Walls,46,† F. Garberson,176,† C. García,167,† J. E. García Navarro,167,† M. Garcia-Sciveres,15,†

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-11

Page 53: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

R.W. Gardner,31,† N. Garelli,143,† V. Garonne,119,† C. Gatti,47,† A. Gaudiello,50a,50b,† G. Gaudio,121a,† B. Gaur,141,†

L. Gauthier,95,† P. Gauzzi,132a,132b,† I. L. Gavrilenko,96,† C. Gay,168,† G. Gaycken,21,† E. N. Gazis,10,† P. Ge,33d,† Z. Gecse,168,†

C. N. P. Gee,131,† D. A. A. Geerts,107,† Ch. Geich-Gimbel,21,† M. P. Geisler,58a,† C. Gemme,50a,† M. H. Genest,55,†

S. Gentile,132a,132b,† M. George,54,† S. George,77,† D. Gerbaudo,163,† A. Gershon,153,† H. Ghazlane,135b,† B. Giacobbe,20a,†

S. Giagu,132a,132b,† V. Giangiobbe,12,† P. Giannetti,124a,124b,† B. Gibbard,25,† S. M. Gibson,77,† M. Gilchriese,15,†

T. P. S. Gillam,28,† D. Gillberg,30,† G. Gilles,34,† D.M. Gingrich,3,e,† N. Giokaris,9,† M. P. Giordani,164a,164c,† F. M. Giorgi,20a,†

F.M. Giorgi,16,† P. F. Giraud,136,† P. Giromini,47,† D. Giugni,91a,† C. Giuliani,48,† M. Giulini,58b,† B. K. Gjelsten,119,†

S. Gkaitatzis,154,† I. Gkialas,154,† E. L. Gkougkousis,117,† L. K. Gladilin,99,† C. Glasman,82,† J. Glatzer,30,†

P. C. F. Glaysher,46,† A. Glazov,42,† M. Goblirsch-Kolb,101,† J. R. Goddard,76,† J. Godlewski,39,† S. Goldfarb,89,†

T. Golling,49,† D. Golubkov,130,† A. Gomes,126a,126b,126d,† R. Gonçalo,126a,† J. Goncalves Pinto Firmino Da Costa,136,†

L. Gonella,21,† S. González de la Hoz,167,† G. Gonzalez Parra,12,† S. Gonzalez-Sevilla,49,† L. Goossens,30,†

P. A. Gorbounov,97,† H. A. Gordon,25,† I. Gorelov,105,† B. Gorini,30,† E. Gorini,73a,73b,† A. Gorišek,75,† E. Gornicki,39,†

A. T. Goshaw,45,† C. Gössling,43,† M. I. Gostkin,65,† D. Goujdami,135c,† A. G. Goussiou,138,† N. Govender,145b,†

H.M. X. Grabas,137,† L. Graber,54,† I. Grabowska-Bold,38a,† P. Grafström,20a,20b,† K-J. Grahn,42,† J. Gramling,49,†

E. Gramstad,119,† S. Grancagnolo,16,† V. Grassi,148,† V. Gratchev,123,† H.M. Gray,30,† E. Graziani,134a,† Z. D. Greenwood,79,o,†

K. Gregersen,78,† I. M. Gregor,42,† P. Grenier,143,† J. Griffiths,8,† A. A. Grillo,137,† K. Grimm,72,† S. Grinstein,12,p,†

Ph. Gris,34,† J.-F. Grivaz,117,† J. P. Grohs,44,† A. Grohsjean,42,† E. Gross,172,† J. Grosse-Knetter,54,† G. C. Grossi,79,†

Z. J. Grout,149,† L. Guan,33b,† J. Guenther,128,† F. Guescini,49,† D. Guest,176,† O. Gueta,153,† E. Guido,50a,50b,† T. Guillemin,117,†

S. Guindon,2,† U. Gul,53,† C. Gumpert,44,† J. Guo,33e,† S. Gupta,120,† P. Gutierrez,113,† N. G. Gutierrez Ortiz,53,†

C. Gutschow,44,† C. Guyot,136,† C. Gwenlan,120,† C. B. Gwilliam,74,† A. Haas,110,† C. Haber,15,† H. K. Hadavand,8,†

N. Haddad,135e,† P. Haefner,21,† S. Hageböck,21,† Z. Hajduk,39,† H. Hakobyan,177,† M. Haleem,42,† J. Haley,114,† D. Hall,120,†

G. Halladjian,90,† G. D. Hallewell,85,† K. Hamacher,175,† P. Hamal,115,† K. Hamano,169,† M. Hamer,54,† A. Hamilton,145a,†

G. N. Hamity,145c,† P. G. Hamnett,42,† L. Han,33b,† K. Hanagaki,118,† K. Hanawa,155,† M. Hance,15,† P. Hanke,58a,†

R. Hanna,136,† J. B. Hansen,36,† J. D. Hansen,36,† M. C. Hansen,21,† P. H. Hansen,36,† K. Hara,160,† A. S. Hard,173,†

T. Harenberg,175,† F. Hariri,117,† S. Harkusha,92,† R. D. Harrington,46,† P. F. Harrison,170,† F. Hartjes,107,† M. Hasegawa,67,†

S. Hasegawa,103,† Y. Hasegawa,140,† A. Hasib,113,† S. Hassani,136,† S. Haug,17,† R. Hauser,90,† L. Hauswald,44,†

M. Havranek,127,† C.M. Hawkes,18,† R. J. Hawkings,30,† A. D. Hawkins,81,† T. Hayashi,160,† D. Hayden,90,† C. P. Hays,120,†

J. M. Hays,76,† H. S. Hayward,74,† S. J. Haywood,131,† S. J. Head,18,† T. Heck,83,† V. Hedberg,81,† L. Heelan,8,† S. Heim,122,†

T. Heim,175,† B. Heinemann,15,† L. Heinrich,110,† J. Hejbal,127,† L. Helary,22,† S. Hellman,146a,146b,† D. Hellmich,21,†

C. Helsens,30,† J. Henderson,120,† R. C.W. Henderson,72,† Y. Heng,173,† C. Hengler,42,† A. Henrichs,176,†

A.M. Henriques Correia,30,† S. Henrot-Versille,117,† G. H. Herbert,16,† Y. Hernández Jiménez,167,† R. Herrberg-Schubert,16,†

G. Herten,48,† R. Hertenberger,100,† L. Hervas,30,† G. G. Hesketh,78,† N. P. Hessey,107,† J. W. Hetherly,40,† R. Hickling,76,†

E. Higón-Rodriguez,167,† E. Hill,169,† J. C. Hill,28,† K. H. Hiller,42,† S. J. Hillier,18,† I. Hinchliffe,15,† E. Hines,122,†

R. R. Hinman,15,† M. Hirose,157,† D. Hirschbuehl,175,† J. Hobbs,148,† N. Hod,107,† M. C. Hodgkinson,139,† P. Hodgson,139,†

A. Hoecker,30,† M. R. Hoeferkamp,105,† F. Hoenig,100,† M. Hohlfeld,83,† D. Hohn,21,† T. R. Holmes,15,† T. M. Hong,122,†

L. Hooft van Huysduynen,110,† W. H. Hopkins,116,† Y. Horii,103,† A. J. Horton,142,† J-Y. Hostachy,55,† S. Hou,151,†

A. Hoummada,135a,† J. Howard,120,† J. Howarth,42,† M. Hrabovsky,115,† I. Hristova,16,† J. Hrivnac,117,† T. Hryn’ova,5,†

A. Hrynevich,93,† C. Hsu,145c,† P. J. Hsu,151,q,† S.-C. Hsu,138,† D. Hu,35,† Q. Hu,33b,† X. Hu,89,† Y. Huang,42,† Z. Hubacek,30,†

F. Hubaut,85,† F. Huegging,21,† T. B. Huffman,120,† E.W. Hughes,35,† G. Hughes,72,† M. Huhtinen,30,† T. A. Hülsing,83,†

N. Huseynov,65,c,† J. Huston,90,† J. Huth,57,† G. Iacobucci,49,† G. Iakovidis,25,† I. Ibragimov,141,† L. Iconomidou-Fayard,117,†

E. Ideal,176,† Z. Idrissi,135e,† P. Iengo,30,† O. Igonkina,107,† T. Iizawa,171,† Y. Ikegami,66,† K. Ikematsu,141,† M. Ikeno,66,†

Y. Ilchenko,31,r,† D. Iliadis,154,† N. Ilic,143,† Y. Inamaru,67,† T. Ince,101,† P. Ioannou,9,† M. Iodice,134a,† K. Iordanidou,35,†

V. Ippolito,57,† A. Irles Quiles,167,† C. Isaksson,166,† M. Ishino,68,† M. Ishitsuka,157,† R. Ishmukhametov,111,† C. Issever,120,†

S. Istin,19a,† J. M. Iturbe Ponce,84,† R. Iuppa,133a,133b,† J. Ivarsson,81,† W. Iwanski,39,† H. Iwasaki,66,† J. M. Izen,41,†

V. Izzo,104a,† S. Jabbar,3,† B. Jackson,122,† M. Jackson,74,† P. Jackson,1,† M. R. Jaekel,30,† V. Jain,2,† K. Jakobs,48,†

S. Jakobsen,30,† T. Jakoubek,127,† J. Jakubek,128,† D. O. Jamin,151,† D. K. Jana,79,† E. Jansen,78,† R.W. Jansky,62,†

J. Janssen,21,† M. Janus,170,† G. Jarlskog,81,† N. Javadov,65,c,† T. Javůrek,48,† L. Jeanty,15,† J. Jejelava,51a,s,† G.-Y. Jeng,150,†

D. Jennens,88,† P. Jenni,48,t,† J. Jentzsch,43,† C. Jeske,170,† S. Jézéquel,5,† H. Ji,173,† J. Jia,148,† Y. Jiang,33b,† S. Jiggins,78,†

J. Jimenez Pena,167,† S. Jin,33a,† A. Jinaru,26a,† O. Jinnouchi,157,† M. D. Joergensen,36,† P. Johansson,139,† K. A. Johns,7,†

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-12

Page 54: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

K. Jon-And,146a,146b,† G. Jones,170,† R.W. L. Jones,72,† T. J. Jones,74,† J. Jongmanns,58a,† P. M. Jorge,126a,126b,† K. D. Joshi,84,†

J. Jovicevic,159a,† X. Ju,173,† C. A. Jung,43,† P. Jussel,62,† A. Juste Rozas,12,p,† M. Kaci,167,† A. Kaczmarska,39,† M. Kado,117,†

H. Kagan,111,† M. Kagan,143,† S. J. Kahn,85,† E. Kajomovitz,45,† C.W. Kalderon,120,† S. Kama,40,† A. Kamenshchikov,130,†

N. Kanaya,155,† M. Kaneda,30,† S. Kaneti,28,† V. A. Kantserov,98,† J. Kanzaki,66,† B. Kaplan,110,† A. Kapliy,31,† D. Kar,53,†

K. Karakostas,10,† A. Karamaoun,3,† N. Karastathis,10,107,† M. J. Kareem,54,† M. Karnevskiy,83,† S. N. Karpov,65,†

Z.M. Karpova,65,† K. Karthik,110,† V. Kartvelishvili,72,† A. N. Karyukhin,130,† L. Kashif,173,† R. D. Kass,111,† A. Kastanas,14,†

Y. Kataoka,155,† A. Katre,49,† J. Katzy,42,† K. Kawagoe,70,† T. Kawamoto,155,† G. Kawamura,54,† S. Kazama,155,†

V. F. Kazanin,109,d,† M. Y. Kazarinov,65,† R. Keeler,169,† R. Kehoe,40,† J. S. Keller,42,† J. J. Kempster,77,† H. Keoshkerian,84,†

O. Kepka,127,† B. P. Kerševan,75,† S. Kersten,175,† R. A. Keyes,87,† F. Khalil-zada,11,† H. Khandanyan,146a,146b,†

A. Khanov,114,† A. G. Kharlamov,109,d,† T. J. Khoo,28,† V. Khovanskiy,97,† E. Khramov,65,† J. Khubua,51b,u,† H. Y. Kim,8,†

H. Kim,146a,146b,† S. H. Kim,160,† Y. Kim,31,† N. Kimura,154,† O.M. Kind,16,† B. T. King,74,† M. King,167,† R. S. B. King,120,†

S. B. King,168,† J. Kirk,131,† A. E. Kiryunin,101,† T. Kishimoto,67,† D. Kisielewska,38a,† F. Kiss,48,† K. Kiuchi,160,†

O. Kivernyk,136,† E. Kladiva,144b,† M. H. Klein,35,† M. Klein,74,† U. Klein,74,† K. Kleinknecht,83,† P. Klimek,146a,146b,†

A. Klimentov,25,† R. Klingenberg,43,† J. A. Klinger,84,† T. Klioutchnikova,30,† E.-E. Kluge,58a,† P. Kluit,107,† S. Kluth,101,†

E. Kneringer,62,† E. B. F. G. Knoops,85,† A. Knue,53,† A. Kobayashi,155,† D. Kobayashi,157,† T. Kobayashi,155,† M. Kobel,44,†

M. Kocian,143,† P. Kodys,129,† T. Koffas,29,† E. Koffeman,107,† L. A. Kogan,120,† S. Kohlmann,175,† Z. Kohout,128,†

T. Kohriki,66,† T. Koi,143,† H. Kolanoski,16,† I. Koletsou,5,† A. A. Komar,96,a,† Y. Komori,155,† T. Kondo,66,†

N. Kondrashova,42,† K. Köneke,48,† A. C. König,106,† S. König,83,† T. Kono,66,v,† R. Konoplich,110,w,† N. Konstantinidis,78,†

R. Kopeliansky,152,† S. Koperny,38a,† L. Köpke,83,† A. K. Kopp,48,† K. Korcyl,39,† K. Kordas,154,† A. Korn,78,†

A. A. Korol,109,d,† I. Korolkov,12,† E. V. Korolkova,139,† O. Kortner,101,† S. Kortner,101,† T. Kosek,129,† V. V. Kostyukhin,21,†

V.M. Kotov,65,† A. Kotwal,45,† A. Kourkoumeli-Charalampidi,154,† C. Kourkoumelis,9,† V. Kouskoura,25,†

A. Koutsman,159a,† R. Kowalewski,169,† T. Z. Kowalski,38a,† W. Kozanecki,136,† A. S. Kozhin,130,† V. A. Kramarenko,99,†

G. Kramberger,75,† D. Krasnopevtsev,98,† A. Krasznahorkay,30,† J. K. Kraus,21,† A. Kravchenko,25,† S. Kreiss,110,†

M. Kretz,58c,† J. Kretzschmar,74,† K. Kreutzfeldt,52,† P. Krieger,158,† K. Krizka,31,† K. Kroeninger,43,† H. Kroha,101,†

J. Kroll,122,† J. Kroseberg,21,† J. Krstic,13,† U. Kruchonak,65,† H. Krüger,21,† N. Krumnack,64,† Z. V. Krumshteyn,65,†

A. Kruse,173,† M. C. Kruse,45,† M. Kruskal,22,† T. Kubota,88,† H. Kucuk,78,† S. Kuday,4b,† S. Kuehn,48,† A. Kugel,58c,†

F. Kuger,174,† A. Kuhl,137,† T. Kuhl,42,† V. Kukhtin,65,† Y. Kulchitsky,92,† S. Kuleshov,32b,† M. Kuna,132a,132b,† T. Kunigo,68,†

A. Kupco,127,† H. Kurashige,67,† Y. A. Kurochkin,92,† R. Kurumida,67,† V. Kus,127,† E. S. Kuwertz,169,† M. Kuze,157,†

J. Kvita,115,† T. Kwan,169,† D. Kyriazopoulos,139,† A. La Rosa,49,† J. L. La Rosa Navarro,24d,† L. La Rotonda,37a,37b,†

C. Lacasta,167,† F. Lacava,132a,132b,† J. Lacey,29,† H. Lacker,16,† D. Lacour,80,† V. R. Lacuesta,167,† E. Ladygin,65,† R. Lafaye,5,†

B. Laforge,80,† T. Lagouri,176,† S. Lai,48,† L. Lambourne,78,† S. Lammers,61,† C. L. Lampen,7,† W. Lampl,7,† E. Lançon,136,†

U. Landgraf,48,† M. P. J. Landon,76,† V. S. Lang,58a,† J. C. Lange,12,† A. J. Lankford,163,† F. Lanni,25,† K. Lantzsch,30,†

S. Laplace,80,† C. Lapoire,30,† J. F. Laporte,136,† T. Lari,91a,† F. Lasagni Manghi,20a,20b,† M. Lassnig,30,† P. Laurelli,47,†

W. Lavrijsen,15,† A. T. Law,137,† P. Laycock,74,† O. Le Dortz,80,† E. Le Guirriec,85,† E. Le Menedeu,12,† M. LeBlanc,169,†

T. LeCompte,6,† F. Ledroit-Guillon,55,† C. A. Lee,145b,† S. C. Lee,151,† L. Lee,1,† G. Lefebvre,80,† M. Lefebvre,169,†

F. Legger,100,† C. Leggett,15,† A. Lehan,74,† G. Lehmann Miotto,30,† X. Lei,7,† W. A. Leight,29,† A. Leisos,154,†

A. G. Leister,176,† M. A. L. Leite,24d,† R. Leitner,129,† D. Lellouch,172,† B. Lemmer,54,† K. J. C. Leney,78,† T. Lenz,21,†

B. Lenzi,30,† R. Leone,7,† S. Leone,124a,124b,† C. Leonidopoulos,46,† S. Leontsinis,10,† C. Leroy,95,† C. G. Lester,28,†

M. Levchenko,123,† J. Levêque,5,† D. Levin,89,† L. J. Levinson,172,† M. Levy,18,† A. Lewis,120,† A.M. Leyko,21,†

M. Leyton,41,† B. Li,33b,x,† H. Li,148,† H. L. Li,31,† L. Li,45,† L. Li,33e,† S. Li,45,† Y. Li,33c,y,† Z. Liang,137,† H. Liao,34,†

B. Liberti,133a,† A. Liblong,158,† P. Lichard,30,† K. Lie,165,† J. Liebal,21,† W. Liebig,14,† C. Limbach,21,† A. Limosani,150,†

S. C. Lin,151,z,† T. H. Lin,83,† F. Linde,107,† B. E. Lindquist,148,† J. T. Linnemann,90,† E. Lipeles,122,† A. Lipniacka,14,†

M. Lisovyi,58b,† T. M. Liss,165,† D. Lissauer,25,† A. Lister,168,† A.M. Litke,137,† B. Liu,151,aa,† D. Liu,151,† J. Liu,85,†

J. B. Liu,33b,† K. Liu,85,† L. Liu,165,† M. Liu,45,† M. Liu,33b,† Y. Liu,33b,† M. Livan,121a,121b,† A. Lleres,55,†

J. Llorente Merino,82,† S. L. Lloyd,76,† F. Lo Sterzo,151,† E. Lobodzinska,42,† P. Loch,7,† W. S. Lockman,137,†

F. K. Loebinger,84,† A. E. Loevschall-Jensen,36,† A. Loginov,176,† T. Lohse,16,† K. Lohwasser,42,† M. Lokajicek,127,†

B. A. Long,22,† J. D. Long,89,† R. E. Long,72,† K. A. Looper,111,† L. Lopes,126a,† D. Lopez Mateos,57,† B. Lopez Paredes,139,†

I. Lopez Paz,12,† J. Lorenz,100,† N. Lorenzo Martinez,61,† M. Losada,162,† P. Loscutoff,15,† P. J. Lösel,100,† X. Lou,33a,†

A. Lounis,117,† J. Love,6,† P. A. Love,72,† N. Lu,89,† H. J. Lubatti,138,† C. Luci,132a,132b,† A. Lucotte,55,† F. Luehring,61,†

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-13

Page 55: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

W. Lukas,62,† L. Luminari,132a,† O. Lundberg,146a,146b,† B. Lund-Jensen,147,† D. Lynn,25,† R. Lysak,127,† E. Lytken,81,†

H. Ma,25,† L. L. Ma,33d,† G. Maccarrone,47,† A. Macchiolo,101,† C.M. Macdonald,139,† J. Machado Miguens,122,126b,†

D. Macina,30,† D. Madaffari,85,† R. Madar,34,† H. J. Maddocks,72,† W. F. Mader,44,† A. Madsen,166,† S. Maeland,14,†

T. Maeno,25,† A. Maevskiy,99,† E. Magradze,54,† K. Mahboubi,48,† J. Mahlstedt,107,† C. Maiani,136,† C. Maidantchik,24a,†

A. A. Maier,101,† T. Maier,100,† A. Maio,126a,126b,126d,† S. Majewski,116,† Y. Makida,66,† N. Makovec,117,† B. Malaescu,80,†

Pa. Malecki,39,† V. P. Maleev,123,† F. Malek,55,† U. Mallik,63,† D. Malon,6,† C. Malone,143,† S. Maltezos,10,†

V.M. Malyshev,109,† S. Malyukov,30,† J. Mamuzic,42,† G. Mancini,47,† B. Mandelli,30,† L. Mandelli,91a,† I. Mandić,75,†

R. Mandrysch,63,† J. Maneira,126a,126b,† A. Manfredini,101,† L. Manhaes de Andrade Filho,24b,† J. Manjarres Ramos,159b,†

A. Mann,100,† P.M. Manning,137,† A. Manousakis-Katsikakis,9,† B. Mansoulie,136,† R. Mantifel,87,† M. Mantoani,54,†

L. Mapelli,30,† L. March,145c,†G. Marchiori,80,†M.Marcisovsky,127,† C. P. Marino,169,†M.Marjanovic,13,† F. Marroquim,24a,†

S. P. Marsden,84,† Z. Marshall,15,† L. F. Marti,17,† S. Marti-Garcia,167,† B. Martin,90,† T. A. Martin,170,† V. J. Martin,46,†

B. Martin dit Latour,14,† M. Martinez,12,p,† S. Martin-Haugh,131,† V. S. Martoiu,26a,† A. C. Martyniuk,78,† M. Marx,138,†

F. Marzano,132a,† A. Marzin,30,† L. Masetti,83,† T. Mashimo,155,† R. Mashinistov,96,† J. Masik,84,† A. L. Maslennikov,109,d,†

I. Massa,20a,20b,† L. Massa,20a,20b,† N. Massol,5,† P. Mastrandrea,148,† A. Mastroberardino,37a,37b,† T. Masubuchi,155,†

P. Mättig,175,† J. Mattmann,83,† J. Maurer,26a,† S. J. Maxfield,74,† D. A. Maximov,109,d,† R. Mazini,151,† S. M. Mazza,91a,91b,†

L. Mazzaferro,133a,133b,† G. Mc Goldrick,158,† S. P. Mc Kee,89,† A. McCarn,89,† R. L. McCarthy,148,† T. G. McCarthy,29,†

N. A. McCubbin,131,† K.W. McFarlane,56,a,† J. A. Mcfayden,78,† G. Mchedlidze,54,† S. J. McMahon,131,†

R. A. McPherson,169,l,† M. Medinnis,42,† S. Meehan,145a,† S. Mehlhase,100,† A. Mehta,74,† K. Meier,58a,† C. Meineck,100,†

B. Meirose,41,† B. R. Mellado Garcia,145c,† F. Meloni,17,† A. Mengarelli,20a,20b,† S. Menke,101,† E. Meoni,161,†

K.M. Mercurio,57,† S. Mergelmeyer,21,† P. Mermod,49,† L. Merola,104a,104b,† C. Meroni,91a,† F. S. Merritt,31,†

A. Messina,132a,132b,† J. Metcalfe,25,† A. S. Mete,163,† C. Meyer,83,† C. Meyer,122,† J-P. Meyer,136,† J. Meyer,107,†

R. P. Middleton,131,† S. Miglioranzi,164a,164c,† L. Mijović,21,† G. Mikenberg,172,† M. Mikestikova,127,† M. Mikuž,75,†

M. Milesi,88,† A. Milic,30,† D.W. Miller,31,† C. Mills,46,† A. Milov,172,† D. A. Milstead,146a,146b,† A. A. Minaenko,130,†

Y. Minami,155,† I. A. Minashvili,65,† A. I. Mincer,110,† B. Mindur,38a,† M. Mineev,65,† Y. Ming,173,† L.M. Mir,12,†

T. Mitani,171,† J. Mitrevski,100,† V. A. Mitsou,167,† A. Miucci,49,† P. S. Miyagawa,139,† J. U. Mjörnmark,81,† T. Moa,146a,146b,†

K. Mochizuki,85,† S. Mohapatra,35,† W. Mohr,48,† S. Molander,146a,146b,† R. Moles-Valls,167,† K. Mönig,42,† C. Monini,55,†

J. Monk,36,† E. Monnier,85,† J. Montejo Berlingen,12,† F. Monticelli,71,† S. Monzani,132a,132b,† R.W. Moore,3,†

N. Morange,117,† D. Moreno,162,† M. Moreno Llácer,54,† P. Morettini,50a,† M. Morgenstern,44,† M. Morii,57,†

M. Morinaga,155,† V. Morisbak,119,† S. Moritz,83,† A. K. Morley,147,† G. Mornacchi,30,† J. D. Morris,76,† S. S. Mortensen,36,†

A. Morton,53,† L. Morvaj,103,† M. Mosidze,51b,† J. Moss,111,† K. Motohashi,157,† R. Mount,143,† E. Mountricha,25,†

S. V. Mouraviev,96,a,† E. J. W. Moyse,86,† S. Muanza,85,† R. D. Mudd,18,† F. Mueller,101,† J. Mueller,125,† K. Mueller,21,†

R. S. P. Mueller,100,† T. Mueller,28,† D. Muenstermann,49,† P. Mullen,53,† Y. Munwes,153,† J. A. Murillo Quijada,18,†

W. J. Murray,170,131,† H. Musheghyan,54,† E. Musto,152,† A. G. Myagkov,130,bb,† M. Myska,128,† O. Nackenhorst,54,†

J. Nadal,54,† K. Nagai,120,† R. Nagai,157,† Y. Nagai,85,† K. Nagano,66,† A. Nagarkar,111,† Y. Nagasaka,59,† K. Nagata,160,†

M. Nagel,101,† E. Nagy,85,† A.M. Nairz,30,† Y. Nakahama,30,† K. Nakamura,66,† T. Nakamura,155,† I. Nakano,112,†

H. Namasivayam,41,† R. F. Naranjo Garcia,42,† R. Narayan,31,† T. Naumann,42,† G. Navarro,162,† R. Nayyar,7,† H. A. Neal,89,†

P.Yu. Nechaeva,96,† T. J. Neep,84,† P. D. Nef,143,† A. Negri,121a,121b,† M. Negrini,20a,† S. Nektarijevic,106,† C. Nellist,117,†

A. Nelson,163,† S. Nemecek,127,† P. Nemethy,110,† A. A. Nepomuceno,24a,† M. Nessi,30,cc,† M. S. Neubauer,165,†

M. Neumann,175,† R.M. Neves,110,† P. Nevski,25,† P. R. Newman,18,† D. H. Nguyen,6,† R. B. Nickerson,120,†

R. Nicolaidou,136,† B. Nicquevert,30,† J. Nielsen,137,† N. Nikiforou,35,† A. Nikiforov,16,† V. Nikolaenko,130,bb,†

I. Nikolic-Audit,80,† K. Nikolopoulos,18,† J. K. Nilsen,119,† P. Nilsson,25,† Y. Ninomiya,155,† A. Nisati,132a,† R. Nisius,101,†

T. Nobe,157,† M. Nomachi,118,† I. Nomidis,29,† T. Nooney,76,† S. Norberg,113,† M. Nordberg,30,† O. Novgorodova,44,†

S. Nowak,101,† M. Nozaki,66,† L. Nozka,115,† K. Ntekas,10,† G. Nunes Hanninger,88,† T. Nunnemann,100,† E. Nurse,78,†

F. Nuti,88,† B. J. O’Brien,46,† F. O’grady,7,† D. C. O’Neil,142,† V. O’Shea,53,† F. G. Oakham,29,e,† H. Oberlack,101,†

T. Obermann,21,† J. Ocariz,80,† A. Ochi,67,† I. Ochoa,78,† J. P. Ochoa-Ricoux,32a,† S. Oda,70,† S. Odaka,66,† H. Ogren,61,†

A. Oh,84,† S. H. Oh,45,† C. C. Ohm,15,† H. Ohman,166,† H. Oide,30,† W. Okamura,118,† H. Okawa,160,† Y. Okumura,31,†

T. Okuyama,155,† A. Olariu,26a,† S. A. Olivares Pino,46,† D. Oliveira Damazio,25,† E. Oliver Garcia,167,† A. Olszewski,39,†

J. Olszowska,39,† A. Onofre,126a,126e,† P. U. E. Onyisi,31,r,† C. J. Oram,159a,† M. J. Oreglia,31,† Y. Oren,153,†

D. Orestano,134a,134b,† N. Orlando,154,† C. Oropeza Barrera,53,† R. S. Orr,158,† B. Osculati,50a,50b,† R. Ospanov,84,†

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-14

Page 56: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

G. Otero y Garzon,27,† H. Otono,70,† M. Ouchrif,135d,† E. A. Ouellette,169,† F. Ould-Saada,119,† A. Ouraou,136,†

K. P. Oussoren,107,† Q. Ouyang,33a,† A. Ovcharova,15,† M. Owen,53,† R. E. Owen,18,† V. E. Ozcan,19a,† N. Ozturk,8,†

K. Pachal,142,† A. Pacheco Pages,12,† C. Padilla Aranda,12,† M. Pagáčová,48,† S. Pagan Griso,15,† E. Paganis,139,† C. Pahl,101,†

F. Paige,25,† P. Pais,86,† K. Pajchel,119,† G. Palacino,159b,† S. Palestini,30,† M. Palka,38b,† D. Pallin,34,† A. Palma,126a,126b,†

Y. B. Pan,173,† E. Panagiotopoulou,10,† C. E. Pandini,80,† J. G. Panduro Vazquez,77,† P. Pani,146a,146b,† S. Panitkin,25,†

D. Pantea,26a,† L. Paolozzi,49,† Th.D. Papadopoulou,10,† K. Papageorgiou,154,† A. Paramonov,6,† D. Paredes Hernandez,154,†

M. A. Parker,28,† K. A. Parker,139,† F. Parodi,50a,50b,† J. A. Parsons,35,† U. Parzefall,48,† E. Pasqualucci,132a,† S. Passaggio,50a,†

F. Pastore,134a,134b,a,† Fr. Pastore,77,† G. Pásztor,29,† S. Pataraia,175,† N. D. Patel,150,† J. R. Pater,84,† T. Pauly,30,† J. Pearce,169,†

B. Pearson,113,† L. E. Pedersen,36,† M. Pedersen,119,† S. Pedraza Lopez,167,† R. Pedro,126a,126b,† S. V. Peleganchuk,109,†

D. Pelikan,166,† H. Peng,33b,† B. Penning,31,† J. Penwell,61,† D. V. Perepelitsa,25,† E. Perez Codina,159a,†

M. T. Pérez García-Estañ,167,† L. Perini,91a,91b,† H. Pernegger,30,† S. Perrella,104a,104b,† R. Peschke,42,† V. D. Peshekhonov,65,†

K. Peters,30,† R. F. Y. Peters,84,† B. A. Petersen,30,† T. C. Petersen,36,† E. Petit,42,† A. Petridis,146a,146b,† C. Petridou,154,†

E. Petrolo,132a,† F. Petrucci,134a,134b,† N. E. Pettersson,157,† R. Pezoa,32b,† P.W. Phillips,131,† G. Piacquadio,143,† E. Pianori,170,†

A. Picazio,49,† E. Piccaro,76,† M. Piccinini,20a,20b,† M. A. Pickering,120,† R. Piegaia,27,† D. T. Pignotti,111,† J. E. Pilcher,31,†

A. D. Pilkington,84,† J. Pina,126a,126b,126d,† M. Pinamonti,164a,164c,dd,† J. L. Pinfold,3,† A. Pingel,36,† B. Pinto,126a,† S. Pires,80,†

M. Pitt,172,† C. Pizio,91a,91b,† L. Plazak,144a,† M.-A. Pleier,25,† V. Pleskot,129,† E. Plotnikova,65,† P. Plucinski,146a,146b,†

D. Pluth,64,† R. Poettgen,83,† L. Poggioli,117,† D. Pohl,21,† G. Polesello,121a,† A. Policicchio,37a,37b,† R. Polifka,158,†

A. Polini,20a,† C. S. Pollard,53,† V. Polychronakos,25,† K. Pommès,30,† L. Pontecorvo,132a,† B. G. Pope,90,†

G. A. Popeneciu,26b,† D. S. Popovic,13,† A. Poppleton,30,† S. Pospisil,128,† K. Potamianos,15,† I. N. Potrap,65,† C. J. Potter,149,†

C. T. Potter,116,† G. Poulard,30,† J. Poveda,30,† V. Pozdnyakov,65,† P. Pralavorio,85,† A. Pranko,15,† S. Prasad,30,† S. Prell,64,†

D. Price,84,† L. E. Price,6,† M. Primavera,73a,† S. Prince,87,† M. Proissl,46,† K. Prokofiev,60c,† F. Prokoshin,32b,†

E. Protopapadaki,136,† S. Protopopescu,25,† J. Proudfoot,6,† M. Przybycien,38a,† E. Ptacek,116,† D. Puddu,134a,134b,†

E. Pueschel,86,† D. Puldon,148,† M. Purohit,25,ee,† P. Puzo,117,† J. Qian,89,† G. Qin,53,† Y. Qin,84,† A. Quadt,54,†

D. R. Quarrie,15,† W. B. Quayle,164a,164b,† M. Queitsch-Maitland,84,† D. Quilty,53,† S. Raddum,119,† V. Radeka,25,†

V. Radescu,42,† S. K. Radhakrishnan,148,† P. Radloff,116,† P. Rados,88,† F. Ragusa,91a,91b,† G. Rahal,178,† S. Rajagopalan,25,†

M. Rammensee,30,† C. Rangel-Smith,166,† F. Rauscher,100,† S. Rave,83,† T. Ravenscroft,53,† M. Raymond,30,† A. L. Read,119,†

N. P. Readioff,74,† D.M. Rebuzzi,121a,121b,† A. Redelbach,174,† G. Redlinger,25,† R. Reece,137,† K. Reeves,41,† L. Rehnisch,16,†

H. Reisin,27,† M. Relich,163,† C. Rembser,30,† H. Ren,33a,† A. Renaud,117,† M. Rescigno,132a,† S. Resconi,91a,†

O. L. Rezanova,109,d,† P. Reznicek,129,† R. Rezvani,95,† R. Richter,101,† S. Richter,78,† E. Richter-Was,38b,† O. Ricken,21,†

M. Ridel,80,† P. Rieck,16,† C. J. Riegel,175,† J. Rieger,54,† M. Rijssenbeek,148,† A. Rimoldi,121a,121b,† L. Rinaldi,20a,†

B. Ristić,49,† E. Ritsch,62,† I. Riu,12,† F. Rizatdinova,114,† E. Rizvi,76,† S. H. Robertson,87,l,† A. Robichaud-Veronneau,87,†

D. Robinson,28,† J. E. M. Robinson,84,† A. Robson,53,† C. Roda,124a,124b,† S. Roe,30,† O. Røhne,119,† S. Rolli,161,†

A. Romaniouk,98,† M. Romano,20a,20b,† S.M. Romano Saez,34,† E. Romero Adam,167,† N. Rompotis,138,† M. Ronzani,48,†

L. Roos,80,† E. Ros,167,† S. Rosati,132a,† K. Rosbach,48,† P. Rose,137,† P. L. Rosendahl,14,† O. Rosenthal,141,†

V. Rossetti,146a,146b,† E. Rossi,104a,104b,† L. P. Rossi,50a,† R. Rosten,138,† M. Rotaru,26a,† I. Roth,172,† J. Rothberg,138,†

D. Rousseau,117,† C. R. Royon,136,† A. Rozanov,85,† Y. Rozen,152,† X. Ruan,145c,† F. Rubbo,143,† I. Rubinskiy,42,† V. I. Rud,99,†

C. Rudolph,44,†M. S. Rudolph,158,† F. Rühr,48,†A. Ruiz-Martinez,30,† Z. Rurikova,48,†N. A. Rusakovich,65,†A. Ruschke,100,†

H. L. Russell,138,† J. P. Rutherfoord,7,† N. Ruthmann,48,† Y. F. Ryabov,123,† M. Rybar,129,† G. Rybkin,117,† N. C. Ryder,120,†

A. F. Saavedra,150,† G. Sabato,107,† S. Sacerdoti,27,† A. Saddique,3,† H. F-W. Sadrozinski,137,† R. Sadykov,65,†

F. Safai Tehrani,132a,† M. Saimpert,136,† H. Sakamoto,155,† Y. Sakurai,171,† G. Salamanna,134a,134b,† A. Salamon,133a,†

M. Saleem,113,† D. Salek,107,† P. H. Sales De Bruin,138,† D. Salihagic,101,† A. Salnikov,143,† J. Salt,167,† D. Salvatore,37a,37b,†

F. Salvatore,149,† A. Salvucci,106,† A. Salzburger,30,† D. Sampsonidis,154,† A. Sanchez,104a,104b,† J. Sánchez,167,†

V. Sanchez Martinez,167,† H. Sandaker,14,† R. L. Sandbach,76,† H. G. Sander,83,† M. P. Sanders,100,† M. Sandhoff,175,†

C. Sandoval,162,† R. Sandstroem,101,† D. P. C. Sankey,131,† M. Sannino,50a,50b,† A. Sansoni,47,† C. Santoni,34,†

R. Santonico,133a,133b,† H. Santos,126a,† I. Santoyo Castillo,149,† K. Sapp,125,† A. Sapronov,65,† J. G. Saraiva,126a,126d,†

B. Sarrazin,21,† O. Sasaki,66,† Y. Sasaki,155,† K. Sato,160,† G. Sauvage,5,a,† E. Sauvan,5,† G. Savage,77,† P. Savard,158,e,†

C. Sawyer,120,† L. Sawyer,79,o,† J. Saxon,31,† C. Sbarra,20a,† A. Sbrizzi,20a,20b,† T. Scanlon,78,† D. A. Scannicchio,163,†

M. Scarcella,150,† V. Scarfone,37a,37b,† J. Schaarschmidt,172,† P. Schacht,101,† D. Schaefer,30,† R. Schaefer,42,† J. Schaeffer,83,†

S. Schaepe,21,† S. Schaetzel,58b,† U. Schäfer,83,† A. C. Schaffer,117,† D. Schaile,100,† R. D. Schamberger,148,† V. Scharf,58a,†

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-15

Page 57: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

V. A. Schegelsky,123,† D. Scheirich,129,† M. Schernau,163,† C. Schiavi,50a,50b,† C. Schillo,48,† M. Schioppa,37a,37b,†

S. Schlenker,30,† E. Schmidt,48,† K. Schmieden,30,† C. Schmitt,83,† S. Schmitt,58b,† S. Schmitt,42,† B. Schneider,159a,†

Y. J. Schnellbach,74,† U. Schnoor,44,† L. Schoeffel,136,† A. Schoening,58b,† B. D. Schoenrock,90,† E. Schopf,21,†

A. L. S. Schorlemmer,54,† M. Schott,83,† D. Schouten,159a,† J. Schovancova,8,† S. Schramm,158,† M. Schreyer,174,†

C. Schroeder,83,† N. Schuh,83,† M. J. Schultens,21,† H.-C. Schultz-Coulon,58a,† H. Schulz,16,† M. Schumacher,48,†

B. A. Schumm,137,† Ph. Schune,136,† C. Schwanenberger,84,† A. Schwartzman,143,† T. A. Schwarz,89,† Ph. Schwegler,101,†

Ph. Schwemling,136,† R. Schwienhorst,90,† J. Schwindling,136,† T. Schwindt,21,† M. Schwoerer,5,† F. G. Sciacca,17,†

E. Scifo,117,† G. Sciolla,23,† F. Scuri,124a,124b,† F. Scutti,21,† J. Searcy,89,† G. Sedov,42,† E. Sedykh,123,† P. Seema,21,†

S. C. Seidel,105,† A. Seiden,137,† F. Seifert,128,† J. M. Seixas,24a,† G. Sekhniaidze,104a,† K. Sekhon,89,† S. J. Sekula,40,†

K. E. Selbach,46,† D.M. Seliverstov,123,a,† N. Semprini-Cesari,20a,20b,† C. Serfon,30,† L. Serin,117,† L. Serkin,164a,164b,†

T. Serre,85,† M. Sessa,134a,134b,† R. Seuster,159a,† H. Severini,113,† T. Sfiligoj,75,† F. Sforza,101,† A. Sfyrla,30,† E. Shabalina,54,†

M. Shamim,116,† L. Y. Shan,33a,† R. Shang,165,† J. T. Shank,22,† M. Shapiro,15,† P. B. Shatalov,97,† K. Shaw,164a,164b,†

S. M. Shaw,84,†A. Shcherbakova,146a,146b,† C. Y. Shehu,149,† P. Sherwood,78,† L. Shi,151,ff,† S. Shimizu,67,† C. O. Shimmin,163,†

M. Shimojima,102,† M. Shiyakova,65,† A. Shmeleva,96,† D. Shoaleh Saadi,95,† M. J. Shochet,31,† S. Shojaii,91a,91b,†

S. Shrestha,111,† E. Shulga,98,† M. A. Shupe,7,† S. Shushkevich,42,† P. Sicho,127,† O. Sidiropoulou,174,† D. Sidorov,114,†

A. Sidoti,20a,20b,† F. Siegert,44,† Dj. Sijacki,13,† J. Silva,126a,126d,† Y. Silver,153,† S. B. Silverstein,146a,† V. Simak,128,†

O. Simard,5,† Lj. Simic,13,† S. Simion,117,† E. Simioni,83,† B. Simmons,78,†D. Simon,34,† R. Simoniello,91a,91b,† P. Sinervo,158,†

N. B. Sinev,116,† G. Siragusa,174,† A. N. Sisakyan,65,a,† S.Yu. Sivoklokov,99,† J. Sjölin,146a,146b,† T. B. Sjursen,14,†

M. B. Skinner,72,† H. P. Skottowe,57,† P. Skubic,113,† M. Slater,18,† T. Slavicek,128,† M. Slawinska,107,† K. Sliwa,161,†

V. Smakhtin,172,† B. H. Smart,46,† L. Smestad,14,† S.Yu. Smirnov,98,† Y. Smirnov,98,† L. N. Smirnova,99,gg,† O. Smirnova,81,†

M. N. K. Smith,35,† R.W. Smith,35,† M. Smizanska,72,† K. Smolek,128,† A. A. Snesarev,96,† G. Snidero,76,† S. Snyder,25,†

R. Sobie,169,l,† F. Socher,44,† A. Soffer,153,† D. A. Soh,151,ff,† C. A. Solans,30,† M. Solar,128,† J. Solc,128,† E.Yu. Soldatov,98,†

U. Soldevila,167,† A. A. Solodkov,130,† A. Soloshenko,65,† O. V. Solovyanov,130,† V. Solovyev,123,† P. Sommer,48,†

H. Y. Song,33b,† N. Soni,1,† A. Sood,15,† A. Sopczak,128,† B. Sopko,128,† V. Sopko,128,† V. Sorin,12,† D. Sosa,58b,†

M. Sosebee,8,† C. L. Sotiropoulou,124a,124b,† R. Soualah,164a,164c,† P. Soueid,95,† A.M. Soukharev,109,d,† D. South,42,†

B. C. Sowden,77,† S. Spagnolo,73a,73b,† M. Spalla,124a,124b,† F. Spanò,77,† W. R. Spearman,57,† F. Spettel,101,† R. Spighi,20a,†

G. Spigo,30,† L. A. Spiller,88,† M. Spousta,129,† T. Spreitzer,158,† R. D. St. Denis,53,a,† S. Staerz,44,† J. Stahlman,122,†

R. Stamen,58a,† S. Stamm,16,† E. Stanecka,39,† C. Stanescu,134a,† M. Stanescu-Bellu,42,† M.M. Stanitzki,42,† S. Stapnes,119,†

E. A. Starchenko,130,† J. Stark,55,† P. Staroba,127,† P. Starovoitov,42,† R. Staszewski,39,† P. Stavina,144a,a,† P. Steinberg,25,†

B. Stelzer,142,† H. J. Stelzer,30,† O. Stelzer-Chilton,159a,† H. Stenzel,52,† S. Stern,101,† G. A. Stewart,53,† J. A. Stillings,21,†

M. C. Stockton,87,† M. Stoebe,87,† G. Stoicea,26a,† P. Stolte,54,† S. Stonjek,101,† A. R. Stradling,8,† A. Straessner,44,†

M. E. Stramaglia,17,† J. Strandberg,147,† S. Strandberg,146a,146b,† A. Strandlie,119,† E. Strauss,143,† M. Strauss,113,†

P. Strizenec,144b,† R. Ströhmer,174,† D.M. Strom,116,† R. Stroynowski,40,† A. Strubig,106,† S. A. Stucci,17,† B. Stugu,14,†

N. A. Styles,42,† D. Su,143,† J. Su,125,† R. Subramaniam,79,† A. Succurro,12,† Y. Sugaya,118,† C. Suhr,108,† M. Suk,128,†

V. V. Sulin,96,† S. Sultansoy,4c,† T. Sumida,68,† S. Sun,57,† X. Sun,33a,† J. E. Sundermann,48,† K. Suruliz,149,†

G. Susinno,37a,37b,† M. R. Sutton,149,† S. Suzuki,66,† Y. Suzuki,66,† M. Svatos,127,† S. Swedish,168,† M. Swiatlowski,143,†

I. Sykora,144a,† T. Sykora,129,† D. Ta,90,† C. Taccini,134a,134b,† K. Tackmann,42,† J. Taenzer,158,† A. Taffard,163,† R. Tafirout,159a,†

N. Taiblum,153,† H. Takai,25,† R. Takashima,69,† H. Takeda,67,† T. Takeshita,140,† Y. Takubo,66,† M. Talby,85,†

A. A. Talyshev,109,d,† J. Y. C. Tam,174,† K. G. Tan,88,† J. Tanaka,155,† R. Tanaka,117,† S. Tanaka,66,† B. B. Tannenwald,111,†

N. Tannoury,21,† S. Tapprogge,83,† S. Tarem,152,† F. Tarrade,29,† G. F. Tartarelli,91a,† P. Tas,129,† M. Tasevsky,127,†

T. Tashiro,68,† E. Tassi,37a,37b,†A. Tavares Delgado,126a,126b,†Y. Tayalati,135d,† F. E. Taylor,94,†G. N. Taylor,88,†W. Taylor,159b,†

F. A. Teischinger,30,† M. Teixeira Dias Castanheira,76,† P. Teixeira-Dias,77,† K. K. Temming,48,† H. Ten Kate,30,†

P. K. Teng,151,† J. J. Teoh,118,† F. Tepel,175,† S. Terada,66,† K. Terashi,155,† J. Terron,82,† S. Terzo,101,† M. Testa,47,†

R. J. Teuscher,158,l,† J. Therhaag,21,† T. Theveneaux-Pelzer,34,† J. P. Thomas,18,† J. Thomas-Wilsker,77,† E. N. Thompson,35,†

P. D. Thompson,18,† R. J. Thompson,84,† A. S. Thompson,53,† L. A. Thomsen,36,† E. Thomson,122,† M. Thomson,28,†

R. P. Thun,89,a,† M. J. Tibbetts,15,† R. E. Ticse Torres,85,† V. O. Tikhomirov,96,hh,† Yu.A. Tikhonov,109,d,† S. Timoshenko,98,†

E. Tiouchichine,85,† P. Tipton,176,† S. Tisserant,85,† T. Todorov,5,a,† S. Todorova-Nova,129,† J. Tojo,70,† S. Tokár,144a,†

K. Tokushuku,66,† K. Tollefson,90,† E. Tolley,57,† L. Tomlinson,84,† M. Tomoto,103,† L. Tompkins,143,ii,† K. Toms,105,†

E. Torrence,116,† H. Torres,142,† E. Torró Pastor,167,† J. Toth,85,jj,† F. Touchard,85,† D. R. Tovey,139,† T. Trefzger,174,†

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-16

Page 58: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

L. Tremblet,30,† A. Tricoli,30,† I. M. Trigger,159a,† S. Trincaz-Duvoid,80,† M. F. Tripiana,12,† W. Trischuk,158,† B. Trocmé,55,†

C. Troncon,91a,† M. Trottier-McDonald,15,† M. Trovatelli,134a,134b,† P. True,90,† L. Truong,164a,164c,† M. Trzebinski,39,†

A. Trzupek,39,† C. Tsarouchas,30,† J.C-L. Tseng,120,† P. V. Tsiareshka,92,† D. Tsionou,154,† G. Tsipolitis,10,† N. Tsirintanis,9,†

S. Tsiskaridze,12,† V. Tsiskaridze,48,† E. G. Tskhadadze,51a,† I. I. Tsukerman,97,† V. Tsulaia,15,† S. Tsuno,66,†

D. Tsybychev,148,† A. Tudorache,26a,† V. Tudorache,26a,† A. N. Tuna,122,† S. A. Tupputi,20a,20b,† S. Turchikhin,99,gg,†

D. Turecek,128,† R. Turra,91a,91b,† A. J. Turvey,40,† P. M. Tuts,35,† A. Tykhonov,49,† M. Tylmad,146a,146b,† M. Tyndel,131,†

I. Ueda,155,† R. Ueno,29,† M. Ughetto,146a,146b,† M. Ugland,14,† M. Uhlenbrock,21,† F. Ukegawa,160,† G. Unal,30,†

A. Undrus,25,† G. Unel,163,† F. C. Ungaro,48,† Y. Unno,66,† C. Unverdorben,100,† J. Urban,144b,† P. Urquijo,88,† P. Urrejola,83,†

G. Usai,8,† A. Usanova,62,† L. Vacavant,85,† V. Vacek,128,† B. Vachon,87,† C. Valderanis,83,† N. Valencic,107,†

S. Valentinetti,20a,20b,† A. Valero,167,† L. Valery,12,† S. Valkar,129,† E. Valladolid Gallego,167,† S. Vallecorsa,49,†

J. A. Valls Ferrer,167,† W. Van Den Wollenberg,107,† P. C. Van Der Deijl,107,† R. van der Geer,107,† H. van der Graaf,107,†

R. Van Der Leeuw,107,† N. van Eldik,152,† P. van Gemmeren,6,† J. Van Nieuwkoop,142,† I. van Vulpen,107,†

M. C. van Woerden,30,† M. Vanadia,132a,132b,† W. Vandelli,30,† R. Vanguri,122,† A. Vaniachine,6,† F. Vannucci,80,†

G. Vardanyan,177,† R. Vari,132a,† E.W. Varnes,7,† T. Varol,40,† D. Varouchas,80,† A. Vartapetian,8,† K. E. Varvell,150,†

F. Vazeille,34,† T. Vazquez Schroeder,87,† J. Veatch,7,† L. M. Veloce,158,† F. Veloso,126a,126c,† T. Velz,21,† S. Veneziano,132a,†

A. Ventura,73a,73b,† D. Ventura,86,† M. Venturi,169,† N. Venturi,158,† A. Venturini,23,† V. Vercesi,121a,† M. Verducci,132a,132b,†

W. Verkerke,107,† J. C. Vermeulen,107,† A. Vest,44,† M. C. Vetterli,142,e,† O. Viazlo,81,† I. Vichou,165,† T. Vickey,139,†

O. E. Vickey Boeriu,139,† G. H. A. Viehhauser,120,† S. Viel,15,† R. Vigne,30,† M. Villa,20a,20b,† M. Villaplana Perez,91a,91b,†

E. Vilucchi,47,† M. G. Vincter,29,† V. B. Vinogradov,65,† I. Vivarelli,149,† F. Vives Vaque,3,† S. Vlachos,10,† D. Vladoiu,100,†

M. Vlasak,128,† M. Vogel,32a,† P. Vokac,128,† G. Volpi,124a,124b,† M. Volpi,88,† H. von der Schmitt,101,† H. von Radziewski,48,†

E. von Toerne,21,† V. Vorobel,129,† K. Vorobev,98,† M. Vos,167,† R. Voss,30,† J. H. Vossebeld,74,† N. Vranjes,13,†

M. Vranjes Milosavljevic,13,† V. Vrba,127,† M. Vreeswijk,107,† R. Vuillermet,30,† I. Vukotic,31,† Z. Vykydal,128,† P. Wagner,21,†

W. Wagner,175,† H. Wahlberg,71,† S. Wahrmund,44,† J. Wakabayashi,103,† J. Walder,72,† R. Walker,100,† W. Walkowiak,141,†

C. Wang,33c,† F. Wang,173,† H. Wang,15,† H. Wang,40,† J. Wang,42,† J. Wang,33a,† K. Wang,87,† R. Wang,6,† S.M. Wang,151,†

T. Wang,21,† X. Wang,176,† C. Wanotayaroj,116,† A. Warburton,87,† C. P. Ward,28,† D. R. Wardrope,78,† M. Warsinsky,48,†

A. Washbrook,46,† C. Wasicki,42,† P. M. Watkins,18,† A. T. Watson,18,† I. J. Watson,150,† M. F. Watson,18,† G. Watts,138,†

S. Watts,84,† B.M. Waugh,78,† S. Webb,84,† M. S. Weber,17,† S.W. Weber,174,† J. S. Webster,31,† A. R. Weidberg,120,†

B. Weinert,61,† J. Weingarten,54,† C. Weiser,48,† H. Weits,107,† P. S. Wells,30,† T. Wenaus,25,† T. Wengler,30,† S. Wenig,30,†

N. Wermes,21,† M. Werner,48,† P. Werner,30,† M. Wessels,58a,† J. Wetter,161,† K. Whalen,29,† A.M. Wharton,72,† A. White,8,†

M. J. White,1,† R. White,32b,† S. White,124a,124b,† D. Whiteson,163,† F. J. Wickens,131,† W. Wiedenmann,173,† M. Wielers,131,†

P. Wienemann,21,† C. Wiglesworth,36,† L. A.M. Wiik-Fuchs,21,† A. Wildauer,101,† H. G. Wilkens,30,† H. H. Williams,122,†

S. Williams,107,† C. Willis,90,† S. Willocq,86,† A. Wilson,89,† J. A. Wilson,18,† I. Wingerter-Seez,5,† F. Winklmeier,116,†

B. T. Winter,21,† M. Wittgen,143,† J. Wittkowski,100,† S. J. Wollstadt,83,† M.W. Wolter,39,† H. Wolters,126a,126c,†

B. K. Wosiek,39,† J. Wotschack,30,† M. J. Woudstra,84,† K.W. Wozniak,39,† M. Wu,55,† M. Wu,31,† S. L. Wu,173,† X. Wu,49,†

Y. Wu,89,† T. R. Wyatt,84,† B.M. Wynne,46,† S. Xella,36,† D. Xu,33a,† L. Xu,33b,kk,† B. Yabsley,150,† S. Yacoob,145b,ll,†

R. Yakabe,67,† M. Yamada,66,† Y. Yamaguchi,118,† A. Yamamoto,66,† S. Yamamoto,155,† T. Yamanaka,155,† K. Yamauchi,103,†

Y. Yamazaki,67,† Z. Yan,22,† H. Yang,33e,† H. Yang,173,† Y. Yang,151,† L. Yao,33a,† W-M. Yao,15,† Y. Yasu,66,† E. Yatsenko,5,†

K. H. Yau Wong,21,† J. Ye,40,† S. Ye,25,† I. Yeletskikh,65,† A. L. Yen,57,† E. Yildirim,42,† K. Yorita,171,† R. Yoshida,6,†

K. Yoshihara,122,† C. Young,143,† C. J. S. Young,30,† S. Youssef,22,† D. R. Yu,15,† J. Yu,8,† J. M. Yu,89,† J. Yu,114,† L. Yuan,67,†

A. Yurkewicz,108,† I. Yusuff,28,mm,† B. Zabinski,39,† R. Zaidan,63,† A.M. Zaitsev,130,bb,† J. Zalieckas,14,† A. Zaman,148,†

S. Zambito,57,† L. Zanello,132a,132b,† D. Zanzi,88,† C. Zeitnitz,175,† M. Zeman,128,† A. Zemla,38a,† K. Zengel,23,† O. Zenin,130,†

T. Ženiš,144a,† D. Zerwas,117,† D. Zhang,89,† F. Zhang,173,† J. Zhang,6,† L. Zhang,48,† R. Zhang,33b,† X. Zhang,33d,†

Z. Zhang,117,† X. Zhao,40,† Y. Zhao,33d,117,† Z. Zhao,33b,† A. Zhemchugov,65,† J. Zhong,120,† B. Zhou,89,† C. Zhou,45,†

L. Zhou,35,† L. Zhou,40,† N. Zhou,163,† C. G. Zhu,33d,† H. Zhu,33a,† J. Zhu,89,† Y. Zhu,33b,† X. Zhuang,33a,† K. Zhukov,96,†

A. Zibell,174,† D. Zieminska,61,† N. I. Zimine,65,† C. Zimmermann,83,† S. Zimmermann,48,† Z. Zinonos,54,† M. Zinser,83,†

M. Ziolkowski,141,† L. Živković,13,† G. Zobernig,173,† A. Zoccoli,20a,20b,† M. zur Nedden,16,† G. Zurzolo,104a,104b,†

L. Zwalinski,30,† V. Khachatryan,179,‡ A.M. Sirunyan,179,‡ A. Tumasyan,179,‡ W. Adam,180,‡ E. Asilar,180,‡ T. Bergauer,180,‡

J. Brandstetter,180,‡ E. Brondolin,180,‡ M. Dragicevic,180,‡ J. Erö,180,‡ M. Flechl,180,‡ M. Friedl,180,‡ R. Frühwirth,180,nn,‡

V.M. Ghete,180,‡ C. Hartl,180,‡ N. Hörmann,180,‡ J. Hrubec,180,‡ M. Jeitler,180,nn,‡ V. Knünz,180,‡ A. König,180,‡

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-17

Page 59: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

M. Krammer,180,nn,‡ I. Krätschmer,180,‡ D. Liko,180,‡ T. Matsushita,180,‡ I. Mikulec,180,‡ D. Rabady,180,oo,‡ B. Rahbaran,180,‡

H. Rohringer,180,‡ J. Schieck,180,nn,‡ R. Schöfbeck,180,‡ J. Strauss,180,‡ W. Treberer-Treberspurg,180,‡ W. Waltenberger,180,‡

C.-E. Wulz,180,nn,‡ V. Mossolov,181,‡ N. Shumeiko,181,‡ J. Suarez Gonzalez,181,‡ S. Alderweireldt,182,‡ T. Cornelis,182,‡

E. A. De Wolf,182,‡ X. Janssen,182,‡ A. Knutsson,182,‡ J. Lauwers,182,‡ S. Luyckx,182,‡ S. Ochesanu,182,‡ R. Rougny,182,‡

M. Van De Klundert,182,‡ H. Van Haevermaet,182,‡ P. Van Mechelen,182,‡ N. Van Remortel,182,‡ A. Van Spilbeeck,182,‡

S. Abu Zeid,183,‡ F. Blekman,183,‡ J. D’Hondt,183,‡ N. Daci,183,‡ I. De Bruyn,183,‡ K. Deroover,183,‡ N. Heracleous,183,‡

J. Keaveney,183,‡ S. Lowette,183,‡ L. Moreels,183,‡ A. Olbrechts,183,‡ Q. Python,183,‡ D. Strom,183,‡ S. Tavernier,183,‡

W. Van Doninck,183,‡ P. Van Mulders,183,‡ G. P. Van Onsem,183,‡ I. Van Parijs,183,‡ P. Barria,184,‡ C. Caillol,184,‡

B. Clerbaux,184,‡ G. De Lentdecker,184,‡ H. Delannoy,184,‡ D. Dobur,184,‡ G. Fasanella,184,‡ L. Favart,184,‡ A. P. R. Gay,184,‡

A. Grebenyuk,184,‡ T. Lenzi,184,‡ A. Léonard,184,‡ T. Maerschalk,184,‡ A. Mohammadi,184,‡ L. Perniè,184,‡

A. Randle-conde,184,‡ T. Reis,184,‡ T. Seva,184,‡ L. Thomas,184,‡ C. Vander Velde,184,‡ P. Vanlaer,184,‡ J. Wang,184,‡

R. Yonamine,184,‡ F. Zenoni,184,‡ F. Zhang,184,pp,‡ K. Beernaert,185,‡ L. Benucci,185,‡ A. Cimmino,185,‡ S. Crucy,185,‡

A. Fagot,185,‡ G. Garcia,185,‡ M. Gul,185,‡ J. Mccartin,185,‡ A. A. Ocampo Rios,185,‡ D. Poyraz,185,‡ D. Ryckbosch,185,‡

S. Salva Diblen,185,‡ M. Sigamani,185,‡ N. Strobbe,185,‡ M. Tytgat,185,‡ W. Van Driessche,185,‡ E. Yazgan,185,‡

N. Zaganidis,185,‡ S. Basegmez,186,‡ C. Beluffi,186,qq,‡ O. Bondu,186,‡ G. Bruno,186,‡ R. Castello,186,‡ A. Caudron,186,‡

L. Ceard,186,‡ G. G. Da Silveira,186,‡ C. Delaere,186,‡ D. Favart,186,‡ L. Forthomme,186,‡ A. Giammanco,186,rr,‡ J. Hollar,186,‡

A. Jafari,186,‡ P. Jez,186,‡ M. Komm,186,‡ V. Lemaitre,186,‡ A. Mertens,186,‡ C. Nuttens,186,‡ L. Perrini,186,‡ A. Pin,186,‡

K. Piotrzkowski,186,‡ A. Popov,186,ss,‡ L. Quertenmont,186,‡ M. Selvaggi,186,‡ M. Vidal Marono,186,‡ N. Beliy,187,‡

T. Caebergs,187,‡ G. H. Hammad,187,‡ W. L. Aldá Júnior,188,‡ G. A. Alves,188,‡ L. Brito,188,‡ M. Correa Martins Junior,188,‡

T. Dos Reis Martins,188,‡ C. Hensel,188,‡ C. Mora Herrera,188,‡ A. Moraes,188,‡ M. E. Pol,188,‡ P. Rebello Teles,188,‡

E. Belchior Batista Das Chagas,189,‡ W. Carvalho,189,‡ J. Chinellato,189,tt,‡ A. Custódio,189,‡ E. M. Da Costa,189,‡

D. De Jesus Damiao,189,‡ C. De Oliveira Martins,189,‡ S. Fonseca De Souza,189,‡ L.M. Huertas Guativa,189,‡

H. Malbouisson,189,‡ D. Matos Figueiredo,189,‡ L. Mundim,189,‡ H. Nogima,189,‡ W. L. Prado Da Silva,189,‡ A. Santoro,189,‡

A. Sznajder,189,‡ E. J. Tonelli Manganote,189,tt,‡ A. Vilela Pereira,189,‡ S. Ahuja,190a,‡ C. A. Bernardes,190b,‡

A. De Souza Santos,190b,‡ S. Dogra,190a,‡ T. R. Fernandez Perez Tomei,190a,‡ E. M. Gregores,190b,‡ P. G. Mercadante,190b,‡

C. S. Moon,190a,uu,‡ S. F. Novaes,190a,‡ Sandra S. Padula,190a,‡ D. Romero Abad,190a,‡ J. C. Ruiz Vargas,190a,‡

A. Aleksandrov,191,‡ V. Genchev,191,oo,‡ R. Hadjiiska,191,‡ P. Iaydjiev,191,‡ A. Marinov,191,‡ S. Piperov,191,‡ M. Rodozov,191,‡

S. Stoykova,191,‡ G. Sultanov,191,‡ M. Vutova,191,‡ A. Dimitrov,192,‡ I. Glushkov,192,‡ L. Litov,192,‡ B. Pavlov,192,‡

P. Petkov,192,‡ M. Ahmad,193,‡ J. G. Bian,193,‡ G.M. Chen,193,‡ H. S. Chen,193,‡ M. Chen,193,‡ T. Cheng,193,‡ R. Du,193,‡

C. H. Jiang,193,‡ R. Plestina,193,vv,‡ F. Romeo,193,‡ S.M. Shaheen,193,‡ J. Tao,193,‡ C. Wang,193,‡ Z. Wang,193,‡ H. Zhang,193,‡

C. Asawatangtrakuldee,194,‡ Y. Ban,194,‡ G. Chen,194,‡ Q. Li,194,‡ S. Liu,194,‡ Y. Mao,194,‡ S. J. Qian,194,‡ D. Wang,194,‡

M. Wang,194,‡ Q. Wang,194,‡ Z. Xu,194,‡ D. Yang,194,‡ Z. Zhang,194,‡ W. Zou,194,‡ C. Avila,195,‡ A. Cabrera,195,‡

L. F. Chaparro Sierra,195,‡ C. Florez,195,‡ J. P. Gomez,195,‡ B. Gomez Moreno,195,‡ J. C. Sanabria,195,‡ N. Godinovic,196,‡

D. Lelas,196,‡ D. Polic,196,‡ I. Puljak,196,‡ Z. Antunovic,197,‡ M. Kovac,197,‡ V. Brigljevic,198,‡ K. Kadija,198,‡ J. Luetic,198,‡

L. Sudic,198,‡ A. Attikis,199,‡ G. Mavromanolakis,199,‡ J. Mousa,199,‡ C. Nicolaou,199,‡ F. Ptochos,199,‡ P. A. Razis,199,‡

H. Rykaczewski,199,‡ M. Bodlak,200,‡ M. Finger,200,ww,‡ M. Finger Jr.,200,ww,‡ A. Ali,201,xx,yy,‡ R. Aly,201,zz,‡ S. Aly,201,zz,‡

Y. Assran,201,aaa,‡ A. Ellithi Kamel,201,bbb,‡ A. Lotfy,201,ccc,‡ M. A. Mahmoud,201,ccc,‡ R. Masod,201,xx,‡ A. Radi,201,yy,xx,‡

B. Calpas,202,‡ M. Kadastik,202,‡ M. Murumaa,202,‡ M. Raidal,202,‡ A. Tiko,202,‡ C. Veelken,202,‡ P. Eerola,203,‡

J. Pekkanen,203,‡ M. Voutilainen,203,‡ J. Härkönen,204,‡ V. Karimäki,204,‡ R. Kinnunen,204,‡ T. Lampén,204,‡

K. Lassila-Perini,204,‡ S. Lehti,204,‡ T. Lindén,204,‡ P. Luukka,204,‡ T. Mäenpää,204,‡ T. Peltola,204,‡ E. Tuominen,204,‡

J. Tuominiemi,204,‡ E. Tuovinen,204,‡ L. Wendland,204,‡ J. Talvitie,205,‡ T. Tuuva,205,‡ M. Besancon,206,‡ F. Couderc,206,‡

M. Dejardin,206,‡ D. Denegri,206,‡ B. Fabbro,206,‡ J. L. Faure,206,‡ C. Favaro,206,‡ F. Ferri,206,‡ S. Ganjour,206,‡

A. Givernaud,206,‡ P. Gras,206,‡ G. Hamel de Monchenault,206,‡ P. Jarry,206,‡ E. Locci,206,‡ M. Machet,206,‡ J. Malcles,206,‡

J. Rander,206,‡ A. Rosowsky,206,‡ M. Titov,206,‡ A. Zghiche,206,‡ S. Baffioni,207,‡ F. Beaudette,207,‡ P. Busson,207,‡

L. Cadamuro,207,‡ E. Chapon,207,‡ C. Charlot,207,‡ T. Dahms,207,‡ O. Davignon,207,‡ N. Filipovic,207,‡ A. Florent,207,‡

R. Granier de Cassagnac,207,‡ S. Lisniak,207,‡ L. Mastrolorenzo,207,‡ P. Miné,207,‡ I. N. Naranjo,207,‡ M. Nguyen,207,‡

C. Ochando,207,‡ G. Ortona,207,‡ P. Paganini,207,‡ S. Regnard,207,‡ R. Salerno,207,‡ J. B. Sauvan,207,‡ Y. Sirois,207,‡

T. Strebler,207,‡ Y. Yilmaz,207,‡ A. Zabi,207,‡ J.-L. Agram,208,ddd,‡ J. Andrea,208,‡ A. Aubin,208,‡ D. Bloch,208,‡ J.-M. Brom,208,‡

M. Buttignol,208,‡ E. C. Chabert,208,‡ N. Chanon,208,‡ C. Collard,208,‡ E. Conte,208,ddd,‡ J.-C. Fontaine,208,ddd,‡ D. Gelé,208,‡

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-18

Page 60: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

U. Goerlach,208,‡ C. Goetzmann,208,‡ A.-C. Le Bihan,208,‡ J. A. Merlin,208,oo,‡ K. Skovpen,208,‡ P. Van Hove,208,‡

S. Gadrat,209,‡ S. Beauceron,210,‡ C. Bernet,210,‡G. Boudoul,210,‡ E. Bouvier,210,‡ S. Brochet,210,‡ C. A. Carrillo Montoya,210,‡

J. Chasserat,210,‡ R. Chierici,210,‡ D. Contardo,210,‡ B. Courbon,210,‡ P. Depasse,210,‡ H. El Mamouni,210,‡ J. Fan,210,‡

J. Fay,210,‡ S. Gascon,210,‡ M. Gouzevitch,210,‡ B. Ille,210,‡ I. B. Laktineh,210,‡ M. Lethuillier,210,‡ L. Mirabito,210,‡

A. L. Pequegnot,210,‡ S. Perries,210,‡ J. D. Ruiz Alvarez,210,‡ D. Sabes,210,‡ L. Sgandurra,210,‡ V. Sordini,210,‡

M. Vander Donckt,210,‡ P. Verdier,210,‡ S. Viret,210,‡ H. Xiao,210,‡ Z. Tsamalaidze,211,ww,‡ C. Autermann,212,‡ S. Beranek,212,‡

M. Bontenackels,212,‡ M. Edelhoff,212,‡ L. Feld,212,‡ A. Heister,212,‡ M. K. Kiesel,212,‡ K. Klein,212,‡ M. Lipinski,212,‡

A. Ostapchuk,212,‡ M. Preuten,212,‡ F. Raupach,212,‡ J. Sammet,212,‡ S. Schael,212,‡ J. F. Schulte,212,‡ T. Verlage,212,‡

H. Weber,212,‡ B. Wittmer,212,‡ V. Zhukov,212,ss,‡ M. Ata,213,‡ M. Brodski,213,‡ E. Dietz-Laursonn,213,‡ D. Duchardt,213,‡

M. Endres,213,‡ M. Erdmann,213,‡ S. Erdweg,213,‡ T. Esch,213,‡ R. Fischer,213,‡ A. Güth,213,‡ T. Hebbeker,213,‡

C. Heidemann,213,‡K. Hoepfner,213,‡D. Klingebiel,213,‡ S. Knutzen,213,‡ P. Kreuzer,213,‡M.Merschmeyer,213,‡A. Meyer,213,‡

P. Millet,213,‡ M. Olschewski,213,‡ K. Padeken,213,‡ P. Papacz,213,‡ T. Pook,213,‡ M. Radziej,213,‡ H. Reithler,213,‡

M. Rieger,213,‡ F. Scheuch,213,‡ L. Sonnenschein,213,‡ D. Teyssier,213,‡ S. Thüer,213,‡ V. Cherepanov,214,‡ Y. Erdogan,214,‡

G. Flügge,214,‡ H. Geenen,214,‡ M. Geisler,214,‡ W. Haj Ahmad,214,‡ F. Hoehle,214,‡ B. Kargoll,214,‡ T. Kress,214,‡

Y. Kuessel,214,‡ A. Künsken,214,‡ J. Lingemann,214,oo,‡ A. Nehrkorn,214,‡ A. Nowack,214,‡ I. M. Nugent,214,‡ C. Pistone,214,‡

O. Pooth,214,‡ A. Stahl,214,‡ M. Aldaya Martin,215,‡ I. Asin,215,‡ N. Bartosik,215,‡ O. Behnke,215,‡ U. Behrens,215,‡

A. J. Bell,215,‡ K. Borras,215,‡ A. Burgmeier,215,‡ A. Cakir,215,‡ L. Calligaris,215,‡ A. Campbell,215,‡ S. Choudhury,215,‡

F. Costanza,215,‡ C. Diez Pardos,215,‡ G. Dolinska,215,‡ S. Dooling,215,‡ T. Dorland,215,‡ G. Eckerlin,215,‡ D. Eckstein,215,‡

T. Eichhorn,215,‡ G. Flucke,215,‡ E. Gallo,215,‡ J. Garay Garcia,215,‡ A. Geiser,215,‡ A. Gizhko,215,‡ P. Gunnellini,215,‡

J. Hauk,215,‡ M. Hempel,215,eee,‡ H. Jung,215,‡ A. Kalogeropoulos,215,‡ O. Karacheban,215,eee,‡ M. Kasemann,215,‡

P. Katsas,215,‡ J. Kieseler,215,‡ C. Kleinwort,215,‡ I. Korol,215,‡ W. Lange,215,‡ J. Leonard,215,‡ K. Lipka,215,‡ A. Lobanov,215,‡

W. Lohmann,215,eee,‡ R. Mankel,215,‡ I. Marfin,215,eee,‡ I.-A. Melzer-Pellmann,215,‡ A. B. Meyer,215,‡ G. Mittag,215,‡

J. Mnich,215,‡ A. Mussgiller,215,‡ S. Naumann-Emme,215,‡ A. Nayak,215,‡ E. Ntomari,215,‡ H. Perrey,215,‡ D. Pitzl,215,‡

R. Placakyte,215,‡ A. Raspereza,215,‡ P. M. Ribeiro Cipriano,215,‡ B. Roland,215,‡ M. Ö. Sahin,215,‡ J. Salfeld-Nebgen,215,‡

P. Saxena,215,‡ T. Schoerner-Sadenius,215,‡ M. Schröder,215,‡ C. Seitz,215,‡ S. Spannagel,215,‡ K. D. Trippkewitz,215,‡

C. Wissing,215,‡ V. Blobel,216,‡ M. Centis Vignali,216,‡ A. R. Draeger,216,‡ J. Erfle,216,‡ E. Garutti,216,‡ K. Goebel,216,‡

D. Gonzalez,216,‡ M. Görner,216,‡ J. Haller,216,‡ M. Hoffmann,216,‡ R. S. Höing,216,‡ A. Junkes,216,‡ R. Klanner,216,‡

R. Kogler,216,‡ T. Lapsien,216,‡ T. Lenz,216,‡ I. Marchesini,216,‡ D. Marconi,216,‡ D. Nowatschin,216,‡ J. Ott,216,‡

F. Pantaleo,216,oo,‡ T. Peiffer,216,‡ A. Perieanu,216,‡ N. Pietsch,216,‡ J. Poehlsen,216,‡ D. Rathjens,216,‡ C. Sander,216,‡

H. Schettler,216,‡ P. Schleper,216,‡ E. Schlieckau,216,‡ A. Schmidt,216,‡ J. Schwandt,216,‡ M. Seidel,216,‡ V. Sola,216,‡

H. Stadie,216,‡ G. Steinbrück,216,‡ H. Tholen,216,‡ D. Troendle,216,‡ E. Usai,216,‡ L. Vanelderen,216,‡ A. Vanhoefer,216,‡

M. Akbiyik,217,‡ C. Amstutz,217,‡ C. Barth,217,‡ C. Baus,217,‡ J. Berger,217,‡ C. Beskidt,217,‡ C. Böser,217,‡ E. Butz,217,‡

R. Caspart,217,‡ T. Chwalek,217,‡ F. Colombo,217,‡ W. De Boer,217,‡ A. Descroix,217,‡ A. Dierlamm,217,‡ R. Eber,217,‡

M. Feindt,217,‡ S. Fink,217,‡ M. Fischer,217,‡ F. Frensch,217,‡ B. Freund,217,‡ R. Friese,217,‡ D. Funke,217,‡ M. Giffels,217,‡

A. Gilbert,217,‡ D. Haitz,217,‡ T. Harbaum,217,‡ M. A. Harrendorf,217,‡ F. Hartmann,217,oo,‡ U. Husemann,217,‡ F. Kassel,217,oo,‡

I. Katkov,217,ss,‡ A. Kornmayer,217,oo,‡ S. Kudella,217,‡ P. Lobelle Pardo,217,‡ B. Maier,217,‡ H. Mildner,217,‡ M. U. Mozer,217,‡

T. Müller,217,‡ Th. Müller,217,‡ M. Plagge,217,‡ M. Printz,217,‡ G. Quast,217,‡ K. Rabbertz,217,‡ S. Röcker,217,‡ F. Roscher,217,‡

I. Shvetsov,217,‡ G. Sieber,217,‡ H. J. Simonis,217,‡ F. M. Stober,217,‡ R. Ulrich,217,‡ J. Wagner-Kuhr,217,‡ S. Wayand,217,‡

T. Weiler,217,‡ S. Williamson,217,‡ C. Wöhrmann,217,‡ R. Wolf,217,‡ G. Anagnostou,218,‡ G. Daskalakis,218,‡ T. Geralis,218,‡

V. A. Giakoumopoulou,218,‡ A. Kyriakis,218,‡ D. Loukas,218,‡ A. Markou,218,‡ A. Psallidas,218,‡ I. Topsis-Giotis,218,‡

A. Agapitos,219,‡ S. Kesisoglou,219,‡ A. Panagiotou,219,‡ N. Saoulidou,219,‡ E. Tziaferi,219,‡ I. Evangelou,220,‡ G. Flouris,220,‡

C. Foudas,220,‡ P. Kokkas,220,‡ N. Loukas,220,‡ N. Manthos,220,‡ I. Papadopoulos,220,‡ E. Paradas,220,‡ J. Strologas,220,‡

G. Bencze,221,‡ C. Hajdu,221,‡ A. Hazi,221,‡ P. Hidas,221,‡ D. Horvath,221,fff,‡ F. Sikler,221,‡ V. Veszpremi,221,‡

G. Vesztergombi,221,ggg,‡ A. J. Zsigmond,221,‡ N. Beni,222,‡ S. Czellar,222,‡ J. Karancsi,222,hhh,‡ J. Molnar,222,‡ Z. Szillasi,222,‡

M. Bartók,223,iii,‡ A. Makovec,223,‡ P. Raics,223,‡ Z. L. Trocsanyi,223,‡ B. Ujvari,223,‡ P. Mal,224,‡ K. Mandal,224,‡ N. Sahoo,224,‡

S. K. Swain,224,‡ S. Bansal,225,‡ S. B. Beri,225,‡ V. Bhatnagar,225,‡ R. Chawla,225,‡ R. Gupta,225,‡ U. Bhawandeep,225,‡

A. K. Kalsi,225,‡ A. Kaur,225,‡ M. Kaur,225,‡ R. Kumar,225,‡ A. Mehta,225,‡ M. Mittal,225,‡ N. Nishu,225,‡ J. B. Singh,225,‡

G. Walia,225,‡ Ashok Kumar,226,‡ Arun Kumar,226,‡ A. Bhardwaj,226,‡ B. C. Choudhary,226,‡ R. B. Garg,226,‡ A. Kumar,226,‡

S. Malhotra,226,‡ M. Naimuddin,226,‡ K. Ranjan,226,‡ R. Sharma,226,‡ V. Sharma,226,‡ S. Banerjee,227,‡ S. Bhattacharya,227,‡

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-19

Page 61: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

K. Chatterjee,227,‡ S. Dey,227,‡ S. Dutta,227,‡ Sa. Jain,227,‡ Sh. Jain,227,‡ R. Khurana,227,‡ N. Majumdar,227,‡ A. Modak,227,‡

K. Mondal,227,‡ S. Mukherjee,227,‡ S. Mukhopadhyay,227,‡ A. Roy,227,‡ D. Roy,227,‡ S. Roy Chowdhury,227,‡ S. Sarkar,227,‡

M. Sharan,227,‡ A. Abdulsalam,228,‡ R. Chudasama,228,‡ D. Dutta,228,‡ V. Jha,228,‡ V. Kumar,228,‡ A. K. Mohanty,228,oo,‡

L.M. Pant,228,‡ P. Shukla,228,‡ A. Topkar,228,‡ T. Aziz,229,‡ S. Banerjee,229,‡ S. Bhowmik,229,jjj,‡ R.M. Chatterjee,229,‡

R. K. Dewanjee,229,‡ S. Dugad,229,‡ S. Ganguly,229,‡ S. Ghosh,229,‡ M. Guchait,229,‡ A. Gurtu,229,kkk,‡ G. Kole,229,‡

S. Kumar,229,‡ B. Mahakud,229,‡ M. Maity,229,jjj,‡ G. Majumder,229,‡ K. Mazumdar,229,‡ S. Mitra,229,‡ G. B. Mohanty,229,‡

B. Parida,229,‡ T. Sarkar,229,jjj,‡ K. Sudhakar,229,‡ N. Sur,229,‡ B. Sutar,229,‡ N. Wickramage,229,lll,‡ S. Sharma,230,‡

H. Bakhshiansohi,231,‡ H. Behnamian,231,‡ S. M. Etesami,231,mmm,‡ A. Fahim,231,nnn,‡ R. Goldouzian,231,‡ M. Khakzad,231,‡

M. Mohammadi Najafabadi,231,‡ M. Naseri,231,‡ S. Paktinat Mehdiabadi,231,‡ F. Rezaei Hosseinabadi,231,‡

B. Safarzadeh,231,ooo,‡ M. Zeinali,231,‡ M. Felcini,232,‡ M. Grunewald,232,‡ M. Abbrescia,233a,233b,‡ C. Calabria,233a,233b,‡

C. Caputo,233a,233b,‡ S. S. Chhibra,233a,233b,‡ A. Colaleo,233a,‡ D. Creanza,233a,233c,‡ L. Cristella,233a,233b,‡

N. De Filippis,233a,233c,‡ M. De Palma,233a,233b,‡ L. Fiore,233a,‡ G. Iaselli,233a,233c,‡ G. Maggi,233a,233c,‡ M. Maggi,233a,‡

G. Miniello,233a,233b,‡ S. My,233a,233c,‡ S. Nuzzo,233a,233b,‡ A. Pompili,233a,233b,‡ G. Pugliese,233a,233c,‡ R. Radogna,233a,233b,‡

A. Ranieri,233a,‡ G. Selvaggi,233a,233b,‡ L. Silvestris,233a,oo,‡ R. Venditti,233a,233b,‡ P. Verwilligen,233a,‡ G. Abbiendi,234a,‡

C. Battilana,234a,oo,‡ A. C. Benvenuti,234a,‡ D. Bonacorsi,234a,234b,‡ S. Braibant-Giacomelli,234a,234b,‡ L. Brigliadori,234a,234b,‡

R. Campanini,234a,234b,‡ P. Capiluppi,234a,234b,‡ A. Castro,234a,234b,‡ F. R. Cavallo,234a,‡ G. Codispoti,234a,234b,‡

M. Cuffiani,234a,234b,‡ G.M. Dallavalle,234a,‡ F. Fabbri,234a,‡ A. Fanfani,234a,234b,‡ D. Fasanella,234a,234b,‡ P. Giacomelli,234a,‡

C. Grandi,234a,‡ L. Guiducci,234a,234b,‡ S. Marcellini,234a,‡ G. Masetti,234a,‡ A. Montanari,234a,‡ F. L. Navarria,234a,234b,‡

A. Perrotta,234a,‡ A.M. Rossi,234a,234b,‡ T. Rovelli,234a,234b,‡ G. P. Siroli,234a,234b,‡ N. Tosi,234a,234b,‡ R. Travaglini,234a,234b,‡

G. Cappello,235a,‡ M. Chiorboli,235a,235b,‡ S. Costa,235a,235b,‡ F. Giordano,235a,‡ R. Potenza,235a,235b,‡ A. Tricomi,235a,235b,‡

C. Tuve,235a,235b,‡ G. Barbagli,236a,‡ V. Ciulli,236a,236b,‡ C. Civinini,236a,‡ R. D’Alessandro,236a,236b,‡ E. Focardi,236a,236b,‡

S. Gonzi,236a,236b,‡ V. Gori,236a,236b,‡ P. Lenzi,236a,236b,‡ M. Meschini,236a,‡ S. Paoletti,236a,‡ G. Sguazzoni,236a,‡

A. Tropiano,236a,236b,‡ L. Viliani,236a,236b,‡ L. Benussi,237,‡ S. Bianco,237,‡ F. Fabbri,237,‡ D. Piccolo,237,‡ V. Calvelli,238a,238b,‡

F. Ferro,238a,‡ M. Lo Vetere,238a,238b,‡ E. Robutti,238a,‡ S. Tosi,238a,238b,‡ M. E. Dinardo,239a,239b,‡ S. Fiorendi,239a,239b,‡

S. Gennai,239a,‡ R. Gerosa,239a,239b,‡ A. Ghezzi,239a,239b,‡ P. Govoni,239a,239b,‡ S. Malvezzi,239a,‡ R. A. Manzoni,239a,239b,‡

B. Marzocchi,239a,239b,oo,‡ D. Menasce,239a,‡ L. Moroni,239a,‡ M. Paganoni,239a,239b,‡ D. Pedrini,239a,‡ S. Ragazzi,239a,239b,‡

N. Redaelli,239a,‡ T. Tabarelli de Fatis,239a,239b,‡ S. Buontempo,240a,‡ N. Cavallo,240a,240c,‡ S. Di Guida,240a,240d,oo,‡

M. Esposito,240a,240b,‡ F. Fabozzi,240a,240c,‡ A. O. M. Iorio,240a,240b,‡ G. Lanza,240a,‡ L. Lista,240a,‡ S. Meola,240a,240d,oo,‡

M. Merola,240a,‡ P. Paolucci,240a,oo,‡ C. Sciacca,240a,240b,‡ F. Thyssen,240a,‡ P. Azzi,241a,oo,‡ N. Bacchetta,241a,‡

D. Bisello,241a,241b,‡ A. Branca,241a,241b,‡ R. Carlin,241a,241b,‡ A. Carvalho Antunes De Oliveira,241a,241b,‡ P. Checchia,241a,‡

M. Dall’Osso,241a,241b,oo,‡ T. Dorigo,241a,‡ U. Dosselli,241a,‡ F. Gasparini,241a,241b,‡ U. Gasparini,241a,241b,‡ A. Gozzelino,241a,‡

K. Kanishchev,241a,241c,‡ S. Lacaprara,241a,‡ M. Margoni,241a,241b,‡ A. T. Meneguzzo,241a,241b,‡ J. Pazzini,241a,241b,‡

N. Pozzobon,241a,241b,‡ P. Ronchese,241a,241b,‡ F. Simonetto,241a,241b,‡ E. Torassa,241a,‡ M. Tosi,241a,241b,‡ M. Zanetti,241a,‡

P. Zotto,241a,241b,‡ A. Zucchetta,241a,241b,oo,‡ G. Zumerle,241a,241b,‡ A. Braghieri,242a,‡ M. Gabusi,242a,242b,‡ A. Magnani,242a,‡

S. P. Ratti,242a,242b,‡ V. Re,242a,‡ C. Riccardi,242a,242b,‡ P. Salvini,242a,‡ I. Vai,242a,‡ P. Vitulo,242a,242b,‡

L. Alunni Solestizi,243a,243b,‡ M. Biasini,243a,243b,‡ G.M. Bilei,243a,‡ D. Ciangottini,243a,243b,oo,‡ L. Fanò,243a,243b,‡

P. Lariccia,243a,243b,‡ G. Mantovani,243a,243b,‡ M. Menichelli,243a,‡ A. Saha,243a,‡ A. Santocchia,243a,243b,‡ A. Spiezia,243a,243b,‡

K. Androsov,244a,ppp,‡ P. Azzurri,244a,‡ G. Bagliesi,244a,‡ J. Bernardini,244a,‡ T. Boccali,244a,‡ G. Broccolo,244a,244c,‡

R. Castaldi,244a,‡ M. A. Ciocci,244a,ppp,‡ R. Dell’Orso,244a,‡ S. Donato,244a,244c,oo,‡ G. Fedi,244a,‡ L. Foà,244a,244c,,‡

A. Giassi,244a,‡ M. T. Grippo,244a,ppp,‡ F. Ligabue,244a,244c,‡ T. Lomtadze,244a,‡ L. Martini,244a,244b,‡ A. Messineo,244a,244b,‡

F. Palla,244a,‡ A. Rizzi,244a,244b,‡ A. Savoy-Navarro,244a,qqq,‡ A. T. Serban,244a,‡ P. Spagnolo,244a,‡ P. Squillacioti,244a,ppp,‡

R. Tenchini,244a,‡ G. Tonelli,244a,244b,‡ A. Venturi,244a,‡ P. G. Verdini,244a,‡ L. Barone,245a,245b,‡ F. Cavallari,245a,‡

G. D’imperio,245a,245b,oo,‡ D. Del Re,245a,245b,‡ M. Diemoz,245a,‡ S. Gelli,245a,245b,‡ C. Jorda,245a,‡ E. Longo,245a,245b,‡

F. Margaroli,245a,245b,‡ P. Meridiani,245a,‡ F. Micheli,245a,245b,‡ G. Organtini,245a,245b,‡ R. Paramatti,245a,‡ F. Preiato,245a,245b,‡

S. Rahatlou,245a,245b,‡ C. Rovelli,245a,‡ F. Santanastasio,245a,245b,‡ P. Traczyk,245a,245b,oo,‡ N. Amapane,246a,246b,‡

R. Arcidiacono,246a,246c,‡ S. Argiro,246a,246b,‡ M. Arneodo,246a,246c,‡ R. Bellan,246a,246b,‡ C. Biino,246a,‡ N. Cartiglia,246a,‡

M. Costa,246a,246b,‡ R. Covarelli,246a,246b,‡ A. Degano,246a,246b,‡ N. Demaria,246a,‡ L. Finco,246a,246b,oo,‡ B. Kiani,246a,246b,‡

C. Mariotti,246a,‡ S. Maselli,246a,‡ E. Migliore,246a,246b,‡ V. Monaco,246a,246b,‡ E. Monteil,246a,246b,‡ M. Musich,246a,‡

M.M. Obertino,246a,246b,‡ L. Pacher,246a,246b,‡ N. Pastrone,246a,‡ M. Pelliccioni,246a,‡ G. L. Pinna Angioni,246a,246b,‡

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-20

Page 62: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

F. Ravera,246a,246b,‡ A. Romero,246a,246b,‡ M. Ruspa,246a,246c,‡ R. Sacchi,246a,246b,‡ A. Solano,246a,246b,‡ A. Staiano,246a,‡

U. Tamponi,246a,‡ S. Belforte,247a,‡ V. Candelise,247a,247b,oo,‡ M. Casarsa,247a,‡ F. Cossutti,247a,‡ G. Della Ricca,247a,247b,‡

B. Gobbo,247a,‡ C. La Licata,247a,247b,‡ M. Marone,247a,247b,‡ A. Schizzi,247a,247b,‡ T. Umer,247a,247b,‡ A. Zanetti,247a,‡

S. Chang,248,‡ A. Kropivnitskaya,248,‡ S. K. Nam,248,‡ D. H. Kim,249,‡ G. N. Kim,249,‡ M. S. Kim,249,‡ D. J. Kong,249,‡

S. Lee,249,‡ Y. D. Oh,249,‡ A. Sakharov,249,‡ D. C. Son,249,‡ J. A. Brochero Cifuentes,250,‡ H. Kim,250,‡ T. J. Kim,250,‡

M. S. Ryu,250,‡ S. Song,251,‡ S. Choi,252,‡ Y. Go,252,‡ D. Gyun,252,‡ B. Hong,252,‡ M. Jo,252,‡ H. Kim,252,‡ Y. Kim,252,‡

B. Lee,252,‡ K. Lee,252,‡ K. S. Lee,252,‡ S. Lee,252,‡ S. K. Park,252,‡ Y. Roh,252,‡ H. D. Yoo,253,‡ M. Choi,254,‡ J. H. Kim,254,‡

J. S. H. Lee,254,‡ I. C. Park,254,‡ G. Ryu,254,‡ Y. Choi,255,‡ Y. K. Choi,255,‡ J. Goh,255,‡ D. Kim,255,‡ E. Kwon,255,‡ J. Lee,255,‡

I. Yu,255,‡ A. Juodagalvis,256,‡ J. Vaitkus,256,‡ Z. A. Ibrahim,257,‡ J. R. Komaragiri,257,‡ M. A. B. Md Ali,257,rrr,‡

F. Mohamad Idris,257,‡ W. A. T. Wan Abdullah,257,‡ E. Casimiro Linares,258,‡ H. Castilla-Valdez,258,‡

E. De La Cruz-Burelo,258,‡ I. Heredia-de La Cruz,258,sss,‡ A. Hernandez-Almada,258,‡ R. Lopez-Fernandez,258,‡

A. Sanchez-Hernandez,258,‡ S. Carrillo Moreno,259,‡ F. Vazquez Valencia,259,‡ S. Carpinteyro,260,‡ I. Pedraza,260,‡

H. A. Salazar Ibarguen,260,‡ A. Morelos Pineda,261,‡ D. Krofcheck,262,‡ P. H. Butler,263,‡ S. Reucroft,263,‡ A. Ahmad,264,‡

M. Ahmad,264,‡ Q. Hassan,264,‡ H. R. Hoorani,264,‡ W. A. Khan,264,‡ T. Khurshid,264,‡ M. Shoaib,264,‡ H. Bialkowska,265,‡

M. Bluj,265,‡ B. Boimska,265,‡ T. Frueboes,265,‡ M. Górski,265,‡ M. Kazana,265,‡ K. Nawrocki,265,‡

K. Romanowska-Rybinska,265,‡ M. Szleper,265,‡ P. Zalewski,265,‡ G. Brona,266,‡ K. Bunkowski,266,‡ K. Doroba,266,‡

A. Kalinowski,266,‡ M. Konecki,266,‡ J. Krolikowski,266,‡ M. Misiura,266,‡ M. Olszewski,266,‡ M. Walczak,266,‡

P. Bargassa,267,‡ C. Beirão Da Cruz E Silva,267,‡ A. Di Francesco,267,‡ P. Faccioli,267,‡ P. G. Ferreira Parracho,267,‡

M. Gallinaro,267,‡ L. Lloret Iglesias,267,‡ F. Nguyen,267,‡ J. Rodrigues Antunes,267,‡ J. Seixas,267,‡ O. Toldaiev,267,‡

D. Vadruccio,267,‡ J. Varela,267,‡ P. Vischia,267,‡ S. Afanasiev,268,‡ P. Bunin,268,‡ M. Gavrilenko,268,‡ I. Golutvin,268,‡

I. Gorbunov,268,‡ A. Kamenev,268,‡ V. Karjavin,268,‡ V. Konoplyanikov,268,‡ A. Lanev,268,‡ A. Malakhov,268,‡

V. Matveev,268,ttt,‡ P. Moisenz,268,‡ V. Palichik,268,‡ V. Perelygin,268,‡ S. Shmatov,268,‡ S. Shulha,268,‡ N. Skatchkov,268,‡

V. Smirnov,268,‡ T. Toriashvili,268,uuu,‡ A. Zarubin,268,‡ V. Golovtsov,269,‡ Y. Ivanov,269,‡ V. Kim,269,vvv,‡ E. Kuznetsova,269,‡

P. Levchenko,269,‡ V. Murzin,269,‡ V. Oreshkin,269,‡ I. Smirnov,269,‡ V. Sulimov,269,‡ L. Uvarov,269,‡ S. Vavilov,269,‡

A. Vorobyev,269,‡ Yu. Andreev,270,‡ A. Dermenev,270,‡ S. Gninenko,270,‡ N. Golubev,270,‡ A. Karneyeu,270,‡ M. Kirsanov,270,‡

N. Krasnikov,270,‡ A. Pashenkov,270,‡ D. Tlisov,270,‡ A. Toropin,270,‡ V. Epshteyn,271,‡ V. Gavrilov,271,‡ N. Lychkovskaya,271,‡

V. Popov,271,‡ I. Pozdnyakov,271,‡ G. Safronov,271,‡ A. Spiridonov,271,‡ E. Vlasov,271,‡ A. Zhokin,271,‡ V. Andreev,272,‡

M. Azarkin,272,www,‡ I. Dremin,272,www,‡ M. Kirakosyan,272,‡ A. Leonidov,272,www,‡ G. Mesyats,272,‡ S. V. Rusakov,272,‡

A. Vinogradov,272,‡ A. Baskakov,273,‡ A. Belyaev,273,‡ E. Boos,273,‡ V. Bunichev,273,‡ M. Dubinin,273,xxx,‡ L. Dudko,273,‡

A. Ershov,273,‡ A. Gribushin,273,‡ V. Klyukhin,273,‡ O. Kodolova,273,‡ I. Lokhtin,273,‡ I. Myagkov,273,‡ S. Obraztsov,273,‡

S. Petrushanko,273,‡ V. Savrin,273,‡ I. Azhgirey,274,‡ I. Bayshev,274,‡ S. Bitioukov,274,‡ V. Kachanov,274,‡ A. Kalinin,274,‡

D. Konstantinov,274,‡ V. Krychkine,274,‡ V. Petrov,274,‡ R. Ryutin,274,‡ A. Sobol,274,‡ L. Tourtchanovitch,274,‡ S. Troshin,274,‡

N. Tyurin,274,‡ A. Uzunian,274,‡ A. Volkov,274,‡ P. Adzic,275,yyy,‡ M. Ekmedzic,275,‡ J. Milosevic,275,‡ V. Rekovic,275,‡

J. Alcaraz Maestre,276,‡ E. Calvo,276,‡ M. Cerrada,276,‡ M. Chamizo Llatas,276,‡ N. Colino,276,‡ B. De La Cruz,276,‡

A. Delgado Peris,276,‡ D. Domínguez Vázquez,276,‡ A. Escalante Del Valle,276,‡ C. Fernandez Bedoya,276,‡

J. P. Fernández Ramos,276,‡ J. Flix,276,‡ M. C. Fouz,276,‡ P. Garcia-Abia,276,‡ O. Gonzalez Lopez,276,‡ S. Goy Lopez,276,‡

J. M. Hernandez,276,‡ M. I. Josa,276,‡ E. Navarro De Martino,276,‡ A. Pérez-Calero Yzquierdo,276,‡ J. Puerta Pelayo,276,‡

A. Quintario Olmeda,276,‡ I. Redondo,276,‡ L. Romero,276,‡ M. S. Soares,276,‡ C. Albajar,277,‡ J. F. de Trocóniz,277,‡

M. Missiroli,277,‡ D. Moran,277,‡ H. Brun,278,‡ J. Cuevas,278,‡ J. Fernandez Menendez,278,‡ S. Folgueras,278,‡

I. Gonzalez Caballero,278,‡ E. Palencia Cortezon,278,‡ J. M. Vizan Garcia,278,‡ I. J. Cabrillo,279,‡ A. Calderon,279,‡

J. R. Castiñeiras De Saa,279,‡ J. Duarte Campderros,279,‡ M. Fernandez,279,‡ G. Gomez,279,‡ A. Graziano,279,‡

A. Lopez Virto,279,‡ J. Marco,279,‡ R. Marco,279,‡ C. Martinez Rivero,279,‡ F. Matorras,279,‡ F. J. Munoz Sanchez,279,‡

J. Piedra Gomez,279,‡ T. Rodrigo,279,‡ A. Y. Rodríguez-Marrero,279,‡ A. Ruiz-Jimeno,279,‡ L. Scodellaro,279,‡ I. Vila,279,‡

R. Vilar Cortabitarte,279,‡ D. Abbaneo,280,‡ E. Auffray,280,‡ G. Auzinger,280,‡ M. Bachtis,280,‡ P. Baillon,280,‡ A. H. Ball,280,‡

D. Barney,280,‡ A. Benaglia,280,‡ J. Bendavid,280,‡ L. Benhabib,280,‡ J. F. Benitez,280,‡ G.M. Berruti,280,‡ P. Bloch,280,‡

A. Bocci,280,‡ A. Bonato,280,‡ C. Botta,280,‡ H. Breuker,280,‡ T. Camporesi,280,‡ G. Cerminara,280,‡ S. Colafranceschi,280,zzz,‡

M. D’Alfonso,280,‡ D. d’Enterria,280,‡ A. Dabrowski,280,‡ V. Daponte,280,‡ A. David,280,‡ M. De Gruttola,280,‡ F. De Guio,280,‡

A. De Roeck,280,‡ S. De Visscher,280,‡ E. Di Marco,280,‡ M. Dobson,280,‡ M. Dordevic,280,‡ T. du Pree,280,‡

N. Dupont-Sagorin,280,‡ A. Elliott-Peisert,280,‡ G. Franzoni,280,‡ W. Funk,280,‡ D. Gigi,280,‡ K. Gill,280,‡ D. Giordano,280,‡

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-21

Page 63: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

M. Girone,280,‡ F. Glege,280,‡ R. Guida,280,‡ S. Gundacker,280,‡ M. Guthoff,280,‡ J. Hammer,280,‡ M. Hansen,280,‡ P. Harris,280,‡

J. Hegeman,280,‡ V. Innocente,280,‡ P. Janot,280,‡ H. Kirschenmann,280,‡ M. J. Kortelainen,280,‡ K. Kousouris,280,‡

K. Krajczar,280,‡ P. Lecoq,280,‡ C. Lourenço,280,‡ M. T. Lucchini,280,‡ N. Magini,280,‡ L. Malgeri,280,‡ M. Mannelli,280,‡

J. Marrouche,280,‡ A. Martelli,280,‡ L. Masetti,280,‡ F. Meijers,280,‡ S. Mersi,280,‡ E. Meschi,280,‡ F. Moortgat,280,‡

S. Morovic,280,‡ M. Mulders,280,‡ M. V. Nemallapudi,280,‡ H. Neugebauer,280,‡ S. Orfanelli,280,aaaa,‡ L. Orsini,280,‡

L. Pape,280,‡ E. Perez,280,‡ A. Petrilli,280,‡ G. Petrucciani,280,‡ A. Pfeiffer,280,‡ D. Piparo,280,‡ A. Racz,280,‡ G. Rolandi,280,bbbb,‡

M. Rovere,280,‡ M. Ruan,280,‡ H. Sakulin,280,‡ C. Schäfer,280,‡ C. Schwick,280,‡ A. Sharma,280,‡ P. Silva,280,‡ M. Simon,280,‡

P. Sphicas,280,cccc,‡ D. Spiga,280,‡ J. Steggemann,280,‡ B. Stieger,280,‡ M. Stoye,280,‡ Y. Takahashi,280,‡ D. Treille,280,‡

A. Tsirou,280,‡ G. I. Veres,280,ggg,‡ N. Wardle,280,‡ H. K. Wöhri,280,‡ A. Zagozdzinska,280,dddd,‡ W. D. Zeuner,280,‡ W. Bertl,281,‡

K. Deiters,281,‡ W. Erdmann,281,‡ R. Horisberger,281,‡ Q. Ingram,281,‡ H. C. Kaestli,281,‡ D. Kotlinski,281,‡

U. Langenegger,281,‡ T. Rohe,281,‡ F. Bachmair,282,‡ L. Bäni,282,‡ L. Bianchini,282,‡ M. A. Buchmann,282,‡ B. Casal,282,‡

G. Dissertori,282,‡ M. Dittmar,282,‡ M. Donegà,282,‡ M. Dünser,282,‡ P. Eller,282,‡ C. Grab,282,‡ C. Heidegger,282,‡ D. Hits,282,‡

J. Hoss,282,‡ G. Kasieczka,282,‡ W. Lustermann,282,‡ B. Mangano,282,‡ A. C. Marini,282,‡ M. Marionneau,282,‡

P. Martinez Ruiz del Arbol,282,‡ M.Masciovecchio,282,‡ D. Meister,282,‡ P. Musella,282,‡ F. Nessi-Tedaldi,282,‡ F. Pandolfi,282,‡

J. Pata,282,‡ F. Pauss,282,‡ L. Perrozzi,282,‡ M. Peruzzi,282,‡ M. Quittnat,282,‡ M. Rossini,282,‡ A. Starodumov,282,eeee,‡

M. Takahashi,282,‡ V. R. Tavolaro,282,‡ K. Theofilatos,282,‡ R. Wallny,282,‡ H. A. Weber,282,‡ T. K. Aarrestad,283,‡

C. Amsler,283,ffff,‡ M. F. Canelli,283,‡ V. Chiochia,283,‡ A. De Cosa,283,‡ C. Galloni,283,‡ A. Hinzmann,283,‡ T. Hreus,283,‡

B. Kilminster,283,‡ C. Lange,283,‡ J. Ngadiuba,283,‡ D. Pinna,283,‡ P. Robmann,283,‡ F. J. Ronga,283,‡ D. Salerno,283,‡

S. Taroni,283,‡ Y. Yang,283,‡ M. Cardaci,284,‡ K. H. Chen,284,‡ T. H. Doan,284,‡ C. Ferro,284,‡ M. Konyushikhin,284,‡

C.M. Kuo,284,‡ W. Lin,284,‡ Y. J. Lu,284,‡ R. Volpe,284,‡ S. S. Yu,284,‡ P. Chang,285,‡ Y. H. Chang,285,‡ Y.W. Chang,285,‡

Y. Chao,285,‡ K. F. Chen,285,‡ P. H. Chen,285,‡ C. Dietz,285,‡ F. Fiori,285,‡ U. Grundler,285,‡ W.-S. Hou,285,‡ Y. Hsiung,285,‡

Y. F. Liu,285,‡ R.-S. Lu,285,‡ M. Miñano Moya,285,‡ E. Petrakou,285,‡ J. f. Tsai,285,‡ Y.M. Tzeng,285,‡ R. Wilken,285,‡

B. Asavapibhop,286,‡ K. Kovitanggoon,286,‡ G. Singh,286,‡ N. Srimanobhas,286,‡ N. Suwonjandee,286,‡ A. Adiguzel,287,‡

S. Cerci,287,gggg,‡ C. Dozen,287,‡ S. Girgis,287,‡ G. Gokbulut,287,‡ Y. Guler,287,‡ E. Gurpinar,287,‡ I. Hos,287,‡

E. E. Kangal,287,hhhh,‡ A. Kayis Topaksu,287,‡ G. Onengut,287,iiii,‡ K. Ozdemir,287,jjjj,‡ S. Ozturk,287,kkkk,‡ B. Tali,287,gggg,‡

H. Topakli,287,kkkk,‡ M. Vergili,287,‡ C. Zorbilmez,287,‡ I. V. Akin,288,‡ B. Bilin,288,‡ S. Bilmis,288,‡ B. Isildak,288,llll,‡

G. Karapinar,288,mmmm,‡ U. E. Surat,288,‡ M. Yalvac,288,‡ M. Zeyrek,288,‡ E. A. Albayrak,289,nnnn,‡ E. Gülmez,289,‡

M. Kaya,289,oooo,‡ O. Kaya,289,pppp,‡ T. Yetkin,289,qqqq,‡ K. Cankocak,290,‡ S. Sen,290,rrrr,‡ F. I. Vardarlı,290,‡ B. Grynyov,291,‡

L. Levchuk,292,‡ P. Sorokin,292,‡ R. Aggleton,293,‡ F. Ball,293,‡ L. Beck,293,‡ J. J. Brooke,293,‡ E. Clement,293,‡ D. Cussans,293,‡

H. Flacher,293,‡ J. Goldstein,293,‡ M. Grimes,293,‡ G. P. Heath,293,‡ H. F. Heath,293,‡ J. Jacob,293,‡ L. Kreczko,293,‡

C. Lucas,293,‡ Z. Meng,293,‡ D.M. Newbold,293,ssss,‡ S. Paramesvaran,293,‡ A. Poll,293,‡ T. Sakuma,293,‡

S. Seif El Nasr-storey,293,‡ S. Senkin,293,‡ D. Smith,293,‡ V. J. Smith,293,‡ K.W. Bell,294,‡ A. Belyaev,294,tttt,‡ C. Brew,294,‡

R.M. Brown,294,‡ D. J. A. Cockerill,294,‡ J. A. Coughlan,294,‡ K. Harder,294,‡ S. Harper,294,‡ E. Olaiya,294,‡ D. Petyt,294,‡

C. H. Shepherd-Themistocleous,294,‡ A. Thea,294,‡ I. R. Tomalin,294,‡ T. Williams,294,‡ W. J. Womersley,294,‡ S. D. Worm,294,‡

M. Baber,295,‡ R. Bainbridge,295,‡ O. Buchmuller,295,‡ A. Bundock,295,‡ D. Burton,295,‡ S. Casasso,295,‡ M. Citron,295,‡

D. Colling,295,‡ L. Corpe,295,‡ N. Cripps,295,‡ P. Dauncey,295,‡ G. Davies,295,‡ A. De Wit,295,‡ M. Della Negra,295,‡

P. Dunne,295,‡ A. Elwood,295,‡ W. Ferguson,295,‡ J. Fulcher,295,‡ D. Futyan,295,‡ G. Hall,295,‡ G. Iles,295,‡ G. Karapostoli,295,‡

M. Kenzie,295,‡ R. Lane,295,‡ R. Lucas,295,ssss,‡ L. Lyons,295,‡ A.-M. Magnan,295,‡ S. Malik,295,‡ J. Nash,295,‡

A. Nikitenko,295,eeee,‡ J. Pela,295,‡ M. Pesaresi,295,‡ K. Petridis,295,‡ D.M. Raymond,295,‡ A. Richards,295,‡ A. Rose,295,‡

C. Seez,295,‡ P. Sharp,295,,‡ A. Tapper,295,‡ K. Uchida,295,‡ M. Vazquez Acosta,295,uuuu,‡ T. Virdee,295,‡ S. C. Zenz,295,‡

J. E. Cole,296,‡ P. R. Hobson,296,‡ A. Khan,296,‡ P. Kyberd,296,‡ D. Leggat,296,‡ D. Leslie,296,‡ I. D. Reid,296,‡ P. Symonds,296,‡

L. Teodorescu,296,‡ M. Turner,296,‡ A. Borzou,297,‡ J. Dittmann,297,‡ K. Hatakeyama,297,‡ A. Kasmi,297,‡ H. Liu,297,‡

N. Pastika,297,‡ O. Charaf,298,‡ S. I. Cooper,298,‡ C. Henderson,298,‡ P. Rumerio,298,‡ A. Avetisyan,299,‡ T. Bose,299,‡

C. Fantasia,299,‡ D. Gastler,299,‡ P. Lawson,299,‡ D. Rankin,299,‡ C. Richardson,299,‡ J. Rohlf,299,‡ J. St. John,299,‡ L. Sulak,299,‡

D. Zou,299,‡ J. Alimena,300,‡ E. Berry,300,‡ S. Bhattacharya,300,‡ D. Cutts,300,‡ N. Dhingra,300,‡ A. Ferapontov,300,‡

A. Garabedian,300,‡ U. Heintz,300,‡ E. Laird,300,‡ G. Landsberg,300,‡ Z. Mao,300,‡ M. Narain,300,‡ S. Sagir,300,‡

T. Sinthuprasith,300,‡ R. Breedon,301,‡G. Breto,301,‡M. Calderon De La Barca Sanchez,301,‡ S. Chauhan,301,‡M. Chertok,301,‡

J. Conway,301,‡ R. Conway,301,‡ P. T. Cox,301,‡ R. Erbacher,301,‡M. Gardner,301,‡W. Ko,301,‡ R. Lander,301,‡M.Mulhearn,301,‡

D. Pellett,301,‡ J. Pilot,301,‡ F. Ricci-Tam,301,‡ S. Shalhout,301,‡ J. Smith,301,‡ M. Squires,301,‡ D. Stolp,301,‡ M. Tripathi,301,‡

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-22

Page 64: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

S. Wilbur,301,‡ R. Yohay,301,‡ R. Cousins,302,‡ P. Everaerts,302,‡ C. Farrell,302,‡ J. Hauser,302,‡ M. Ignatenko,302,‡

G. Rakness,302,‡ D. Saltzberg,302,‡ E. Takasugi,302,‡ V. Valuev,302,‡ M. Weber,302,‡ K. Burt,303,‡ R. Clare,303,‡ J. Ellison,303,‡

J. W. Gary,303,‡ G. Hanson,303,‡ J. Heilman,303,‡ M. Ivova Rikova,303,‡ P. Jandir,303,‡ E. Kennedy,303,‡ F. Lacroix,303,‡

O. R. Long,303,‡ A. Luthra,303,‡ M. Malberti,303,‡ M. Olmedo Negrete,303,‡ A. Shrinivas,303,‡ S. Sumowidagdo,303,‡

H. Wei,303,‡ S. Wimpenny,303,‡ J. G. Branson,304,‡ G. B. Cerati,304,‡ S. Cittolin,304,‡ R. T. D’Agnolo,304,‡ A. Holzner,304,‡

R. Kelley,304,‡ D. Klein,304,‡ J. Letts,304,‡ I. Macneill,304,‡ D. Olivito,304,‡ S. Padhi,304,‡ M. Pieri,304,‡ M. Sani,304,‡

V. Sharma,304,‡ S. Simon,304,‡ M. Tadel,304,‡ Y. Tu,304,‡ A. Vartak,304,‡ S. Wasserbaech,304,vvvv,‡ C. Welke,304,‡

F. Würthwein,304,‡ A. Yagil,304,‡ G. Zevi Della Porta,304,‡ D. Barge,305,‡ J. Bradmiller-Feld,305,‡ C. Campagnari,305,‡

A. Dishaw,305,‡ V. Dutta,305,‡ K. Flowers,305,‡ M. Franco Sevilla,305,‡ P. Geffert,305,‡ C. George,305,‡ F. Golf,305,‡

L. Gouskos,305,‡ J. Gran,305,‡ J. Incandela,305,‡ C. Justus,305,‡ N. Mccoll,305,‡ S. D. Mullin,305,‡ J. Richman,305,‡ D. Stuart,305,‡

I. Suarez,305,‡ W. To,305,‡ C. West,305,‡ J. Yoo,305,‡ D. Anderson,306,‡ A. Apresyan,306,‡ A. Bornheim,306,‡ J. Bunn,306,‡

Y. Chen,306,‡ J. Duarte,306,‡ A. Mott,306,‡ H. B. Newman,306,‡ C. Pena,306,‡ M. Pierini,306,‡ M. Spiropulu,306,‡

J. R. Vlimant,306,‡ S. Xie,306,‡ R. Y. Zhu,306,‡ V. Azzolini,307,‡ A. Calamba,307,‡ B. Carlson,307,‡ T. Ferguson,307,‡

Y. Iiyama,307,‡ M. Paulini,307,‡ J. Russ,307,‡ M. Sun,307,‡ H. Vogel,307,‡ I. Vorobiev,307,‡ J. P. Cumalat,308,‡ W. T. Ford,308,‡

A. Gaz,308,‡ F. Jensen,308,‡ A. Johnson,308,‡ M. Krohn,308,‡ T. Mulholland,308,‡ U. Nauenberg,308,‡ J. G. Smith,308,‡

K. Stenson,308,‡ S. R. Wagner,308,‡ J. Alexander,309,‡ A. Chatterjee,309,‡ J. Chaves,309,‡ J. Chu,309,‡ S. Dittmer,309,‡

N. Eggert,309,‡ N. Mirman,309,‡ G. Nicolas Kaufman,309,‡ J. R. Patterson,309,‡ A. Rinkevicius,309,‡ A. Ryd,309,‡

L. Skinnari,309,‡ L. Soffi,309,‡ W. Sun,309,‡ S. M. Tan,309,‡ W.D. Teo,309,‡ J. Thom,309,‡ J. Thompson,309,‡ J. Tucker,309,‡

Y. Weng,309,‡ P. Wittich,309,‡ S. Abdullin,310,‡ M. Albrow,310,‡ J. Anderson,310,‡ G. Apollinari,310,‡ L. A. T. Bauerdick,310,‡

A. Beretvas,310,‡ J. Berryhill,310,‡ P. C. Bhat,310,‡ G. Bolla,310,‡ K. Burkett,310,‡ J. N. Butler,310,‡ H.W. K. Cheung,310,‡

F. Chlebana,310,‡ S. Cihangir,310,‡ V. D. Elvira,310,‡ I. Fisk,310,‡ J. Freeman,310,‡ E. Gottschalk,310,‡ L. Gray,310,‡ D. Green,310,‡

S. Grünendahl,310,‡ O. Gutsche,310,‡ J. Hanlon,310,‡ D. Hare,310,‡ R.M. Harris,310,‡ J. Hirschauer,310,‡ B. Hooberman,310,‡

Z. Hu,310,‡ S. Jindariani,310,‡ M. Johnson,310,‡ U. Joshi,310,‡ A.W. Jung,310,‡ B. Klima,310,‡ B. Kreis,310,‡ S. Kwan,310,,‡

S. Lammel,310,‡ J. Linacre,310,‡ D. Lincoln,310,‡ R. Lipton,310,‡ T. Liu,310,‡ R. Lopes De Sá,310,‡ J. Lykken,310,‡

K. Maeshima,310,‡ J. M. Marraffino,310,‡ V. I. Martinez Outschoorn,310,‡ S. Maruyama,310,‡ D. Mason,310,‡ P. McBride,310,‡

P. Merkel,310,‡ K. Mishra,310,‡ S. Mrenna,310,‡ S. Nahn,310,‡ C. Newman-Holmes,310,‡ V. O’Dell,310,‡ O. Prokofyev,310,‡

E. Sexton-Kennedy,310,‡ A. Soha,310,‡ W. J. Spalding,310,‡ L. Spiegel,310,‡ L. Taylor,310,‡ S. Tkaczyk,310,‡ N. V. Tran,310,‡

L. Uplegger,310,‡ E.W. Vaandering,310,‡ C. Vernieri,310,‡ M. Verzocchi,310,‡ R. Vidal,310,‡ A. Whitbeck,310,‡ F. Yang,310,‡

H. Yin,310,‡ D. Acosta,311,‡ P. Avery,311,‡ P. Bortignon,311,‡ D. Bourilkov,311,‡ A. Carnes,311,‡ M. Carver,311,‡ D. Curry,311,‡

S. Das,311,‡ G. P. Di Giovanni,311,‡ R. D. Field,311,‡ M. Fisher,311,‡ I. K. Furic,311,‡ J. Hugon,311,‡ J. Konigsberg,311,‡

A. Korytov,311,‡ J. F. Low,311,‡ P. Ma,311,‡ K. Matchev,311,‡ H. Mei,311,‡ P. Milenovic,311,wwww,‡ G. Mitselmakher,311,‡

L. Muniz,311,‡ D. Rank,311,‡ L. Shchutska,311,‡ M. Snowball,311,‡ D. Sperka,311,‡ S. j. Wang,311,‡ J. Yelton,311,‡

S. Hewamanage,312,‡ S. Linn,312,‡ P. Markowitz,312,‡ G. Martinez,312,‡ J. L. Rodriguez,312,‡ A. Ackert,313,‡ J. R. Adams,313,‡

T. Adams,313,‡ A. Askew,313,‡ J. Bochenek,313,‡ B. Diamond,313,‡ J. Haas,313,‡ S. Hagopian,313,‡ V. Hagopian,313,‡

K. F. Johnson,313,‡ A. Khatiwada,313,‡ H. Prosper,313,‡ V. Veeraraghavan,313,‡ M. Weinberg,313,‡ V. Bhopatkar,314,‡

M. Hohlmann,314,‡ H. Kalakhety,314,‡ D. Mareskas-palcek,314,‡ T. Roy,314,‡ F. Yumiceva,314,‡ M. R. Adams,315,‡

L. Apanasevich,315,‡ D. Berry,315,‡ R. R. Betts,315,‡ I. Bucinskaite,315,‡ R. Cavanaugh,315,‡ O. Evdokimov,315,‡

L. Gauthier,315,‡ C. E. Gerber,315,‡ D. J. Hofman,315,‡ P. Kurt,315,‡ C. O’Brien,315,‡ I. D. Sandoval Gonzalez,315,‡

C. Silkworth,315,‡ P. Turner,315,‡ N. Varelas,315,‡ Z. Wu,315,‡ M. Zakaria,315,‡ B. Bilki,316,xxxx,‡ W. Clarida,316,‡ K. Dilsiz,316,‡

S. Durgut,316,‡ R. P. Gandrajula,316,‡ M. Haytmyradov,316,‡ V. Khristenko,316,‡ J.-P. Merlo,316,‡ H. Mermerkaya,316,yyyy,‡

A. Mestvirishvili,316,‡ A. Moeller,316,‡ J. Nachtman,316,‡ H. Ogul,316,‡ Y. Onel,316,‡ F. Ozok,316,nnnn,‡ A. Penzo,316,‡

C. Snyder,316,‡ P. Tan,316,‡ E. Tiras,316,‡ J. Wetzel,316,‡ K. Yi,316,‡ I. Anderson,317,‡ B. A. Barnett,317,‡ B. Blumenfeld,317,‡

D. Fehling,317,‡ L. Feng,317,‡ A. V. Gritsan,317,‡ P. Maksimovic,317,‡ C. Martin,317,‡ K. Nash,317,‡ M. Osherson,317,‡

M. Swartz,317,‡ M. Xiao,317,‡ Y. Xin,317,‡ P. Baringer,318,‡ A. Bean,318,‡ G. Benelli,318,‡ C. Bruner,318,‡ J. Gray,318,‡

R. P. Kenny III,318,‡ D. Majumder,318,‡ M. Malek,318,‡ M. Murray,318,‡ D. Noonan,318,‡ S. Sanders,318,‡ R. Stringer,318,‡

Q. Wang,318,‡ J. S. Wood,318,‡ I. Chakaberia,319,‡ A. Ivanov,319,‡ K. Kaadze,319,‡ S. Khalil,319,‡ M. Makouski,319,‡

Y. Maravin,319,‡ L. K. Saini,319,‡ N. Skhirtladze,319,‡ I. Svintradze,319,‡ S. Toda,319,‡ D. Lange,320,‡ F. Rebassoo,320,‡

D. Wright,320,‡ C. Anelli,321,‡ A. Baden,321,‡ O. Baron,321,‡ A. Belloni,321,‡ B. Calvert,321,‡ S. C. Eno,321,‡ C. Ferraioli,321,‡

J. A. Gomez,321,‡ N. J. Hadley,321,‡ S. Jabeen,321,‡ R. G. Kellogg,321,‡ T. Kolberg,321,‡ J. Kunkle,321,‡ Y. Lu,321,‡

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-23

Page 65: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

A. C. Mignerey,321,‡ K. Pedro,321,‡ Y. H. Shin,321,‡ A. Skuja,321,‡ M. B. Tonjes,321,‡ S. C. Tonwar,321,‡ A. Apyan,322,‡

R. Barbieri,322,‡ A. Baty,322,‡ K. Bierwagen,322,‡ S. Brandt,322,‡ W. Busza,322,‡ I. A. Cali,322,‡ L. Di Matteo,322,‡

G. Gomez Ceballos,322,‡ M. Goncharov,322,‡ D. Gulhan,322,‡ G.M. Innocenti,322,‡ M. Klute,322,‡ D. Kovalskyi,322,‡

Y. S. Lai,322,‡ Y.-J. Lee,322,‡ A. Levin,322,‡ P. D. Luckey,322,‡ C. Mcginn,322,‡ X. Niu,322,‡ C. Paus,322,‡ D. Ralph,322,‡

C. Roland,322,‡ G. Roland,322,‡ G. S. F. Stephans,322,‡ K. Sumorok,322,‡ M. Varma,322,‡ D. Velicanu,322,‡ J. Veverka,322,‡

J. Wang,322,‡ T.W. Wang,322,‡ B. Wyslouch,322,‡ M. Yang,322,‡ V. Zhukova,322,‡ B. Dahmes,323,‡ A. Finkel,323,‡ A. Gude,323,‡

P. Hansen,323,‡ S. Kalafut,323,‡ S. C. Kao,323,‡ K. Klapoetke,323,‡ Y. Kubota,323,‡ Z. Lesko,323,‡ J. Mans,323,‡

S. Nourbakhsh,323,‡ N. Ruckstuhl,323,‡ R. Rusack,323,‡ N. Tambe,323,‡ J. Turkewitz,323,‡ J. G. Acosta,324,‡ S. Oliveros,324,‡

E. Avdeeva,325,‡ K. Bloom,325,‡ S. Bose,325,‡ D. R. Claes,325,‡ A. Dominguez,325,‡ C. Fangmeier,325,‡ R. Gonzalez Suarez,325,‡

R. Kamalieddin,325,‡ J. Keller,325,‡ D. Knowlton,325,‡ I. Kravchenko,325,‡ J. Lazo-Flores,325,‡ F. Meier,325,‡ J. Monroy,325,‡

F. Ratnikov,325,‡ J. E. Siado,325,‡ G. R. Snow,325,‡ M. Alyari,326,‡ J. Dolen,326,‡ J. George,326,‡ A. Godshalk,326,‡ I. Iashvili,326,‡

J. Kaisen,326,‡ A. Kharchilava,326,‡ A. Kumar,326,‡ S. Rappoccio,326,‡ G. Alverson,327,‡ E. Barberis,327,‡ D. Baumgartel,327,‡

M. Chasco,327,‡ A. Hortiangtham,327,‡ A. Massironi,327,‡ D.M. Morse,327,‡ D. Nash,327,‡ T. Orimoto,327,‡

R. Teixeira De Lima,327,‡ D. Trocino,327,‡ R.-J. Wang,327,‡ D. Wood,327,‡ J. Zhang,327,‡ K. A. Hahn,328,‡ A. Kubik,328,‡

N. Mucia,328,‡ N. Odell,328,‡ B. Pollack,328,‡ A. Pozdnyakov,328,‡ M. Schmitt,328,‡ S. Stoynev,328,‡ K. Sung,328,‡

M. Trovato,328,‡ M. Velasco,328,‡ S. Won,328,‡ A. Brinkerhoff,329,‡ N. Dev,329,‡ M. Hildreth,329,‡ C. Jessop,329,‡

D. J. Karmgard,329,‡ N. Kellams,329,‡ K. Lannon,329,‡ S. Lynch,329,‡ N. Marinelli,329,‡ F. Meng,329,‡ C. Mueller,329,‡

Y. Musienko,329,ttt,‡ T. Pearson,329,‡ M. Planer,329,‡ R. Ruchti,329,‡ G. Smith,329,‡ N. Valls,329,‡ M. Wayne,329,‡ M. Wolf,329,‡

A. Woodard,329,‡ L. Antonelli,330,‡ J. Brinson,330,‡ B. Bylsma,330,‡ L. S. Durkin,330,‡ S. Flowers,330,‡ A. Hart,330,‡ C. Hill,330,‡

R. Hughes,330,‡ K. Kotov,330,‡ T. Y. Ling,330,‡ B. Liu,330,‡ W. Luo,330,‡ D. Puigh,330,‡ M. Rodenburg,330,‡ B. L. Winer,330,‡

H.W. Wulsin,330,‡ O. Driga,331,‡ P. Elmer,331,‡ J. Hardenbrook,331,‡ P. Hebda,331,‡ S. A. Koay,331,‡ P. Lujan,331,‡

D. Marlow,331,‡ T. Medvedeva,331,‡ M. Mooney,331,‡ J. Olsen,331,‡ C. Palmer,331,‡ P. Piroué,331,‡ X. Quan,331,‡ H. Saka,331,‡

D. Stickland,331,‡ C. Tully,331,‡ J. S. Werner,331,‡ A. Zuranski,331,‡ V. E. Barnes,332,‡ D. Benedetti,332,‡ D. Bortoletto,332,‡

L. Gutay,332,‡M. K. Jha,332,‡M. Jones,332,‡K. Jung,332,‡M. Kress,332,‡N. Leonardo,332,‡D. H. Miller,332,‡N. Neumeister,332,‡

F. Primavera,332,‡ B. C. Radburn-Smith,332,‡ X. Shi,332,‡ I. Shipsey,332,‡ D. Silvers,332,‡ J. Sun,332,‡ A. Svyatkovskiy,332,‡

F. Wang,332,‡ W. Xie,332,‡ L. Xu,332,‡ J. Zablocki,332,‡ N. Parashar,333,‡ J. Stupak,333,‡ A. Adair,334,‡ B. Akgun,334,‡

Z. Chen,334,‡ K.M. Ecklund,334,‡ F. J. M. Geurts,334,‡ M. Guilbaud,334,‡ W. Li,334,‡ B. Michlin,334,‡ M. Northup,334,‡

B. P. Padley,334,‡ R. Redjimi,334,‡ J. Roberts,334,‡ J. Rorie,334,‡ Z. Tu,334,‡ J. Zabel,334,‡ B. Betchart,335,‡ A. Bodek,335,‡

P. de Barbaro,335,‡ R. Demina,335,‡ Y. Eshaq,335,‡ T. Ferbel,335,‡ M. Galanti,335,‡ A. Garcia-Bellido,335,‡ P. Goldenzweig,335,‡

J. Han,335,‡ A. Harel,335,‡ O. Hindrichs,335,‡ A. Khukhunaishvili,335,‡ G. Petrillo,335,‡ M. Verzetti,335,‡ L. Demortier,336,‡

S. Arora,337,‡ A. Barker,337,‡ J. P. Chou,337,‡ C. Contreras-Campana,337,‡ E. Contreras-Campana,337,‡ D. Duggan,337,‡

D. Ferencek,337,‡ Y. Gershtein,337,‡ R. Gray,337,‡ E. Halkiadakis,337,‡ D. Hidas,337,‡ E. Hughes,337,‡ S. Kaplan,337,‡

R. Kunnawalkam Elayavalli,337,‡ A. Lath,337,‡ S. Panwalkar,337,‡ M. Park,337,‡ S. Salur,337,‡ S. Schnetzer,337,‡

D. Sheffield,337,‡ S. Somalwar,337,‡ R. Stone,337,‡ S. Thomas,337,‡ P. Thomassen,337,‡ M. Walker,337,‡ M. Foerster,338,‡

G. Riley,338,‡ K. Rose,338,‡ S. Spanier,338,‡ A. York,338,‡ O. Bouhali,339,zzzz,‡ A. Castaneda Hernandez,339,‡ M. Dalchenko,339,‡

M. De Mattia,339,‡ A. Delgado,339,‡ S. Dildick,339,‡ R. Eusebi,339,‡ W. Flanagan,339,‡ J. Gilmore,339,‡ T. Kamon,339,aaaaa,‡

V. Krutelyov,339,‡ R. Montalvo,339,‡ R. Mueller,339,‡ I. Osipenkov,339,‡ Y. Pakhotin,339,‡ R. Patel,339,‡ A. Perloff,339,‡

J. Roe,339,‡ A. Rose,339,‡ A. Safonov,339,‡ A. Tatarinov,339,‡ K. A. Ulmer,339,oo,‡ N. Akchurin,340,‡ C. Cowden,340,‡

J. Damgov,340,‡ C. Dragoiu,340,‡ P. R. Dudero,340,‡ J. Faulkner,340,‡ S. Kunori,340,‡ K. Lamichhane,340,‡ S.W. Lee,340,‡

T. Libeiro,340,‡ S. Undleeb,340,‡ I. Volobouev,340,‡ E. Appelt,341,‡ A. G. Delannoy,341,‡ S. Greene,341,‡ A. Gurrola,341,‡

R. Janjam,341,‡ W. Johns,341,‡ C. Maguire,341,‡ Y. Mao,341,‡ A. Melo,341,‡ P. Sheldon,341,‡ B. Snook,341,‡ S. Tuo,341,‡

J. Velkovska,341,‡ Q. Xu,341,‡ M.W. Arenton,342,‡ S. Boutle,342,‡ B. Cox,342,‡ B. Francis,342,‡ J. Goodell,342,‡ R. Hirosky,342,‡

A. Ledovskoy,342,‡ H. Li,342,‡ C. Lin,342,‡ C. Neu,342,‡ E. Wolfe,342,‡ J. Wood,342,‡ F. Xia,342,‡ C. Clarke,343,‡ R. Harr,343,‡

P. E. Karchin,343,‡ C. Kottachchi Kankanamge Don,343,‡ P. Lamichhane,343,‡ J. Sturdy,343,‡ D. A. Belknap,344,‡

D. Carlsmith,344,‡ M. Cepeda,344,‡ A. Christian,344,‡ S. Dasu,344,‡ L. Dodd,344,‡ S. Duric,344,‡ E. Friis,344,‡ B. Gomber,344,‡

R. Hall-Wilton,344,‡ M. Herndon,344,‡ A. Hervé,344,‡ P. Klabbers,344,‡ A. Lanaro,344,‡ A. Levine,344,‡ K. Long,344,‡

R. Loveless,344,‡ A. Mohapatra,344,‡ I. Ojalvo,344,‡ T. Perry,344,‡ G. A. Pierro,344,‡ G. Polese,344,‡ I. Ross,344,‡ T. Ruggles,344,‡

T. Sarangi,344,‡ A. Savin,344,‡ A. Sharma,344,‡ N. Smith,344,‡ W. H. Smith,344,‡ D. Taylor,344,‡ and N. Woods344,‡

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-24

Page 66: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

(ATLAS Collaboration)†(CMS Collaboration)‡

1Department of Physics, University of Adelaide, Adelaide, Australia2Physics Department, SUNY Albany, Albany, New York, USA

3Department of Physics, University of Alberta, Edmonton, Alberta, Canada4aDepartment of Physics, Ankara University, Ankara, Turkey

4bIstanbul Aydin University, Istanbul, Turkey4cDivision of Physics, TOBB University of Economics and Technology, Ankara, Turkey

5LAPP, CNRS/IN2P3 and Université Savoie Mont Blanc, Annecy-le-Vieux, France6High Energy Physics Division, Argonne National Laboratory, Argonne, Illinois, USA

7Department of Physics, University of Arizona, Tucson, Arizona, USA8Department of Physics, The University of Texas at Arlington, Arlington, Texas, USA

9Physics Department, University of Athens, Athens, Greece10Physics Department, National Technical University of Athens, Zografou, Greece

11Institute of Physics, Azerbaijan Academy of Sciences, Baku, Azerbaijan12Institut de Física d’Altes Energies and Departament de Física de la Universitat Autònoma de Barcelona, Barcelona, Spain

13Institute of Physics, University of Belgrade, Belgrade, Serbia14Department for Physics and Technology, University of Bergen, Bergen, Norway

15Physics Division, Lawrence Berkeley National Laboratory and University of California, Berkeley, California, USA16Department of Physics, Humboldt University, Berlin, Germany

17Albert Einstein Center for Fundamental Physics and Laboratory for High Energy Physics, University of Bern, Bern, Switzerland18School of Physics and Astronomy, University of Birmingham, Birmingham, United Kingdom

19aDepartment of Physics, Bogazici University, Istanbul, Turkey19bDepartment of Physics, Dogus University, Istanbul, Turkey

19cDepartment of Physics Engineering, Gaziantep University, Gaziantep, Turkey20aINFN Sezione di Bologna, Bologna, Italy

20bDipartimento di Fisica e Astronomia, Università di Bologna, Bologna, Italy21Physikalisches Institut, University of Bonn, Bonn, Germany

22Department of Physics, Boston University, Boston, Massachusetts, USA23Department of Physics, Brandeis University, Waltham, Massachusetts, USA

24aUniversidade Federal do Rio De Janeiro COPPE/EE/IF, Rio de Janeiro, Brazil24bElectrical Circuits Department, Federal University of Juiz de Fora (UFJF), Juiz de Fora, Brazil

24cFederal University of Sao Joao del Rei (UFSJ), Sao Joao del Rei, Brazil24dInstituto de Fisica, Universidade de Sao Paulo, Sao Paulo, Brazil

25Physics Department, Brookhaven National Laboratory, Upton, New York, USA26aNational Institute of Physics and Nuclear Engineering, Bucharest, Romania

26bNational Institute for Research and Development of Isotopic and Molecular Technologies,Physics Department, Cluj Napoca, Romania

26cUniversity Politehnica Bucharest, Bucharest, Romania26dWest University in Timisoara, Timisoara, Romania

27Departamento de Física, Universidad de Buenos Aires, Buenos Aires, Argentina28Cavendish Laboratory, University of Cambridge, Cambridge, United Kingdom

29Department of Physics, Carleton University, Ottawa, Ontario, Canada30CERN, Geneva, Switzerland

31Enrico Fermi Institute, University of Chicago, Chicago, Illinois, USA32aDepartamento de Física, Pontificia Universidad Católica de Chile, Santiago, Chile

32bDepartamento de Física, Universidad Técnica Federico Santa María, Valparaíso, Chile33aInstitute of High Energy Physics, Chinese Academy of Sciences, Beijing, China

33bDepartment of Modern Physics, University of Science and Technology of China, Anhui, China33cDepartment of Physics, Nanjing University, Jiangsu, China33dSchool of Physics, Shandong University, Shandong, China

33eDepartment of Physics and Astronomy, Shanghai Key Laboratory for Particle Physics and Cosmology,Shanghai Jiao Tong University, Shanghai, China

33fPhysics Department, Tsinghua University, Beijing 100084, China34Laboratoire de Physique Corpusculaire, Clermont Université and Université Blaise Pascal and CNRS/IN2P3,

Clermont-Ferrand, France35Nevis Laboratory, Columbia University, Irvington, New York, USA

36Niels Bohr Institute, University of Copenhagen, Kobenhavn, Denmark

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-25

Page 67: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

37aINFN Gruppo Collegato di Cosenza, Laboratori Nazionali di Frascati, Frascati, Italy37bDipartimento di Fisica, Università della Calabria, Rende, Italy

38aAGH University of Science and Technology, Faculty of Physics and Applied Computer Science, Krakow, Poland38bMarian Smoluchowski Institute of Physics, Jagiellonian University, Krakow, Poland

39Institute of Nuclear Physics Polish Academy of Sciences, Krakow, Poland40Physics Department, Southern Methodist University, Dallas, Texas, USA

41Physics Department, University of Texas at Dallas, Richardson, Texas, USA42DESY, Hamburg and Zeuthen, Germany

43Institut für Experimentelle Physik IV, Technische Universität Dortmund, Dortmund, Germany44Institut für Kern- und Teilchenphysik, Technische Universität Dresden, Dresden, Germany

45Department of Physics, Duke University, Durham, North Carolina, USA46SUPA-School of Physics and Astronomy, University of Edinburgh, Edinburgh, United Kingdom

47INFN Laboratori Nazionali di Frascati, Frascati, Italy48Fakultät für Mathematik und Physik, Albert-Ludwigs-Universität, Freiburg, Germany

49Section de Physique, Université de Genève, Geneva, Switzerland50aINFN Sezione di Genova, Genova, Italy

50bDipartimento di Fisica, Università di Genova, Genova, Italy51aE. Andronikashvili Institute of Physics, Iv. Javakhishvili Tbilisi State University, Tbilisi, Georgia

51bHigh Energy Physics Institute, Tbilisi State University, Tbilisi, Georgia52II Physikalisches Institut, Justus-Liebig-Universität Giessen, Giessen, Germany

53SUPA-School of Physics and Astronomy, University of Glasgow, Glasgow, United Kingdom54II Physikalisches Institut, Georg-August-Universität, Göttingen, Germany

55Laboratoire de Physique Subatomique et de Cosmologie, Université Grenoble-Alpes, CNRS/IN2P3, Grenoble, France56Department of Physics, Hampton University, Hampton, Virginia, USA

57Laboratory for Particle Physics and Cosmology, Harvard University, Cambridge, Massachusetts, USA58aKirchhoff-Institut für Physik, Ruprecht-Karls-Universität Heidelberg, Heidelberg, Germany

58bPhysikalisches Institut, Ruprecht-Karls-Universität Heidelberg, Heidelberg, Germany58cZITI Institut für technische Informatik, Ruprecht-Karls-Universität Heidelberg, Mannheim, Germany

59Faculty of Applied Information Science, Hiroshima Institute of Technology, Hiroshima, Japan60aDepartment of Physics, The Chinese University of Hong Kong, Shatin, N.T., Hong Kong, China

60bDepartment of Physics, The University of Hong Kong, Hong Kong, China60cDepartment of Physics, The Hong Kong University of Science and Technology, Clear Water Bay, Kowloon, Hong Kong, China

61Department of Physics, Indiana University, Bloomington, Indiana, USA62Institut für Astro- und Teilchenphysik, Leopold-Franzens-Universität, Innsbruck, Austria

63University of Iowa, Iowa City, Iowa, USA64Department of Physics and Astronomy, Iowa State University, Ames, Iowa, USA

65Joint Institute for Nuclear Research, JINR Dubna, Dubna, Russia66KEK, High Energy Accelerator Research Organization, Tsukuba, Japan

67Graduate School of Science, Kobe University, Kobe, Japan68Faculty of Science, Kyoto University, Kyoto, Japan

69Kyoto University of Education, Kyoto, Japan70Department of Physics, Kyushu University, Fukuoka, Japan

71Instituto de Física La Plata, Universidad Nacional de La Plata and CONICET, La Plata, Argentina72Physics Department, Lancaster University, Lancaster, United Kingdom

73aINFN Sezione di Lecce, Lecce, Italy73bDipartimento di Matematica e Fisica, Università del Salento, Lecce, Italy

74Oliver Lodge Laboratory, University of Liverpool, Liverpool, United Kingdom75Department of Physics, Jožef Stefan Institute and University of Ljubljana, Ljubljana, Slovenia

76School of Physics and Astronomy, Queen Mary University of London, London, United Kingdom77Department of Physics, Royal Holloway University of London, Surrey, United Kingdom

78Department of Physics and Astronomy, University College London, London, United Kingdom79Louisiana Tech University, Ruston, Louisiana, USA

80Laboratoire de Physique Nucléaire et de Hautes Energies, UPMC and Université Paris-Diderot and CNRS/IN2P3, Paris, France81Fysiska institutionen, Lunds universitet, Lund, Sweden

82Departamento de Fisica Teorica C-15, Universidad Autonoma de Madrid, Madrid, Spain83Institut für Physik, Universität Mainz, Mainz, Germany

84School of Physics and Astronomy, University of Manchester, Manchester, United Kingdom85CPPM, Aix-Marseille Université and CNRS/IN2P3, Marseille, France

86Department of Physics, University of Massachusetts, Amherst, Massachusetts, USA87Department of Physics, McGill University, Montreal, Quebec, Canada

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-26

Page 68: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

88School of Physics, University of Melbourne, Victoria, Australia89Department of Physics, The University of Michigan, Ann Arbor, Michigan, USA

90Department of Physics and Astronomy, Michigan State University, East Lansing, Michigan, USA91aINFN Sezione di Milano, Milano, Italy

91bDipartimento di Fisica, Università di Milano, Milano, Italy92B.I. Stepanov Institute of Physics, National Academy of Sciences of Belarus, Minsk, Republic of Belarus

93National Scientific and Educational Centre for Particle and High Energy Physics, Minsk, Republic of Belarus94Department of Physics, Massachusetts Institute of Technology, Cambridge, Massachusetts, USA

95Group of Particle Physics, University of Montreal, Montreal, Quebec, Canada96P.N. Lebedev Institute of Physics, Academy of Sciences, Moscow, Russia

97Institute for Theoretical and Experimental Physics (ITEP), Moscow, Russia98National Research Nuclear University MEPhI, Moscow, Russia

99D.V. Skobeltsyn Institute of Nuclear Physics, M.V. Lomonosov Moscow State University, Moscow, Russia100Fakultät für Physik, Ludwig-Maximilians-Universität München, München, Germany101Max-Planck-Institut für Physik (Werner-Heisenberg-Institut), München, Germany

102Nagasaki Institute of Applied Science, Nagasaki, Japan103Graduate School of Science and Kobayashi-Maskawa Institute, Nagoya University, Nagoya, Japan

104aINFN Sezione di Napoli, Napoli, Italy104bDipartimento di Fisica, Università di Napoli, Napoli, Italy

105Department of Physics and Astronomy, University of New Mexico, Albuquerque, New Mexico, USA106Institute for Mathematics, Astrophysics and Particle Physics, Radboud University Nijmegen/Nikhef, Nijmegen, Netherlands

107Nikhef National Institute for Subatomic Physics and University of Amsterdam, Amsterdam, Netherlands108Department of Physics, Northern Illinois University, DeKalb, Illinois, USA

109Budker Institute of Nuclear Physics, SB RAS, Novosibirsk, Russia110Department of Physics, New York University, New York, New York, USA

111The Ohio State University, Columbus, Ohio, USA112Faculty of Science, Okayama University, Okayama, Japan

113Homer L. Dodge Department of Physics and Astronomy, University of Oklahoma, Norman, Oklahoma, USA114Department of Physics, Oklahoma State University, Stillwater, Oklahoma, USA

115Palacký University, RCPTM, Olomouc, Czech Republic116Center for High Energy Physics, University of Oregon, Eugene, Oregon, USA

117LAL, Université Paris-Sud and CNRS/IN2P3, Orsay, France118Graduate School of Science, Osaka University, Osaka, Japan

119Department of Physics, University of Oslo, Oslo, Norway120Department of Physics, Oxford University, Oxford, United Kingdom

121aINFN Sezione di Pavia, Pavia, Italy121bDipartimento di Fisica, Università di Pavia, Pavia, Italy

122Department of Physics, University of Pennsylvania, Philadelphia, Pennsylvania, USA123National Research Centre “Kurchatov Institute” B.P.Konstantinov Petersburg Nuclear Physics Institute, St. Petersburg, Russia

124aINFN Sezione di Pisa, Pisa, Italy124bDipartimento di Fisica E. Fermi, Università di Pisa, Pisa, Italy

125Department of Physics and Astronomy, University of Pittsburgh, Pittsburgh, Pennsylvania, USA126aLaboratorio de Instrumentacao e Fisica Experimental de Particulas-LIP, Lisboa, Portugal

126bFaculdade de Ciências, Universidade de Lisboa, Lisboa, Portugal126cDepartment of Physics, University of Coimbra, Coimbra, Portugal

126dCentro de Física Nuclear da Universidade de Lisboa, Lisboa, Portugal126eDepartamento de Fisica, Universidade do Minho, Braga, Portugal

126fDepartamento de Fisica Teorica y del Cosmos and CAFPE, Universidad de Granada, Granada (Spain), Portugal126gDep Fisica and CEFITEC of Faculdade de Ciencias e Tecnologia, Universidade Nova de Lisboa, Caparica, Portugal

127Institute of Physics, Academy of Sciences of the Czech Republic, Praha, Czech Republic128Czech Technical University in Prague, Praha, Czech Republic

129Faculty of Mathematics and Physics, Charles University in Prague, Praha, Czech Republic130State Research Center Institute for High Energy Physics, Protvino, Russia

131Particle Physics Department, Rutherford Appleton Laboratory, Didcot, United Kingdom132aINFN Sezione di Roma, Roma, Italy

132bDipartimento di Fisica, Sapienza Università di Roma, Roma, Italy133aINFN Sezione di Roma Tor Vergata, Roma, Italy

133bDipartimento di Fisica, Università di Roma Tor Vergata, Roma, Italy134aINFN Sezione di Roma Tre, Roma, Italy

134bDipartimento di Matematica e Fisica, Università Roma Tre, Roma, Italy

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-27

Page 69: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

135aFaculté des Sciences Ain Chock, Réseau Universitaire de Physique des Hautes Energies-Université Hassan II,Casablanca, Morocco

135bCentre National de l’Energie des Sciences Techniques Nucleaires, Rabat, Morocco135cFaculté des Sciences Semlalia, Université Cadi Ayyad, LPHEA-Marrakech, Morocco135dFaculté des Sciences, Université Mohamed Premier and LPTPM, Oujda, Morocco

135eFaculté des sciences, Université Mohammed V-Agdal, Rabat, Morocco136DSM/IRFU (Institut de Recherches sur les Lois Fondamentales de l’Univers), CEA Saclay (Commissariat à l’Energie Atomique et

aux Energies Alternatives), Gif-sur-Yvette, France137Santa Cruz Institute for Particle Physics, University of California Santa Cruz, Santa Cruz, California, USA

138Department of Physics, University of Washington, Seattle, Washington, USA139Department of Physics and Astronomy, University of Sheffield, Sheffield, United Kingdom

140Department of Physics, Shinshu University, Nagano, Japan141Fachbereich Physik, Universität Siegen, Siegen, Germany

142Department of Physics, Simon Fraser University, Burnaby, British Columbia, Canada143SLAC National Accelerator Laboratory, Stanford, California, USA

144aFaculty of Mathematics, Physics & Informatics, Comenius University, Bratislava, Slovak Republic144bDepartment of Subnuclear Physics, Institute of Experimental Physics of the Slovak Academy of Sciences, Kosice, Slovak Republic

145aDepartment of Physics, University of Cape Town, Cape Town, South Africa145bDepartment of Physics, University of Johannesburg, Johannesburg, South Africa145cSchool of Physics, University of the Witwatersrand, Johannesburg, South Africa

146aDepartment of Physics, Stockholm University, Sweden146bThe Oskar Klein Centre, Stockholm, Sweden

147Physics Department, Royal Institute of Technology, Stockholm, Sweden148Departments of Physics & Astronomy and Chemistry, Stony Brook University, Stony Brook, New York, USA

149Department of Physics and Astronomy, University of Sussex, Brighton, United Kingdom150School of Physics, University of Sydney, Sydney, Australia

151Institute of Physics, Academia Sinica, Taipei, Taiwan152Department of Physics, Technion: Israel Institute of Technology, Haifa, Israel

153Raymond and Beverly Sackler School of Physics and Astronomy, Tel Aviv University, Tel Aviv, Israel154Department of Physics, Aristotle University of Thessaloniki, Thessaloniki, Greece

155International Center for Elementary Particle Physics and Department of Physics, The University of Tokyo, Tokyo, Japan156Graduate School of Science and Technology, Tokyo Metropolitan University, Tokyo, Japan

157Department of Physics, Tokyo Institute of Technology, Tokyo, Japan158Department of Physics, University of Toronto, Toronto, Ontario, Canada

159aTRIUMF, Vancouver, British Columbia, Canada159bDepartment of Physics and Astronomy, York University, Toronto, Ontario, Canada

160Faculty of Pure and Applied Sciences, University of Tsukuba, Tsukuba, Japan161Department of Physics and Astronomy, Tufts University, Medford, Massachusetts, USA

162Centro de Investigaciones, Universidad Antonio Narino, Bogota, Colombia163Department of Physics and Astronomy, University of California Irvine, Irvine, California, USA

164aINFN Gruppo Collegato di Udine, Sezione di Trieste, Udine, Italy164bICTP, Trieste, Italy

164cDipartimento di Chimica, Fisica e Ambiente, Università di Udine, Udine, Italy165Department of Physics, University of Illinois, Urbana, Illinois, USA

166Department of Physics and Astronomy, University of Uppsala, Uppsala, Sweden167Instituto de Física Corpuscular (IFIC) and Departamento de Física Atómica, Molecular y Nuclear and Departamento de Ingeniería

Electrónica and Instituto de Microelectrónica de Barcelona (IMB-CNM), University of Valencia and CSIC, Valencia, Spain168Department of Physics, University of British Columbia, Vancouver, British Columbia, Canada

169Department of Physics and Astronomy, University of Victoria, Victoria, British Columbia, Canada170Department of Physics, University of Warwick, Coventry, United Kingdom

171Waseda University, Tokyo, Japan172Department of Particle Physics, The Weizmann Institute of Science, Rehovot, Israel

173Department of Physics, University of Wisconsin, Madison, Wisconsin, USA174Fakultät für Physik und Astronomie, Julius-Maximilians-Universität, Würzburg, Germany

175Fachbereich C Physik, Bergische Universität Wuppertal, Wuppertal, Germany176Department of Physics, Yale University, New Haven, Connecticut, USA

177Yerevan Physics Institute, Yerevan, Armenia178Centre de Calcul de l’Institut National de Physique Nucléaire et de Physique des Particules (IN2P3), Villeurbanne, France

179Yerevan Physics Institute, Yerevan, Armenia180Institut für Hochenergiephysik der OeAW, Wien, Austria

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-28

Page 70: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

181National Centre for Particle and High Energy Physics, Minsk, Belarus182Universiteit Antwerpen, Antwerpen, Belgium183Vrije Universiteit Brussel, Brussel, Belgium

184Université Libre de Bruxelles, Bruxelles, Belgium185Ghent University, Ghent, Belgium

186Université Catholique de Louvain, Louvain-la-Neuve, Belgium187Université de Mons, Mons, Belgium

188Centro Brasileiro de Pesquisas Fisicas, Rio de Janeiro, Brazil189Universidade do Estado do Rio de Janeiro, Rio de Janeiro, Brazil

190aUniversidade Estadual Paulista, São Paulo, Brazil190bUniversidade Federal do ABC, São Paulo, Brazil

191Institute for Nuclear Research and Nuclear Energy, Sofia, Bulgaria192University of Sofia, Sofia, Bulgaria

193Institute of High Energy Physics, Beijing, China194State Key Laboratory of Nuclear Physics and Technology, Peking University, Beijing, China

195Universidad de Los Andes, Bogota, Colombia196University of Split, Faculty of Electrical Engineering, Mechanical Engineering and Naval Architecture, Split, Croatia

197University of Split, Faculty of Science, Split, Croatia198Institute Rudjer Boskovic, Zagreb, Croatia

199University of Cyprus, Nicosia, Cyprus200Charles University, Prague, Czech Republic

201Academy of Scientific Research and Technology of the Arab Republic of Egypt,Egyptian Network of High Energy Physics, Cairo, Egypt

202National Institute of Chemical Physics and Biophysics, Tallinn, Estonia203Department of Physics, University of Helsinki, Helsinki, Finland

204Helsinki Institute of Physics, Helsinki, Finland205Lappeenranta University of Technology, Lappeenranta, Finland

206DSM/IRFU, CEA/Saclay, Gif-sur-Yvette, France207Laboratoire Leprince-Ringuet, Ecole Polytechnique, IN2P3-CNRS, Palaiseau, France

208Institut Pluridisciplinaire Hubert Curien, Université de Strasbourg, Université de Haute Alsace Mulhouse,CNRS/IN2P3, Strasbourg, France

209Centre de Calcul de l’Institut National de Physique Nucleaire et de Physique des Particules, CNRS/IN2P3, Villeurbanne, France210Université de Lyon, Université Claude Bernard Lyon 1, CNRS-IN2P3, Institut de Physique Nucléaire de Lyon, Villeurbanne, France

211Institute of High Energy Physics and Informatization, Tbilisi State University, Tbilisi, Georgia212RWTH Aachen University, I. Physikalisches Institut, Aachen, Germany

213RWTH Aachen University, III. Physikalisches Institut A, Aachen, Germany214RWTH Aachen University, III. Physikalisches Institut B, Aachen, Germany

215Deutsches Elektronen-Synchrotron, Hamburg, Germany216University of Hamburg, Hamburg, Germany

217Institut für Experimentelle Kernphysik, Karlsruhe, Germany218Institute of Nuclear and Particle Physics (INPP), NCSR Demokritos, Aghia Paraskevi, Greece

219University of Athens, Athens, Greece220University of Ioánnina, Ioánnina, Greece

221Wigner Research Centre for Physics, Budapest, Hungary222Institute of Nuclear Research ATOMKI, Debrecen, Hungary

223University of Debrecen, Debrecen, Hungary224National Institute of Science Education and Research, Bhubaneswar, India

225Panjab University, Chandigarh, India226University of Delhi, Delhi, India

227Saha Institute of Nuclear Physics, Kolkata, India228Bhabha Atomic Research Centre, Mumbai, India

229Tata Institute of Fundamental Research, Mumbai, India230Indian Institute of Science Education and Research (IISER), Pune, India

231Institute for Research in Fundamental Sciences (IPM), Tehran, Iran232University College Dublin, Dublin, Ireland

233aINFN Sezione di Bari, Bari, Italy233bUniversità di Bari, Bari, Italy233cPolitecnico di Bari, Bari, Italy

234aINFN Sezione di Bologna, Bologna, Italy234bUniversità di Bologna, Bologna, Italy

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-29

Page 71: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

235aINFN Sezione di Catania, Catania, Italy235bUniversità di Catania, Catania, Italy

235cCSFNSM, Catania, Italy236aINFN Sezione di Firenze, Firenze, Italy

236bUniversità di Firenze, Firenze, Italy237INFN Laboratori Nazionali di Frascati, Frascati, Italy

238aINFN Sezione di Genova, Genova, Italy238bUniversità di Genova, Genova, Italy

239aINFN Sezione di Milano-Bicocca, Milano, Italy239bUniversità di Milano-Bicocca, Milano, Italy

240aINFN Sezione di Napoli, Napoli, Italy240bUniversità di Napoli “Federico II,” Napoli, Italy

240cUniversità della Basilicata, Roma, Italy240dUniversità G. Marconi, Roma, Italy

241aINFN Sezione di Padova, Padova, Italy241bUniversità di Padova, Padova, Italy241cUniversità di Trento, Trento, Italy

242aINFN Sezione di Pavia, Pavia, Italy242bUniversità di Pavia, Pavia, Italy

243aINFN Sezione di Perugia, Perugia, Italy243bUniversità di Perugia, Perugia, Italy

244aINFN Sezione di Pisa, Pisa, Italy244bUniversità di Pisa, Pisa, Italy

244cScuola Normale Superiore di Pisa, Pisa, Italy245aINFN Sezione di Roma, Roma, Italy

245bUniversità di Roma, Roma, Italy246aINFN Sezione di Torino, Novara, Italy

246bUniversità di Torino, Novara, Italy246cUniversità del Piemonte Orientale, Novara, Italy

247aINFN Sezione di Trieste, Trieste, Italy247bUniversità di Trieste, Trieste, Italy

248Kangwon National University, Chunchon, Korea249Kyungpook National University, Daegu, Korea250Chonbuk National University, Jeonju, Korea

251Chonnam National University, Institute for Universe and Elementary Particles, Kwangju, Korea252Korea University, Seoul, Korea

253Seoul National University, Seoul, Korea254University of Seoul, Seoul, Korea

255Sungkyunkwan University, Suwon, Korea256Vilnius University, Vilnius, Lithuania

257National Centre for Particle Physics, Universiti Malaya, Kuala Lumpur, Malaysia258Centro de Investigacion y de Estudios Avanzados del IPN, Mexico City, Mexico

259Universidad Iberoamericana, Mexico City, Mexico260Benemerita Universidad Autonoma de Puebla, Puebla, Mexico

261Universidad Autónoma de San Luis Potosí, San Luis Potosí, Mexico262University of Auckland, Auckland, New Zealand

263University of Canterbury, Christchurch, New Zealand264National Centre for Physics, Quaid-I-Azam University, Islamabad, Pakistan

265National Centre for Nuclear Research, Swierk, Poland266Institute of Experimental Physics, Faculty of Physics, University of Warsaw, Warsaw, Poland

267Laboratório de Instrumentação e Física Experimental de Partículas, Lisboa, Portugal268Joint Institute for Nuclear Research, Dubna, Russia

269Petersburg Nuclear Physics Institute, Gatchina (St. Petersburg), Russia270Institute for Nuclear Research, Moscow, Russia

271Institute for Theoretical and Experimental Physics, Moscow, Russia272P.N. Lebedev Physical Institute, Moscow, Russia

273Skobeltsyn Institute of Nuclear Physics, Lomonosov Moscow State University, Moscow, Russia274State Research Center of Russian Federation, Institute for High Energy Physics, Protvino, Russia

275University of Belgrade, Faculty of Physics and Vinca Institute of Nuclear Sciences, Belgrade, Serbia276Centro de Investigaciones Energéticas Medioambientales y Tecnológicas (CIEMAT), Madrid, Spain

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-30

Page 72: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

277Universidad Autónoma de Madrid, Madrid, Spain278Universidad de Oviedo, Oviedo, Spain

279Instituto de Física de Cantabria (IFCA), CSIC-Universidad de Cantabria, Santander, Spain280CERN, European Organization for Nuclear Research, Geneva, Switzerland

281Paul Scherrer Institut, Villigen, Switzerland282Institute for Particle Physics, ETH Zurich, Zurich, Switzerland

283Universität Zürich, Zurich, Switzerland284National Central University, Chung-Li, Taiwan

285National Taiwan University (NTU), Taipei, Taiwan286Chulalongkorn University, Faculty of Science, Department of Physics, Bangkok, Thailand

287Cukurova University, Adana, Turkey288Middle East Technical University, Physics Department, Ankara, Turkey

289Bogazici University, Istanbul, Turkey290Istanbul Technical University, Istanbul, Turkey

291Institute for Scintillation Materials of National Academy of Science of Ukraine, Kharkov, Ukraine292National Scientific Center, Kharkov Institute of Physics and Technology, Kharkov, Ukraine

293University of Bristol, Bristol, United Kingdom294Rutherford Appleton Laboratory, Didcot, United Kingdom

295Imperial College, London, United Kingdom296Brunel University, Uxbridge, United Kingdom

297Baylor University, Waco, Texas, USA298The University of Alabama, Tuscaloosa, Alabama, USA

299Boston University, Boston, Massachusetts, USA300Brown University, Providence, Rhode Island, USA

301University of California, Davis, Davis, California, USA302University of California, Los Angeles, Los Angeles, California, USA

303University of California, Riverside, Riverside, California, USA304University of California, San Diego, La Jolla, California, USA

305University of California, Santa Barbara, Santa Barbara, California, USA306California Institute of Technology, Pasadena, California, USA307Carnegie Mellon University, Pittsburgh, Pennsylvania, USA308University of Colorado at Boulder, Boulder, Colorado, USA

309Cornell University, Ithaca, New York, USA310Fermi National Accelerator Laboratory, Batavia, Illinois, USA

311University of Florida, Gainesville, Florida, USA312Florida International University, Miami, Florida, USA313Florida State University, Tallahassee, Florida, USA

314Florida Institute of Technology, Melbourne, Florida, USA315University of Illinois at Chicago (UIC), Chicago, Illinois, USA

316The University of Iowa, Iowa City, Iowa, USA317Johns Hopkins University, Baltimore, Maryland, USA318The University of Kansas, Lawrence, Kansas, USA319Kansas State University, Manhattan, Kansas, USA

320Lawrence Livermore National Laboratory, Livermore, California, USA321University of Maryland, College Park, Maryland, USA

322Massachusetts Institute of Technology, Cambridge, Massachusetts, USA323University of Minnesota, Minneapolis, Minnesota, USA

324University of Mississippi, Oxford, Mississippi, USA325University of Nebraska-Lincoln, Lincoln, Nebraska, USA

326State University of New York at Buffalo, Buffalo, New York, USA327Northeastern University, Boston, Massachusetts, USA

328Northwestern University, Evanston, Illinois, USA329University of Notre Dame, Notre Dame, Indiana, USA

330The Ohio State University, Columbus, Ohio, USA331Princeton University, Princeton, New Jersey, USA332Purdue University, West Lafayette, Indiana, USA

333Purdue University Calumet, Hammond, Indiana, USA334Rice University, Houston, Texas, USA

335University of Rochester, Rochester, New York, USA336The Rockefeller University, New York, New York, USA

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-31

Page 73: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

337Rutgers, The State University of New Jersey, Piscataway, New Jersey, USA338University of Tennessee, Knoxville, Tennessee, USA

339Texas A&M University, College Station, Maryland, USA340Texas Tech University, Lubbock, Texas, USA

341Vanderbilt University, Nashville, Tennessee, USA342University of Virginia, Charlottesville, Virginia, USA

343Wayne State University, Detroit, Michigan, USA344University of Wisconsin, Madison, Wisconsin, USA

aDeceased.bAlso at Department of Physics, King’s College London, London, United Kingdom.cAlso at Institute of Physics, Azerbaijan Academy of Sciences, Baku, Azerbaijan.dAlso at Novosibirsk State University, Novosibirsk, Russia.eAlso at TRIUMF, Vancouver, BC, Canada.fAlso at Department of Physics, California State University, Fresno, CA, USA.gAlso at Department of Physics, University of Fribourg, Fribourg, Switzerland.hAlso at Departamento de Fisica e Astronomia, Faculdade de Ciencias, Universidade do Porto, Portugal.iAlso at Tomsk State University, Tomsk, Russia.jAlso at CPPM, Aix-Marseille Université and CNRS/IN2P3, Marseille, France.kAlso at Università di Napoli Parthenope, Napoli, Italy.lAlso at Institute of Particle Physics (IPP), Canada.

mAlso at Particle Physics Department, Rutherford Appleton Laboratory, Didcot, United Kingdom.nAlso at Department of Physics, St. Petersburg State Polytechnical University, St. Petersburg, Russia.oAlso at Louisiana Tech University, Ruston, LA, USA.pAlso at Institucio Catalana de Recerca i Estudis Avancats, ICREA, Barcelona, Spain.qAlso at Department of Physics, National Tsing Hua University, Taiwan.rAlso at Department of Physics, The University of Texas at Austin, Austin, TX, USA.sAlso at Institute of Theoretical Physics, Ilia State University, Tbilisi, Georgia.tAlso at CERN, Geneva, Switzerland.uAlso at Georgian Technical University (GTU),Tbilisi, Georgia.vAlso at Ochadai Academic Production, Ochanomizu University, Tokyo, Japan.wAlso at Manhattan College, New York, NY, USA.xAlso at Institute of Physics, Academia Sinica, Taipei, Taiwan.yAlso at LAL, Université Paris-Sud and CNRS/IN2P3, Orsay, France.zAlso at Academia Sinica Grid Computing, Institute of Physics, Academia Sinica, Taipei, Taiwan.aaAlso at School of Physics, Shandong University, Shandong, China.bbAlso at Moscow Institute of Physics and Technology State University, Dolgoprudny, Russia.ccAlso at Section de Physique, Université de Genève, Geneva, Switzerland.ddAlso at International School for Advanced Studies (SISSA), Trieste, Italy.eeAlso at Department of Physics and Astronomy, University of South Carolina, Columbia, SC, USA.ffAlso at School of Physics and Engineering, Sun Yat-sen University, Guangzhou, China.ggAlso at Faculty of Physics, M.V.Lomonosov Moscow State University, Moscow, Russia.hhAlso at National Research Nuclear University MEPhI, Moscow, Russia.iiAlso at Department of Physics, Stanford University, Stanford, CA, USA.jjAlso at Institute for Particle and Nuclear Physics, Wigner Research Centre for Physics, Budapest, Hungary.kkAlso at Department of Physics, The University of Michigan, Ann Arbor, MI, USA.llAlso at Discipline of Physics, University of KwaZulu-Natal, Durban, South Africa.

mmAlso at University of Malaya, Department of Physics, Kuala Lumpur, Malaysia.nnAlso at Vienna University of Technology, Vienna, Austria.ooAlso at CERN, European Organization for Nuclear Research, Geneva, Switzerland.ppAlso at State Key Laboratory of Nuclear Physics and Technology, Peking University, Beijing, China.qqAlso at Institut Pluridisciplinaire Hubert Curien, Université de Strasbourg, Université de Haute Alsace Mulhouse, CNRS/IN2P3,Strasbourg, France.rrAlso at National Institute of Chemical Physics and Biophysics, Tallinn, Estonia.ssAlso at Skobeltsyn Institute of Nuclear Physics, Lomonosov Moscow State University, Moscow, Russia.ttAlso at Universidade Estadual de Campinas, Campinas, Brazil.uuAlso at Centre National de la Recherche Scientifique (CNRS)–IN2P3, Paris, France.vvAlso at Laboratoire Leprince-Ringuet, Ecole Polytechnique, IN2P3–CNRS, Palaiseau, France.wwAlso at Joint Institute for Nuclear Research, Dubna, Russia.xxAlso at Ain Shams University, Cairo, Egypt.

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-32

Page 74: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

yyAlso at British University in Egypt, Cairo, Egypt.zzAlso at Helwan University, Cairo, Egypt.aaaAlso at Suez University, Suez, Egypt.bbbAlso at Cairo University, Cairo, Egypt.cccAlso at Fayoum University, El-Fayoum, Egypt.dddAlso at Université de Haute Alsace, Mulhouse, France.eeeAlso at Brandenburg University of Technology, Cottbus, Germany.fffAlso at Institute of Nuclear Research ATOMKI, Debrecen, Hungary.

gggAlso at Eötvös Loránd University, Budapest, Hungary.hhhAlso at University of Debrecen, Debrecen, Hungary.iiiAlso at Wigner Research Centre for Physics, Budapest, Hungary.jjjAlso at University of Visva-Bharati, Santiniketan, India.

kkkAlso at King Abdulaziz University, Jeddah, Saudi Arabia.lllAlso at University of Ruhuna, Matara, Sri Lanka.

mmmAlso at Isfahan University of Technology, Isfahan, Iran.nnnAlso at University of Tehran, Department of Engineering Science, Tehran, Iran.oooAlso at Plasma Physics Research Center, Science and Research Branch, Islamic Azad University, Tehran, Iran.pppAlso at Università degli Studi di Siena, Siena, Italy.qqqAlso at Purdue University, West Lafayette, IN, USA.rrrAlso at International Islamic University of Malaysia, Kuala Lumpur, Malaysia.sssAlso at Consejo National de Ciencia y Tecnologia, Mexico, Mexico.tttAlso at Institute for Nuclear Research, Moscow, Russia.

uuuAlso at Institute of High Energy Physics and Informatization, Tbilisi State University, Tbilisi, Georgia.vvvAlso at St. Petersburg State Polytechnical University, St. Petersburg, Russia.

wwwAlso at National Research Nuclear University ’Moscow Engineering Physics Institute’ (MEPhI), Moscow, Russia.xxxAlso at California Institute of Technology, Pasadena, CA, USA.yyyAlso at Faculty of Physics, University of Belgrade, Belgrade, Serbia.zzzAlso at Facoltà Ingegneria, Università di Roma, Roma, Italy.aaaaAlso at National Technical University of Athens, Athens, Greece.bbbbAlso at Scuola Normale e Sezione dell’INFN, Pisa, Italy.ccccAlso at University of Athens, Athens, Greece.ddddAlso at Warsaw University of Technology, Institute of Electronic Systems, Warsaw, Poland.eeeeAlso at Institute for Theoretical and Experimental Physics, Moscow, Russia.ffffAlso at Albert Einstein Center for Fundamental Physics, Bern, Switzerland.

ggggAlso at Adiyaman University, Adiyaman, Turkey.hhhhAlso at Mersin University, Mersin, Turkey.iiiiAlso at Cag University, Mersin, Turkey.jjjjAlso at Piri Reis University, Istanbul, Turkey.

kkkkAlso at Gaziosmanpasa University, Tokat, Turkey.llllAlso at Ozyegin University, Istanbul, Turkey.

mmmmAlso at Izmir Institute of Technology, Izmir, Turkey.nnnnAlso at Mimar Sinan University, Istanbul, Istanbul, Turkey.ooooAlso at Marmara University, Istanbul, Turkey.ppppAlso at Kafkas University, Kars, Turkey.qqqqAlso at Yildiz Technical University, Istanbul, Turkey.rrrrAlso at Hacettepe University, Ankara, Turkey.ssssAlso at Rutherford Appleton Laboratory, Didcot, United Kingdom.ttttAlso at School of Physics and Astronomy, University of Southampton, Southampton, United Kingdom.

uuuuAlso at Instituto de Astrofísica de Canarias, La Laguna, Spain.vvvvAlso at Utah Valley University, Orem, UT, USA.

wwwwAlso at University of Belgrade, Faculty of Physics and Vinca Institute of Nuclear Sciences, Belgrade, Serbia.xxxxAlso at Argonne National Laboratory, Argonne, IL, USA.yyyyAlso at Erzincan University, Erzincan, Turkey.zzzzAlso at Texas A&M University at Qatar, Doha, Qatar.aaaaaAlso at Kyungpook National University, Daegu, Korea.

PRL 114, 191803 (2015) P HY S I CA L R EV I EW LE T T ER S week ending15 MAY 2015

191803-33

Page 75: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Fragile Families Challenge

A mass collaboration combining predictive modeling, causalinference, and qualitative interviews to improve the lives ofdisadvantaged children in the US.

By working together we can do (provably) better than any of uscan do individually.

Page 76: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Fragile Families Challenge

A mass collaboration combining predictive modeling, causalinference, and qualitative interviews to improve the lives ofdisadvantaged children in the US.

By working together we can do (provably) better than any of uscan do individually.

Page 77: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Fragile Families Challenge will help:

I prioritize issues for randomized controlled trials

I find “dark matter”

I change the way that social science happens

Page 78: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Fragile Families Challenge will help:

I prioritize issues for randomized controlled trials

I find “dark matter”

I change the way that social science happens

Page 79: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Fragile Families Challenge will help:

I prioritize issues for randomized controlled trials

I find “dark matter”

I change the way that social science happens

Page 80: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

I Birth cohort panel study

I ≈ 5,000 children born in 20 U.S. cities

I Followed from birth through age 15

Page 81: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 82: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 83: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Fragile Families Challenge:

1. common task method (e.g., Netflix Prize)

2. use submissions to do cool stuff

Page 84: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Fragile Families Challenge:

1. common task method (e.g., Netflix Prize)

2. use submissions to do cool stuff

Page 85: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

1. standard common task method (e.g., Netflix Prize)

2. use submissions to do cool stuff

Page 86: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 87: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 88: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 89: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 90: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Use community model to

I prioritize issues for randomized controlled trials

I look for “dark matter”

Page 91: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Use community model to

I prioritize issues for randomized controlled trials

I look for “dark matter”

Page 92: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 93: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Causal inference from observational data:

I Perfectly match two kids who are identical except whetherthey were evicted or not

I Propensity score matching (roughly, one dimensionalmatching)

I Community model produces propensity scores used formatching

Page 94: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Causal inference from observational data:

I Perfectly match two kids who are identical except whetherthey were evicted or not

I Propensity score matching (roughly, one dimensionalmatching)

I Community model produces propensity scores used formatching

Page 95: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Causal inference from observational data:

I Perfectly match two kids who are identical except whetherthey were evicted or not

I Propensity score matching (roughly, one dimensionalmatching)

I Community model produces propensity scores used formatching

Page 96: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

●●

●●

●●

●● ●

●●

●●● ●● ●● ●●

● ●

● ●

●●

● ●

●●

● ●

● ●

● ●

● ●●● ●

●●

● ●

●● ●

●●

● ●● ●● ●

●● ●●●●

● ●

●●●

●●● ●

●● ●●●

● ● ●●●

● ●

● ●

●●

●●

● ●

0

1

2

3

4

0 1 2 3 4 5Income / poverty line

Num

ber

of c

hild

ren

● Observed eviction

0.05

0.10

0.15

P(Evicted)

Eviction DGP

pi = logit−1

(−Income +

Number of kids

2− 3.5

)Evictedi ∼ Bernoulli(pi )

Page 97: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

●●

●●

●●

●● ●

●●

●●● ●● ●● ●●

● ●

● ●

●●

● ●

●●

● ●

● ●

● ●

● ●●● ●

●●

● ●

●● ●

●●

● ●● ●● ●

●● ●●●●

● ●

●●●

●●● ●

●● ●●●

● ● ●●●

● ●

● ●

●●

●●

● ●

0

1

2

3

4

0 1 2 3 4 5Income / poverty line

Num

ber

of c

hild

ren

● Observed eviction

0.05

0.10

0.15

P(Evicted)

Eviction DGP

pi = logit−1

(−Income +

Number of kids

2− 3.5

)Evictedi ∼ Bernoulli(pi )

Page 98: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

I A social scientist submits a logistic regression

logit−1(pi ) = β0 +

Not in DGP︷ ︸︸ ︷β1(Race)i + β2(Sex)i +

In true DGP︷ ︸︸ ︷β3(Income)i

I A data scientist submits a random forest

pi = f (

Not in DGP︷ ︸︸ ︷Race, Sex,

In DGP︷ ︸︸ ︷Number of children)

I A famous professor uses a new measure of “cultural capital”

pi = logit−1β0 +

Not in DGP︷ ︸︸ ︷β1(Race) + β2(Sex) + β3(Cultural capital)

Page 99: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

● ●

●●

●●

●●

●●●●

●●

●●●

●●

●●

●●

●●

●●●●

●●●

●●●

● ●

●●

●●

●●

●●

● ●

●●

●●

●●

● ●

●●

●●

●●●●

●●

●●

●●

●●

●●

●●

●●●●●

●●●

●●

●●

●●●

●●●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

0.00

0.05

0.10

0.15

0.00 0.05 0.10 0.15True P(Eviction)

Mod

eled

P(E

vict

ion)

Logit, Brier = 0.0346

Page 100: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

●●

●●

●●

●● ●●●

●●

●●

● ●

●● ●●

●●●

●●

●●

● ●

● ● ●

●●

●●

●● ●

●●

●●

●●

● ●

●●

●●

●●

● ●

●●●

●●●

●●

●●

●●

●●●

●●

● ●

●●●

●●

● ●

●●

●●

● ●●

●●

●●●

●●

● ●

●●

● ●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

● ●●

●●

●●

●● ●

●●

●●

●●

●●

●●

●●

● ●●

●●

●●

●●●

●●

●● ●●

●●

●●

●●

●●● ●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●● ● ●

● ●

●●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

● ●

● ● ●

● ●

● ●●●

●●●

●●●

●●

●●

●●●●

●●●

●●

● ●

●●

●●

● ●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●●

●●

●● ●

●● ●

●●

●●

●●●

●●

● ●

● ●

●●

●●

● ●

● ●●

● ●●

●●

●●

0.00

0.05

0.10

0.15

0.00 0.05 0.10 0.15True P(Eviction)

Mod

eled

P(E

vict

ion)

RF, Brier = 0.035

Page 101: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

●●

●●

● ●

●●

●●●

●●

●●

● ●

● ●● ●●

● ●

●●

●●

● ●

●●●●

●● ●●

●● ●●

●●●

● ●● ●

●●

●● ●

●●●●●

● ●

●●●

● ●

●●

● ●●●

● ●

●●

●●

● ●

●●

●●●

●●

● ●

●●

●●

●●

●●

●●

● ●

●● ●

●●

●●●

● ●

●●●

●●●

●● ●

● ●●

● ●●

●●

●●

●●

●● ●

●●

●● ●

● ●

● ●

●●

●●

●●

● ●

●●

●●

● ●

●●

● ●

●●

●●●

●●

●●

●●

●●

●●

●●●●

●●

●●

● ●

● ●

●●

●●●

●●

●● ●

● ● ●

●●

●●

● ●

●●

●●

●●

●●●

● ●●

●●

●●●●

●●

●●●

●●●

●●

●●●

●● ●

●●●

● ●

●●

●●●

●● ●

● ●

●●

●●

●● ●

●●●

●●

●●

●●

●●

●● ●

●●●

● ● ●

●●

●●

●●

● ●●

●●

●●

● ●

●●

●● ●

●●

●●

●●

●●●

●●

●●

●●

●● ●●

●●●

● ●

● ●

●●●

●●● ●

●●

●●

●●

●●

●●

●●

● ●

●●

●● ●

●●

●●

●●

●●

● ●●

● ●●●

●●●

●●

●●

●●

● ●

●●●●●

●●

●●

●●

●● ●●

● ●●●●

● ●

● ●

●●

●●

●●

●● ●

●●

●●

●● ●

● ●

● ●●

● ●

●●

●● ●●

●●●

●●●

●● ●

●● ●

0.00

0.05

0.10

0.15

0.00 0.05 0.10 0.15True P(Eviction)

Mod

eled

P(E

vict

ion)

Culture, Brier = 0.0355

Page 102: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

●●

●●

● ●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

● ●

●●●

●●●

●● ●

●● ●

●●

●●

●●

● ●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●●

●●

●●

●●

●●

●●●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

● ●●

●● ●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

● ●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

0.00

0.05

0.10

0.15

0.00 0.05 0.10 0.15True P(Eviction)

Mod

eled

P(E

vict

ion)

SL, Brier = 0.0345

Page 103: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

● ●

●●

●●

●●

●●

●●

●●●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●●●●

●●●

●●●

●●●

● ●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

● ●

●●

●●

● ●

●●

●●●●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●●●

●●●

●●●

●●

●●

● ●

●●●

●●

●●●●

●●

●●

●●●

●●

●●

●●

●●

●●●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

● ●

●●

●●

●●

●●

●●

● ●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●● ●

● ●

● ●●

●●

●●

●●

●● ●●●

●●

●●

● ●

●●

●●●●●

●●

●●●

●●

●●

●●

●●

● ●

● ● ●

● ●●●

●● ●

●●

●●

●●

●●

●●

●●

● ●

● ●

●●

●●

●●

● ●

●●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●●

●●

● ●

●●●

●●

●●

● ●

●●

●●

●●●

●●●

●●●

●●

● ●

●●

●● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●●

●●

●●

●●

●●

● ●

●●

●● ●

●● ●

● ●●● ●

●●

●●●

●●

●●

●●

●●●●

●●

●●

● ●●

●●

●●

●●●●

●●●

●●

●● ●●

●●

●●

●●●

●●●●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●● ● ●

● ●

●● ●

●●

● ●

●●

●●

●●

● ●

●●

●●

●●

●●●

●●

●● ●

●●

●●●●

● ●

● ● ●

● ●

●● ●●●

●●● ●●●

●●

●●

●●●●

●●●

●●

●●

● ●

●●

●●

●●

●●

●●●

●●

● ●●

●●

● ●

●●

●●

●●●

●●

● ●

● ●

●●

●●

●●

●●

●●

● ●●

●●

●● ●

●● ●

●● ●●

● ●●●

● ●

● ●

● ●

●●

●●

● ●

● ●●

● ●●●

●●

●●

●● ●

●●

●● ●● ●

●●

●●●

●●●●

●●

●●

●●

●●●

● ●●

●● ●● ●●

● ●

●●

● ●●●●

●● ●

●●●●●

●●

●● ●●

●●

●● ●●

●●●

● ●● ●

●●

● ●●●

●● ●●

●●●● ●●

● ●

●●

●● ● ●● ●

●●● ●●●

● ●

●●

●●

●●

● ●

●●

●●●●

●● ●●●

●●

● ●

●●●

●●

●●

●●

●●

●●

●●

●●●

●●● ●

●● ●●

●●

●●

● ●

●● ●

● ●●● ● ●

●●

●●●●● ●

● ●●● ●●

●●

●●●

●●

●●

●●

●● ●● ●

● ●

●● ●

●●

● ●

●●

●●

● ●●●

●●●

● ●

● ●●

●●

●●

●●

●●●

● ●

●●

● ●●

●●●

●●●●

●●

●●

●●

● ●

●●

● ● ●●●●

●●●

●●●

●●

●●

●●

● ●

●●

●● ●

● ●●

●●●

●●

●●●●

● ● ●●

●●

●●

● ●

●●

●●

●●

● ●

●●

●●

●●●

● ● ●●

●●

●●● ●

●●

● ●●●

●●

●● ●●●●●● ●●●●

●● ●

●●

●● ●● ●

●●

● ●● ●●

●●

●●

●●●●

●●

●●

●●

●●

●●

●● ●

●●

●● ●●

●●

●●

●●

●●

●●

●●

●● ●●

●●

●● ●● ● ●

●●

●●●

●●

●●

●●

● ●●

●●

●●

● ● ●

●●

●●●●

● ●●●

●●

●● ●

●●

●●

● ●●

●●●

●●

●●

●●● ●

●●●

●●

●●●

● ●●

●● ●●

●●● ●

●● ●

● ●

●●

●●●

●●●● ●

●●

● ●

●●

●●

●●

●●●

●●●

●●

●●

● ●

●●●● ●

●●

●●

●●

●●

●●

●●

●●●

●● ●● ●

● ●●

●●

●●●

●●

●●

●●

●● ●

●●●●●●

●●

●●

●●●

●●

●●

●●●

●●

●● ●●●

● ●●●●●

●● ●

● ●

● ●

●●●

●●

●●

●●

●●

●● ● ●●●

●●

●●●

●●

●●● ●

● ●

● ●●● ●

●●

●●●

●●● ●●

● ●●

●●●

●● ●

●●

●● ●

●●

●●

●●

● ●

● ●

●●

●●●●

●●

●●

●● ●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●●

● ●

●●

●●●

●●

● ●

●●●

●●●

●●● ●

●●● ●

●●

●●

●●

● ●

●●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●●●●

●●●

●●

●●

●●

●●

●●

●●●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●● ●

●●● ●

●●

●●

●●●

● ●

●●● ●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

●●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

● ●

●●

●●

● ●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

● ●

●●●

●●

Logit, Brier = 0.0346 RF, Brier = 0.035

Culture, Brier = 0.0355 SL, Brier = 0.0345

0.00

0.05

0.10

0.15

0.00

0.05

0.10

0.15

0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.15True P(Eviction)

Mod

eled

P(E

vict

ion)

Page 104: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

With community propensity score we can:

I use propensity score matching to estimate the effect ofeviction on outcomes collected in future waves

Page 105: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Use community model to

I prioritize issues for randomized controlled trials

I look for “dark matter”

Page 106: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Use community model to

I prioritize issues for randomized controlled trials

I look for “dark matter”

Page 107: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Most social science models have poor predictive performance andmost social scientists don’t care

Y vs β

Page 108: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Why do social science models have such poor predictiveperformance?

I poor measurement

I “dark matter”

Page 109: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Why do social science models have such poor predictiveperformance?

I poor measurement

I “dark matter”

Page 110: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Why do social science models have such poor predictiveperformance?

I poor measurement

I “dark matter”

Page 111: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Grade point average (GPA)

Page 112: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Assumed data generating process: kids have high GPA if

I High vocabulary skills at school entry

I Low material hardship at school entry

I Low behavior problems

Page 113: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Assumed data generating process: kids have high GPA if

I High vocabulary skills at school entry

I Low material hardship at school entry

I Low behavior problems

Page 114: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Signal = 1 + 3× logit−1([Vocabulary score at 5]

− 3× [Material hardship at 5]

− [Behavior problems at 9]

+ 2)

Noise ∼ Beta(α = 5, β = 5)× 2×min(Signal− 1, 4− Signal)

But imagine material hardship is unmeasured!

Page 115: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

I A social scientist submits an OLS model

Yi = β0 +

Not in true DGP︷ ︸︸ ︷β1(Race)i + β2(Sex)i

+ γ

(Race)i × (Sex)i ×

Variable in true DGP︷ ︸︸ ︷{Vocab,Vocab2,Vocab3}i

I A data scientist submits a random forest

Yi = f (

Not in true DGP︷ ︸︸ ︷Race, Sex ,

Variable in true DGP︷ ︸︸ ︷Behavior problems)

I A famous professor uses a new measure of “cultural capital”

Yi = β0 +

Not in true DGP︷ ︸︸ ︷β1(Race) + β2(Sex) + β3(Cultural capital)

Page 116: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

●●

●●

● ●

●●

●●

●●

●●

●●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

1

2

3

4

1 2 3 4True signal

Pre

dict

ed G

PA a

t age

15

OLS model with interactions: MSE = 0.307

Page 117: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

●●

●●

●●

●●

● ●

●●

●●

●●●

●●

●●

● ●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

1

2

3

4

1 2 3 4True signal

Pre

dict

ed G

PA a

t age

15

Random forest: MSE = 0.443

Page 118: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

● ●● ●

●● ●

●●

●●● ●

●●

●● ●

●● ●

●●

● ●●

●●

●●

●●

●●

●● ●●

●●●●

●●

● ●

● ●

●●

●● ● ●

●●

● ●

●●

● ●●

●●

● ●

●●

● ●●●

● ●

● ● ●

● ●

●●●

● ●●

●● ●

● ●

●●

●●●

●● ●●●

● ●

● ●●

●●

● ●

●●●

● ●●

● ●

● ●

● ●

●●

●●

●●

●●

●●●

●●

●●

● ●

●●

●●

● ●

●●

●●●

●● ● ●

● ●

● ●

●●●

●● ● ●

●●

●●

● ●

● ● ●●

●● ●

● ● ●

● ●

●●

●● ●●● ●

●● ● ● ●

●●●

●●

●●

●●●

●●

●● ●●

● ●

● ●

●●

1

2

3

4

1 2 3 4True signal

Pre

dict

ed G

PA a

t age

15

OLS culture model: MSE = 0.621

Page 119: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

●●

●●

●● ●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

● ●

●●

●●

●●

●●

●●

● ●

●●

●●

● ●●

●●

●●

●●

1

2

3

4

1 2 3 4True signal

Pre

dict

ed G

PA a

t age

15

Super Learner: MSE = 0.257

Page 120: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

● ●

●●

●●

●●

●●

●● ●

●●

●●

●●

●●

●●● ●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

● ●●

●●

●●

●●

●●

●●

●●

● ●

●●

●● ●

●●

●●

●●

●●

●●

●●●

● ●

●●

● ●

●●

●●

● ●●

●●

●●

●●

●●

●●

●●

●●

●●●

● ●● ●●

●● ●

●●●

●● ●●●

●● ●

●● ●●●●

●●

● ●●

●●

●●

●●●

●●

●●●

●●●

● ● ●●●● ●●

●●

●● ●

● ●●

●●●● ● ●

●●

●●●

●●

● ●

● ●● ●●

●●

●●

●●

● ●●

●●

●● ●●●● ●

● ● ●● ●

●●

●●●●

●●

● ●●●

●● ●●

●●

●●

●●

● ●

●●

●●

●●

●●●

●●

●● ● ●●

● ●

●●

●● ●

●●●

●● ●

●●

●●●●

● ●●● ●

● ●

● ●●●

●●●

●●●

●●

●●●

●●

●●●

●●

●●

●●

●●●

● ●

●●●

●●

●●

● ●

●●●

●●

●● ● ●● ●

● ●●

● ●●

●●

●●●

●●

●● ● ●

●●

●●●

●●

●●

● ●●

● ● ●●●

●● ●

●●

● ● ●●

● ●●

●●●

●●● ●●● ●

●●● ● ●

● ●●●

●●

●●●

●●● ●●

●● ●●

● ●

● ●

●●●

●●

●●

●●

●●

●●

●●●

●●

●●

● ●

●●

● ●

●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

● ●

●●●

● ●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

● ●

●●

● ●●

●●

●●

●●●

●●

OLS fit: MSE = 0.307 RF fit: MSE = 0.443

Culture fit: MSE = 0.621 SL fit: MSE = 0.257

1

2

3

4

1

2

3

4

1 2 3 4 1 2 3 4Truth

Pre

dict

ions

Fit of submitted models

Page 121: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

OLS fit: MSE = 0.307 RF fit: MSE = 0.443

Culture fit: MSE = 0.621 SL fit: MSE = 0.257

0

20

40

60

0

20

40

60

−2 −1 0 1 −2 −1 0 1Model residual

Fre

quen

cy

Unusually low residual Typical residual Unusually high residual

Choosing kids to interview

Page 122: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

● ●

● ●

● ●●

● ●

●●

●●

● ●●

●●

●●

●●

●● ●

● ●●●

● ●

●●

● ●

● ● ●

●●●

● ●

● ●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

● ●

● ●

●●

● ●

●●

●●

●● ●

●●

● ●

●●

●●

●●

● ●

●●●

●●

● ●

● ●

● ●

● ● ●

●●

●●

●●

●●

● ●

● ●

● ●

●●

●●

●●

●●

●●

● ●

● ●

● ●

●●

●●

● ●

●●

● ●

●●

● ●

●●●

● ●

● ●

● ●●

●●

● ●

●●

●● ●

● ● ●●

● ●

●●

● ●

● ●●

● ●

● ●

●●

● ●

● ●

●●

● ●

●●

● ●

●●

● ●

●●

●●●

●●

● ●

●●

●●

● ●

●●

●●

● ●

●●

●●

●●●

●●

●●

●●

● ●

● ●

● ●

● ●●

● ●

● ●

●●

● ●

●● ●

●●

●●

●●●

● ●●

● ●

● ●

●●

●●

●●

●●

● ●

●●

●●

●●

● ●

● ●

●●

● ●

●●

● ●

● ●

● ●

●●

● ●●

●●

●●

●●

● ● ●

●●

●●

●●

●● ●

●●●●

● ●

●●

●●

●●●

●●

●●

● ●

● ●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

● ●

●●

●●

●● ●

●●

● ●

●●

●●

●●

● ●

●●●

●●

● ●

● ●

●●

● ●●

●●

● ●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

● ●

●●

● ●

●●

●●

● ●

● ●

●●

● ●

● ●●

● ●

● ●

●●

● ●●

●●

● ●

●●

●● ●

● ● ●●

● ●

●●

● ●

● ●●

●●

● ●

●●

● ●

●●

● ●

●●

● ●

●●

●●

●●

●●

●●

● ●

●●

●●

● ●

●●

●●

● ●

●●

●●

●● ●

●●

●●

●●

● ●

●●

● ●

● ●●

●●

● ●

●●

● ●

● ● ●

●●

●●

●●●

● ●

● ●

● ●

● ●

●●

●●

●●

●●

●●

●●

●●

● ●

● ●

● ●

●●

●●

● ●

● ●

Culture fit, Cor = −0.35 OLS fit, Cor = −0.44

RF fit, Cor = −0.4 SL fit, Cor = −0.5

0.0

0.2

0.4

0.6

0.0

0.2

0.4

0.6

−2 −1 0 1 −2 −1 0 1

Model residual

Mat

eria

l har

dshi

p (u

nobs

erve

d)

● ● ●Unusually low residual Typical residual Unusually high residual

Learning from outliers

Page 123: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Use community model to

I prioritize issues for randomized controlled trials

I look for “dark matter”

Page 124: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Results from a mini pilot test

Page 125: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

I undergraduates, graduate students, and faculty at Princeton

I about 4 hours to make a simple submission

I 11 submissions received

Page 126: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

I undergraduates, graduate students, and faculty at Princeton

I about 4 hours to make a simple submission

I 11 submissions received

Page 127: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

I undergraduates, graduate students, and faculty at Princeton

I about 4 hours to make a simple submission

I 11 submissions received

Page 128: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 129: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

●●

● ●

●●

●●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●●

●●

●●

●● ●

●●●

●●

●●

●● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●●

●●

● ●

●●

● ●

● ●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

● ●

●●●

● ●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

● ●●

●●

●●

●●

●●

●●

●●

●●

●●

●● ●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

●● ●

●●●

●●

●●

●●

●●

● ●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

● ●

●●●

● ●

●●

●●

●●

● ●

●●●

●●

●●

●●

●●

●●

●●

●● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

●●

● ●

●●●

●●

●●

●●

● ●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●● ●

●●

●●●

●●

●●

●●

● ●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●●

●● ●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●●

●●

● ●

●●

●●

●●

●●

●●

●●●

●●

●●●

●●

●●

●●

●●

●●

●●

● ●●

●●

●●

●●

●●

● ●

●●

●●

● ●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●● ●

●●

●●

●●

●●

●●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

● ●

●●●

●●●

● ●

●●

●●

●●

●●

●●

●●

● ●

● ●

●●

●●

●●

● ●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

● ●

● ●

●●

●●

●●●

●●

● ●

●● ●● ●

●●

●● ●

●●●

●●

●●●

●●

●●

●●●

● ●

●●

●● ●

● ●

●●

●●

●●●

●●

●● ●●●

●●● ● ●

●●● ●

●●●

●●

●●●●

●●●

● ●●

●●

●●

●●

●●

●●●●●

● ●

●●

●●

●●●

●●●

●●●

●●●

●●● ●

●●

●●

●●

●●

●●

●●● ●

●● ●

●●

● ●

●●●●

●●

●●

●●●

●●●

● ● ●

● ● ●●●

●●

● ●●

●●

●● ●

●●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●● ●

●●

●●

● ●●

●● ●

●●●

●●

● ●

●●

●●

●●●

● ●●

● ●

●●●

●●

●●

●●

●●

●●

●● ●

● ●

●●●

●●

●●

●●

●●

● ●●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

● ●●●

●●

●● ●●●

● ●●

●●

●●

●●

● ●

● ●

●● ●●● ●

●●●● ● ●●●

●●

●●

● ●

●● ●●●

●●

●●

● ●

●●

●●

●●

●●

●●●

●●

●●

●●

●●●

●●●

●●●

●●

●●

●●

●●

●● ●●

●●●

●●●

●●

●●

●●●

●●

●●

●●

● ●

●● ●

● ●

●● ●●

●●

●●

●● ●

●●

●●

●●●●

● ●

●●● ●

● ●

●●

●●●

●●

●●●

● ●

●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●● ●●

●●●

● ● ●●

●●

●●●

● ●

●●

●●

●●

●●

● ●●●●●

● ●

●● ●●

● ●●

●●

●●

●●

●●

●●●●●

●●

●●

●●

●●

● ●

●● ●

●●

●●

●●

●●

●●

● ●● ● ●●● ●

●●

●●●●

●●

●●

●●

●●

●●●

●●

● ●●●

●●

●●● ●●●

●●

●● ●

●●

● ●

● ●

● ●

●●

●●●

●●

●●

●●●

●● ●

●●●

● ●

●●

● ●

●●

●●

●● ●

●●

●●

●●

●●●

●●

●●● ●

● ●●

●●

●●

●●

● ●●

●●

● ●●●●

●●

●●●●

●●

●●

●●●●

● ● ●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●●●

● ●●

●●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

● ● ●

●●

● ●

● ●

●●

●●

●●

●●

●●

●●

●●

● ●●

● ●●

●●

●●●

● ●

● ●

●●

●●

●●●

●●

●●

●●●

●●

●●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

● ●

● ●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●● ●

●●

●● ●● ●

●●

● ●

●●

●●

●●

●●

●●

●●

●● ●

● ●

●●

● ●

●●

●●

●●

●●●

●●

●●

● ●

●●

●●

●●

●●

● ●

●●

●●

●●

●●●

●●

●●

● ●● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●●

● ●●

●●●

●●

●●

●●

●●

●●

● ●

● ●

●●

●● ● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●● ●

●●●

●●

● ●

●●

●●

●●

●●

●●

● ●

●●

● ●

● ●

●●

●●

● ●

●● ●

●●

●●

●●

● ●●

●●

●●

●●●

●●

●●

●●

●●

●●●

●●

●●●

●●

●●

●●

● ●

●●

●●

● ●

●●

●●●

●●

●●

●●

●●

●●

●● ●

● ●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

● ●●

● ●

●●

● ●

● ●

● ●

●●

●●

● ●

●●

●●

●● ●

●●

● ●

●●●

●●

●● ●

●●

●●

●●

● ●

●●

●●

●●

● ●●

●●

●●●

●●

●●

● ●

●●●

● ●

●●

●●

● ●

●●

●● ●●●

●●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●●

●●

●●

●●●

●●

●● ●●

● ●

●●

●●

●● ●

● ●

●●

● ●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●●

●●

● ●

●●

●● ●

● ●

●●

●●

●●

●● ●

●●

●●

●●

●●●

●●

●●

●●

●●●

● ● ●●

●●

●● ●

●●

●●

●●

●●

● ●

●● ●

●●●

● ●

●●●

● ●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

● ●

●●

●●

●●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

● ●

● ●

●●

●●

●●

●●

●●

●●

●● ●

●●

●● ●

● ●

●●

●●●

● ●

●●

●●

●●

● ●●

●●

●●

●●

●●

● ●

●●

●●

● ●●

●●

● ●

●●

● ●

●● ●

●●

● ●

●●

●●

●●

●●

●●

● ●

●●

●●

● ●

●●

●● ●

● ●

●●

● ●

●●●

●●

● ●

●●

●●

●● ●

●●● ●

●●●

●●

●●

● ●

●●●

●●

●●

●●

●●

●●

●●

●●●

●●●●

●●

●●

● ●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

● ●

● ●●

● ●

●●●

●●

● ●

● ●

● ●

●●

● ●

●●

● ●

● ●

●●

●●

●●

●●

● ●

● ●

● ●● ●

● ●

●●

●●

● ●

● ●

● ●

● ●

●●

●●

●●

● ●●

● ●●

● ●●●

●●

●●●

●●

● ●

●●

●●

● ●

● ●

●●

● ●

● ●●● ● ●●

●●

● ●

●●

●●

●●

●●

●●●

● ●

●●

● ●●

●●

●●

●●

●●

●●●

●●

●●

● ●

●●

●●

● ●● ●

●●

●●

●●

● ●

●●

●●

●●

● ●

● ●●

●●

●●

●●

●●

● ●

●●

● ●●

● ●●

●●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

● ●

●●●

●●

●● ●

● ●

●●

● ●

●● ●

●●

● ●●●

●●

●● ●

●●

● ● ●● ●●

●●

●●

● ●

●● ●

● ●

● ●

●● ●

● ● ● ●

●●●

●●

● ●

● ●

●●

● ●

●●

● ●

●●

● ●

● ●

●●

● ●

●● ● ●

●●●

●●●

● ●

●●

●● ●

● ●●

●●

● ●

●●

●●● ●

●●●

●●●●

●●

●● ● ●●

● ●

●●

●●

●●

●●

●●

● ●● ●

● ●

●●

● ●

●●

●●

●●

● ●●

● ●

●●

●●

●●

●●

● ● ●●

● ●●

●●

●●

● ●

● ●●

●●

● ●

●●

● ●

●●

● ●

●●

● ●●● ●

● ●●

●●

●●

● ●

●●

●●

●●

●●

●●●

●●

●●

●●

●●● ●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●●

●●

●●

●●

●●

●●●

●● ●

●●

●●●

●● ●

● ●●

●●●

●●

●●

●●

●●

●●

● ●

●●

● ●

●●

●●

●●

● ●

● ●●

● ●● ●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

● ●

● ●

●●

●●

●●

●●

●●

●●●

● ●

●●

●● ●●

●●

● ●

●●

●●

●●

●● ●

●●

●●

●●

●●

● ●

●●

●●

● ●

● ●

●●●

●●●

●●

●●

●●

●●

●●

● ●

● ●

●●

●●

●●●●

●●

● ●

● ●●

● ●

● ●

● ●●

● ●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

● ●

● ●

●●

●●

●●

●●●

●●

●●

●●●

●●

● ●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

● ●

●●

● ●●

●●●

● ●

●●● ●●● ● ●● ●●● ● ●●● ● ●● ● ●● ●● ●●● ●● ●●●●● ●● ●● ● ●● ●● ●●● ●● ●● ●● ●●●● ●● ●●● ●●● ● ●●●● ● ●●● ●● ●● ●●● ●● ● ●● ●●● ●● ●● ●●●● ●●● ● ●● ●● ●●● ●● ●●●● ●●● ● ●●● ●●●● ●● ●● ●●●●●● ● ●● ● ●● ●● ●● ●● ● ● ●●● ●●●● ●●●● ●●●●●● ●● ●●● ● ●● ● ●● ●●●●● ●●● ●●●● ●●● ●● ●● ●●●● ●● ●●● ● ●●●●●● ●● ●● ●● ●● ●●● ●● ●●● ● ● ●●●●●●● ●●●●●●● ●● ●●●●● ● ●●● ● ● ●●● ● ●● ●● ●●● ●● ●● ●●● ● ●●● ●●●●● ● ●●● ● ●●●●● ● ● ●● ● ●●●●●●● ●● ●● ●● ●● ● ●●●● ●●● ●● ●● ● ●● ● ● ●● ●● ●● ●●● ●● ● ●● ● ● ●● ●●● ●● ●●●● ●●●● ● ●●● ●● ● ●● ● ●● ●●● ●● ●● ● ● ●●● ●●●● ● ●● ● ●●● ● ●●●●● ● ●● ●●● ● ● ●● ●● ●●●●●●● ● ●● ● ●● ●● ●● ●● ●● ●●●● ● ●● ●● ●●● ● ●● ● ●●●●● ●●● ●●● ● ●● ● ●●●●● ● ●●● ● ●●●●●● ● ●●● ●●●● ●●● ●●●● ● ●●●●●● ● ● ●●● ●●●● ● ●● ●●● ● ●●●● ● ● ●● ●●● ●●●● ● ●●● ●● ●● ●●● ● ●●● ●● ●●● ● ●● ●●● ●●● ●● ●●● ●●● ●● ● ●●●●● ●●● ● ●●● ●●●● ● ●●● ● ●●●●● ● ●●●● ●● ●● ●●● ● ●●●● ●●● ●●●●● ●●●● ●● ●● ●● ●●● ●●●● ●● ● ●●● ●● ●● ●●●●●● ●● ●●● ●● ●● ●●● ●●● ●●●● ●● ●●● ●●●● ● ●●●● ●● ●● ●● ●● ●● ●● ●●● ●●● ●● ● ●● ● ●●● ● ●●● ●● ● ● ●● ●● ● ●● ●●● ● ●● ●● ● ●●● ● ●●●● ●● ●● ●● ●● ●●●● ●●● ●● ●● ●●●● ● ● ● ● ● ●● ●●●● ●●●● ● ● ● ●● ●●●● ● ●● ●●● ● ●●● ●●●● ●●●● ●● ●● ●●● ●● ●●● ●● ●●●●●● ●● ● ●● ●●● ●●●● ●●● ●●● ●●● ●● ●●● ●● ●●● ●● ●● ●● ●● ●● ●●● ●●●● ●●●● ● ● ● ●●●● ●●●● ●● ● ●●● ●● ●● ●●● ●● ●● ●● ● ●●● ● ● ● ●●● ●● ● ●●● ●●● ●● ●● ●● ●●● ●●● ● ● ●● ●●●● ● ●●● ●● ●●●●●●● ●●● ● ● ●● ●● ●●●● ●● ●● ●● ●● ●● ●●● ● ●●● ●●● ● ●●● ●● ●● ● ●●● ●● ●●●● ●● ● ●● ●● ●● ●● ● ●●● ●● ●●●●● ●● ●● ● ●● ● ●●● ● ●●● ●●● ●●●●● ●●●● ●●● ● ●●● ●●● ●● ●● ●● ● ●● ●●● ●● ●● ●● ●● ● ●●●● ●●● ●●● ● ●● ●●● ● ●●● ● ●● ●● ●● ● ●●●● ●● ● ●● ●● ●●●● ● ● ●● ●●● ● ●●● ●●●● ● ● ●●● ●● ● ●●● ●●● ● ●● ● ●●●● ●●● ●● ●●● ●● ● ●●● ●● ●●● ●●●● ● ●●●●● ●● ●●● ● ●●●● ● ●● ●● ●

●●●

● ●●●

●● ●

●●

●●

●●

●●

●● ●●

●●

● ●●

●●

●● ●

●●

●●

●●

●●

●●

●●

●●

●●

● ●●

●●

●●

●●

●●●

●●

●●●

● ●●●

●●

●●●

●● ●

●●

●●

●●

●●●

● ●●

●● ●●

●●

●●

●●

●●

●●

●●●

●●●

●●

●●●●

● ●●●●●●

● ●

●●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

● ●●

● ●●

●●

●●

●●●

● ●

●●

●● ●

●●

●●

● ●

●●

●●●

●●

●●

●●

●●

●● ●

●●

●●

●●

●●

● ●

●●

●● ●●

●●

● ● ●●

●●

●●

●●

●●

●●

● ●●

●●● ●

●●

●●

●●

●●

●●

●●

●●

● ● ●

●●

●●

● ●

●●

●●

●●●●

●●

● ●●

●●●

●●

●●

●● ●

●●

●●

●●

●● ●

●●

● ●●

●●

●●

●●

● ●

●●

● ●●●●

●●

●●

●●●

● ●●

●●

●●

● ●●●●

●●●●

●●

●●

●●

●●● ●

●●

●●● ●●

●●●

●●●

● ●●

●●

●●●●●● ●

●●●

● ●

●● ●

●●

● ●●

● ●●

●●●

●●●

●●

●●

●●

●●

●●●

● ●●

● ●

●●●

●●

● ●

●●

●●

●●

● ●

●●

●●

●●●

●●

●●

●●●

●●

● ●

●●

●●

●●

● ●●

●●

● ●

● ●

● ●

●●

●●

●●

●●

●●

●●●

●● ●

●●

●●

●●

●●

●●●

●●

●●

●●

●●●● ●

●● ●●

●●

●●●

●● ●

●●●

● ●●

●●

●●

● ●●●● ●

●●●

●●

● ●●

●●

●●●

●●

●●

●●

●● ●

●●

●●

● ●●●

●●

●●

●● ●●

●●●●

● ●●

●●

●●

●●

●● ●●

●● ●● ●

●●

●●

●●

●●●

●●

●● ●

●● ●

● ●●

● ●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

● ●

●●●

●●

● ●●●

●●●

●●

●●●●●

●●

●●●

●●●

●●

●● ●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

●●

●●

● ●

●● ●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

● ● ●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

● ●

●●●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

● ●

●●

● ●●

●●

●●

● ●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

● ●

●●

●●

●●

●●

●●●

●●

●●

●● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●● ●

●●

●●

●●

●●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●● ●

● ●

●●

● ●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

● ●

●● ●

●●

●●

●●●

●● ●

●●

●●

●● ●

●●

●●

●●

●●

●●

●●

●● ●

●● ●

●●

●●

●●

●●

● ●●

●●●

●●

●●

●●

●●

●●

● ●

●●

●●

● ●

●●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●● ●

●●

●●●

●●

●●

●●

●●

●●

● ●●

●●●

●●

● ●●

●●

●●

●●

●●

●●

●●

● ●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

●●

● ●

●●

● ●

● ●

●●

●●

●●

●●

●●

●●

●●

●●

●●

● ●

●●

● ●

●●

● ●

●●

●●

●●

● ●

●●

●●

●●

●●

●●

● ●

●●

● ●

●●

● ● ●

●●

●●

●●

●●

●●

●●

StackedMSE = 0.062

SubmissionMSE = 0.066

SubmissionMSE = 0.067

SubmissionMSE = 0.067

SubmissionMSE = 0.072

SubmissionMSE = 0.073

SubmissionMSE = 0.076

SubmissionMSE = 0.081

SubmissionMSE = 0.085

SubmissionMSE = 0.087

SubmissionMSE = 0.112

SubmissionMSE = 0.191

True latent ''grittiness''

Pre

dict

ed g

rit a

t age

15

Grit: Do we recover the signal?

Page 130: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Mini pilot test suggests that this is possible

Page 131: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Fragile Families Challenge:

1. common task method (e.g., Netflix Prize)

2. use submissions to do cool stuff

Page 132: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 133: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

vsPrediction Information

Page 134: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

vsPrediction Information

Page 135: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 136: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 137: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology
Page 138: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

1. common task method (e.g., Netflix Prize)

2. use submissions to do cool stuff

Page 139: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Fragile Families Challenge

Want to participate?

Page 140: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Fragile Families Challenge

Want to participate?

Page 141: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Four main research designs:

I Observing behavior

I Asking questions

I Running experiments

I Creating mass collaboration

Page 142: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

+Readymades Custommades

https://commons.wikimedia.org/wiki/File:Duchamp_Fountaine.jpghttps://commons.wikimedia.org/wiki/File:%27David%27_by_Michelangelo_JBU0001.JPG

Page 143: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Ethics

Page 144: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

With great power there must also come

great responsibility

Amazing Fantasy #15, “Spider-Man!”, Writer: Stan Lee, Illustrator: Steve Ditko, 1962

Page 145: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

With great power there must also come

great responsibility

Amazing Fantasy #15, “Spider-Man!”, Writer: Stan Lee, Illustrator: Steve Ditko, 1962

Page 146: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Bit by Bit:Social Research in the Digital Age

Social Scientists ←→ Data Scientists

Page 147: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Read & Participate in Open Review: www.bitbybitbook.com

Page 148: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

http://www.openreviewtoolkit.org

Page 149: Beyond Big Data - AT&T Labs - Statistics Researchstats.research.att.com/nycseminars/slides/salganik.pdf · 2017-02-09 · Beyond Big Data Matthew J. Salganik Department of Sociology

Bit by Bit:Social Research in the Digital Age

Social Scientists ←→ Data Scientists

Read & Participate in Open Review:http://www.bitbybitbook.com