Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big...

41
Confessions of a "Recovering" Data Broker Responsible Innova.on in the Age of Big Data and Big Brother Jim Adler Vice President, Products Metanau.x [email protected].com @jim_adler hDp://jimadler.me Markkula Center for Applied Ethics Feb 25 2014

description

It's been said that the human brain is comprised of 300 million pattern matchers fed with data from our five primary senses and memories. In this age of distributed computing and cheap storage in the cloud, "thinking" without a biological brain is possible for the first time in history. The sensory input into this new, extracorporeal brain is big data. Global data supply chains carry exabytes of government, corporate, and social data powering breakthrough uses in medicine, transportation, communications, and energy. However, equally fantastic is the specter of abuses by powerful players to exploit private information, subtly discriminate, or mistakenly prosecute the innocent. This talk discusses the current state of these data supply chains, where they are headed, and the societal implications for privacy, security, and liberty. And it calls technologists, business leaders, and humanists -- i.e., geeks, suits, and wonks -- to together resolve the tension between cultural values and fast-paced technology.

Transcript of Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big...

Page 1: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Confessions  of  a  "Recovering"  Data  Broker    Responsible  Innova.on  in  the  Age  of  Big  Data  and  Big  Brother  

Jim  Adler  Vice  President,  Products  Metanau.x    [email protected]  @jim_adler  hDp://jimadler.me    

Markkula  Center  for  Applied  Ethics  Feb  25  2014  

 

Page 2: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

“Can’t  we  all  just  get  along?”  Plea

Geeks  

Wonks  Suits  

Social  Entrepreneur  

High-­‐Tech  Mercenary  

Responsible  Innovator  

Tradi?onal  Capitalist  

−  Rodney  King  

Page 3: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators
Page 4: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Norio  Ohga  Sony  President  74  min  CD  

Steve  Jobs  ‘nuff  said  

Eclectic  generalists  drive  innovation.  Lesson

Temple  Grandin  Animal  Handling  

Stephen  Hawking  Cosmology  

Richard  Feynman  Quantum  Physics  

Page 5: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

I  am  not  an  attorney.  Confession

Intelligence  

Social  Inep.tude  Obsession   Dork  

Nerd  Geek   Dweeb  

Page 6: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

You  can  often  do  more  good  from  the  inside  than  the  outside.  

•  Founded  in  2003  

•  20B  public  records  

•  30M  visitors  per  month  

•  50M+  reports  sold  

Confession

Page 7: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

The  “public”  data  supply  chain  of  you  Confession

Government

Commercial

Self-Reported

Risk  

Marke.ng  Directory  

Background  

Use

Search  

Blogs  

Criminal  Records  

Civil  Suits  

Addresses  Phone  

Numbers  

Payments  Resumes  

Public  Posts   Names  

Collection

Big Data Engines

Page 8: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Billions  of  Records  Millions  of  People  

Jim  Adler  Houston,  TX  

Age  70  

Jim  Adler  Redmond,  WA  

Age  50  Jim  Adler  Denver,  CO  Age  48  

Jim  Adler  McKinney,  TX  

Age  57  

Jim  Adler  Canaan,  NH  Age  59  

Jim  Adler  Has.ngs,  NE  

Age  32  

213  records  linked  to  the  correct  37  Jim  Adlers    

Philip  Collins  

375  People   Jim  Adler  213  Records  37  People  

Randolph  Hutchins  5  People  

Gwen  Fleming  2  People  Carol  Brooks  

9800  Records  1250  People  

Confession We  don’t  know  you  all  that  well.  

Page 9: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

FIND  OWNER  OF  DOG’S  RELATIVE  FOR  TRANSPLANT  

SINGLES  CURIOUS  ABOUT  THE  PEOPLE  THEY  MEET  

PARENTS    ENSURING  WHO  THEIR  KIDS  SAFETY  

GENEALOGISTS    CULTIVATING  THEIR  FAMILY  TREE  

BUSINESSES  THAT  NEED  TO  UPDATE  CONTACT  INFORMATION  ON  CUSTOMERS  

FINDING  LONG-­‐LOST  FRIENDS,  MILITARY  BUDDIES,  ROOMMATES,  OR  CLASSMATES  

ANYONE  CURIOUS  ABOUT  WHO'S  EMAILING  OR  CALLING  THEM  

THOSE  IN  LEGALLY  ENTANGLED  LOOKING  FOR  COURT  RECORDS   ANYONE  WHO  NEED  ADDRESS  

HISTORIES  FOR  PASSPORTS  

SOCIAL  NETWORKERS  LOOKING  TO  EXPAND  THEIR  FRIENDS  LIST   PROFESSIONALS  LEARNING  ABOUT  

COLLEAGUES  AT  CONFERENCES  

RECONNECTING  OUT-­‐OF-­‐TOUCH  FAMILY  MEMBERS  

ONLINE  SHOPPERS  VERIFYING  ONLINE  SELLERS  

INVESTIGATIVE  JOURNALISTS  RUNNING  DOWN  LEADS  

SALES  PROFESSIONALS  LOOKING  FOR  NEW  PROSPECTS  

NETWORKERS  SEEKING  BUSINESS  OPPORTUNITIES  

LAW  ENFORCEMENT  

NON-­‐PROFIT  ORGANIZATIONS  LOOKING  FOR  SUPPORTERS  

FIANCÉS  AND  THEIR  CURIOUS  FAMILY  MEMBERS  

SOCIAL  WORKERS  WHO  NEED  TO  KNOW  MORE  ABOUT  THEIR  CLIENTS  

CALLER  ID  OF  HARASSING  PHONE  CALLS  

ALUMNI  GROUPS  ARRANGING  REUNIONS  

ADOPTED  KIDS  SEEKING  THEIR  BIOLOGICAL  PARENTS  

AIRLINES  TRYING  TO  RETURN  LOST  LUGGAGE  

CHECKING  OUT  A  PROSPECTIVE  SOCIAL  NETWORK  CONNECTION  

CHECKING  OUT  A  PROSPECTIVE  DATE  

CHECKING  OUT  A  PROSPECTIVE  TENANT  

FINDING  PEOPLE  THAT  HAVE  THE  SAME  ILLNESS  AS  YOU  

RESEARCHING  A  PROSPECTIVE  EMPLOYEE  

ANYONE  RETRIEVING  COURT  RECORDS  

REGULATED  

Lots  of  uses  for  your  data  …  some  regulated.  

LAWYERS  NEEDING  QUICK  ACCESS  TO  COURT  RECORDS  

BANKING  SERVICES  

RESEARCH  

SHARING  

LEARNING  ABOUT    A  BUSINESS  

Confession

Page 10: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Opt-­‐out  doesn’t  always  mean  deletion.  Confession

Jane Hampton (309)555-8931

Jane Hampton 06/23/1998 123 Main Peoria, IL

Jane Hampton 123 Main Peoria, IL [email protected]

Page 11: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Listen  to  your  toughest  critics.  Lesson

Page 12: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Can  I  have  a  little  narcissism  with  my  voyeurism?  

•  What  does  my  background  check  say?  

•  Privacy  controls  –  Suppress  single  address  or  

phone  number  

•  Comment  on  your  own  public  profile  

Lesson

Page 13: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

New  Data  Broker  Bill  Introduced  This  Month  

•  “Data  Broker  Accountability  and  Transparency  Act”  

•  Prohibits  “data  brokers”  from  using  decep?ve  means  to  collect  informa.on  about  consumers.  

•  Transparency  to  consumers  about  informa.on  about  them.  

•  Consumers  can  correct  the  data.  

•  Opt-­‐out  of  having  their  data  collected.  

•  FTC  enforcement  

Regulation

Page 14: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

When  towns  were  small,  personal  anonymity  was  low  …  

“The  only  thing  worse  than  being  talked  about,  is  not  being  talked  about.”    

−  Oscar  Wilde  

Lesson

Page 15: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

“Good  Fences  Make  Good  Neighbors”    

−  Robert  Frost  

Urban  populations  grew  along  with  personal  anonymity…  

Lesson

Page 16: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

0  

20  

40  

60  

80  

100  

120  

1850   1890   1930   1970   2010  

Pri

vacy

Exp

ecta

tion

s !

…  we’re  suffering  from  Privacy  Vertigo.  Confession

“Rockwell”  Era  

Urban  Density  

“Good  Fences”  Era   “Privacy  Ver.go”  

Era  

   Online  Density    

Page 17: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Peer  to  Peer   Corpora.on  &  Customer/Employee  

Government  &  Ci.zen  

Your  God  &  You  

Privacy  Rights  !  

Power  Disparity  !    

In  privacy  contexts,  Power  matters.  Lesson

Page 18: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

How  to  unpack  Privacy?  Think  PPP.  

PERILS  

Lesson

Page 19: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Mapping  Places-­‐Players-­‐Perils  Cases  M

ORE  P

LAYER  P

OW

ER  G

AP  

Peers

Parents

Employers/Landlords/Insurers

Governments

MO R E   P R I V A T E   P L A C E S  

Priv

ate

Curt

ilage

Publ

ic

Lesson

Page 20: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

MO R E   P R I V A T E   P L A C E S  

MORE  P

LAYER  P

OW

ER  G

AP  

News  of  the  World  phone  hacking  

Rutgers  student  commits  suicide  aXer  spied  by  

webcam  

FBI  GPS  criminal  surveillance  Google  privacy  

policy  unifica?on  

Target  finds  out  teen  pregnant  before  parents  

GM  OnStar  tracks  users  

Woman  caught  naked  by  Google  

Street  View  

Actress  sues  IMDB  over  revealing  her  

age  

US  deports  Bri?sh  tourists  over  Tweets  

FB  user  sets  fire  to  home  aXer  de-­‐

friending  

"Girls  Around  Me"  pulled  from  market  

Health  orgs  use  Twi[er  to  track  

illness  

NSA  internet  ci?zen  surveillance  

Georgia  teacher  fired  aXer  pos?ng  

vaca?on  pics  

Places-­‐Players-­‐Perils  Cases  

Ethically Challenging

Lesson

Page 21: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

MO R E   P R I V A T E   P L A C E S  

MORE  P

LAYER  P

OW

ER  G

AP  

News  of  the  World  phone  hacking  

Rutgers  student  commits  suicide  aXer  spied  by  

webcam  

FBI  GPS  criminal  surveillance  Google  privacy  

policy  unifica?on  

Target  finds  out  teen  pregnant  before  parents  

GM  OnStar  tracks  users  

Woman  caught  naked  by  Google  

Street  View  

Actress  sues  IMDB  over  revealing  her  

age  

US  deports  Bri?sh  tourists  over  Tweets  

FB  user  sets  fire  to  home  aXer  de-­‐

friending  

"Girls  Around  Me"  pulled  from  market  

Health  orgs  use  Twi[er  to  track  

illness  

NSA  internet  ci?zen  

surveillance  Georgia  teacher  fired  aXer  pos?ng  

vaca?on  pics  

Big  brother  is  watching  (duh).  

“We’re  being  asked  to  trust  without  being  able  to  verify.”  −  Alex  Howard  (big  data  journalist)  

Pres.  Obama  calls  for  more  transparency  in  FISA  court  and  surveillance  laws  

NSA  chief  announces  plan  to  replace  1,000  sysadmins  with  machines  

Confession

Page 22: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Technology  grows  exponentially.    Wisdom  grows  linearly.  

•  Gov’t  doesn’t  trust  people  (at  least  sysadmins)  but  does  trust  machines  

•  LiDle  Transparency    

•  Wisdom  is  hard  to  come  by  

 •  Sen.ent  (?)  brain  in  

the  cloud  in  <  20  years  

Lesson

Wisdom  

Knowledge  

Informa.on  

Data  

Page 23: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

A  head  in  the  clouds  <  20  years  Prediction

$27,100  

$13,500  

$6,800  

$3,400  

$1,700  

$850  

$420  

$210  

$100  

$53  

$26  

$13  

$7  

$3  $2  

$1  $1  

$10  

$100  

$1,000  

$10,000  

$100,000  

2012   2014   2016   2018   2020   2022   2024   2026   2028   2030   2032   2034   2036   2038   2040   2042  

Cost  per  Month  (000s)  

Year  

Less  than  $700K  per  year  

More  than  $325M  per  year  Human  Brain  •  20,000  TFlops  •  2,500  Terabytes  

Chris  Westbury,  University  of  Alberta    

à  4  M  AWS  m1.large  nodes  

Page 24: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

“Watch  your  thoughts,  they  become  words.  Watch  your  words,  they  become  ac.ons.  Watch  your  ac.ons,  they  become  habits.  Watch  your  habits,  they  become  your  character.  Watch  your  character,  it  becomes  your  des.ny.”    

 –  Lao  Tzu  

“…  the  essen.al  crime  that  contained  all  others  in  itself.  Thoughtcrime,  they  called  it.”  

   –  George  Orwell  

Big  data  inferences  are  not  thoughtcrimes.  Lesson

Page 25: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Target  knows  you’re  pregnant  and  when  you’re  due.  So,  what’s  so  perilous?  

Confession

Page 26: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

“To  Serve  Man”  is  a  cookbook.  Confession

“If  you’re  not  paying  for  the  product,  you  are  the  product.”    

−  Claire  Wolfe  (paraphrased)  

Page 27: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Sometimes  you’re  in  a  public  place  when  you  think  you’re  in  a  private  place.  

“Gaydar”

A 2009 MIT study found it was possible to predict men’s sexual orientation by analyzing the gender and sexuality of their social network contacts – even if the rest of the information on their profile was set to private.

Confession

Page 28: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

John  Foreman’s  Excellent  Disney  Adventure  

Confession

Page 29: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Felon  Classi\ier  

Objec.ve  If  someone  has  minor  offenses  on  their  criminal  record,    do  they  also  have  felonies?  

Model  Learner  250  M  Defendants   Feature  

Extrac.on  

15K  Labels  

15K  Predictors  Cleaning  

Linking  

Sampling  

Bloomberg  ar.cle:  hDp://bloom.bg/1eMtnug    

Page 30: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

How  does  the  Felon  Classi\ier  work?  

Gender   Eye  Color   Ta[oos   Criminal  Offenses   Score  

Over  Threshold  of  3.5?  

Likely    Felon?  

               

   

NO  

               

   

YES  

Hazel  (+1.7)  

Male   Blue   2  +  (+1.3)   Traffic  only  

Female  (-­‐0.5)   Brown   <  2   4  or  fewer  misdemeanors  (+1.9)  

YES  

Green   8  or  fewer  misdemeanors  

NO  4.4

Hazel  

Male  (+0.1)   Blue   2  +   Traffic  only  (-­‐0.5)  

Female   Brown  (+1.2)   <  2  (+0.1)   4  or  fewer  misdemeanors  

YES  

Green   8  or  fewer  misdemeanors  

NO  0.9

Bloomberg  ar.cle:  hDp://bloom.bg/1eMtnug    Blog  widget:  hDp://jimadler.me    

Page 31: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Classi\iers  depend  on  policy  as  much  as  technology.  

AN

ARCH

Y  

T Y R A N N Y  

0.0%  

20.0%  

40.0%  

60.0%  

80.0%  

100.0%  

0.0%   5.0%   10.0%   15.0%   20.0%  

False  Negative  Rate  

False  Positive  Rate  

Threshold:  0.66  FP  Rate:    5%    FN  Rate:  22%    

Threshold:  1.1  FP  Rate:    1%    FN  Rate:  40%    

Threshold:  -­‐1.82  FP  Rate:    19%    FN  Rate:  0%    

Confession

Page 32: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

NYC  Stop  &  Frisk  Found  Unconstitutional  Ruling

“The  city  …  believes  that  blacks  and  Hispanics  should  be  stopped  at  the  same  rate  as  their  propor.on  of  the  local  criminal  suspect  popula.on.”  

−  US  District  Judge  Shira  Scheindlin    All NYC Residents

Minorities 50%

90% of Criminals are Minorities

Criminals

Page 33: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

“Half  the  money  I  spend  on  advertising  is  wasted;  the  trouble  is  I  don't  know  which  half.”  

Lesson

PMinority is a Criminal =PCriminal is a Minority

PMinority

PCriminal

PMinority is a Criminal =90%50%

5%= 9%

PMinority is NOT a Criminal =100−PMinority is a Criminal

= 91%

If  it’s  not  ok  to  stop  99%  of  the  general  popula.on  for  nothing,  why  is  it  ok  to  stop  91%  of  minori.es  for  nothing?  

All NYC Residents

Minorities 50%

Criminals 5%

90% of Criminals

are Minorities

10% of Criminals are Not

Minorities

Bayes’  Rule  

Page 34: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Asians 10%

When  might  Stop  &  Frisk  be  OK?  Lesson

PMinority is a Criminal =PCriminal is a Minority

PMinority

PCriminal

PMinority is a Criminal =90%10%

5%= 45%

PMinority is NOT a Criminal =100−PMinority is a Criminal

= 55%

All NYC Residents

Criminals 5%

Bayes’  Rule  

If  it’s  not  ok  to  stop  99%  of  the  general  popula.on  for  nothing,  is  it  ok  to  stop  55%  of  minori.es  for  nothing?  

Page 35: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

What  about  Newark’s  Stop  &  Frisk?  Lesson

PMinority is a Criminal =PCriminal is a Minority

PMinority

PCriminal

PMinority is a Criminal =90%50%

20%= 36%

PMinority is NOT a Criminal =100−PMinority is a Criminal

= 64%

All Newark Residents

Bayes’  Rule  

If  it’s  not  ok  to  stop  96%  of  the  general  popula.on  for  nothing,  is  it  ok  to  stop  64%  of  minori.es  for  nothing?  

Minorities 50%

Criminals 20%

hDp://www.ny.mes.com/2014/02/25/nyregion/newark-­‐stop-­‐and-­‐frisk-­‐data-­‐is-­‐analyzed.html    

Page 36: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Hilary  Mason’s  Maxim  

Math  +  Code  =  Awesome  

Quants

Making  a  killing  on  Wall  Street  but  s.ll  can’t  impress  the  chicks  

Weakonomics.com  

Lesson

Page 37: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Corollary  to  Mason’s  Maxim  

Values  *  (Math  +  Code)  =  Awesome  

Lesson

Page 38: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

“The  beatings  will  continue  until  morale  improves.”  

Prediction

Unthinkable

Radical

Acceptable

Sensible

Popular

Policy Facebook Newsfeed

Ad Targeting

Facebook Beacon

Pre-crime

Skynet

Overton  Window  

Page 39: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Living  within  a  Filter  Bubble  (with  apologies  to  Eli  Pariser)  

Lesson

…  but  then  we  reshape  our  tools  …  

“We  shape    our  tools  …    

…  and  thereawer  our  tools  shape  us.”  

−  Marshall  McLuhan  

Page 40: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Lesson “No  one  here  gets  out  alive.”  −  Jim  Morrison  

Adapt,  Invent  

Scru.nize,  Incen.vize  

Listen,  Learn   Geeks  

Wonks  Suits  

Page 41: Confessions of a “Recovering” Data Broker: Responsible Innovation in the Age of Big Data, Big Brother, and the Coming Skynet Terminators

Questions?  

 Jim  Adler    www.metanau.x.com  [email protected]  @jim_adler