Extracting Intelligence from Big Data

21
© 2014 Quid, Inc. 1 Big Data Visualization Meetup @ CA Technologies Ruggero Altair Tacchi, PhD Data Scientist at Quid March 27, 2014 BIG DATA INTELLIGENCE [email protected]

Transcript of Extracting Intelligence from Big Data

Page 1: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 1

Big Data Visualization Meetup @ CA Technologies Ruggero Altair Tacchi, PhD Data Scientist at Quid March 27, 2014

BIG DATA INTELLIGENCE

[email protected]

Page 2: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 2 2

Quid is a Business Intelligence platform. Quid has created a full-stack platform that brings together the world’s business data streams

ü  Company data

ü  News data

ü  Patent data

ü  Organizational data

ü  Scientific papers

Page 3: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 3 3

Q: Who owns the discussion about the future of the car?

Page 4: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 4 4 [email protected]

Q: Who owns the discussion about the future of the car?

Page 5: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 5 5 Source: xkcd 1334

Page 6: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 6 6 Source: xkcd 1334

Search is hard

Page 7: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 7 7

224

239

248

262

286

311

346

346

396

520

550

571

659

735

1,065

Chrysler

Chevrolet

Hyundai

Honda

Volkswagen

Nissan

Volvo

Apple

Mercedes

General Motors

BMW

Audi

Toyota

Ford

Google

Top entities within future car news network, by number of articles

23%

16%

14%

12%

12%

11%

9%

8%

8%

7%

6%

6%

5%

5%

5%

Share of voice Proportion of articles by theme

New car features

Autonomous driving

A: Google has 23% share of voice in the discussion on the future of the car; traditional players focused on new features, not capitalizing on interest in future / autonomous driving

Page 8: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 8 8

Q: Which media sources are most closely broadcasting NASA’s press releases?

Page 9: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 9 9

-100 -80 -60 -40 -20 0 20 40 60 80 100 The New York Times The Business Insider

CBC News Aero-News.net

Popular Mechanics CBS News

International Business Times Everything Alabama

CNET PerthNow

Business Wire The Register

RedOrbit Boston.com

Space Ref Freshnews.com

EurekAlert Softpedia

HeraldOnline.com Reuters

Engadget CNN

BBC News Geekosystem.com

Slashgear Gizmag

The Inquisitr Big Pond News

Kurzweilai Planetary Society Blog

ITWorld.com The Verge Ecoustics

More representative

Alignment Score

Less representative

A: The New York Times’ articles most closely reflect narratives that NASA originates

Page 10: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 10 10 Source: xkcd 173

Page 11: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 11 11 Source: xkcd 173

Networks, not lists

Page 12: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 12 12

Analyzing ~1,500 long-form articles about space, thematic clusters form around NASA’s past & present, as wells as the future of commercial space

Present: NASA-led Space Exploration (49%)

Future: Commercial Space (26%)

Past: Traditional NASA (25%)

Long-form news network, colored by conversation themes, major themes labeled

Page 13: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 13 13

Long-form news network, NASA publications highlighted and clusters containing them labeled

NASA’s press release strategy has focused on the peripheral; it is largely absent from the core conversation debating the future vs. the past of space

Source NASA

Other

Vesta Asteroid Moon

SpaceX & Dragon Capsule

Mars Curiosity

Hubble Telescope & Exoplanets

Space Shuttle

Page 14: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 14 14

Quid Technology

Company A Company B

< >< >

< >

< machine vision > < gaze coordinates >

< eye tracking >

Analyst has a big-picture view

+ Ability to zoom down to details

KEYWORDS EXTRACTED FROM TEXT

REPLICATED AT A VERY LARGE SCALE

LINKS ESTABLISHED USING SHARED

LANGUAGE

< eye tracking > < gestures >

< eye control >

Page 15: Extracting Intelligence from Big Data

< Neural Connectivity >

< Autism >

< Mathematical >

< Divergent thinking >

NATURAL LANGUAGE PROCESSING

Page 16: Extracting Intelligence from Big Data

Neural Connectivity Autism

Mathematical Divergent thinking

Concepts

DIGITAL SIGNATURE

Sig

nific

ance

Page 17: Extracting Intelligence from Big Data

Document #1

Document 2

Document 3

Document 4

DIGITAL SIGNATURE

Page 18: Extracting Intelligence from Big Data

Document #3

Document #1

(similar)

Page 19: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 19 19

From lists to networks, from networks to lists

Page 20: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 20 20

Demo

Page 21: Extracting Intelligence from Big Data

© 2014 Quid, Inc. 21 21

For information contact us at http://quid.com/contact

… and we’re hiring!

http://quid.com/careers

Danielle Ben-Gera Kartik Sundar Joey Hobbs Ruggero Altair Tacchi