Slide 1

INFORMATION VISUALIZATION / EXPLORATORY DATA ANALYSIS Prof. Marti A. Hearst, UC Berkeley Bay Area PHUSE Single Day Event, 9/26/2014

Slide 2

WHY INFOVIZ? Why not just statistics?

Slide 3

INSIGH T

Slide 4

Same Formula; Different Structure http://www.cliffsnotes.com/sciences/chemistry/chemistry/organic-compounds/structural-formulas

Slide 5

Slide 6

Slide 7

BRILLIANT INTERACTION NYTimes: Paths to the White House infoviz students: TaleSpin Airline Accidents

Slide 8

http://elections.nytimes.com/2012/results/president/scenarios

Slide 9

Slide 10

http://people.ischool.berkeley.edu/~jannah/Planes/intro.html TaleSpin Jannah, Agrawal, Siddiqui

Slide 11

BART Ridership Chen, Goel, Perry

Slide 12

BRILLIANT COMPRESSION NYTimes: Front Row to Fashion Week

Slide 13

http://www.nytimes.com/newsgraphics/2013/09/13/fashion-week-editors-picks/

Slide 14

NARRATIVE + EXPLORATION Infoviz class: Cal v. Stanford Drought and Wildfires in California

Slide 15

Slide 16

Reed, Swigert, & Malina

Slide 17

Slide 18

Slide 19

Slide 20

BIOSCIENCE IS RICH IN VISUALIZATIONS Find them at biosearch.berkeley.edu

Slide 21

Query on miRNA at biosearc.berkeley.edu

Slide 22

Slide 23

WHAT IS EXPLORATORY DATA ANALYSIS?

Slide 24

What is Exploratory Data Analysis? looking at data to see what it seems to say Tukey the first step before confirmatory techniques getting to know the lay of the land detective work

Slide 25

Why do we do EDA? Optimize a function Create a narrative, tell a story Plan a strategy Monitor a situation Look for causal relationships Solve a crime

Slide 26

What do we do when we do EDA? Overviews Get to know the data: tendencies, trends Make discoveries Find anomolies / outliers / errors Formulate hypotheses Support / refute / confirm them

Slide 27

EDA Assignment Readings: Steve Fews book Now You See It Steve Few on Exploratory Vistas Al Inselberg on Multidimensional Data Detective Polaris paper (foundations of Tableau) Short Tukey paper on EDA Tableau Videos Demonstrations of Tableau on a data set for something we did in class Practice Assignment Study EDA assignments by 2 other students Write paragraphs about each Instructor commented on these Redirected students who were not on the right path

Slide 28

EDA Assignment Assignment: Select data set Formulate hypotheses Explore those hypotheses; let the data determine next steps Verify or refute hypotheses; reformulate or formulate new ones Create dashboards summarizing the results for each.

Slide 29

EDA ASSIGNMENT Faye Ip on BART Strike

Slide 30

QUESTION #1 Do union workers make more money than non-union workers? (Answer: no)

Slide 31

Slide 32

QUESTION #2 Is BART management-heavy? (Answer: no)

Slide 33

Slide 34

QUESTION #3 Do union workers earn a lot of overtime pay? (Answer: no, except for transportation operations, but they have low base pay. However there are some interesting outliers amount the non-union workers...)

Slide 35

Slide 36

QUESTION #4 What is going on in the Finance Department? (Answer something suspicious! Roberta Collier base pay $33,971, other pay $289,534)

Slide 37

Slide 38

Slide 39

EDA TOOL COMPARISON Saraiya, North, & Duca. "An evaluation of microarray visualization tools for biological insight.Infoviz 2004.

Slide 40

Slide 41