SEAN LAHMAN – [email protected] ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging...

68
SEAN LAHMAN – [email protected] SEAN LAHMAN – [email protected] ROCHESTER DEMOCRAT & CHRONICLE ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES SEANLAHMAN.COM/RESOURCES Digging into Census Data Digging into Census Data to Find Good Stories to Find Good Stories

Transcript of SEAN LAHMAN – [email protected] ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging...

Page 1: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

SEAN LAHMAN – [email protected] LAHMAN – [email protected] DEMOCRAT & CHRONICLEROCHESTER DEMOCRAT & CHRONICLE

SEANLAHMAN.COM/RESOURCESSEANLAHMAN.COM/RESOURCES

Digging into Census DataDigging into Census Data to Find Good Stories to Find Good Stories

Page 2: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Digging for Stories

Page 3: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Computer Assisted Reporting

“Journalists need to be data-savvy. It used to be that you would get stories by chatting to people in bars, and it still might be that you'll do it that way some times.

But now it's also going to be about poring over data and equipping yourself with the tools to analyse it and picking out what's interesting.”

London, November 2010

“Journalists need to be data-savvy. It used to be that you would get stories by chatting to people in bars, and it still might be that you'll do it that way some times.

But now it's also going to be about poring over data and equipping yourself with the tools to analyse it and picking out what's interesting.”

London, November 2010

Tim Berners-LeeInventor of the World Wide Web

Page 4: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Overview of the U.S. Census

Page 5: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Since 1790

Representatives and direct Taxes shall be apportioned among the several States

which may be included within this Union, according to their respective Numbers…

Page 6: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

10 Questions in 10 Minutes

•How many people live

here?

•Age, gender, race of

each

•Home ownership?

Page 7: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Data Release Schedule

Dec 2010 Totals for all states

February & March - Redistricting data for

each state

May – Demographic profiles

June-August – Summary File 1

Late 2011 / early 2012 – Summary File 2

Page 8: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

The End…

Page 9: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Shortest. Census. Form. Ever.

The more questions

the Census Bureau

asked, the fewer

responses they

received.

Page 10: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

American Community Survey

•Samples roughly 3 million people per year

•1-year, 3-year, and5-year data released

•65,000 & 20,000 population sizes

Page 11: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

“Census data” is really many data sets

Decennial CensusAmerican Community SurveySmall Area Income and Poverty EstimatesAmerican Housing SurveyConsumer Expenditure SurveyPublic Use Microdata SamplesSurvey of Construction… and more

Page 12: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Levels of Complexity

Age

Gender

Race

Location

Page 13: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Geographical Groupings

Page 14: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Census Tracts

Page 15: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

1790 Map

Page 16: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Getting the Data

http://www2.census.gov/census_2010/

Page 17: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

American Fact Finder

Page 18: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

AFF2

Page 19: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

AFF3

Page 20: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

AFF4

Page 21: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

AFF5

Page 22: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

AFF - new

Page 23: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

AFF-new1

Page 24: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

AFF-new2

Page 25: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

AFF-new3

Page 26: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

DataFerrett

http://thedataweb.org/ or http://dataferrett.census.gov

Page 27: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

DF1

Page 28: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

IRE

Page 29: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Other Resources

New York State Data Centerhttp://esd.ny.gov/

Lewis Mumford Center - University of Albany http://www.albany.edu/mumford/

University of Virginia http://mapserver.lib.virginia.edu/

NYC Department of City Planninghttp://gis.nyc.gov/dcp/pa/address.jsp

University of Michiganhttp://www.icpsr.umich.edu/icpsrweb/ICPSR/

University of Minnesota (PUMS)http://usa.ipums.org/usa/

Page 30: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Finding Story Ideas

"People don't really tell you

this, but often the amount

of time you spend finding a

decent story is more than

the time it takes to produce

the story.“

-- Ira Glass

"People don't really tell you

this, but often the amount

of time you spend finding a

decent story is more than

the time it takes to produce

the story.“

-- Ira Glass

Page 31: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Civics for Journalists

Who is your audience?

Context

Need reliable numbers other than the

Census Bureau

Page 32: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Redistricting

Redistricting is an intensely political process

There is a vocabulary to redistricting

Section 5

Gerrymandering

Huge opportunity to share historical info with

readers

Communities of Interest

Page 33: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Population

Urban sprawl, neighborhood decay, suburban

flight

Population density maps

Growth/decline of population in

neighborhoods

Average household size (changes,

comparisons between neighborhoods)

Page 34: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Age and Gender

(More detailed age breakdowns available in

May)

Graying or seeing a baby boom?

Concentrations of older residents vs. children

Gender differences in neighborhoods

Generational conflicts (mixing of generations)

Page 35: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Race and Ethnicity

(Top level race data in first release, more detail in summer release)

Look at race breakdowns by age (growth of minority population tends to be bottom up)

Surge in Hispanic population is a national story (14 to 35 million from 1980-2000)

Segregation & diversity (see the Mumford Center at SUNY Albany, or USAT diversity index)

Page 36: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Relationships

Types of households (available in may)

Seniors living alone

Grandchildren living in household

Consider mapping same-sex couples, single

mothers

Page 37: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Housing

Vacant housing units: what is the trend, and

where?

Owner-occupied vs. rentals

How many people own their homes free and

clear? Where are they?

Foreclosures… where and how many?

Page 38: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Other Ideas

Redistricting on the local level

Compare racial composition of school

population with citizens 18+ (voters)

New ACS variables: healthcare coverage,

degree field, Veterans’ disability, marital history

Housing double-up as an indicator of economic

impact

Page 39: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

New York Ideas

Look at the extent to which the recession, mortgage meltdown slowed the migration away from NY.  

NY an example of state that is aging, but also seeing a decline in child population (<18) 2000-10

Also look at: % Children w/immigrant parents, children speaking other than English, HS dropout rates for 1st generation vs. 2nd generation Hispanics

To what extent does # of seats impact fed $ compared to seniority of your reps (and which committees they are on)

Page 40: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Demographic Resources

Our Patchwork Nation – Dante Chinni

Identified clusters based on income, education,

population growth, unemployment, foreclosure

rates, Starbucks vs. Wal-Mart

Who We Are Now – Sam Roberts

The Big Sort – Bill Bishop

A Field Guide to Sprawl – Dolores Hayden

Page 41: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

American Community Survey

Page 42: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

American Community Survey

Page 43: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

American Community Survey

Page 44: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

American Community Survey

Page 45: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

American Community Survey

Page 46: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Data Visualization

Page 47: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Shan CarterData Visualization

“The last thing the internet needs is more data.” Shan Carter, Interactive Graphics

EditorThe New York Times

Page 48: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Data Visualization as a new medium

Page 49: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Protovis-1

Page 50: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Protovis-2

Page 51: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Science Fair Poster

Page 52: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Science Fair Poster 2

Page 53: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Martini Glass

Page 54: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Data Slide Show

Page 55: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Drill Down Story

Page 56: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Another Drill Down

Page 57: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Not Just for End Users

Page 58: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Demographic Explosion

Crime data

Campaign finance

Voter registration

Public payrolls

Student test scores

Page 59: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Netflix

http://www.nytimes.com/interactive/2010/01/10/nyregion/20100110-netflix-map.html

Page 60: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Mapping Tools

Adobe Flash

Google Maps API

MAPublisher

GEOCommons

Social Explorer

Census Bureau – Thematic and Reference

Maps

Page 61: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Adobe Flash

Des Moines RegisterJames Wilkerson

http://data.desmoinesregister.com/dmr/iowa-census/redistricting-map/

Page 62: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

MAPublisher with Illustrator

Tampa TribuneKevin Wiatrowski

http://www2.tbo.com/static/maps/tbocom-special-report-data-maps-map-builder/

Page 63: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Google Maps API

Page 64: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

GeoCommons

Page 65: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Social Explorer

http://SocialExplorer.com

Page 66: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Census Bureau – Maps Tool

Page 67: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Digging for Stories

Page 68: SEAN LAHMAN – SLAHMAN@GANNETT.COM ROCHESTER DEMOCRAT & CHRONICLE SEANLAHMAN.COM/RESOURCES Digging into Census Data to Find Good Stories.

Questions

SeanLahman.com/resourcesSeanLahman.com/resources