TheDataWeb: a New Framework for Data Cavan Capps, Chief TheDataWeb Applications Branch Data...

32
TheDataWeb: a New Framework for Data Cavan Capps, Chief TheDataWeb Applications Branch Data Integration Division Howard Hogan, Director Demographic Programs Directorate

Transcript of TheDataWeb: a New Framework for Data Cavan Capps, Chief TheDataWeb Applications Branch Data...

TheDataWeb: a New Framework for Data TheDataWeb: a New Framework for Data

Cavan Capps, Chief

TheDataWeb Applications Branch

Data Integration Division

Howard Hogan, Director

Demographic Programs Directorate

““In God we TrustIn God we Trust -- -- ““In God we TrustIn God we Trust -- --

-- for everything else we -- for everything else we need data”need data”-- for everything else we -- for everything else we need data”need data”

Michael Bloomberg .... on making decisions

for business or government

Data = A number in a context

Data = A number in a context

“10.0%” is NOT data

“The 2005 poverty rate for the U.S. is 10.0%” is data

“The 2006 poverty rate for the U.S. as collected by the ACS for the housing unit population is 10.0%” is more data

Information on questionnaire, sample size, rotation, imputation, weighting, etc., is still more data

4

The Wider ContextThe Wider ContextOne datum is seldom useful

Analysis requires putting the data point in context

Related variables

Other geographies

Other time periods

5

Dissemination ChallengesDissemination Challenges

How to present the right data with the right context to meet users actual needs

How to ensure that the most recent and most correct data are displayed

6

Different issues

Different audiences

Solution = Different views of the same data

Dissemination ChallengesDissemination Challenges

7

A Three Part ApproachA Three Part Approach

HotReports

DataFerrett

TheDataWeb

8

HotReportsHotReports

Targeted a local decision-makers with limited time and statistical background

Bring together relevant variables for local areas

Topically orientedUpdated dynamicallyCan be designed to support decision-makingGuided use of statistical data

9

10

Relatively Quick to BuildRelatively Quick to Build

Drag & drop layout

Statistically smart

Gives an analyst a chance to layout data for a problem

Creates information

11

Relatively Quick to BuildRelatively Quick to Build

50% of time is designing HotReport (finding

right data and laying it out)

20% of time is creating HotReport 30% of time is reviewing and fact checking

12

Typical HotReport UsersTypical HotReport UsersRegional economic developers

Emergency planning and coordination

Public health planning

Grant eligibility

Performance indicators

13

DataFerrett: a data browserDataFerrett: a data browser

Targeted at sophisticated data users

Brings together multiple data sets

Updated dynamically

Brings data context along with the numbers

14

DataFerrett: a data browserDataFerrett: a data browser

Speeds analysis

• Data manipulation

• Advanced tabulation and descriptive statistics

• Mapping and business graphics using statistical rules

• Adding regressions and other advanced statistics

15

TheDataWeb BrowserTheDataWeb Browser

Data set collections are

in folders

16

TheDataWeb BrowserTheDataWeb Browser

Highlighted data sets can be

searched

17

TheDataWeb BrowserTheDataWeb Browser

.

Variables returned from search

18

TheDataWeb BrowserTheDataWeb Browser

Multiple kinds of datasets supported

19

TheDataWeb BrowserTheDataWeb BrowserBefore selecting, examine variable documentation with questions, universes and response labels or ranges

20

TheDataWeb BrowserTheDataWeb BrowserSelected variables aretabulated in thespreadsheetcontrolled bystatistical rules

21

TheDataWeb BrowserTheDataWeb BrowserMapping, andbusinessgraphics areavailable for alldata

22

DataFerret UsersDataFerret Users

Federal and state government • (.gov) = 7,876 users

• (.us) = 5,923 user accounts

Education (.edu) = 42,828 user accountsNon-profit (.org) = 10,792 user accountsPrivate companies (.com) = 100,384

• Press - Consulting Retail

• Marketing - Insurance and Financial

• Pharmaceuticals

23

TheDataWebTheDataWeb

“TheDataWeb” is the software engineering that make DataFerrett and HotReports possible

24

A Smart Data-Networking Framework

A Smart Data-Networking Framework

Capacity to handle different kinds of data in the same environment or framework

Empowered by statistical intelligence• documentation• statistical usage rules• data integration rules

Stores the data one time, use it many times More data in the network the more useful

25

TheDataWeb FrameworkTheDataWeb Framework

26

TheDataWeb FrameworkTheDataWeb Framework

27

TheDataWeb FrameworkTheDataWeb Framework

28

TheDataWeb FrameworkTheDataWeb Framework

29

TheDataWeb FrameworkTheDataWeb Framework

30

Based on CollaborationBased on Collaboration

“Open Source” statistical partnership with Australian Bureau of Statistics and other interested agencies

Based on statistical analysts providing statistical rules

Based on analysts creating a presentation and analytical review

31

Useful LinksUseful Links

http://dataferrett.census.gov

www.thedataweb.org

www.thedataweb.org/twiki

www.thedataweb.org/forum

Contact Contact Contact Contact Cavan Capps

[email protected] work

866-437-0171 toll free

301-908-6216 cell

DataFerrett HelpDesk: Toll Free: 866-437-0171

DataFerrettTeam Email:[email protected]