2008 NAPHSIS Annual Meeting Celebrating 75 Years of Excellence Orlando, FL June 1 st – 5 th, 2008...

38
2008 NAPHSIS Annual Meeting Celebrating 75 Years of Excellence Orlando, FL June 1 st Publish or Perish: After 75 Years, Have State Compendiums of Vital Statistics Outlived Their Usefulness? Mark Flotow and Gary Morgan Illinois Center for Health Statistics IL Dept of Public Health 5 June, 2008 Orlando, FL

Transcript of 2008 NAPHSIS Annual Meeting Celebrating 75 Years of Excellence Orlando, FL June 1 st – 5 th, 2008...

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Publish or Perish: After 75 Years, Have State Compendiums of Vital

Statistics Outlived Their Usefulness?

Mark Flotowand Gary Morgan

Illinois Center for Health StatisticsIL Dept of Public Health

5 June, 2008Orlando, FL

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

And the answer is . . .

. . . “MAYBE”

. . . Failure to evolve is not an option

. . . for continued survival

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Past Evolution (IL examples)

1960 Characteristics:

- Thin (54 pages)- Typed; includes 9 pages of text- A marvel of duplication technology

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Past Evolution (IL examples)

1980 Characteristics:

- Thicker (184 pages), thanks to modern data processing

- Mainframe-looking output, plus 14 pages of text

- A marvel of cut-and-paste technology

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Past Evolution (IL examples)

2000 Characteristics:

- Phonebook thick (318 pages), thanks to really modern data processing

- PC-based output plus 47 pages of text, integrated with tables and graphs

- A marvel of Y2K survival

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Future Evolution . . .

. . . do we need to continue to print our annual compendiums??

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Publish? Perish the Thought . . .

The pros (and prose) of old school publishing:

- Excellent desktop reference- Libraries still love them- Portable and visual- A permanent record

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Publish? Perish the Thought . . .

The cons (and complaints) of old school publishing:

- Expensive to print and distribute- S-l-o-w (layout, editorial review,

duplicating, binding, etc.)- Corrections and errata are continuous

issues

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Publish? Perish the Thought . . .

The pros of Web publishing:- Cheap to produce and about nil to

distribute- Not a permanent record; can be

corrected, modified, replaced, deleted- Always quicker than printing (fewer

production steps)- Can add extra flash and features (e.g., a

hot-linked TOC)

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Publish? Perish the Thought . . .

The cons of Web publishing:

- Needs to be monitored; generally not “set and forget” (a case of higher expectations and perpetual responsibility)

- In some cases, passing on costs and time of printing to consumer (i.e., collectively inefficient)

- Need PC, Internet access

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Publish? Perish the Thought . . .

What do my users need? Typical questions for which they seek answers . . .

- I just need the (one) number of . . .- Tell/Give me everything you know/have

about . . .- How does my area compare to the state

on . . . ?

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Publish? Perish the Thought . . .

What do my users need? Typical questions for which they seek answers (continued)

- What is the rank of X ? (e.g., leading causes of death)

- Can you tell me if X is going up or down during the period of . . . ?

- Why does X go up and down from year to year . . . ?

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Publish? Perish the Thought . . .

“MAYBE” Part I.

- There are advantages to both print and Web publishing.

- Perhaps only a minority of users need the printed version:

- state offices- local health departments- libraries or other reference environs

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

And Now a Word About the Future

(If “WDQS” is “a Word”) Will Web-based Data Query Systems supplant annual vital statistics compendiums?

- In terms of data or statistical tables, it is completely possible.

- Think of the users who need the one number, the rank, the rates, etc.

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

And Now a Word About the Future

Will WDQS supplant annual vital statistics compendiums? (continued)

- Another question: Is the vital statistician basically a programmer, a technician or an interpreter, relative to the data?

- Think of the users who need the explanations, the “hows,” the “whys”

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

And Now a Word About the Future

Will WDQS supplant annual vital statistics compendiums? (continued)

- Analysis is the key component:- trend spotting- investigation (e.g., issue du jour)- summarizing results in plain prose- explaining statistical results

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

And Now a Word About the Future

Will WDQS supplant annual vital statistics compendiums? (continued)

- Analysis is the key component: (cont.)- explaining statistical . . . power,

calculation, limitations,appropriate application, etc.

- explaining history of investigation

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

And Now a Word About the Future

Will WDQS supplant annual vital statistics compendiums? (continued)

- Analysis is the key component: (cont.)- explaining history of collection- how items are measured- showing which differences are trivial versus important (i.e., significant)

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

And Now a Word About the Future

Will WDQS supplant annual vital statistics compendiums? (continued)

Another devil’s advocate question: why not utilize other research statisticians, say at state universities, for VS analysis?

- who are getting their hands dirty inthe data?

- whose job is it 24/7 (7.5/5)?

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

And Now a Word About the Future

“MAYBE” Part II.

- VS need to be tied to public health policy, grant activities, local/state needs assessments, programmatic applications, etc. to be effectively used or presented, say in a VS compendium.

- Analysis is your most valuable asset.

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Um, How Do You Do That?

- Pay attention* to what your agency’s programs are using and asking for

- Pay attention* to what your clients (say they) utilize in your compendium

- Survey your clients, if necessary

* Pay attention = serve on committees, talk to program people, scan the news, etc.

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Um, How Do You Do That?

- Be proactive; the days of people simply coming to you because VS data are the only game in town are (long) over

- Listen, liaison, link the data dots- Adapt (evolve) your VS compendium (and

other products) accordingly

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Case Study: How We Did That

- IL Program for Local Assessment of Needs (IPLAN) wanted a data tool kit for local community groups to use to assess key health indicators and determine five-year priorities for intervention

- Part of LHD re-certification- Community groups’ members not data

savvy, let alone public health statisticians

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Case Study: How We Did That

- IPLAN needs (continued)

- Regarding VS data, we determined:- long-term planning the focus- lots of small numbers issues for

many LHDs- age-adjusted rates, for example,

difficult to comprehend by users

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Case Study: How We Did That

- IPLAN needs (continued)

- Main VS response was data for the IPLAN database but we also adapted our VS compendium:

- dropped YPLL- added premature mortality rates

(PMR)- added multi-year averaging

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Case Study: How We Did That

- IPLAN needs (continued)

- Adapted VS compendium: (continued)- added county comparison tables- added confidence intervals for

selected measures (e.g., IMR)- added explanations, such as

ICD-9/10 comparison

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

“Publish or Perish . . .”

5 June, 2008Natality example

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

“Publish or Perish . . .”

5 June, 2008

Mortality example

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

“Publish or Perish . . .”

5 June, 2008County comparisons (PMR)

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Case Study: How We Did That

Will County example, Heart Disease PMR:Year Deaths Deaths Crude All ages 0-64 Rate PMR AADR1999 941 149 194.6 33.6 291.72000 926 175 182.2 37.6 273.52001 925 142 172.3 28.8 263.02002 993 174 175.7 33.5 266.42003 972 182 163.5 33.2 246.02004 880 174 141.5 30.3 214.52005 904 185 140.9 31.2 205.7 % Change 1999-2001

to -1% +16% -19% -5% -20% == 2003-2005

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Other Things to Keep in Mind

“MAYBE” Part III.- Don’t forget year-to-year comparability is

a VS compendium strength and don’t neglect your core content.

- The compendium is expected to be the “gold standard” for VS data.

- VS compendiums are not necessarily meant to be the “latest news” but rather the “last word” regarding a statistical year.

“Publish or Perish . . .”

5 June, 2008

2008 NAPHSIS Annual MeetingCelebrating 75 Years of ExcellenceOrlando, FL June 1st – 5th, 2008

Thank You

Mark FlotowIllinois Center for Health StatisticsIL Dept Public HealthSpringfield, [email protected] site: www.idph.state.il.us