Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

16
Measuring Child & Family Outcomes: nec nectac National TA Meeting Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys

Transcript of Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Page 1: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

Strategies for Improving Response

RatesMinnesota’s First Year

Success

Family OutcomesSurveys

Page 2: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

We are home to…• The Mall of America• The first professional wrestler to hold

the office of Governor• The headwaters of the Mississippi

River• The world’s largest ball of twine

• Yes, that says “twine”

Page 3: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

Page 4: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

Why am I up here today?

76%76%

Page 5: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

Key Decisions• What tool to use?• How often to distribute it?• To who?• By whom?• How to get it back?• Follow up?

Page 6: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

Which Tool?• Considered

– NCSEAM– ECO– Developing our own

• Minnesota’s adopted the ECO Survey– Length– Readability– Question Format

Page 7: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

Distributed to…..?• Considered

– Sample– Universal Distribution

• Minnesota surveys all families

Page 8: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

Survey FormatConsidered• Web-based• Scantron• Pencil/Paper

MN uses a paper version of the ECO survey. Child’s MARSS number is printed on survey

Page 9: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

Frequency of DistributionConsidered

– Pre/post– Annually– One time per family

Adopted a one-time approach– Families receive a survey at exit from

Part C– Turn 3 or exit for another reason

Page 10: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

Distribution Methodology• Surveys are handed to families

during a home visit around the time of exit from Part C.

• Given by the family’s service coordinator or Primary Service Provider

• Provided training on “talking points”

Page 11: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

Talking Points• Each family’s answers are private• They will not be shared directly with

program staff• Responses will be combined with

responses from other families to create a statewide and local picture of the early intervention system

• Information will be used to help make programs stronger

Page 12: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

Language or Literacy Barriers

• Districts use interpreters when necessary**

• When literacy is a barrier, districts use a staff member who is NOT a service provider to gather responses through an interview

(**Now available in multiple languages)

Page 13: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

Available LanguagesArabic, Cambodian, Croatian,

Hmong, Laotian, Simplified Chinese, Oromo, Russian,

Somali, Spanish, Vietnamese& English.

Page 14: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

Method of Return• Family given an envelop with

proper postage• Addressed to the MN Department

of Education• Minnesota utilizes an intentional

lack of follow-up

Page 15: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007

First “Year’s” Data• Implemented the survey process

on April 1, 2006• 2/2007 SPP included 3 months’

worth of data• 530 families eligible to receive the

survey• 403 surveys returned

Page 16: Strategies for Improving Response Rates Minnesota’s First Year Success Family Outcomes Surveys.

Measuring Child & Family Outcomes: necnectac National TA Meeting August 2007