Welcome!Review of the National Part C APR

Indicator 4 Family DataFFY 2011 (2011-12)

Siobhan Colgan, ECTA, DaSyMelissa Raspa, ECTA

A few polls…

Who are we?

Purpose of Today’s Webinar

• To share & discuss Part C APR Indicator 4 national data

• To highlight key resources related to family data & family outcomes

• To offer an opportunity for participants to weigh in on family topics of interest

Part C APR Indicator 4

Percent of families who report that early intervention services have helped the family… (A)…know their rights(B)…effectively communicate their children's

needs(C)…help their children develop and learn

What Data are Included?

• All 56 states & jurisdictions reporting• Data submitted in states’ APRs in

February, 2013– Data from School Year (SY) 2011-2012– Federal Fiscal Year (FFY) 2011

• Quantitative data as reported by OSEP• Additional ECO analyses

Summary of APR Results Areas

• State Approaches– Surveys used – Survey

Implementation• Data Quality

– Numbers and Response rates

– Representativeness

• Current Year C4 Data – Trends over time– By survey used– By region– By state size– By percent served

State Approaches: Surveys Used

• 25 NCSEAM (45%) [same as last year]

• 24 ECO FOS (43%) [same as last year]– 15 using the original FOS (27%) [17 last year]– 9 using the revised FOS (16%) [7 last year]

• 7 state-developed (13%) [same as last year]

7

State Approaches: Surveys Used

State Approaches: Survey Implementation

• Dissemination & return approaches– Hand-delivered– Mailed– Online option

• Follow-up strategies: – Phone calls – Reminder mailings– Incentives to programs – Incentives to families

• Populations surveyed– All families in program– Families of children in

program a minimum amount of time (6, 9, 12 months)

• Survey Timing– Annual point in time – Aligned with child’s

participation in program (e.g. at IFSP, at exit)

– Other (monitoring schedule, regional)

Data Quality: Response Rates & Number Surveyed

• Response rate average = 37.5% (49 states reporting) [up from 36.9% last year]– Ranging from 8% to 100% – Ten states with response rates below 20% – Ten states with response rates above 50%

• Mean number of surveys returned = 949

– Ranging from n=34 to n=437410

Response Rates by Survey Distribution andReturn Methods

  Response rate States (n)

In-person Only Distribution 49.6% 17

With in-person return 63.7% 5

With multiple return methods 49.5% 5

With mail return 35.7% 6

Multiple/Combined Distribution Methods (two or more)

41.5% 9

With mail return 47.2% 2

With multiple return methods 39.9% 7

Mailed-Only Distribution 27.0% 23

With multiple return methods 31.8% 8

With mail return 24.4% 15

Data Quality: Representativeness of Family Data

• Variables analyzed by states (in descending order or frequency):– Race/ ethnicity – Geographic variables (district, county, region)– Child’s Gender – Child’s age (at time of survey, at referral)– Others: disability/eligibility categories, length of time in

services, income, primary language• Comparison data: 618 data tables and/or

program data

Data Quality: Comments, Questions, Discussion

• What strategies have you tried to improve your data quality (response rates, representativeness of responses)

• What are the challenges you face in your family survey process– – implementing the survey? – being confident in the quality of data?– using the data?

ECO ECO-Revised NCSEAM State Survey0

10

20

30

40

50

60

70

80

90

100

8984 85

9692

8884

9592

8691

96

Indicator C4 by Survey Used

4A4B4C

<2.1% 2.1% to <2.5% 2.5% to <3.1%

3.1% to <4%

4% or higher

0

10

20

30

40

50

60

70

80

90

100

92

8583

87 86

91

86 8488 88

9390 89 90 90

Indicator C4 by Percent Served Groups

4A4B4C

Region 1 Region 2 Region 3 Region 4 Region 5 Region 60

10

20

30

40

50

60

70

80

90

100

82

87 8884

94

87

83

87 89 87

93

878891 91

88

9591

Indicator C4 by RRC Region

4A4B4C

<1,000 1,000 to 2,599

2,600 to 4,799

4,800 to 9,999

>10,0000

10

20

30

40

50

60

70

80

90

100

90 89 90 90

77

93

88 8992

78

93 91 92 93

85

Indicator C4 by Child Count Groups

4A4B4C

Resource Sharing & TA Needs

• Graphing Template: Comparing national to state data

• ECO/ECTA “Talking with Families” web page

• DaSy “For Families” webpage with survey

• Final Poll: Family Topics TA Needs