Welcome! Review of the National Part C APR Indicator 4 Family Data FFY 2011 (2011-12)
description
Transcript of Welcome! Review of the National Part C APR Indicator 4 Family Data FFY 2011 (2011-12)
Welcome!Review of the National Part C APR
Indicator 4 Family DataFFY 2011 (2011-12)
Siobhan Colgan, ECTA, DaSyMelissa Raspa, ECTA
A few polls…
Who are we?
Purpose of Today’s Webinar
• To share & discuss Part C APR Indicator 4 national data
• To highlight key resources related to family data & family outcomes
• To offer an opportunity for participants to weigh in on family topics of interest
Part C APR Indicator 4
Percent of families who report that early intervention services have helped the family… (A)…know their rights(B)…effectively communicate their children's
needs(C)…help their children develop and learn
What Data are Included?
• All 56 states & jurisdictions reporting• Data submitted in states’ APRs in
February, 2013– Data from School Year (SY) 2011-2012– Federal Fiscal Year (FFY) 2011
• Quantitative data as reported by OSEP• Additional ECO analyses
Summary of APR Results Areas
• State Approaches– Surveys used – Survey
Implementation• Data Quality
– Numbers and Response rates
– Representativeness
• Current Year C4 Data – Trends over time– By survey used– By region– By state size– By percent served
State Approaches: Surveys Used
• 25 NCSEAM (45%) [same as last year]
• 24 ECO FOS (43%) [same as last year]– 15 using the original FOS (27%) [17 last year]– 9 using the revised FOS (16%) [7 last year]
• 7 state-developed (13%) [same as last year]
7
State Approaches: Surveys Used
State Approaches: Survey Implementation
• Dissemination & return approaches– Hand-delivered– Mailed– Online option
• Follow-up strategies: – Phone calls – Reminder mailings– Incentives to programs – Incentives to families
• Populations surveyed– All families in program– Families of children in
program a minimum amount of time (6, 9, 12 months)
• Survey Timing– Annual point in time – Aligned with child’s
participation in program (e.g. at IFSP, at exit)
– Other (monitoring schedule, regional)
Data Quality: Response Rates & Number Surveyed
• Response rate average = 37.5% (49 states reporting) [up from 36.9% last year]– Ranging from 8% to 100% – Ten states with response rates below 20% – Ten states with response rates above 50%
• Mean number of surveys returned = 949
– Ranging from n=34 to n=437410
Response Rates by Survey Distribution andReturn Methods
Response rate States (n)
In-person Only Distribution 49.6% 17
With in-person return 63.7% 5
With multiple return methods 49.5% 5
With mail return 35.7% 6
Multiple/Combined Distribution Methods (two or more)
41.5% 9
With mail return 47.2% 2
With multiple return methods 39.9% 7
Mailed-Only Distribution 27.0% 23
With multiple return methods 31.8% 8
With mail return 24.4% 15
Data Quality: Representativeness of Family Data
• Variables analyzed by states (in descending order or frequency):– Race/ ethnicity – Geographic variables (district, county, region)– Child’s Gender – Child’s age (at time of survey, at referral)– Others: disability/eligibility categories, length of time in
services, income, primary language• Comparison data: 618 data tables and/or
program data
Data Quality: Comments, Questions, Discussion
• What strategies have you tried to improve your data quality (response rates, representativeness of responses)
• What are the challenges you face in your family survey process– – implementing the survey? – being confident in the quality of data?– using the data?
ECO ECO-Revised NCSEAM State Survey0
10
20
30
40
50
60
70
80
90
100
8984 85
9692
8884
9592
8691
96
Indicator C4 by Survey Used
4A4B4C
<2.1% 2.1% to <2.5% 2.5% to <3.1%
3.1% to <4%
4% or higher
0
10
20
30
40
50
60
70
80
90
100
92
8583
87 86
91
86 8488 88
9390 89 90 90
Indicator C4 by Percent Served Groups
4A4B4C
Region 1 Region 2 Region 3 Region 4 Region 5 Region 60
10
20
30
40
50
60
70
80
90
100
82
87 8884
94
87
83
87 89 87
93
878891 91
88
9591
Indicator C4 by RRC Region
4A4B4C
<1,000 1,000 to 2,599
2,600 to 4,799
4,800 to 9,999
>10,0000
10
20
30
40
50
60
70
80
90
100
90 89 90 90
77
93
88 8992
78
93 91 92 93
85
Indicator C4 by Child Count Groups
4A4B4C
Resource Sharing & TA Needs
• Graphing Template: Comparing national to state data
• ECO/ECTA “Talking with Families” web page
• DaSy “For Families” webpage with survey
• Final Poll: Family Topics TA Needs