Steven H. Shaha, PhD, DBA Professor, Center for Public Policy and Administration
-
Upload
hanna-riggs -
Category
Documents
-
view
30 -
download
0
description
Transcript of Steven H. Shaha, PhD, DBA Professor, Center for Public Policy and Administration
1
Program Evaluation and Impact Assessment: Internet-Delivered, On-Demand
Professional DevelopmentParticipating Schools
versus Their Respective Districts
Steven H. Shaha, PhD, DBAProfessor, Center for Public Policy and Administration
Independent EvaluatorJuly 2013
NOTE: Findings that follow are published as: Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013 (in press)
2
Overarching Research Question:
Does teacher engagement in PD 360 and Observation 360,
tools within the Educator Effectiveness System,
significantly affect student success?
3
Methods
• Design: Quasi-experimental, retrospective, pre-post, normalized treatment-control / participation vs. non-participation (2009-10, 2010-11)
• Goal: Multi-State, large n with comparable student populations (matched, controlled)
• Student Change:* Metric was percent students classified as Proficient or Advanced in respective States.
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
4
SampleParticipation
– Systematic sample of 169 elementary schools, in 73 districts, in 19 States• N determined by a priori Power analysis
– Schools eligible for inclusion in the sample as participating Schools met the following criteria:• More than 10 teachers total• 80% or more of teachers viewed materials• Minimum average of 90.0 minutes of viewing per teacher for the school
– Districts included were only those for which eligible schools were included• Normalizing for difference in socio-economic and demographic factors between participating Schools and their
Districts cumulatively as the statistical comparison group
Data– Participation data were extracted from the Internet-based professional development
application as surveilled– Student performance data were captured from publically available, Internet-accessed
sources (school as unit of measure, percent Proficient or Advanced as metric)
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
5
Impacts on Math
58.4
69.5
62.8
65.5
52.054.056.058.060.062.064.066.068.070.072.0
Year 1 Year 2
Comparative Change in Math Performance
Schools
Districts
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
6
Impacts on Math
58.4
69.5
62.8
65.5
52.054.056.058.060.062.064.066.068.070.072.0
Year 1 Year 2
Comparative Change in Math Performance
Schools
Districts
Math: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Signifi cance
Pct. Change from Yr 1
Statistical Signifi cance
Schools Mean 58.4 69.5 11.1 p<.001 4.2 18.9% p<.001 4.5StDev 21.9 21.1 Effect Size Effect Size
Districts Mean 62.8 65.5 2.6 p<.01 4.2% p<.01
StDev 20.4 20.2
Net Difference 8.4 p<.001 14.7% p<.001Level of Signifi cance p=0.065 p=0.085 p<.001 p<.001
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
7
Impacts on Math
58.4
69.5
62.8
65.5
52.054.056.058.060.062.064.066.068.070.072.0
Year 1 Year 2
Comparative Change in Math Performance
Schools
Districts
Math: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Signifi cance
Pct. Change from Yr 1
Statistical Signifi cance
Schools Mean 58.4 69.5 11.1 p<.001 4.2 18.9% p<.001 4.5StDev 21.9 21.1 Effect Size Effect Size
Districts Mean 62.8 65.5 2.6 p<.01 4.2% p<.01
StDev 20.4 20.2
Net Difference 8.4 p<.001 14.7% p<.001Level of Signifi cance p=0.065 p=0.085 p<.001 p<.001
Districts improved by 2.6 net percentage points (p<.01).
Improvement is percent change: [(Year2-Year1)/Year1]Comparative change: [School change/District change]7
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
8
Impacts on Math
58.4
69.5
62.8
65.5
52.054.056.058.060.062.064.066.068.070.072.0
Year 1 Year 2
Comparative Change in Math Performance
Schools
Districts
Math: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Signifi cance
Pct. Change from Yr 1
Statistical Signifi cance
Schools Mean 58.4 69.5 11.1 p<.001 4.2 18.9% p<.001 4.5StDev 21.9 21.1 Effect Size Effect Size
Districts Mean 62.8 65.5 2.6 p<.01 4.2% p<.01
StDev 20.4 20.2
Net Difference 8.4 p<.001 14.7% p<.001Level of Signifi cance p=0.065 p=0.085 p<.001 p<.001
Districts improved by 2.6 net percentage points (p<.01).
That’s 4.2% better than baseline.
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
9
Impacts on Math
58.4
69.5
62.8
65.5
52.054.056.058.060.062.064.066.068.070.072.0
Year 1 Year 2
Comparative Change in Math Performance
Schools
Districts
Math: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Signifi cance
Pct. Change from Yr 1
Statistical Signifi cance
Schools Mean 58.4 69.5 11.1 p<.001 4.2 18.9% p<.001 4.5StDev 21.9 21.1 Effect Size Effect Size
Districts Mean 62.8 65.5 2.6 p<.01 4.2% p<.01
StDev 20.4 20.2
Net Difference 8.4 p<.001 14.7% p<.001Level of Signifi cance p=0.065 p=0.085 p<.001 p<.001
Districts improved by 2.6 net percentage points (p<.01).
That’s 4.2% better than baseline.
Participating Schools improved by 11.1 net percentage points (p<.001).
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
10
Impacts on Math
58.4
69.5
62.8
65.5
52.054.056.058.060.062.064.066.068.070.072.0
Year 1 Year 2
Comparative Change in Math Performance
Schools
Districts
Math: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Signifi cance
Pct. Change from Yr 1
Statistical Signifi cance
Schools Mean 58.4 69.5 11.1 p<.001 4.2 18.9% p<.001 4.5StDev 21.9 21.1 Effect Size Effect Size
Districts Mean 62.8 65.5 2.6 p<.01 4.2% p<.01
StDev 20.4 20.2
Net Difference 8.4 p<.001 14.7% p<.001Level of Signifi cance p=0.065 p=0.085 p<.001 p<.001
Districts improved by 2.6 net percentage points (p<.01).
That’s 4.2% better than baseline.
Participating Schools improved by 11.1 net percentage points (p<.001).
That’s 18.9% better than baseline.
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
11
Impacts on Math
58.4
69.5
62.8
65.5
52.054.056.058.060.062.064.066.068.070.072.0
Year 1 Year 2
Comparative Change in Math Performance
Schools
Districts
Math: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Signifi cance
Pct. Change from Yr 1
Statistical Signifi cance
Schools Mean 58.4 69.5 11.1 p<.001 4.2 18.9% p<.001 4.5StDev 21.9 21.1 Effect Size Effect Size
Districts Mean 62.8 65.5 2.6 p<.01 4.2% p<.01
StDev 20.4 20.2
Net Difference 8.4 p<.001 14.7% p<.001Level of Signifi cance p=0.065 p=0.085 p<.001 p<.001
Districts improved by 2.6 net percentage points (p<.01).
That’s 4.2% better than baseline.
Participating Schools improved by 11.1 net percentage points (p<.001).
That’s 18.9% better than baseline.
Participating Schools improved by 8.4 points more than Districts (p<.001).
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
12
Impacts on Math
58.4
69.5
62.8
65.5
52.054.056.058.060.062.064.066.068.070.072.0
Year 1 Year 2
Comparative Change in Math Performance
Schools
Districts
Math: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Signifi cance
Pct. Change from Yr 1
Statistical Signifi cance
Schools Mean 58.4 69.5 11.1 p<.001 4.2 18.9% p<.001 4.5StDev 21.9 21.1 Effect Size Effect Size
Districts Mean 62.8 65.5 2.6 p<.01 4.2% p<.01
StDev 20.4 20.2
Net Difference 8.4 p<.001 14.7% p<.001Level of Signifi cance p=0.065 p=0.085 p<.001 p<.001
Districts improved by 2.6 net percentage points (p<.01).
That’s 4.2% better than baseline.
Participating Schools improved by 11.1 net percentage points (p<.001).
That’s 18.9% better than baseline.
Participating Schools improved by 8.4 points more than Districts (p<.001).
That’s 14.7% more versus baselines.
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
13
Impacts on Math
58.4
69.5
62.8
65.5
52.054.056.058.060.062.064.066.068.070.072.0
Year 1 Year 2
Comparative Change in Math Performance
Schools
Districts
Math: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Signifi cance
Pct. Change from Yr 1
Statistical Signifi cance
Schools Mean 58.4 69.5 11.1 p<.001 4.2 18.9% p<.001 4.5StDev 21.9 21.1 Effect Size Effect Size
Districts Mean 62.8 65.5 2.6 p<.01 4.2% p<.01
StDev 20.4 20.2
Net Difference 8.4 p<.001 14.7% p<.001Level of Signifi cance p=0.065 p=0.085 p<.001 p<.001
Districts improved by 2.6 net percentage points (p<.01).
That’s 4.2% better than baseline.
Participating Schools improved by 11.1 net percentage points (p<.001).
That’s 18.9% better than baseline.
Participating Schools experienced 4.2 TIMES greater improvement or Effect Size (p<.001).
Participating Schools improved by 8.4 points more than Districts (p<.001).
That’s 14.7% more versus baselines.
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
14
Impacts on Math
58.4
69.5
62.8
65.5
52.054.056.058.060.062.064.066.068.070.072.0
Year 1 Year 2
Comparative Change in Math Performance
Schools
Districts
Math: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Signifi cance
Pct. Change from Yr 1
Statistical Signifi cance
Schools Mean 58.4 69.5 11.1 p<.001 4.2 18.9% p<.001 4.5StDev 21.9 21.1 Effect Size Effect Size
Districts Mean 62.8 65.5 2.6 p<.01 4.2% p<.01
StDev 20.4 20.2
Net Difference 8.4 p<.001 14.7% p<.001Level of Signifi cance p=0.065 p=0.085 p<.001 p<.001
Districts improved by 2.6 net percentage points (p<.01).
That’s 4.2% better than baseline.
Participating Schools improved by 11.1 net percentage points (p<.001).
That’s 18.9% better than baseline.
Participating Schools experienced 4.2 TIMES greater improvement or Effect Size (p<.001).
That’s a 4.5 Effect Size versus baselines (p<.001)
Participating Schools improved by 8.4 points more than Districts (p<.001).
That’s 14.7% more versus baselines.
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
15
Impacts on MathComparative Growth for Participating SchoolsIn percentage of students Proficient or Advanced:
• 11.1 net improvement for Schools (p<.001)
– 8.4 more than their respective Districts (p<.001)
– 18.9% better than their Yr. 1 baseline (p<.001)
– 14.7% better than Districts vs. baselines (p<.001)
• Effect Sizes:– 4.2 times greater improvement for net growth vs.
Districts (p<.001)
– 4.5 times greater improvement for growth from baselines vs. Districts (p<.001)
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
56.9
67.2
61.262.7
50.052.054.056.058.060.062.064.066.068.0
Year 1 Year 2
Comparative Change in Reading Performance
Schools
Districts
Impacts on Reading
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
56.9
67.2
61.262.7
50.052.054.056.058.060.062.064.066.068.0
Year 1 Year 2
Comparative Change in Reading Performance
Schools
Districts
Impacts on Reading
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
Reading: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Significance
Pct. Change from Yr 1
Statistical Significance
Schools Mean 56.9 67.2 10.3 p<.001 6.5 18.1% p<.001 7.2StDev 22.4 22.1 Effect Size Effect Size
Districts Mean 61.2 62.7 1.6 p<.01 2.5% p<.01
StDev 21.1 20.7
Net Difference 8.7 p<.001 15.6% p<.001Level of Significance p=0.079 p=0.063 p<.001 p<.001
Reading: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Significance
Pct. Change from Yr 1
Statistical Significance
Schools Mean 56.9 67.2 10.3 p<.001 6.5 18.1% p<.001 7.2StDev 22.4 22.1 Effect Size Effect Size
Districts Mean 61.2 62.7 1.6 p<.01 2.5% p<.01
StDev 21.1 20.7
Net Difference 8.7 p<.001 15.6% p<.001Level of Significance p=0.079 p=0.063 p<.001 p<.001
56.9
67.2
61.262.7
50.052.054.056.058.060.062.064.066.068.0
Year 1 Year 2
Comparative Change in Reading Performance
Schools
Districts
Districts improved by 1.6 net percentage points (p<.01).
Impacts on Reading
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
Reading: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Significance
Pct. Change from Yr 1
Statistical Significance
Schools Mean 56.9 67.2 10.3 p<.001 6.5 18.1% p<.001 7.2StDev 22.4 22.1 Effect Size Effect Size
Districts Mean 61.2 62.7 1.6 p<.01 2.5% p<.01
StDev 21.1 20.7
Net Difference 8.7 p<.001 15.6% p<.001Level of Significance p=0.079 p=0.063 p<.001 p<.001
56.9
67.2
61.262.7
50.052.054.056.058.060.062.064.066.068.0
Year 1 Year 2
Comparative Change in Reading Performance
Schools
Districts
Districts improved by 1.6 net percentage points (p<.01).
That’s 2.5% better than baseline.
Impacts on Reading
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
Reading: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Significance
Pct. Change from Yr 1
Statistical Significance
Schools Mean 56.9 67.2 10.3 p<.001 6.5 18.1% p<.001 7.2StDev 22.4 22.1 Effect Size Effect Size
Districts Mean 61.2 62.7 1.6 p<.01 2.5% p<.01
StDev 21.1 20.7
Net Difference 8.7 p<.001 15.6% p<.001Level of Significance p=0.079 p=0.063 p<.001 p<.001
56.9
67.2
61.262.7
50.052.054.056.058.060.062.064.066.068.0
Year 1 Year 2
Comparative Change in Reading Performance
Schools
Districts
Districts improved by 1.6 net percentage points (p<.01).
That’s 2.5% better than baseline.
Participating Schools improved by 10.3 net percentage points (p<.001).
Impacts on Reading
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
Reading: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Significance
Pct. Change from Yr 1
Statistical Significance
Schools Mean 56.9 67.2 10.3 p<.001 6.5 18.1% p<.001 7.2StDev 22.4 22.1 Effect Size Effect Size
Districts Mean 61.2 62.7 1.6 p<.01 2.5% p<.01
StDev 21.1 20.7
Net Difference 8.7 p<.001 15.6% p<.001Level of Significance p=0.079 p=0.063 p<.001 p<.001
56.9
67.2
61.262.7
50.052.054.056.058.060.062.064.066.068.0
Year 1 Year 2
Comparative Change in Reading Performance
Schools
Districts
Districts improved by 1.6 net percentage points (p<.01).
That’s 2.5% better than baseline.
Participating Schools improved by 10.3 net percentage points (p<.001).
That’s 18.1% better than baseline.
Impacts on Reading
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
Reading: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Significance
Pct. Change from Yr 1
Statistical Significance
Schools Mean 56.9 67.2 10.3 p<.001 6.5 18.1% p<.001 7.2StDev 22.4 22.1 Effect Size Effect Size
Districts Mean 61.2 62.7 1.6 p<.01 2.5% p<.01
StDev 21.1 20.7
Net Difference 8.7 p<.001 15.6% p<.001Level of Significance p=0.079 p=0.063 p<.001 p<.001
56.9
67.2
61.262.7
50.052.054.056.058.060.062.064.066.068.0
Year 1 Year 2
Comparative Change in Reading Performance
Schools
Districts
Districts improved by 1.6 net percentage points (p<.01).
That’s 2.5% better than baseline.
Participating Schools improved by 10.3 net percentage points (p<.001).
That’s 18.1% better than baseline.
Participating Schools improved by 8.7 points more than Districts (p<.001).
Impacts on Reading
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
Reading: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Significance
Pct. Change from Yr 1
Statistical Significance
Schools Mean 56.9 67.2 10.3 p<.001 6.5 18.1% p<.001 7.2StDev 22.4 22.1 Effect Size Effect Size
Districts Mean 61.2 62.7 1.6 p<.01 2.5% p<.01
StDev 21.1 20.7
Net Difference 8.7 p<.001 15.6% p<.001Level of Significance p=0.079 p=0.063 p<.001 p<.001
56.9
67.2
61.262.7
50.052.054.056.058.060.062.064.066.068.0
Year 1 Year 2
Comparative Change in Reading Performance
Schools
Districts
Districts improved by 1.6 net percentage points (p<.01).
That’s 2.5% better than baseline.
Participating Schools improved by 10.3 net percentage points (p<.001).
That’s 18.1% better than baseline.
Participating Schools improved by 8.7 points more than Districts (p<.001).
That’s 15.6% more versus baselines.
Impacts on Reading
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
24
Reading: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Significance
Pct. Change from Yr 1
Statistical Significance
Schools Mean 56.9 67.2 10.3 p<.001 6.5 18.1% p<.001 7.2StDev 22.4 22.1 Effect Size Effect Size
Districts Mean 61.2 62.7 1.6 p<.01 2.5% p<.01
StDev 21.1 20.7
Net Difference 8.7 p<.001 15.6% p<.001Level of Significance p=0.079 p=0.063 p<.001 p<.001
56.9
67.2
61.262.7
50.052.054.056.058.060.062.064.066.068.0
Year 1 Year 2
Comparative Change in Reading Performance
Schools
Districts
Districts improved by 1.6 net percentage points (p<.01).
That’s 2.5% better than baseline.
Participating Schools improved by 10.3 net percentage points (p<.001).
That’s 18.1% better than baseline.
Participating Schools experienced 6.5 TIMES greater improvement or Effect Size (p<.001).
Participating Schools improved by 8.7 points more than Districts (p<.001).
That’s 15.6% more versus baselines.
Impacts on Reading
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
25
Reading: Pct. of Students Proficient OR Advanced
Year 1 Year 2Net
ChangeStatistical
Significance
Pct. Change from Yr 1
Statistical Significance
Schools Mean 56.9 67.2 10.3 p<.001 6.5 18.1% p<.001 7.2StDev 22.4 22.1 Effect Size Effect Size
Districts Mean 61.2 62.7 1.6 p<.01 2.5% p<.01
StDev 21.1 20.7
Net Difference 8.7 p<.001 15.6% p<.001Level of Significance p=0.079 p=0.063 p<.001 p<.001
56.9
67.2
61.262.7
50.052.054.056.058.060.062.064.066.068.0
Year 1 Year 2
Comparative Change in Reading Performance
Schools
Districts
Districts improved by 1.6 net percentage points (p<.01).
That’s 2.5% better than baseline.
Participating Schools improved by 10.3 net percentage points (p<.001).
That’s 18.1% better than baseline.
Participating Schools experienced 6.5 TIMES greater improvement or Effect Size (p<.001).
That’s a 7.2 Effect Size versus baselines (p<.001)
Participating Schools improved by 8.7 points more than Districts (p<.001).
That’s 15.6% more versus baselines.
Impacts on Reading
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
26
Impacts on ReadingComparative Growth for Participating SchoolsIn percentage of students Proficient or Advanced:
• 10.3 net improvement for Schools (p<.001)
– 8.7 more than their respective Districts (p<.001)
– 18.1% better than their Yr. 1 baseline (p<.001)
– 15.6% better than Districts vs. baselines (p<.001)
• Effect Sizes:– 6.5 times greater improvement for net growth vs.
Districts (p<.001)
– 7.2 times greater improvement for growth from baselines vs. Districts (p<.001)
Shaha SH, & Ellsworth H. Quasi-experimental Study of the Impact of On-demand Professional Development on Students Performance. International Journal of Evaluation and Research in Education (IJERE). Vol.2, no 4, Dec. 2013.
*The original study of 15.3% cited has an errata underway to become 18.1%.