1

School Performance Measure Calculations SY 2014-15

Office of Achievement and Accountability

This presentation is intended to guide you in reviewing your School Performance Measure (SPM) report.

It will answer the following questions:

• What is the School Performance Measure (SPM)?

• What are the categories and indicators of SPM?

• How do I interpret my 2014-15 SPM report?

• How is SPM calculated?

• Where can I find more information about SPM?

Agenda

2

What is the School Performance Measure?

3

School Performance Measure Overview4

• The SPM reflects City Schools’ values including progress for all students and the cultivation of a nurturing learning environment• Collectively, a school’s teachers and school leadership play an

instrumental role in affecting student growth

• The SPM serves as a component of the 2014-15 teacher and school leader evaluation systems • For more information on SPM in evaluations, please visit City

Schools Inside regarding teacher and school leader evaluations

School Performance Measure Overview5

• The SPM is a measure of quantitative indicators that reflects a whole school’s year-long performance. Data are: • Lagged, so the 2014-15 SPM is based on SY 2013-14 data• District-normed, so schools are scored relative to one another• Context-specific, giving consideration to absolute

performance and annual progress

• Alternative schools and alternative options programs are excluded from SPM because the majority of these schools and programs are missing data on most indicators

What are the categories and indicators of SPM?

6

2014-15 School Performance Measure Categories

• The SPM measures school performance in 3 categories

o Elementary and middle schools have only learning environment data as a result of the transition to PARCC o Schools serving grades 9-12 include progress and college & career readiness

7

School Performance Measure

Learning Environ

mentProgress

College and

Career Readines

s

• ES/MS (100%)

• HS (33%)

• HS Only (33%)

• HS Only (33%)

2014-15 School Performance Measure Indicators

8

Learning Environment Progress* College/Career Readiness* (or Growth)

ES/MS Indicators

• School Survey: Parents• School Survey: Staff • School Survey: Students• Attendance Rate• Chronic Absence Rate• Cohort Retention Rate (2-

year)

Not applicable for SY 14-15 Not applicable for SY 14-15

HS Indicators • School Survey: Parents• School Survey: Staff • School Survey: Students• Attendance Rate• Chronic Absence Rate• Cohort Retention Rate (2-

year)• Dropout Rate (4-year)

Progress toward AMO for: • HSA Algebra • HSA English • HSA Biology

• SAT/ACT Participation

AND

Progress toward AMO for: • College/Career

Preparation • Graduation rate (5-year)

* Progress and college/career readiness use state-developed annual measurable objective (AMO) data. When 2014 AMO data are not available, 2013 data are used.

How do I interpret my 2014-15 SPM report?

9

Elementary and Middle Schools

SPM = Learning Environment

• School Survey: Parents

• School Survey: Staff

• School Survey: Students

• Attendance Rate*

• Chronic Absence Rate*

• Cohort Retention Rate (2-

year)*

2014-15 School Performance Measure Reports

10

* For these indicators, schools receive the greater of two scaled scores: either the absolute performance or the change in the indicator from the previous year. Unlike the other indicators, low rates of chronic absence yield higher scores.

High Schools

Learning

Environment

School Survey: Parents, Staff, and Students

Attendance Rate* Chronic Absence Rate*Cohort Retention Rate

(2-year)*Dropout Rate (4-year)*

2014-15 School Performance Measure Reports

11

Progress

AMO- HSA AlgebraAMO- HSA EnglishAMO- HSA Biology

College & Career

Readiness

SAT/ACT Participation Rate

AMO- College/Career Preparation

AMO – Graduation Rate (5-year)

SPM = Average of three categories:

* For these indicators, schools receive the greater of two scaled scores: either the absolute performance or the change in the indicator from the previous year. Unlike the other indicators, low rates of chronic absence and dropout yield higher scores.

1. Scoring: Comparisons Between Schools

• Scaled scores on each indicator are calculated based on each school’s

performance relative to other schools in the same school grade-band

2. Absolute or Change Scores

• Scaled scores are compared, and schools receive whichever score is

greater: the absolute or change score

3. Overall Scoring

• The overall score is calculated by taking the average of scaled scores

for each available indicator

How is SPM calculated?

12

1. Scoring: Comparisons Between Schools

13

• Schools receive scaled scores based on how they perform relative to other schools within their grade-bands (E, EM, M, MH, H)*

• SPM is on a 100-point scale, and scores are based on floors (10th percentile) and targets (90th percentile, or 1 for AMO data) based on the following calculation:

• In this example, the floor is 64.2 and the target is 79.6

School indicator value– floor

Target– floor x 100

* Grade bands M, MH, and EMH were grouped for learning environment data, and EMH, MH, and H were grouped for high

school-only data

65.9– 64.2 79.6– 64.2

x 100 = 11.04

1.715.4

=

2. Absolute or Change Scores14

• Schools can receive scores for improving their performance from the previous year in attendance, chronic absence, cohort retention, and dropout rate

• In this example, the school receives the change score because it is greater than the absolute score for attendance. Here is the comparison:

• Absolute: 2014 Attendance = 87.87%• Because the floor for elementary schools is 89.37% for attendance,

this school would receive a scaled score of 0 based on absolute attendance.

• Change: Change in Attendance (performance from SY 2014 (87.87%) – performance from SY 2013 (88.0%)= -.83• Because the floor is -1.76, and the target is .62 for change in

attendance, this school would receive a scaled score of 39.22.

3. Overall Scoring15

Elementary/Middle Schools• Each of the Learning Environment

indicators receives an equal weight in the final score

• Final score= average of 6 indicators (or available indicators)

High Schools• All indicators within categories

receive an equal weight• Final score= average of 3

categories (or available categories)

Where can I find additional information about SPM?

16

Additional Resources17

• Accessing SPM reports • Principals have access to SPM reports on Principal’s

Dashboard

• For more information on SPM in evaluations, please visit City Schools Inside regarding teacher and school leader effectiveness evaluations

• For questions not addressed on the website, please contact: • Effectiveness@bcps.k12.md.us

INDICATOR DEFINITIONS

Appendix

18

Learning Environment Indicators

Indicator Definition

School Survey- Parents

Average percent (%) of parents responding positively to items regarding school administration, physical environment, learning climate, family involvement, school resources, safety, satisfaction with school, creativity and the arts, and student grit, on 100-point index

School Survey- StaffAverage percent (%) of staff responding positively to items regarding school administration, physical environment, learning climate, family involvement, school resources, safety, satisfaction with school, creativity and the arts, and student grit, on 100-point index

School Survey- Students

Average percent (%) of students responding positively to items regarding school administration, physical environment, learning climate, family involvement, school resources, safety, satisfaction with school, creativity and the arts, and student grit, on 100-point index

Attendance RateAverage daily attendance rate (%, aggregate number of days attending divided by the aggregate number of days of membership)

Chronic Absence Rate

Proportion of enrolled students absent more than 20 days (%, number of students absent more than 20 school days and enrolled at least 90 days, divided by total number of students enrolled at least 90 days)

Cohort Retention Rate (2-year)

Proportion of students remaining at school 2 years after normal entry grade (%, number of students who remain at the school two years after entry at normal entry grade divided by the number of students who enroll at the beginning of the entry year-- base year for 2014 is 9/30 enrollment file for SY11-12)

Dropout Rate (4-year) (HS only)

4-year adjusted proportion of dropouts in 2010 cohort (%, number of students who withdraw from school (for any reason other than death) and do not reenroll, divided by the number of students who entered grade 9 for the first time in 2010. Adjusted for transfers to other schools and other districts-- transfer students are removed from denominator)

19

Progress IndicatorsHS Only

Indicator Definition

AMO- HSA Algebra

Proportional achievement relative to HSA Algebra AMO (%, number of students advanced and proficient in algebra divided by the total number of students eligible to take assessments; this proficiency rate is divided by the school's AMO target. AMOs are set in annual equal increments toward a 50% reduction in the percentage of students who are not proficient by 2017. Proficiency rates from assessments administered in SY10-11 are used for the baseline year.)

AMO- HSA English

Proportional achievement relative to HSA English AMO (%, number of students advanced and proficient in English divided by the total number of students eligible to take assessments; this proficiency rate is divided by the school's AMO target. AMOs are set in annual equal increments toward a 50% reduction in the percentage of students who are not proficient by 2017. Proficiency rates from assessments administered in SY10-11 are used for the baseline year.)

AMO- HSA Biology

Proportional achievement relative to HSA Biology AMO (%, number of students advanced and proficient in biology divided by the total number of students eligible to take assessments; this proficiency rate is divided by the school's AMO target. AMOs are set in annual equal increments toward a 50% reduction in the percentage of students who are not proficient by 2017. Proficiency rates from assessments administered in SY10-11 are used for the baseline year.)

20

College/Career Readiness Indicators HS Only

Indicator Definition

SAT/ACT Participation

Proportion students who took SAT or ACT (%, number of diploma track seniors who took the SAT or ACT divided by the number of students in grade 12 based on end of year attendance records that are graduating or still enrolled and not on a SPED Certification track)

AMO- College/Career Preparation

Proportional measure of graduates qualifying for any of following: AP/IB proficiency, CTE concentrator, or college enrollment relative to AMO (%, number of students succeeding in one of the following areas: Advanced Placement or International Baccalaureate, Career and Technology Education Concentrators, and College Enrollment within 16 months of high school graduation, divided by number of graduates; this rate is divided by the school's AMO target. The CCP targets are on a trajectory toward 2017, when each school is expected to reduce its percent of students that are not completing the CCP goals by half.)

AMO- Graduation Rate (5-year)

Proportional measure of graduation rate relative to AMO (%, number of students who graduated with a regular Maryland High School Diploma in 5-year adjusted cohort (from June 2013 to June 2014) divided by number of students in cohort; this number is divided by the school's AMO target. The 5-year adjusted cohort graduation rate targets are on a trajectory toward 2020, when each school is expected to reduce its rate of non-graduating students by half.)

21