Using Student Growth Percentiles in Educator Evaluations
Warm Up
The median is the middle number in a sequence of numbers
• On your table is a ½ sheet of paper that lists the heights of students in a teacher’s class
• Write the students’ heights in order from shortest to tallest
• Identify the median height and circle it
Norms• Fully present• Share your expertise• Equity of voice• Active listening• Respect the current speaker – no side
conversations• Safety to share different opinions and
perspectives• Respectful use of technology
ConnectorOn an index card please complete the
following sentence stem
“One of the most important learnings that I hope to take away today is…”
Give One, Get One!
You will have 5 minutes to:
Circulate around the roomIntroduce yourself to a colleague
(name, position & district)Share the information on your card,
and then exchange cardsStart the process over again
Outcomes for Today
• To increase knowledge of Student Growth Percentiles (SGPs) and Median Student Growth Percentiles (MSGPs)
• Clarify the connection between SGPs and SLGs for the 2015-16 SY
Waiver Update
On July 23, 2015,the USDOE approved Oregon’s ESEA flexibility waiver renewal request for three years through the 2017-2018 school year
In other words…
Oregon met the condition placed on our waiver the previous year to provide evidence of a statewide approach for how teachers and principals set their student learning and growth goals in tested grades and subjects to ensure rigor and consistency across the state
As a result…
Beginning in the 2015-16 school year, as a requirement of the ESEA waiver, all districts will begin using Student Growth Percentiles (SGPs) to meet the state assessment requirement for Student Learning and Growth (SLG) in grades 4-8 in English/Language arts (ELA) and math
Request to USED for 2015-16• ODE has requested a modification to the
waiver • Districts will determine MSGPs, but not
incorporate them in educator summative evaluations for SY 2015-2016
• Districts required to provide SGP training to staff
• ODE recommends that all educators set two goals that use Category 2 measures
Student Growth Percentiles
(SGPs)
Normative growth measure
One year of growth
Growth is relative to students with a similar score history
What do we mean by normative growth?
35% 65%
Percentiles
35th
3rd Grade
2262
Level 1
4th Grade
2398
Level 2
Anthony
Level 1
Level 2
Level 3
Level 4
2367
ELA/Literacy Scale Score Thresholds
2432 2490
OregonScore Distribution
3rd Grade Reading
Grade 3
Grade 4
Level 1
Level 2 Level 3
Level 4
4th Grade2398
3rd Grade2262
2398- 2262
136 points
Anthony’s Comparison Group
19
All 3rd grade test takers in Oregon
Anthony
…with Anthony’s Prior Score ~2262
Level 1
Level 2 Level 3
Level 4
Anthony’s prior score ~2262
Anthony’s Comparison Group
Anthony
Level 1
Lev el 2 Level 3
Level 4
Level 1
Level 2 Level 3
Level 4
Anthony’s Comparison Group
High score
Middle score
4th Grade Score Distribution
Anthony’s prior score ~2262
Level 1
Level 2 Level 3
Level 4
Anthony’s Comparison Group
4th Grade Score Distribution
80% of students in Anthony’s comparison group scored below him
2398
Level 1
Level 2 Level 3
Level 4SGP = 80
Anthony’s Comparison Group
4th Grade Score Distribution
Processing Time
• With the colleagues at your table:
• Talk about what you’ve heard so far• Identify a question your group still has about
SGPs
(Up Next: Determining Median SGPs)
Term Clarification
• A Student Growth Percentiles (SGP) measures growth for an individual student
• A Median Student Growth Percentile (MSGP) represents the exact middle of a group of students’ SGPs
Median Student Growth Percentiles
Students in Mr. Waters class
Student SGPSheryl 3Hector 22Robert 36Miranda 38Tre 51Anna 54Eric 71Anthony 80Amina 93
Making a Determination of Student Growth
Category 1 SLG Rating
1 2 3 4
Median SGP Criteria
1 to 34percentile
35 to 49percentile
50 to 64percentile
65 to 99percentile
Interpretation Low growth Below average growth
Above average growth
High growth
The Median Student Growth Percentile (SGP) determines the educator’s Category 1 SLG Rating
X-Axis = SLG Rating • SLG performance level based on two
goals• Two-year cycle select two of four goals • Score SLG goals• Get a rating between 1 and 4;• Use X-Axis thresholds to determine
SLG level: • 4 = both goals 4s• 3 = both goals 3s; one goal 3 & one
goal 4; one goal 2 & one 4• 2 = both goals 2s; one goal 2 & one
3; one goal 1 & one 3; one goal 4 & one 1
• 1= both goals 1s; one goal 1 & one 2
Mr. Waters• SGP was rated 3• Second SLG was rated 3
X-Axis Rating = Level 3 SLG Rating
Y-Axis = PP/PR Rating
• Add up all component scores for total points possible;
• Divide by number of components in your rubric;
• Get a rating between 1 and 4; • Use Y-Axis threshold to determine
PP/PR level:• 3.6 - 4.0 = 4 • 2.81-3.59 =3 • 1.99 – 2.8 = 2 * • < 1.99 = 1
*PP/PR Scoring Rule: If the educator scores two 1’s in any PP/PR component and his/her average score falls between 1.99-2.499, the educator’s performance level cannot be rated above a 1.
Mr. Waters• District rubric with 20
components• Component ratings:
• 17 components were rated 3; and 3 were rated 2 = 57 points possible
• 57/20=2.85
2.85 = Level 3 PP/PR Rating
*Inquiry Process
Mr. Waters: Y-axis = 3 & X-axis = 3
Y-A
xis:
PP
/ P
R
LEVEL 4
Collegial
*SLG Inquiry
3
Facilitative or
Collegial
* SLG Inquiry
3 or 4
Facilitative
4
Facilitative
4
LEVEL 3
Collegial or Consulting
*SLG Inquiry
2 or 3
Collegial
3
Collegial
3
Collegial
3
LEVEL 2
Consulting
2
Consulting
2
Consulting
2
Collegial or Consulting
* PP/PR Inquiry
2 or 3
LEVEL 1
Directed
1
Directed
1
Consulting or
Directed
* PP/PR Inquiry
1 or 2
Consulting
* PP/PR Inquiry
2
LEVEL 1 LEVEL 2 LEVEL 3
LEVEL 4
X-Axis: SLG
Questions?
Your Turn!
• Use the data packet provided to:• Calculate Mr. Hendrick’s Y-axis rating • Determine Mr. Hendrick’s median SGP• Calculate Mr. Hendrick’s X-axis rating
• Share Out
*Inquiry Process
Y-
Axi
s: PP
/ P
R
LEVEL 4
Collegial
*SLG Inquiry
3
Facilitative or
Collegial
* SLG Inquiry
3 or 4
Facilitative
4
Facilitative
4
LEVEL 3
Collegial or Consulting
*SLG Inquiry
2 or 3
Collegial
3
Collegial
3
Collegial
3
LEVEL 2
Consulting
2
Consulting
2
Consulting
2
Collegial or Consulting
* PP/PR Inquiry
2 or 3
LEVEL 1
Directed
1
Directed
1
Consulting or
Directed
* PP/PR Inquiry
1 or 2
Consulting
* PP/PR Inquiry
2
LEVEL 1 LEVEL 2 LEVEL 3
LEVEL 4
X-Axis: SLG
Timeline and Responsibilities2015-16
SYODE RESPONSIBILITIES DISTRICT RESPONSIBILITIES
Fall 2015
Provide districts state criteria for determining Median Student Growth Percentiles (see Table 3 on page 5 in this guidance).
Provide districts with communications and guidance.
Select Option A or Option B to be used district-wide.Establish a process for determining the teacher of record.
Create class rosters and establish a roster verification process.
2015-16 School Year
Provide districts with professional development and technical support.
Provide training in the district to educators, evaluators, and coordinating staff.
February - June 2016
Administer Smarter Balanced Assessment Administer Smarter Balanced AssessmentEducators verify class rosters.
Summer 2016
Calculate Student Growth Percentiles for all students.
Send districts Student Growth Percentiles and Smarter Balanced achievement data in August.
Receive Student Growth Percentiles and Smarter Balanced results from ODE.
Fall 2016
Provide guidance and support to districts. Determine the Median Student Growth Percentile ratings using the state criteria.
Incorporate median Student Growth Percentile ratings into educator summative evaluations.
How do SGPs change the goal setting and scoring processes?
• Teachers and principals in grades 4- 8 in ELA and math
• All other educators
All Other Educators• Minimum of 2 SLG goals each year• Quality Review Checklist used for goal setting• Goals can use either:
• Category 1 (statewide assessments) OR• Category 2 (school or district-wide assessments)
measures• Goals scored using the statewide SLG Scoring
Rubric• Oregon Matrix used to identify summative scores
• Student Learning and Growth Guidance
Teachers and Principals in Grades 4 – 8 ELA and Math• Minimum of 2 SLG goals each year• Quality Review Checklist used for goal setting• One goal must use Category 1 measure (Smarter)
• Method for scoring Category 1 goal depends on whether the district uses Option A or Option B
• Second goal can use either Category 1 or Category 2 measures• Category 2 goals scored using the statewide SLG
Scoring Rubric• Oregon Matrix used to identify summative scores
What do districts need to do?
• Select Option A or B
• Establish procedures
• Create rosters
Select Option A or Option B
Collaboration is key!
Option A Option BEducators are not required to set a Category 1 SLG goal. There is no required goal setting process for Category 1.
Educators are required to set one Category 2 SLG goal using the SLG goal template and rate their goal using the SLG scoring rubric
Educators are required to set one Category 1 SLG goal using Smarter Balanced and rate their goal using the SLG scoring rubric. Educators are required to set one Category 2 SLG goal using the SLG goal template and rate their goal using the SLG scoring rubric .
Student Growth Percentiles are used exclusively to determine the Category 1 SLG rating.
Educators’ SLG goal rating is then compared with their Median Student Growth Percentile rating to determine their final Category 1 SLG rating.
OPTION A
Fall
1. Districts determine which educators are required to use Median Student Growth Percentiles and create the educators’ class rosters for teachers and principals in grades 4-8, ELA/math.
2. Educators set a Category 2 SLG goal following the SLG goal setting template. (They do not set a
Category 1 SLG goal.)
Spring
3. In May educators verify their class roster through a district-determined process.
Summer/Fall
4. Districts receive Student Growth Percentiles from ODE in August following the spring test administration.
5. Using the Student Growth Percentiles data from ODE, districts calculate the Median Student Growth Percentiles for the educator’s class roster as follows:
a. Rank the students’ scores in the class roster from highest to lowest.b. Locate the middle score (median) in the range to find the Median Student Growth Percentile.
• If the educator has an even number of students, average the two middle scores.c. Using the state criteria identify the corresponding Median Student Growth Percentile Category 1
SLG rating (1-4).
6. The educator and evaluator use the X-axis table to determine the educator’s SLG performance level for the Oregon Matrix based on the Median Student Growth Percentile and Category 2 SLG goal ratings.
Fall
1. Districts determine which educators are required to use median Student Growth Percentiles and create the educators’ class rosters for teachers and principals in grades 4-8, ELA/math. 2. Educators set two goals: Category 1 SLG goal and Category 2 SLG goal following the SLG goal setting template.
Spring
3. In May, educators verify their class roster through a district-determined process.
Summer/Fall
4. Districts receive Student Growth Percentiles from ODE in August following the spring test administration. 5. Using the Student Growth Percentiles data from ODE, districts calculate the Median Student Growth Percentiles for the educator’s class roster as follows:
Rank the students’ scores in the class roster from highest to lowest.Locate the middle score (median) in the range to find the Median Student Growth Percentile.
If the educator has an even number of students, average the two middle scores.Using the state criteria identify the corresponding Median Student Growth Percentile Category 1 SLG rating (1-4).
6. Using the state assessment results, the educator and evaluator score the Category 1 SLG goal using the state SLG Goal Scoring Rubric. 7. The evaluator uses the decision table to compare the educator’s Category 1 SLG goal rating with the Median Student Growth Percentile rating to determine the combined Category 1 SLG rating (X- and Y-axes intersect). 8. The educator and evaluator use the X-axis table to determine the educator’s SLG performance level for the Oregon Matrix based on the Median Student Growth Percentile and Category 2 SLG goal ratings. 9. If the ratings differ by more than two, use the inquiry process below to determine the final rating.
OPTION B
FOCUSED COLLABORATIONLearning Exercise
• Discuss with colleagues at your table how your district might go about making the decision as to which option the district will choose
Remember Districts are advised to have a collaborative team
of teachers, administrators, and association representatives work collaboratively to choose
between Options A and B
• Before using Student Growth Percentiles, districts will need to establish procedures and a process for using Median Student Growth Percentiles district-wide.
• This process should be established Fall 2015
Starting to Plan…
Establish Procedures…
• Teacher of Record: which teachers and principals are responsible for content covered by Smarter Balanced assessments in grades 4-8 for ELA and math
• Roster creation and verification• Provide rosters to teachers and principals in
the fall for planning purposes• Verify rosters in the spring for evaluation
Create rosters…• Determine who is on each roster
• Elementary: Every student in a class that takes Smarter in ELA or math
• Middle: All students within a particular course who take Smarter in either ELA or math
• Principals: All students in a particular grade who take Smarter in either ELA or math
Impact of Class Size on SGPs
• Districts are required to use Median Student Growth Percentiles for educators who have at least 20 students
• Teachers and principals in grades 4-8 (ELA and math only) who fall below 20 students must use other measures that are valid, reliable, and comparable across the school or district (Category 2 measures)
Using an index card at your table, please identify:
• One learning from today; and • Two questions you still have about SGPs
Feedback
Resources
• ODE Webpage for SGPs has been added to the EE Toolkit
• ESD Regional Workshops• Contact your ESD to find out when a
regional training might be available in your area
Remaining questions?
ODE Contacts
Educator Effectiveness Team:
• Tanya Frisendahl [email protected]
• Sarah Martin [email protected]
• Sarah Phillips [email protected]
• Brian Putnam [email protected]
Top Related