NWEA 2011 - RIT Scale Norms

Post on 02-Jan-2016

37 views 1 download

description

NWEA 2011 - RIT Scale Norms. Some Things You Should Know About the 2011 RIT Scale Norms Prepared by: Dan Henderson, NWEA Partner Relations Region Manager John Woodin, NWEA Partner Relations State Representative. Introduction. “No, your students’ performance didn’t change from last spring.” - PowerPoint PPT Presentation

Transcript of NWEA 2011 - RIT Scale Norms

NWEA 2011 - RIT Scale Norms

Some Things You Should Know About the 2011 RIT Scale Norms

Prepared by:Dan Henderson, NWEA Partner Relations Region ManagerJohn Woodin, NWEA Partner Relations State Representative

Introduction“No, your students’ performance

didn’t change from last spring.”The norm group and

methodology did changeSimply creates a different

comparisonA 215 RIT is still a 215 RIT –

means the same thing related to performance

Key Differences from 2008Methodology: set of norms more

representative of school age population

Everyone will see some changes: status and growth norms

Norms have been applied to both past and current scores (for consistency and growth projections)

What will be “fixed” in the 2011 Norms…Asterisks * will be replaced with 1 or

99 (percentiles)Kindergarten growth norms will be

reinstated for fall to springKindergarten status norms will be

reinstated for fall and winter11th grade norms will be reinstated as

soon as possible

Sampling student test records “Students” were randomly sampled from a pool of test event records. (all test records of the student from the study period in the subject of

interest)

• Pool represented about 5.1 million students,• from 13,000 schools • located in more than 2,700 school

districts• from over 50 states and • contained about 35 million test

events.

Smallest grade level sample was about 20,000 students.

Post-stratification procedures •Based on school-level variables commonly associated with challenges and opportunities

•School–level variables: Mix of student ethnicity, percent free/reduced lunch eligibility, Title 1 eligibility, ALL Title 1, grade range served, charter status, magnet status, enrollment at each grade, total enrollment, school level, school type, school locale, pupil-teacher ratio.

•Combined to form a School Challenge Index (SCI) for each state – using ALL schools in the state, not only NWEA schools

•SCI was used as a post-stratification weight for all analyses

Differences in Status NormsMinor changes in status normsPercentiles changed very littleLarger changes for grades 1 & 2 for

high and low achieving students◦ Difference in partner base (more schools

and students than 2008)◦ Different methodology for selection which

results in more representative norms

130 140 150 160 170 180 1900

102030405060708090

100

Reading - Grade 1 - Fall

20082011

RIT Score

Perc

enti

le R

ank

140 150 160 170 180 190 200 2100

102030405060708090

100

Reading - Grade 1 - Spring

20082011

RIT Score

Perc

enti

le R

ank

155 165 175 185 195 205 215 2250

102030405060708090

100

Reading - Grade 3 - Fall

20082011

RIT Score

Perc

enti

le R

ank

165 175 185 195 205 215 225 2350

102030405060708090

100

Reading - Grade 3 - Spring

20082011

RIT Score

Perc

enti

le R

ank

170 180 190 200 210 220 230 2400

102030405060708090

100

Reading - Grade 5 - Fall

20082011

RIT Score

Perc

enti

le R

ank

175 185 195 205 215 225 235 2450

102030405060708090

100

Reading - Grade 5 - Spring

20082011

RIT Score

Perc

enti

le R

ank

175 185 195 205 215 225 235 2450

102030405060708090

100

Reading - Grade 7 - Fall

20082011

RIT Score

Perc

enti

le R

ank

180 190 200 210 220 230 240 2500

102030405060708090

100

Reading - Grade 7 - Spring

20082011

RIT Score

Perc

enti

le R

ank

140 150 160 170 180 190 200 2100

20

40

60

80

100

Mathematics - Grade 1 - Spring

20082011

RIT Score

Perc

enti

le R

ank

130 140 150 160 170 180 190 200 2100

102030405060708090

100

Mathematics - Grade 1 - Fall

20082011

RIT Score

Perc

enti

le R

ank

160 170 180 190 200 210 2200

102030405060708090

100

Mathematics - Grade 3 - Fall

20082011

RIT Score

Perc

enti

le R

ank

170 180 190 200 210 220 2300

20

40

60

80

100

Mathematics - Grade 3 - Spring

20082011

RIT Score

Perc

enti

le R

ank

180 190 200 210 220 230 2400

102030405060708090

100

Mathematics - Grade 5 - Fall

20082011

RIT Score

Perc

enti

le R

ank

180 190 200 210 220 230 240 2500

20

40

60

80

100

Mathematics - Grade 5 - Spring

20082011

RIT Score

Perc

enti

le R

ank

Difference in Growth NormsLess difference in the middle of

achievement continuumLarger differences at the two ends of

achievement (especially extremes)High or low achievers may see larger

differences in growth projectionsLow Achievers: lower grow

projections than in the pastHigh Achievers: higher growth

projections

Growth in 2008 Norm study

Pt. AFALL

Pt. BSpring

Growth within the grade only

How growth is conceptualized Previous

grade Grade of Interest Next grade

S F W S F

1 36 54 8272

Instructional weeks

*

1

2

3

4

5

6

students

.

.

.

All scores included

All scores included

Flat Growth RatesGrowth projections tend to be

flatter in 2011 than the 2008 norms◦Grades 5, 6, 8 show flat growth in Math◦In a large national sample, students in

these grades tended to show similar growth regardless of where they were on the RIT scale

Due to sampling methods – overly large impact of extreme scores in 2008

155 165 175 185 195 205 215 225 2350

5

10

15

Reading - Grade 3 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

160 170 180 190 200 210 220 230 2400

5

10

15

Reading - Grade 5 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

160 170 180 190 200 210 220 230 2400

5

10

15

Reading - Grade 7 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

165 175 185 195 205 215 225 235 24502468

1012141618

Reading - Grade 8 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

155 165 175 185 195 205 215 225 235 24502468

10121416

Mathematics - Grade 3 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

160 170 180 190 200 210 220 230 240 25002468

10121416

Mathematics - Grade 4 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

165 175 185 195 205 215 225 235 245 25502468

10121416

Mathematics - Grade 5 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

170 180 190 200 210 220 230 240 250 2600

2

4

6

8

10

12

14

Mathematics - Grade 6 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

170 180 190 200 210 220 230 240 250 26002468

101214

Mathematics - Grade 7 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

170 180 190 200 210 220 230 240 250 2600

2

4

6

8

10

12

14

Mathematics - Grade 8 - Fall to Spring

20082011

Starting RIT Score

Gro

wth

in R

ITs

Applying Growth to Past Terms

Since NWEA uses growth norms that overlap from year to year – had to apply the norms backward

Cannot compare 2008 growth norms to 2011 growth norms – not comparable