Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data
Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data
description
Transcript of Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data
Interpreting Feedback from Baseline Tests - Whole School & Individual Student Data
Course: CEM Information Systems for Beginners and New Users
Day 1 Session 2
Wednesday 17th October 2012
Peter Hendry: CEM Consultant
•To inform professional judgement
•To start a conversation
USING BASELINE DATA FOR TEACHING AND LEARNING
IF FEEDBACK DATA IS TO BE TRUSTED THEN PROBABLY:
• The students understood the purpose of the assessments
• And each student did their best at the time…….
• As a year group, how able are they?
• What strengths and weaknesses does the group have?
• How did each student perform?
Bands, percentiles, standardised scores…
0
50 60 70 80 90 100 110 120 130 140 150
Standardised scores
DC B
A
105 20 301 40 90 958070 996050Percentiles:
25 75
National Quartile Ability Bands
BASELINE D C B A
ALIS: AV GCSE <5.0 5.0-5.7 5.7-6.55 >6.55
Yellis % >43 43-52 52-61 >61
STANDARDISED CABT MidYIS, Yellis and Alis <90 90-100 100-110 >110
IN ANY COHORT, 25% OF THE POPULATION WILL BE IN EACH BAND.
THE VALUES MAY VARY SLIGHTLY FROM YEAR TO YEAR
BANDS
Alis: year 12 students, two baseline profiles for the same school
Nationally, 25% in each band
Comments and potential implications?
Band Profile Graph: all MidYIS cohort
Checking this graph each year will give you an immediate overview of your intake.
A school with a ‘completely average’ intake would have 25% of pupils within each band.
Band D Band A
35
2621
17
0
10
20
30
40
50
60
70
80
90
100
D C B A
Per
cen
t
Maths: Percent in each BandYear 7 MidYIS Test 2011/2012
17
37
2025
0
10
20
30
40
50
60
70
80
90
100
D C B A
Per
cent
Vocabulary: Percent in each BandYear 7 MidYIS Test 2011/2012
Band A Band ABand D Band D
Comments?
11
21
33 35
0
10
20
30
40
50
60
70
80
90
100
D C B A
Per
cent
Non-Verbal: Percent in each BandYear 7 MidYIS Test 2011/2012
2924 26
21
0
10
20
30
40
50
60
70
80
90
100
D C B A
Per
cen
t
Skills: Percent in each BandYear 7 MidYIS Test 2011/2012
2924 26
21
0
10
20
30
40
50
60
70
80
90
100
D C B A
Per
cen
t
Skills: Percent in each BandYear 7 MidYIS Test 2011/2012
38
2619 17
0
10
20
30
40
50
60
70
80
90
100
D C B A
Per
cen
t
Proof Reading: Percent in each BandYear 7 MidYIS Test 2011/2012
24 23 2330
0
10
20
30
40
50
60
70
80
90
100
D C B A
Per
cent
Perceptual Speed & Accuracy: Percent in each BandYear 7 MidYIS Test 2011/2012
Vocabulary Maths Non Verbal Skills MidYIS Score
St.
Sco
re
Ban
d
St.
Sco
re
Ban
d
St.
Sco
re
Ban
d
St.
Sco
re
Ban
d
St.
Sco
re
Ban
d
Average 100.6 95.9 105.3 99.2 98.1
St. error 1.1 1.1 1.1 1.1 1.1
On another day, with 95% certainty, the score of 100.6 (+/- 1.1 x 2)
• would not be higher than 100.6 + 2.2 = 102.8
• would not be lower than 100.6 – 2.2 = 98.4
Standardised Scores Sort Data By...
Mean Score: 100
Standard Deviation: 15
How might this information be useful?
Scores Standardised On A Nationally Representative Sample of Schools
Vocabulary Maths Non Verbal Skills MidYIS ScoreS
t. S
core
Ban
d
St.
Sco
re
Ban
d
St.
Sco
re
Ban
d
St.
Sco
re
Ban
d
St.
Sco
re
Ban
d
100.6 95.9 105.3 99.2 98.1
1.1 1.1 1.1 1.1 1.1
134 A 119 A 116 A 87 D 130 A
95 C 97 C 88 D 85 D 95 C
99 C 104 B 112 A 110 B 101 B
93 C 94 C 120 A 91 C 93 C
116 A 99 C 118 A 84 D 109 B
93 C 95 C 120 A 113 A 93 C
92 C 83 D 112 A 94 C 87 D
102 B 102 B 112 A 108 B 102 B
Proof Reading PSA
St.
Sco
re
Ban
d
St.
Sco
re
Ban
d
93.7 102.2
1.1 1.1
101 B 83 D
76 D 93 C
97 C 114 A
80 D 99 C
102 B 78 D
119 A 107 B
80 D 102 B
106 B 107 B
Scores over 130 – top 2% nationally
Scores over 126 – top 5% nationally
Scores over 120 – top 10% nationally
Scores over 110 – top 25% nationally
Using national baseline test scores to Identify Gifted Pupils
Year 7: the ‘top’ students
Vocabulary Maths Non Verbal Skills MidYIS Score
St.
Sco
re
Ban
d
St.
Sco
re
Ban
d
St.
Sco
re
Ban
d
St.
Sco
re
Ban
d
St.
Sco
re
Ban
d
100.6 95.9 105.3 99.2 98.1
1.1 1.1 1.1 1.1 1.1
150 A 150 A 142 A 150 A 150 A
122 A 132 A 130 A 150 A 130 A
134 A 119 A 116 A 87 D 130 A
120 A 123 A 110 B 132 A 123 A
127 A 113 A 122 A 95 C 123 A
117 A 121 A 116 A 109 B 121 A
117 A 120 A 120 A 128 A 120 A
125 A 111 A 114 A 100 B 120 A
146 146145 146101 83124 129109 89
Pro
of
read
ing
Per
cep
tual
sp
eed
an
d a
ccu
racy
50 60 70 80 90 100 110 120 130 140 150
Standardised Test Score
Stanine 1
2 3 4 5 6 7 8 9
4% 4 % 7% 7% 12% 12% 17% 17% 20%
Individual Pupil Record 75Date Of Birth: 24/12/97 Student Number:Sex: F Form:
Band Stanine PercentileStandard
ScoreVocabulary B 5 53 101
Maths B 5 52 101
Non-Verbal C 5 46 98
Skills C 5 46 99
MidYIS Score B 5 52 101
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Na
tio
na
lly
Sta
nd
ard
ise
d S
core
s
Nationally Standardised Scores with 95% Confidence Band
106 B 96 C
Proof Reading PSA
A relatively lower vocabulary score might indicate a difficulty which:
• could contribute to under-performance in most, if not all subjects
• might lead to ‘stressful situations’
• may lead to further investigation and subsequent pupil support
Individual Pupil Record ZUHA OKARVIDate Of Birth: 15/10/98 Student Number:Sex: F Form: 8C
Band Stanine PercentileStandard
ScoreVocabulary C 4 35 94
Maths B 6 75 110
Non-Verbal B 6 63 105
Skills A 7 84 115
MidYIS Score B 5 54 102
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Nat
iona
lly S
tand
ardi
sed
Sco
res
Nationally Standardised Scores with 95% Confidence Band
Individual Pupil Record RAWAD OKBIDate Of Birth: 29/08/99 Student Number:Sex: M Form: 8E
Band Stanine PercentileStandard
ScoreVocabulary D 3 20 87
Maths B 5 58 103
Non-Verbal B 6 67 107
Skills B 6 71 108
MidYIS Score C 4 34 94
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Na
tio
nall
y S
tan
da
rdis
ed
Sco
res
Nationally Standardised Scores with 95% Confidence Band
Proof Reading PSA Proof Reading PSA
121 A 108 B 88 D 118 A
A relatively low maths score might indicate potential weaknesses in subject areas which require:
• numerical skills
• logical thinking
• skills such as sequencing
CONVERSELY: a high maths score but a low vocab/reading score…….
Individual Pupil Record RACHEL STRONACHDate Of Birth: 13/1/99 Student Number:Sex: F Form: 8E
Band Stanine PercentileStandard
ScoreVocabulary B 6 63 105
Maths D 3 15 84
Non-Verbal A 6 76 111
Skills B 6 67 107
MidYIS Score C 4 37 95
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Na
tio
na
lly
Sta
nd
ard
ise
d S
core
s
Nationally Standardised Scores with 95% Confidence Band
Individual Pupil Record CAMERON BALLDate Of Birth: 29/10/98 Student Number:Sex: M Form: 8E
Band Stanine PercentileStandard
ScoreVocabulary C 5 45 98
Maths A 9 99 135
Non-Verbal C 4 39 96
Skills B 6 74 110
MidYIS Score A 7 87 117
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Nat
iona
lly S
tand
ardi
sed
Sco
res
Nationally Standardised Scores with 95% Confidence Band
A relatively high non-verbal score might indicate potential strengths in subject areas which require:
• 3d, and 3d into 2d, visualisation
• Spatial awareness
• Understanding images in 2d representing 3d
• Extracting information from visual images
• Science, D and T, Art, Geography……
and vice versa
Individual Pupil Record SULAIMAN BAHELMIDate Of Birth: 23/2/99 Student Number:Sex: M Form:
Band Stanine PercentileStandard
ScoreVocabulary A 7 81 113
Maths B 6 66 106
Non-Verbal D 3 18 86
Skills B 6 68 107
MidYIS Score A 7 77 111
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Nat
iona
lly S
tand
ardi
sed
Sco
res
Nationally Standardised Scores with 95% Confidence Band
Date Of Birth: Student Number:Sex: M Form: 7E
Band Stanine PercentileStandard
ScoreVocabulary C 4 32 93
Maths C 4 34 94
Non-Verbal A 8 91 120
Skills C 4 28 91
MidYIS Score C 4 31 93
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Nat
ion
ally
Sta
nda
rdis
ed S
core
s
Nationally Standardised Scores with 95% Confidence Band
A relatively low skills score might indicate potential weaknesses such as:
• Speed of processing/working
• Potential underperformance in test/examination conditions
• Poor written work (SPG etc.)
and vice versa
Skills: Proof Reading
Skills: Perceptual Speed and Accuracy
Date Of Birth: Student Number:Sex: M Form: 7Y
Band Stanine PercentileStandard
ScoreVocabulary A 9 99 134
Maths A 8 90 119
Non-Verbal A 7 85 116
Skills D 3 20 87
MidYIS Score A 9 98 130
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Nat
iona
lly S
tand
ardi
sed
Sco
res
Nationally Standardised Scores with 95% Confidence Band
Proof Reading PSA
Sex: M Form:
Band Stanine PercentileStandard
ScoreVocabulary C 5 50 100
Maths A 8 89 119
Non-Verbal B 5 54 102
Skills B 6 61 104
MidYIS Score B 6 72 109
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Nat
iona
lly S
tand
ardi
sed
Sco
res
Nationally Standardised Scores with 95% Confidence Band
Proof Reading PSA
101 B 83 D 83 D 114 A
SEN use of MIDYIS test results
Analysis of baseline test individual skill profiles to indicate potential areas of learning difficulties
e.g. If the two lowest scores are the vocabulary and skills section and are, or close to being, statistically significant (see IPR)
• Then the student might be dyslexic.......
• Follow-up with appropriate diagnostic tests…..
Individual Pupil Record LAUREN BAKERDate Of Birth: 28/11/99 Student Number: J870396003050
Sex: F Form: 7C
Band Stanine PercentileStandard
ScoreVocabulary C 4 27 91
Maths B 6 68 107
Non-Verbal B 6 75 110
Skills D 2 10 81
MidYIS Score C 5 45 98
50
60
70
80
90
100
110
120
130
140
150
Vocabulary Maths Non-Verbal Skills MidYIS Score
Nat
ion
ally
Sta
nd
ard
ised
Sco
res
Nationally Standardised Scores with 95% Confidence Band
07S1 - 117
07Q1 + + 117
07H1 + 126
07M2 - 106
07Q2 + 127
07H1 - + 120
07Y1 111
07Y1 + + 113
07S2 98
07S2 - - 137
07T2 + 116
07Q1 + 101
07S1 + 113
07H2 - 126
07H1 + 88
07H2 104
07M1 123
07M2 - 128
07S1 - 111
07Q1 + 114
07Q2 + 109
7Y2 - + 132
Last Name First Name Tutor Group Vocab Maths Non Verbal Skills Overall MidYIS
Sharing data with colleagues: e.g. baseline test data
INSIGHT Pupil IPR
Band Stanine PercentileStandard
ScoreKS3
Equivalent
Speed Reading B 6 69 107 6c
Text Comprehension B 5 60 104 5a
Passage Comprehension C 5 45 98 5b
Overall Reading B 5 59 103 5a
Number & Algebra D 3 19 87 4a
Handling Data B 6 61 104 6a
Space, Shape & Measures D 4 23 89 5c
Overall Mathematics C 4 31 93 5b
Biology A 7 82 114 6a
Chemistry A 9 96 127 7a
Physics A 8 89 118 7c
Overall Science A 8 93 122 7b
Vocabulary B 6 65 106
Non Verbal B 6 70 108
Skills A 8 92 121
Overall Ability C 4 36 94
40
60
80
100
120
140
160
Sp
eed
Rea
din
g
Tex
t Co
mp
rehe
nsio
n
Pas
sag
e C
om
preh
ensi
on
Ove
rall
Rea
ding
Num
ber &
Alg
ebra
Han
dlin
g D
ata
Sp
ace,
Sh
ape
& M
easu
res
Ove
rall
Mat
hem
atic
s
Bio
logy
Ch
emis
try
Ph
ysic
s
Ove
rall
Sci
ence
Vo
cabu
lary
No
n V
erba
l
Ski
lls
Ove
rall
Abi
lity
Sta
nd
ard
ised
Sco
res
Standardised Scores With 95% Confidence Band
Mat
hs
N
2a
c
3b
a
c
4b
a
c
5b
a
c
6b
a
c
7b
a
c
8b
a
Sp
eed
Rea
din
g
Tex
t Co
mp
rehe
nsio
n
Pas
sag
e C
om
preh
ensi
on
Ove
rall
Rea
ding
Num
ber &
Alg
ebra
Han
dlin
g D
ata
Sp
ace,
Sh
ape
& M
easu
res
Ove
rall
Mat
hem
atic
s
Bio
logy
Ch
emis
try
Ph
ysic
s
Ove
rall
Sci
ence
KS
3 L
evel
KS3 Equivalent Levels with 95% Confidence Band
IPRs in KS3 Levels
NATIONAL AVERAGE
The code:
j: reduces size
k: infills
m: inverts