Multiple Approaches to Multiple Measures: Four Three Approaches to Improving Student Achievement...
-
Upload
piers-stokes -
Category
Documents
-
view
219 -
download
1
Transcript of Multiple Approaches to Multiple Measures: Four Three Approaches to Improving Student Achievement...
Multiple Approaches to Multiple Measures:
Four Three Approaches to Improving Student Achievement Through More Holistic, Evidence-
Based Multiple Measures Assessment and Placement
RP Conference April 8, 2015
• Janet Fulks• Dean of Student Success & Precollegiate Director of Making
it Happen, Bakersfield College
• Erik Cooper• Dean, Planning, Research, and Resource DevelopmentSierra
College
• Andrew Fuenmayor• Senior Research Analyst, Long Beach City College
• John Hetts• Senior Director of Data Science, Educational Results
Partnership and CalPASS Plus
Student transitions to CC• Community colleges rely nearly entirely on
standardized assessment• Increasingly, students placed below college-level
• Significant barrier (Bailey, Jeong, and Cho, 2010)
• First interaction• Imply that most students are not ready for college and
are likely to fail• Convinces many, including our students
• Multiple measures (esp. GPA) hold substantial promise for fairer and more accurate predictor of college performance/graduation• Challenges to implementation, ROI, second order effects
Four reimaginations of that front-door interaction in CCCs
• Bakersfield College• Sierra College• Long Beach City College
• Rio Hondo College
Bakersfield College
Overview of Intervention• Multiple measures placement• Testing changes: test and location• Student Support• Mentors• Summer Bridge• Convocation Ceremony• Classroom Interventionists
Key Data Issues for BC
Completion Data
Basic Skills Progress
Data
CCSSE – Perception
Data
Equity Data
SSSP-Student
Service Data40.5%
33.5% 31.7%
57.2%
44.1%
34.7%
43.6%
34.8%30.8%
33.3%
51.5%
42.9%
30.3%
40.7%
Completion Unprepared Students Statewide and Bakersfield College
Statewide Rate BC Rate
Goals of MIH Make a difference in the number of students who succeed
By connecting earlier in the pipelineProviding timely information and guidance at BC
Increase Student engagementclassroom interventions, SARS, Habits of the Mind and mentors
Decrease Student time to completionBetter placement –multiple measures, new placement testFaster remediation2 years to complete the degree - when college ready
Assess Learning outcomes (Think, Communicate, Demonstrate, Engage)Pilot with 500; Scale up to all students
Achieving the Dream Summit
4 levels below three levels below two levels below one level below Transfer level
2013 Writing (n=2171) 11% 37% 6% 17% 29%
2014 Writing (n=2175) 8% 35% 6% 19% 31%
Series3 NaN NaN NaN NaN NaN
2013 Math (n=2581) 35% 35% 21% 6% 3%
2014 Math (n=2489) 33% 18% 30% 7% 12%
3%
8%
13%
18%
23%
28%
33%
38%
11%
37%
6%
17%
29%
8%
35%
6%
19%
31%
35% 35%
21%
6%
3%
33%
18%
30%
7%
12%
Placement Changes as a Result of Multiple Measures Implementation 2013 compared to 2014
Perc
ent
Plac
ed a
t tr
ansf
er le
vel a
nd b
elow
for
Mat
h an
d W
ritin
g
Placement Test Results Jan 2013-December 2013
4 Levels below
3 Levels below
2 Levels below
1 Levels below
Transfer Level
Total tested
Math 2684 2034 2359 732 325 8134
English 659 2710 513 1318 2124 7323
Reading 509 799 727 872 4359 7265
The Pathway by Placement in course load and price
Math 16 units $736.00
14 units $644.00
10 units $460.00
5 units $230.00
English no class offered
10 units $460.00
8 units $368.00
4 units $184.00
Reading no class offered
10 units $460.00
7 units $322.00
3 units $138.00
Cost in Dollars from levels below to transfer
Math $ 1,975,585 $1,309,574 $1,085,075 $168,373 Math $ 4,538,609
English no class offered
$1,246,374 $ 188,640 $242,537 English $ 1,677,552
Reading no class offered
$367,609 $233,933 $120,308 Reading $ 721,850
If all who tested were remediated $6,938,012
School Multiple Measured up
Accelerated Compressed Not Moved
Success No Success No Success No Success No
HS#1 16 4 7 3 33 12
HS#2 11 13 4 7 1 3 34 31
HS#3 13 7 11 3 6 0 11 8
HS#4 8 10 3 6 0 0 15 18
HS#5 4 1 2 0 0 0 2 0
HS#6 0 0 0 0 0 0 2 2
HS#7 24 19 11 12 1 1 29 31
HS#8 0 0 0 0 0 0 2 3
HS#9 11 8 9 4 0 0 32 14
HS#10 6 8 3 9 0 0 27 32
HS#11 19 2 6 0 2 0 36 19
Total 112 72 56 44 10 4 223 170
Treatment success rate
61% 56% 71% 57%
Treatment Results and Success Data by High School
12
What we have learned from the data
2014 MIH Cohort (n=467)
Previous 3 Cohorts (n=326)
Enrolled 70% (326) 58% (264) Percent with Multiple Measures Placement
100% 0
Enrolled in English first semester 76% (248) 38% (100) Enrolled in ENSL first semester 10% (32) 28% (75) Enrolled in Math first semester 75% (246) 41% (108)
GPA and Unit ceiling???????
13
What we have learned from the dataMIH Group Math
(college-wide)
English (college-wide)
Reading (college-wide)
Total students enrolled from each cohort
2011 64% (50.5%)
57% (57.4%)
62% (59.3%)
73
2012 59% (52.7%)
64% (61%)
75% (60.8%)
92
2013 64% (53.1%)
61% (61.8%)
59% (61.6%)
99
2014 47% 60% 62% 326
English 1A Transfer, Degree and Certificate
29% placed
English (7323 placed)
English 50 4 units
18% placed
English 60 4 units
7% placed
ACDV 65 2 units
37% placed
Academic Development
ACDV 201 9% placed
ENGLISH PLACEMENT 7323 STUDENTS PLACED 2012-13
18%
Academic Development
ACDV 201 (9%)
English 60 & English 50 Compressed Learning Community
25% placed into this series 8 units in one semester
ACDV 65 2 units
37% placed
29%
Academic Development
ACDV 201 (9%)
English 53 Accelerated 25% placed into this series
4 units in one semester
ACDV 65 2 units
37% placed
New Placement based on HS GPA and HS
English Grades
English 53 Accelerated 65% placed into this series
4 units in one semester
Potential UNITS Cost to
get all to English 1A
$1,677,552 3 semesters 10
units
Potential UNITS Cost to
get all to English 1A $1,084,682
2 semesters 6 units
Potential UNITS Cost to
get all to English 1A $208,851
1 semester 4 units
Negative
Positive1. Correction of institutional barriers2. A learning institution (president &
classified)3. Analysis of this group compared
to overall4. Equity insights5. Improvements to bridge and
summer6. Improvements to other support
services and instruction7. Partners – high schools,
community groups, CalPASS, CalSOAP
1. Inability to use many college services
2. Problems with communicating through email
– Email address– Not using email – texting– No computers
3. Messaging and culture (financial aid & early alert)
4. Overall Math + English + Reading + 12 + units were too much all together
5. Learned about unit ceiling for this cohort
Lessons Learned and Unintended Consequences
Our president and her mentee
Sierra College
Long Beach City College