Pennsylvania Value-Added Assessment System (PVAAS): A Compass for Improvement Oxford Area School...
-
Upload
diana-clark -
Category
Documents
-
view
217 -
download
2
Transcript of Pennsylvania Value-Added Assessment System (PVAAS): A Compass for Improvement Oxford Area School...
Pennsylvania Value-Added Pennsylvania Value-Added Assessment System (PVAAS):Assessment System (PVAAS):A Compass for ImprovementA Compass for Improvement
Oxford Area School DistrictOxford Area School DistrictFebruary 14, 2013February 14, 2013
PVAAS IS: Analysis of existing assessment data
• Longitudinal PSSA scores in available content areas
Math, Reading, Science, Writing• Provides reliable estimates
A measure of a school’s effectiveness
Critical Relationship: Growth Data vs. Achievement Data
PVAAS IS PVAAS IS NOTNOT
Another testAnother test Able to provide a measure of growth Able to provide a measure of growth
for an individual studentfor an individual student A comparison of single test scoresA comparison of single test scores
High Achievement
Average Achievement
Low Achievement
Current Data Collection Approaches
Achievement is based on each student’s ending point.
OASD/State 2012 Reading OASD/State 2012 Reading PSSA Disaggregated GroupsPSSA Disaggregated Groups
Key Concepts Key Concepts
Achievement Progress Measures students’
performance at a single point in time
Compares student performance to a standard
Critical to students’ post-secondary opportunities
Highly correlated with demographic factors, such as socioeconomic status
Measures students’ progress across time/years
Compares student performance to his/her own prior performance
Critical to ensuring students’ future academic success
Not correlated with demographic factors
Key Concepts Key Concepts
PVAAS reporting reflects the effectiveness of your district’s or school’s Standards-Aligned System
PVAAS reporting reflects the district’s or school’s system regarding curriculum, assessment, and instruction
Key Concepts Key Concepts
There is NO relationship between demographic variables such as socioeconomic status and growth.
• There are high achieving schools making high growth;• There are high achieving schools making low growth;• There are low achieving schools making high growth; • There are low achieving schools making low growth.
Growth reporting reflects what WE do with students in terms of academic growth in schools/districts.
-- VAAS can remove the effects of factors not under the control of the school. (McCaffrey, Lockwood, Koretz & Hamilton, 2003; Ross, Wang, Sanders, Wright & Stringfield, 1999a; Wright, Horn & Sanders, 1997).
PVAAS Adds Another Variable To Achievement…Progress
Below Growth
Standard
At or AboveGrowth
Standard
Progress is based Progress is based on each cohorton each cohort’’s starting points starting point..
0 = Growth Standard
TWO Types of PVAAS InformationTWO Types of PVAAS Information
Today
Looking Back/Evaluation…
Value-added Growth Reports For Groups of Students
Looking Forward/Planning…
PVAAS Projection Reports For Individual Students and Groups of Students
What questions does PVAAS What questions does PVAAS answer?answer?
1.1. Did each group of students make a year’s worth of Did each group of students make a year’s worth of growth in reading (grades 4-8 and 11), math (grades growth in reading (grades 4-8 and 11), math (grades 4-8 and 11), science (grades 4, 8 and 11), and writing 4-8 and 11), science (grades 4, 8 and 11), and writing (grades 5, 8 and 11)?(grades 5, 8 and 11)?
1.1. Did each subgroup of students make a year’s worth Did each subgroup of students make a year’s worth of growth in reading (grades 4-8 and 11), math of growth in reading (grades 4-8 and 11), math (grades 4-8 and 11), science (grades 4, 8 and 11), (grades 4-8 and 11), science (grades 4, 8 and 11), and writing (grades 5, 8 and 11)?and writing (grades 5, 8 and 11)?
1.1. Is each student on a trajectory to reach proficient or Is each student on a trajectory to reach proficient or advanced on a future PSSA reading, math, science, advanced on a future PSSA reading, math, science, and writing?and writing?
SAS PVAAS WebsiteSAS PVAAS Website
Professional Development Opportunities, New Features, Guide to District/School Reports, Guide to
Public Reporting, IU Point of Contact . . .
https://pvaas.sas.com
Overview of PVAAS Overview of PVAAS ReportingReporting
PVAAS ReportingPVAAS Reporting
Value-Added Reports and ProjectionsValue-Added Reports and Projections Reading, Math, Science and WritingReading, Math, Science and Writing District Level ReportingDistrict Level Reporting School Level ReportingSchool Level Reporting Grade Level Reporting (4-8, 11)Grade Level Reporting (4-8, 11) Subgroups Reporting (ex. IEP, ED, ELL)Subgroups Reporting (ex. IEP, ED, ELL) Performance Levels (Advanced, Proficient, Basic, Performance Levels (Advanced, Proficient, Basic,
Below Basic)Below Basic)
Student Level Reporting – Student Level Reporting – Only for projectionsOnly for projections• Reading, Math, Science, WritingReading, Math, Science, Writing
Did students make one Did students make one yearyear’’s academic growth s academic growth
last year?last year?
Scatter Plot Quadrants Scatter Plot Quadrants and Their Meaningsand Their Meanings
Quad 1 - Excelling
Higher Achievement,Higher Growth
Quad 4 - Improving
Lower Achievement, Higher Growth
Quad 2 - SlippingHigher
Achievement,Negative Growth
Quad 3 - Underperforming
Lower Achievement,Lower Growth
1616
School to CountySchool to CountyGrade 4 MathGrade 4 Math
School to CountySchool to CountyGrade 4 ReadingGrade 4 Reading
School to CountySchool to CountyGrade 5 MathGrade 5 Math
School to CountySchool to CountyGrade 5 ReadingGrade 5 Reading
School to CountySchool to CountyGrade 6 MathGrade 6 Math
School to CountySchool to CountyGrade 6 ReadingGrade 6 Reading
School to CountySchool to CountyGrade 7 MathGrade 7 Math
School to CountySchool to CountyGrade 7 ReadingGrade 7 Reading
School to CountySchool to CountyGrade 8 MathGrade 8 Math
School to CountySchool to CountyGrade 8 ReadingGrade 8 Reading
School to CountySchool to CountyGrade 11 MathGrade 11 Math
School to CountySchool to CountyGrade 11 ReadingGrade 11 Reading
Publicly Released Data: School SearchPublicly Released Data: School Search
Allows users to find and compare the Allows users to find and compare the achievement and gains of grade levels in all achievement and gains of grade levels in all schools in PA (grades 4-8 & 11)schools in PA (grades 4-8 & 11)• Will display the schoolWill display the school’’s quintile relative to all schools in s quintile relative to all schools in
PennsylvaniaPennsylvania• Can search for Can search for ““comparable schoolscomparable schools”” • Similar demographicsSimilar demographics
January 2011January 2011 2929
Average Growth IndexAverage Growth Index
Math (Grades 4-8) Math (Grades 4-8) • AGI 10.7 (19AGI 10.7 (19thth out of 553 districts) out of 553 districts)• *Significant evidence that the district *Significant evidence that the district
exceeded the standard for PA Academic exceeded the standard for PA Academic GrowthGrowth
• Range of growth 20.5 – (-55.9)Range of growth 20.5 – (-55.9)• Only 1/12 other Chester County school Only 1/12 other Chester County school
district ranked higher. district ranked higher.
Average Growth IndexAverage Growth Index
Reading (Grades 4-8) Reading (Grades 4-8) • AGI 5.6 (38AGI 5.6 (38thth out of 553 districts) out of 553 districts)• *Significant evidence that the district *Significant evidence that the district
exceeded the standard for PA Academic exceeded the standard for PA Academic GrowthGrowth
• Range of growth 15.4 – (-46.3)Range of growth 15.4 – (-46.3)• Only 3/12 other Chester County school Only 3/12 other Chester County school
districts ranked higher. districts ranked higher.
Gerald L. Zahorchak, D.Ed. Secretary of Education
Commonwealth of Pennsylvania
https://pvaas.sas.com
333 Market Street Harrisburg, PA 17126