PVAAS and PVAAS Teacher Specific Reporting

Erin Van GuilderAntietam School District

Goal of Session

By the end of the session, participants will be able to answer the following questions:

1. What is PVAAS and how is it a part of the Teacher Effectiveness Model?

2. How does PVAAS measure growth?3. What does PVAAS tell us about growth in our district and

school(s)?4. What is PVAAS Teacher Specific Reporting?5. How Specific Reporting is Determined for a Teacher?6. What and when is Roster Verification?

4

PVAAS Teacher Reporting Implementation Timeline

THE CONCEPT OF PVAAS GROWTH AND MEASURING GROWTH METHODOLOGY

F2F Overview 2013 7

PVAAS Analyses

PSSA Writing

Keystone Exams:

Algebra I, Biology,

Literature

PSSA Science

PSSA Reading

PSSA Math

2. LOOKING AHEADPlanning for

Students’ Needs:Student Projections

to Future Tests

1. LOOKING BACKEvaluating School

Effectiveness:Value Added &

Diagnostic Reports

PVAAS 2 Reporting Categories

8

LOOKING AHEADLOOKING

BACK

How much growth did groups of students make in the past school year?

PVAAS…a Growth and Projections Model

PVAAS Academic Growth does NOT…

Does NOT Does NOT

PVAAS Academic Growth is

• PVAAS Growth provides a measure of the growth of a teacher’s group of students

Where does the PVAAS Growth Measure come from?

Testing Subject-Grades

Methodologies

Measurement

Assessment in Consecutive Years

Math, 4-8Reading, 4-8

Growth Standards

Growth in Math and Reading

Assessments not in Consecutive Years

Writing, 5 & 8

Science- 4&8

Keystones- Algebra 1, Biology, Literature

Predictive Predicted scaled score based on each students’ academic assessment history across subjects

F2F Overview 2013

Prior Achievement for GroupHigher Achievement

Concept of Measuring Growth in PVAAS

Lower Achievement

13

• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student

• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students

F2F Overview 2013

Prior Achievement for GroupHigher Achievement

Concept of Measuring Growth in PVAAS

Lower Achievement

14

• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student

• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students

Most Recent School Year for Group

Higher Achievement

Lower Achievement

F2F Overview 2013

Prior Achievement for GroupHigher Achievement

Concept of Measuring Growth in PVAAS

Lower Achievement

15

• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student

• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students

Most Recent School Year for Group

Higher Achievement

Lower Achievement

F2F Overview 2013

Prior Achievement for GroupHigher Achievement

Concept of Measuring Growth in PVAAS

Lower Achievement

16

• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student

• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students

Most Recent School Year for Group

Higher Achievement

Lower Achievement

F2F Overview 2013

Prior Achievement for GroupHigher Achievement

Concept of Measuring Growth in PVAAS

Lower Achievement

17

• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student

• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students

Most Recent School Year for Group

Higher Achievement

Lower Achievement

F2F Overview 2013

Prior Achievement for GroupHigher Achievement

Concept of Measuring Growth in PVAAS

Lower Achievement

18

• For grades 4-8, Math and Reading - represents the mean achievement level of the group of student

• For Science, Writing, & Keystones- represents the mean predicted and observed/actual achievement level of the group of students

Most Recent School Year for Group

Higher Achievement

Lower Achievement

F2F Overview 2013

Regardless of the entering achievement level of the group…

19

F2F Overview 2013

Regardless of the entering achievement level of the group…

• Students should not lose ground academically

20

F2F Overview 2013

Regardless of the entering achievement level of the group…

• Students should not lose ground academically

• A reasonable goal would be to at least maintain the achievement level of the group

21

F2F Overview 2013

Regardless of the entering achievement level of the group…

• Students should not lose ground academically

• A reasonable goal would be to at least maintain the achievement level of the group

• All groups of students can make growth

22

PVAAS Value-AddedGrowth Measures Reading and Math 4-8

The Growth Measure is NOT reported in years and cannot

be referenced in terms of number of year’s growth.

1000 1100 1200 1300 1400 1500 Scale Score Points

0 10 20 30 40 50 60 70 80 90 100NCE Units

Growth is measured in Normal Curve Equivalent (NCE) units as scale scores cannot be compared from grade to grade and year to year.

The Growth Measure is NOT reported in percentages and cannot be referenced in terms of an increase or decrease in percentage points.

PVAAS Value-Added Growth Measures - Science, Writing and Keystones

• Growth is measured in scale score points.

• The Growth Measure is NOT reported in years and cannot be referenced in terms of number of year’s growth.

• The Growth Measure is NOT reported in percentages and cannot be referenced in terms of an increase or decrease in percentage points.

TEACHER SPECIFIC REPORTING

What is PVAAS teacher-specific reporting?

• Estimates the effect of a teacher’s performance on the academic growth of a group of students.

• Taking into account both their endpoint and their entering achievement level.

• By concentrating on growth, PVAAS puts the emphasis on what educators can influence.

26

Purpose of PVAAS Teacher Specific Reporting

• To inform teaching practice in order to guide replication, changes,

or

• adjustments of teaching practices for continual professional growth.

Who does this affect?

A PA certified educator with full or partial responsibility for content

specific instruction of the assessed eligible content as measured by a PA

state assessment

Face to Face Online Instruction28

PVAAS Teacher Reporting: Teachers in Which Tested Grades/Subjects/Courses?

• PSSA: With/Without Accommodations (Not PASA)– Grades 4-8: Reading and Math– Grades 4 & 8: Science– Grades 5 & 8: Writing

• Future: Transition into ELA Assessment• Courses Culminating in Keystone Exams:

With/Without Accommodations– Algebra I– Literature– Biology

Approximately 30-40% of your teaching staff will be eligible

for a PVAAS teacher specific

score

29

What is content-specific instruction?

• Content Specific Instruction: When a teacher(s) has the responsibility to

• plan the instruction of the assessed eligible content,• provide the instruction of the assessed eligible content,• use the assessment information to evaluate the

effectiveness of the instruction of the assessed eligible content on a PA state assessment.

Defined on the Framework for Teaching by both Domains 1 and 3

Special education teachers, intervention specialists, reading/math specialists, ESL teachers, and gifted teachers are eligible for a

PVAAS score

30

HOW DOES TSR GET COMPUTED?

An Example

Teacher Specific Reporting Example: Mrs. Smith’s Class

Students not included in Teacher Specific Reporting

New Terms: % Instructional Responsibility

% Student + Teacher Enrollmen

t

Full or Partial %

of Instructio

n• This % is your total Instructional Responsibility

for a student. • This % reflects how much the student will be

weighted in the PVAAS analyses.• The % Instructional Responsibility is

calculated by multiplying the (% Student + Teacher Enrollment) by (Full or Partial % of Instruction).

% Instructional Responsibility

34

Calculating: % Student + Teacher Enrollment

% Student + Teacher Enrollmen

t

What proportion of the

grade/subject/course are the student and teacher concurrently

enrolled?

Day 1

Day 140Last Day

Before Testing Window

Grade/Subject/Course

Student Enrolled

Teacher Enrolled

% Student + Teacher Enrollment =

Concurrent Enrollment 35

Calculating: Full or Partial % of Instruction

Full or Partial % of Instruction

Full % of Instruction = 100%

Are you the only PA certified educator responsible for the content-specific instruction (Domains 1 and 3) of the

assessed eligible content in the grade/subject/course?

YES NO

Partial % of Instruction = <100%Proportion of responsibility for the content-specific instruction of the assessed eligible content

in the grade/subject/course (Domains 1 and 3)

36

Mrs. Smith’s % Instructional Responsibility The Total % Instructional Responsibility for Each Student

New # of Students in the TSR Group

Mrs. Smith’s Class

Actual # of Students

Instructional Responsibility of the actual # of students

TEACHER VERIFICATION

Teachers, school administrators and district administrators verifying data that is used to yield PVAAS teacher specific reporting– data that will ultimately be used as part of a teacher’s evaluation.

The PVAAS rosters are prepopulated from the

PIMS Course/HQT submitted by LEAs to PIMS (Student, Staff,

Course Templates)

What is this Verification process all about?

40

SY13-14 PVAAS Roster Verification Timeline

3 New Terms

42

Access to Teacher Specific Reporting

What does my District or School Admin see?

• The same PVAAS data and reporting for an individual teacher that a teacher can see

• No additional data or reporting on any individual teacher!

School Admin. can also:• See a District/School Teacher Summary for

quick access by school/ grade/ subject/ course

• Search to locate an individual teacher’s report

• Will PVAAS teacher‐specific reporting be reported publicly?– Act 82 states that “An employee's

individual rating form shall not be subject to disclosure

– Reference: Act of February 14, 2008 (P.L. 6, No.3), known as the "Right‐to‐Know Law." PDE will follow the law on non‐disclosure.

Support and Next Steps

Next Steps- Fall TrainingTypes of Reports for Teacher• Resources and Supports

LEA DATA TO PVAAS TEACHER SPECIFICREPORTING

ROSTER VERIFICATION: