PVAAS Train-the-Trainer Webinar for IU & PaTTAN Staff:
Preparing for Fall 2014 PVAAS Training Sessions September 23, 2014
1:00 p.m. Thanks for joining us today! Our session will begin
promptly at 1:00 p.m.
Slide 2
PVAAS Statewide Team for PDE Joan Perekupka Jennifer Ross
2
Slide 3
Tools available along the bottom of your window Click here to
open the Message pane. Enter your questions here! Click here to
mute/unmute yourself. (Remember to mute yourself when youre not
speaking.) (The red line through the microphone indicates you are
muted.)
Slide 4
To adjust your speaker volume, hover over the phone button.
This will display the Devices window, with a sliding volume bar for
your device: 4 Hover
Slide 5
Clicking this button will open the Participants panel,
displaying who is participating in todays session. Click the button
at the bottom right to toggle your webinar layout (view): (We would
suggest using the Presentation view, but youre welcome to see which
you prefer.)
Slide 6
Session Logistics & Registration Review of Session Content
October Ready, Set, Grow Sessions (for Administrator Teams)
November/December Professional Development: Growth not Gotcha
Sessions (for Teachers and Administrators) Changes from August
Building Capacity Session Roles Essential Knowledge &
Understanding for Supporting Sessions PVAAS Reporting Release &
Accounts Release dates IU accounts Demo accounts 6
Slide 7
Night of October 23 Teacher Specific Reporting released to
District Admins & School Admins ONLY Night of October 30
Teacher Specific Reporting released to teachers Reports available
in: Math Reading Science Keystones
Slide 8
Session Logistics & Registration 8
Slide 9
October Sessions ONLY! 8:30am-9:00am Registration for session
9:00am-3:00pm Session What is the plan for lunch at your IU? Might
want to include in your reminder about session November/December
Sessions ONLY! 8:00am-8:30am Registration for AM session ONLY
8:30am-11:30am AM session 12:00pm-12:30pm Registration for PM
session ONLY 12:30pm-3:30pm PM session Lunch Arrangements: provide
a list of local options for facilitators/order in AM if possible
(we will pay when on-site) 9
Slide 10
Presentation PowerPoint Participants can bring this with them
as paper or electronic copy! Will be available on PVAAS login page
Will NOT be bringing any paper copies Supplemental Handout PVAAS
Statewide Team will be providing paper copies! Scenario Responses
& Take-Aways For October sessions ONLY PVAAS Statewide Team
will be providing paper copies! 10
Slide 11
Will be available on PVAAS login page Available night of
September 25 Direct participants to download PPT prior to session!
On Moodle, WikiSpace, IU webpage, etc. Participants should bring
printed or electronic copy to session This is similar to last year!
11
Slide 12
Advertise and communicate information about sessions to LEAs
Time frame Participants need to bring a computer and PVAAS login
information Participation in October session Admin teams will get
an opportunity to have a virtual follow up meeting (up to one hour)
with a PVAAS Statewide Core Team member at a later date 12
Slide 13
Manage registration For October sessions ONLY Do you have a
waiting list for LEAs wanting to send more than 4 admins? What is
your plan for those on the waiting list? Multiple sessions IUs with
two October dates ALL November/December sessions Want to fill
sessions Do not want 50 in one session & 5 in another! Act 45
& 48 (if IU chose to provide credits) 13
Slide 14
Following this webinar do a check on registration numbers to
date Do you have any sessions with less than 10 participants
registered? Do you have a waiting list? Do you need to do any
additional communications? Do you need to us to help send out a
communication to certain account holders? Keep an eye on
registration in case any sessions need to be cancelled and some
participants need to be contacted to change sessions 14
Slide 15
Send email reminder to all participants registered Date and
time of the session Direct participants to download session PPT
from PVAAS login page (available night of Sept 25) Participants
should bring printed or electronic copy to session Bring a laptop!
Ideal is 1 per person given confidentiality of data iPads and
Tablets can be used Ensure all participants have their own unique
PVAAS username, PVAAS password, and PPID Suggest they try logging
in prior to session Contact their PVAAS District or School Admin if
do not have an account Can use Forgot Username/Password link on
PVAAS login page 15
Slide 16
Room Set-Up Projector, microphone, and wireless internet access
Provide computer for facilitator, if possible Table Arrangement TOT
Sessions Tables Teacher Sessions Tables or classroom style will
work, depending on room space Technology Support Arrange for
technology staff to assist facilitator and participants in logging
onto IU network for internet access 16
Slide 17
Electronic file of participants and email addresses Goal is to
send follow-up survey week following the session Email
[email protected]@iu13.org Or, mail hard copies to
Lancaster-Lebanon IU 13 Attn: PVAAS, 1020 New Holland Avenue,
Lancaster, PA 17601 Copies of all sign-in sheets & evaluation
forms (if using Act 45/48 evaluations) Will take with us at end of
session 17
Slide 18
18
Slide 19
Review of Session Content 19
Slide 20
20
Slide 21
1.Introduction 2.Administrator Reports 3.What is PVAAS? Why is
it important? 4.Teacher Specific Reports a)Value Added b)Diagnostic
5.Planning for Today 6.Developing Plan to Train, Support, and
Communicate with Staff 7.Resources and Support 8.Next Steps ** -
Responding to Teachers Questions throughout session 21
Slide 22
Scenarios Immediate report out of responses Documentation of
report out for each scenario Removed 2 scenarios now a total of 9
Slight rewording of several scenarios Adjustments for October Admin
sessions Admin reports earlier in session Shortened sections on
Custom Diagnostic Reports & Bridging Reports Expanded section
on Developing a Plan to Train, Support, and Communicate with
Teachers Session Tweaks since August Building Capacity Session
22
Slide 23
Encourage district teams to PROVIDE training for their staff
Note successes, questions, concerns, struggles AFTER training,
schedule follow-up conference call/webinar between the District
Admin Team participating in session and PVAAS Statewide Team member
Chance to ask questions and concepts which need further
clarification ONE HOUR per LEA/District First-come, first-serve
Based on availability of PVAAS Statewide Team members Email
[email protected] from LEA/District [email protected] At fall
session, will be asking District Admin team to provide us with
District Contact Name/E-mail/Phone Next Steps for District Admin
Teams 23
Slide 24
Download (for YOUR use ONLY!) PPT Supplemental Handout
Take-Away Scenarios & Responses Pay close attention to ALL
activities and discussion questions Available via Dropbox
Questions? [email protected]@iu13.org To Prepare for
Sessions 24
Slide 25
Participate in or view: Teacher-Specific Reporting webinar Sept
9 th @ 1:00-2:00pm (recorded) Sept 24 th @ 9:00-10:00am
Teacher-Specific Reporting Virtual Learning Modules Teachers (45
minutes) Admins (15 minutes) Other VLMs? Concept of Growth High
Achievement & Growth 25
Slide 26
Review Building Capacity session materials from August Where
did you have questions in that session? Are you prepared to discuss
the take-away responses provided to the scenarios? Connection to A
Framework for Teaching! Your background (curriculum, instruction,
TAC, special education) can assist participants in the
self-reflection questions related to PVAAS Teacher-Specific
reporting 26
Slide 27
27
Slide 28
Session Roles 28
Slide 29
Lead Facilitator(s) Jennifer Ross Joan Perekupka Cindy
Goldsworthy Session & Participant Support IU PVAAS Teams Jim
Bohan & John Dellegrotto 29
Slide 30
Engage Participants! Check for Understanding! 30
Slide 31
Scenarios are a strategy to support administrators in answering
teachers questions What is the teacher REALLY asking? Do you know
how YOU might respond? Do you know resources, materials, and
evidence related to the question? How does your belief system
impact this support? 31
Slide 32
Be prepared to help participants navigate AND interpret reports
Effectively support participants by asking questions: How would YOU
interpret this report? What reflection questions might you ask
based on this report? 32
Slide 33
Assisting participants in creating self- reflection questions
of the PVAAS reports related back 22 components of professional
practices in A Framework for Teaching LEAs are struggling to make
connections. We need to make connections for them! Make sure all IU
staff working on various parts of the EE system make connections to
the other parts 33
Slide 34
34
Slide 35
Essential Knowledge & Understanding for Supporting Sessions
35
Slide 36
Understanding KEY District and School reportingAND the Concept
of Growthis KEY for educators in understanding Teacher- Specific
reporting! 36
Slide 37
Predictive methodology is used to estimate growth in Keystone
content areas. This is same methodology used to measure growth in
Science and Writing, and even grade 11 assessments in prior years.
Students taking the Keystone exams have prior history of PSSA data.
37
Slide 38
PVAAS uses all of that prior data to calculate predicted scores
for the student group. Growth is a function of the difference
between the average predicted score of the student group and the
average actual score of the student group. This methodology can be
used and produces reliable results because high correlations exist
between the PSSA and Keystone scores across subjects, and because
there is a strong relationship among scores across grade levels in
single subject area. 38
Slide 39
To illustrate using 2012-2013 data: the average multiple
correlation obtained when predicting PSSA Math using all prior test
scores ranges from 0.82 to 0.87; the average multiple correlation
obtained when predicting PSSA Reading using all prior test scores
ranges from 0.79 to 0.85; the average multiple correlation obtained
when predicting PSSA Science using all prior test scores ranges
from 0.78 to 0.81; and the predicted scores of Keystone using PSSA
prior test scores has a multiple correlation ranging from 0.77 to
0.79. 39
Slide 40
40 2014 Distribution of Grade 5 Scores 2015 Distribution of
Grade 6 Scores 2016 Distribution of Grade 7 Scores Is the group of
students (indicated by the yellow star) at the same RELATIVE
position in the distribution of statewide scores? THIS IS AN
EXAMPLE ONLY!
Slide 41
41 To actually be included in PVAAS Teacher Specific reporting,
a student MUST: Have a PSSA or Keystone score from the most recent
year NOT be a foreign exchange student NOT be a first-year ELL
student NOT be Proficient or Advanced on a PRIOR Keystone exam NOT
be claimed at less than 10% instructional responsibility NOT have
tested with the PASA (alternate assessment)
Slide 42
PA Data Group of Students Students Prior Data Across Grades
& Subjects Estimated Prior (or Entering) Achievement of the
Group of Students Measuring Growth: Students Starting Point 42
Slide 43
Prior (or Entering) Achievement of the Group of Students Higher
Achievement Lower Achievement Higher Achievement Lower Achievement
Current Achievement of the Group of Students Concept of Measuring
Growth In District & School Reporting, students are weighted
equally. For Teacher Specific Reporting, students are weighted by
taking into account the % Total Instructional Responsibility for
each student. 43
Slide 44
Students taking the Keystone exam in BOTH the winter and spring
testing windows are included in the Value-Added reports if they are
enrolled in the Keystone-related course AND took the Keystone exam
at the end of the course that same school year. Students taking the
Keystone exam in the summer testing window, however, are NOT
included in value-added reporting Only exception is year-round
schools; currently, only one in PA. 44
Slide 45
PVAAS Accounts 45
Slide 46
46 September 19 District Admins ONLY September 24 ALL PVAAS
account holders October 23 (night) Teacher Specific Reporting to
District/School Admins only October 30 (night) Teacher Specific
Reporting to Teachers
Slide 47
47 As an IU account holder, you will have access to reporting
on September 24 when reporting released to all account holders. If
an LEA has questions about their reporting prior to September 24,
please direct them to contact us at
[email protected]@iu13.org
Slide 48
New Accounts as of Sept 26!! PRACTICE, PRACTICE, PRACTICE!
48
Slide 49
49
Slide 50
Does each person at your IU (who are involved with PVAAS
sessions this fall) have appropriate PVAAS account access PRIOR to
fall sessions? Need changes to accounts? Need new accounts? Contact
our team: [email protected] with the users name, role, and email
[email protected] Must cc: IU Executive Director 50