Slide 1

PVAAS Train-the-Trainer Webinar for IU & PaTTAN Staff: Preparing for Fall 2014 PVAAS Training Sessions September 23, 2014 1:00 p.m. Thanks for joining us today! Our session will begin promptly at 1:00 p.m.

Slide 2

PVAAS Statewide Team for PDE Joan Perekupka Jennifer Ross 2

Slide 3

Tools available along the bottom of your window Click here to open the Message pane. Enter your questions here! Click here to mute/unmute yourself. (Remember to mute yourself when youre not speaking.) (The red line through the microphone indicates you are muted.)

Slide 4

To adjust your speaker volume, hover over the phone button. This will display the Devices window, with a sliding volume bar for your device: 4 Hover

Slide 5

Clicking this button will open the Participants panel, displaying who is participating in todays session. Click the button at the bottom right to toggle your webinar layout (view): (We would suggest using the Presentation view, but youre welcome to see which you prefer.)

Slide 6

Session Logistics & Registration Review of Session Content October Ready, Set, Grow Sessions (for Administrator Teams) November/December Professional Development: Growth not Gotcha Sessions (for Teachers and Administrators) Changes from August Building Capacity Session Roles Essential Knowledge & Understanding for Supporting Sessions PVAAS Reporting Release & Accounts Release dates IU accounts Demo accounts 6

Slide 7

Night of October 23 Teacher Specific Reporting released to District Admins & School Admins ONLY Night of October 30 Teacher Specific Reporting released to teachers Reports available in: Math Reading Science Keystones

Slide 8

Session Logistics & Registration 8

Slide 9

October Sessions ONLY! 8:30am-9:00am Registration for session 9:00am-3:00pm Session What is the plan for lunch at your IU? Might want to include in your reminder about session November/December Sessions ONLY! 8:00am-8:30am Registration for AM session ONLY 8:30am-11:30am AM session 12:00pm-12:30pm Registration for PM session ONLY 12:30pm-3:30pm PM session Lunch Arrangements: provide a list of local options for facilitators/order in AM if possible (we will pay when on-site) 9

Slide 10

Presentation PowerPoint Participants can bring this with them as paper or electronic copy! Will be available on PVAAS login page Will NOT be bringing any paper copies Supplemental Handout PVAAS Statewide Team will be providing paper copies! Scenario Responses & Take-Aways For October sessions ONLY PVAAS Statewide Team will be providing paper copies! 10

Slide 11

Will be available on PVAAS login page Available night of September 25 Direct participants to download PPT prior to session! On Moodle, WikiSpace, IU webpage, etc. Participants should bring printed or electronic copy to session This is similar to last year! 11

Slide 12

Advertise and communicate information about sessions to LEAs Time frame Participants need to bring a computer and PVAAS login information Participation in October session Admin teams will get an opportunity to have a virtual follow up meeting (up to one hour) with a PVAAS Statewide Core Team member at a later date 12

Slide 13

Manage registration For October sessions ONLY Do you have a waiting list for LEAs wanting to send more than 4 admins? What is your plan for those on the waiting list? Multiple sessions IUs with two October dates ALL November/December sessions Want to fill sessions Do not want 50 in one session & 5 in another! Act 45 & 48 (if IU chose to provide credits) 13

Slide 14

Following this webinar do a check on registration numbers to date Do you have any sessions with less than 10 participants registered? Do you have a waiting list? Do you need to do any additional communications? Do you need to us to help send out a communication to certain account holders? Keep an eye on registration in case any sessions need to be cancelled and some participants need to be contacted to change sessions 14

Slide 15

Send email reminder to all participants registered Date and time of the session Direct participants to download session PPT from PVAAS login page (available night of Sept 25) Participants should bring printed or electronic copy to session Bring a laptop! Ideal is 1 per person given confidentiality of data iPads and Tablets can be used Ensure all participants have their own unique PVAAS username, PVAAS password, and PPID Suggest they try logging in prior to session Contact their PVAAS District or School Admin if do not have an account Can use Forgot Username/Password link on PVAAS login page 15

Slide 16

Room Set-Up Projector, microphone, and wireless internet access Provide computer for facilitator, if possible Table Arrangement TOT Sessions Tables Teacher Sessions Tables or classroom style will work, depending on room space Technology Support Arrange for technology staff to assist facilitator and participants in logging onto IU network for internet access 16

Slide 17

Electronic file of participants and email addresses Goal is to send follow-up survey week following the session Email pdepvaas@iu13.orgpdepvaas@iu13.org Or, mail hard copies to Lancaster-Lebanon IU 13 Attn: PVAAS, 1020 New Holland Avenue, Lancaster, PA 17601 Copies of all sign-in sheets & evaluation forms (if using Act 45/48 evaluations) Will take with us at end of session 17

Slide 18

18

Slide 19

Review of Session Content 19

Slide 20

20

Slide 21

1.Introduction 2.Administrator Reports 3.What is PVAAS? Why is it important? 4.Teacher Specific Reports a)Value Added b)Diagnostic 5.Planning for Today 6.Developing Plan to Train, Support, and Communicate with Staff 7.Resources and Support 8.Next Steps ** - Responding to Teachers Questions throughout session 21

Slide 22

Scenarios Immediate report out of responses Documentation of report out for each scenario Removed 2 scenarios now a total of 9 Slight rewording of several scenarios Adjustments for October Admin sessions Admin reports earlier in session Shortened sections on Custom Diagnostic Reports & Bridging Reports Expanded section on Developing a Plan to Train, Support, and Communicate with Teachers Session Tweaks since August Building Capacity Session 22

Slide 23

Encourage district teams to PROVIDE training for their staff Note successes, questions, concerns, struggles AFTER training, schedule follow-up conference call/webinar between the District Admin Team participating in session and PVAAS Statewide Team member Chance to ask questions and concepts which need further clarification ONE HOUR per LEA/District First-come, first-serve Based on availability of PVAAS Statewide Team members Email pdepvaas@iu13.org from LEA/District Adminpdepvaas@iu13.org At fall session, will be asking District Admin team to provide us with District Contact Name/E-mail/Phone Next Steps for District Admin Teams 23

Slide 24

Download (for YOUR use ONLY!) PPT Supplemental Handout Take-Away Scenarios & Responses Pay close attention to ALL activities and discussion questions Available via Dropbox Questions? pdepvaas@iu13.orgpdepvaas@iu13.org To Prepare for Sessions 24

Slide 25

Participate in or view: Teacher-Specific Reporting webinar Sept 9 th @ 1:00-2:00pm (recorded) Sept 24 th @ 9:00-10:00am Teacher-Specific Reporting Virtual Learning Modules Teachers (45 minutes) Admins (15 minutes) Other VLMs? Concept of Growth High Achievement & Growth 25

Slide 26

Review Building Capacity session materials from August Where did you have questions in that session? Are you prepared to discuss the take-away responses provided to the scenarios? Connection to A Framework for Teaching! Your background (curriculum, instruction, TAC, special education) can assist participants in the self-reflection questions related to PVAAS Teacher-Specific reporting 26

Slide 27

27

Slide 28

Session Roles 28

Slide 29

Lead Facilitator(s) Jennifer Ross Joan Perekupka Cindy Goldsworthy Session & Participant Support IU PVAAS Teams Jim Bohan & John Dellegrotto 29

Slide 30

Engage Participants! Check for Understanding! 30

Slide 31

Scenarios are a strategy to support administrators in answering teachers questions What is the teacher REALLY asking? Do you know how YOU might respond? Do you know resources, materials, and evidence related to the question? How does your belief system impact this support? 31

Slide 32

Be prepared to help participants navigate AND interpret reports Effectively support participants by asking questions: How would YOU interpret this report? What reflection questions might you ask based on this report? 32

Slide 33

Assisting participants in creating self- reflection questions of the PVAAS reports related back 22 components of professional practices in A Framework for Teaching LEAs are struggling to make connections. We need to make connections for them! Make sure all IU staff working on various parts of the EE system make connections to the other parts 33

Slide 34

34

Slide 35

Essential Knowledge & Understanding for Supporting Sessions 35

Slide 36

Understanding KEY District and School reportingAND the Concept of Growthis KEY for educators in understanding Teacher- Specific reporting! 36

Slide 37

Predictive methodology is used to estimate growth in Keystone content areas. This is same methodology used to measure growth in Science and Writing, and even grade 11 assessments in prior years. Students taking the Keystone exams have prior history of PSSA data. 37

Slide 38

PVAAS uses all of that prior data to calculate predicted scores for the student group. Growth is a function of the difference between the average predicted score of the student group and the average actual score of the student group. This methodology can be used and produces reliable results because high correlations exist between the PSSA and Keystone scores across subjects, and because there is a strong relationship among scores across grade levels in single subject area. 38

Slide 39

To illustrate using 2012-2013 data: the average multiple correlation obtained when predicting PSSA Math using all prior test scores ranges from 0.82 to 0.87; the average multiple correlation obtained when predicting PSSA Reading using all prior test scores ranges from 0.79 to 0.85; the average multiple correlation obtained when predicting PSSA Science using all prior test scores ranges from 0.78 to 0.81; and the predicted scores of Keystone using PSSA prior test scores has a multiple correlation ranging from 0.77 to 0.79. 39

Slide 40

40 2014 Distribution of Grade 5 Scores 2015 Distribution of Grade 6 Scores 2016 Distribution of Grade 7 Scores Is the group of students (indicated by the yellow star) at the same RELATIVE position in the distribution of statewide scores? THIS IS AN EXAMPLE ONLY!

Slide 41

41 To actually be included in PVAAS Teacher Specific reporting, a student MUST: Have a PSSA or Keystone score from the most recent year NOT be a foreign exchange student NOT be a first-year ELL student NOT be Proficient or Advanced on a PRIOR Keystone exam NOT be claimed at less than 10% instructional responsibility NOT have tested with the PASA (alternate assessment)

Slide 42

PA Data Group of Students Students Prior Data Across Grades & Subjects Estimated Prior (or Entering) Achievement of the Group of Students Measuring Growth: Students Starting Point 42

Slide 43

Prior (or Entering) Achievement of the Group of Students Higher Achievement Lower Achievement Higher Achievement Lower Achievement Current Achievement of the Group of Students Concept of Measuring Growth In District & School Reporting, students are weighted equally. For Teacher Specific Reporting, students are weighted by taking into account the % Total Instructional Responsibility for each student. 43

Slide 44

Students taking the Keystone exam in BOTH the winter and spring testing windows are included in the Value-Added reports if they are enrolled in the Keystone-related course AND took the Keystone exam at the end of the course that same school year. Students taking the Keystone exam in the summer testing window, however, are NOT included in value-added reporting Only exception is year-round schools; currently, only one in PA. 44

Slide 45

PVAAS Accounts 45

Slide 46

46 September 19 District Admins ONLY September 24 ALL PVAAS account holders October 23 (night) Teacher Specific Reporting to District/School Admins only October 30 (night) Teacher Specific Reporting to Teachers

Slide 47

47 As an IU account holder, you will have access to reporting on September 24 when reporting released to all account holders. If an LEA has questions about their reporting prior to September 24, please direct them to contact us at pdepvaas@iu13.org.pdepvaas@iu13.org

Slide 48

New Accounts as of Sept 26!! PRACTICE, PRACTICE, PRACTICE! 48

Slide 49

49

Slide 50

Does each person at your IU (who are involved with PVAAS sessions this fall) have appropriate PVAAS account access PRIOR to fall sessions? Need changes to accounts? Need new accounts? Contact our team: pdepvaas@iu13.org with the users name, role, and email addresspdepvaas@iu13.org Must cc: IU Executive Director 50

Slide 51

51

Slide 52

Questions? Feedback? Other? Email pdepvaas@iu13.org withpdepvaas@iu13.org any thoughts before OR after fall sessions! 52

Slide 53

53