Administering the 2010 HSTW Assessment for TCTW Sites
description
Transcript of Administering the 2010 HSTW Assessment for TCTW Sites
Southern
Regional
Education
Board
HSTW
Administering the 2010 HSTW Assessment for
TCTW Sites
Southern
Regional
Education
Board
HSTW
About the HSTW Assessment
HSTW and TCTW are research-based school improvement models
HSTW Assessment is used to set baselines, acknowledge progress, identify areas for improvement, and set priorities
Only initiatives combining student achievement data with students’ perceptions of school and classroom practices
Required of HSTW and TCTW sites in even-numbered years
Administered to seniors to collect data on entire high school experience
Southern
Regional
Education
Board
HSTWExamples of How Schools
and Centers Use the Results
Lobby for state actions to support school improvement
Identify a need for improvement Gain support for school improvement Engage the entire faculty in school
improvement Set priorities for school improvement Improve classroom practices
Southern
Regional
Education
Board
HSTWExamples of How Schools
and Centers Use the Results
In 2008, one TCTW center said “the teacher survey was a real eye-opener. Through the data, we very quickly realized that we had teachers on our campus with very different views regarding the purpose of career/technical education, particularly in the area of academic reinforcement. The survey data will allow us to identify the highest priority staff development needs and to begin creating a common understanding of our center’s role in a students’ technical and academic success.”
Southern
Regional
Education
Board
HSTW
Five Components
Reading testMathematics test Science testStudent survey
Course-taking patternsSchool/center and classroom
experiences
Teacher survey
Southern
Regional
Education
Board
HSTW
Reading Test
90 minutes80% informational texts; 20%
literary non-fiction textsIncludes meaning vocabularyIncludes paired texts (to assess
critical analysis)Does not include literary fiction or
poetry
Southern
Regional
Education
Board
HSTW
Mathematics Test
70 minutesContent
10% Number Properties and Operations
30% Measurement/Geometry25% Data Analysis, Statistics and
Probability35% Algebra
Southern
Regional
Education
Board
HSTW
Science Test
70 minutesContent
40% Life Sciences40% Physical Sciences20% Earth and Space Science
Southern
Regional
Education
Board
HSTW
Student Survey
Section 1Course-taking patterns
Sections 2 and 3School and classroom experiencesBased on HSTW Key Practices
Southern
Regional
Education
Board
HSTW
Teacher Survey
Center and classroom experiencesCenter missionHigh expectations and extra helpGuiding and supporting studentsCurriculum content and engaging
students in learningTransitionsLeadership and professional growth
Southern
Regional
Education
Board
HSTW
Results
HSTW Award of Educational Achievement
Student reportsSchool report
Southern
Regional
Education
Board
HSTWHSTW Award of Educational
Achievement
Mailed to centers April 30, 2010Awarded to students who:
Meet all three readiness goalsComplete at least two parts of the
HSTW-Recommended Curriculum• English/language arts, mathematics,
science
Complete a concentration• Career/technical, mathematics/science,
humanities
Southern
Regional
Education
Board
HSTW
Student reports
Mailed to centers April 30, 2010Performance on reading,
mathematics and science testPerformance level
Completion of recommended curriculum and concentration
Award status
Southern
Regional
Education
Board
HSTW
HSTW Assessment Report
Mailed to centers June 30, 2010Two months earlier than previous years!
Executive SummaryOne page summary of performance and
implementation
OverviewSlightly longer summary
Full reportTables breaking out achievement by experiences **No teacher survey results
• Teacher survey results will be provided in a separate report.
Southern
Regional
Education
Board
HSTW
Administering the Assessment
1. Place orderOrder window
• September 1 – October 30, 2009
Orders must be placed online on SREB Web site
All communication and materials will be sent to contact person listed on order form
Southern
Regional
Education
Board
HSTW
Information needed to place order
If your center has previously participated in an assessment
Name, e-mail address and phone number of contact person (will receive all materials and communication via mail and e-mail through summer 2010)
Complete shipping address (no P.O. boxes)Director name, e-mail address and phone numberSampling method and number of students to be
assessedPayment information and billing addressDates the center plans to assess within windowNumber of teachers
Southern
Regional
Education
Board
HSTW
Payment Information
If your center or district is paying for the assessment, a purchase order is due to SREB by November 16, 2009 to confirm your order
Final payment is due to SREB by April 30, 2010
SREB will accept payments beginning immediately (call Fran Mathis at 404-879-5611 to request an early invoice)
Southern
Regional
Education
Board
HSTW
Administering the Assessment
2. Review administration materialsAvailable on SREB Web site
beginning September 1, 2009A link also will be included in the
order confirmation e-mail sent upon placing an order
Review materials immediatelySet timeline for preparation and
administration
Southern
Regional
Education
Board
HSTW
Administration Materials
Test Administration GuideSampling InstructionsStudent Roster FormCourse Description GuideCourse Matching ChartChecklistTest Description and Sample Question
BookletInformation for SitesTasks and Timelines
Southern
Regional
Education
Board
HSTW
Task Schedule Estimated Time
Identify students Sept. – Nov. 2009 3 hours
Identify assistants Sept. – Nov. 2009 1 hour
Schedule time and place Sept. – Nov. 2009 2 hours
Notify students and teachers Sept. – Nov. 2009 2 hours
Prepare student roster Oct. – Dec. 2009 1 hour
Complete course matching chart Oct. – Dec. 2009 5 days*
Prepare student transcripts Jan. 2010 5 days*
Receive and check materials Jan. 20, 2010 1 hour
Assign answer documents to students
Jan. 20-27, 2010 3 hours
Complete section 1 of student survey for students
Jan. – Feb. 2010 3 days*
Administer assessment and teacher survey
Jan. 29 – Feb. 19, 2010
2-4 days
Return materialsNo later than Feb.
19, 20101 hour
Sample Timeline
Southern
Regional
Education
Board
HSTW
Administering the Assessment
3. Identify studentsUse sampling plan selected on order
• All seniors• Random sample of 60+ seniors• All CT seniors• Random sample of 60+ CT seniors
Include all currently enrolled students in sampling
• Only exclude students if IEP exempts them from state assessments
Use sampling instructions provided to select sample
Southern
Regional
Education
Board
HSTW
Identifying Students to Participate
Only include seniorsIf selecting a sample, select a true random
sample using the instructions providedOnly exclude students if their IEP exempts
them from state assessmentsAccommodations provided for state
assessments should be provided for this assessment
• Contact ETS by October 30, 2009 to request large-print or CD materials
Accommodations exist for English language learners
Southern
Regional
Education
Board
HSTW
Identifying Students When Home Schools Are Also Participating
Center should select sample.Home school should select sample.Center and home school should compare lists to
see if any students were double-selected. If no students were double-selected, proceed as
usual. If students were double-selected, students should
assess at home school.Call ETS (Lisa Rion – 609-734-5646) to obtain a
special code.Enter that special code on all double-selected
students’ answer documents. Their results will go into both reports while they only participate once.
Southern
Regional
Education
Board
HSTW
Administering the Assessment
4. SchedulingIdentify assistants
• One assistant per 15 students is ideal
Schedule dates, times and locations• Include make-up sessions• SREB recommends administering
assessment over 2-3 days
Schedule date, time and location for teacher survey
• Web-based teacher survey
Southern
Regional
Education
Board
HSTW
Administering the Assessment
5. NotificationNotify students, parents and
teachersProvide informational materials
and/or schedule an informational meeting
Southern
Regional
Education
Board
HSTW
Administering the Assessment
6. Prepare student roster form Include names of all participating studentsWill need to include each student’s Assessment ID
number from the answer document he or she is assigned
Keep fully completed roster on file with testing records for five years
Recommend including students’ e-mail addresses to assist with Follow-Up Survey of 2010 Graduates
Needed to identify students for student reports and awards if they failed to include their name on their answer document
Southern
Regional
Education
Board
HSTW
Administering the Assessment
7. Course-taking preparationWork with home schools to complete
course-matching chart, using course description guide
• Used to link local course titles to generic SREB course titles
Include all courses current seniors could have taken during high school
Collect transcripts and course schedules for participating students, including spring courses
Southern
Regional
Education
Board
HSTW
Administering the Assessment
8. Receive assessment materialsMaterials schedule to arrive by January 20, 2010
• TCTW Teacher Survey instructions will be sent separately
Verify contents according to instructions immediately
• This gives ETS time to send new materials should an error have occurred
Keep secure (locked) until testing beginsThese are secure testing materials and all materials
(used and unused) will need to be returnedKeep the boxes – you will need them to return
materials
Southern
Regional
Education
Board
HSTW
Administering the Assessment
9. Prepare assessment materialsAssign each student an answer document
• Record each student’s Assessment ID number from the answer document on the student roster form
Complete section 1 (transcript analysis) for students
• Strongly recommended, but not required• Reduces testing time• Increases accuracy
Southern
Regional
Education
Board
HSTW
Administering the Assessment
10. Review testing arrangementsConfirm dates, times and locationsRemind participantsReview administration plan with
assistants
Southern
Regional
Education
Board
HSTW
Administering the Assessment
11. Administer assessmentStudent and Teacher Window: January 29 –
February 19, 2010Administration guide includes scripts and complete
instructions for administering the student assessment
Students must complete all four componentsAll materials must be postmarked for return using
the enclosed instructions and labels no later than February 19, 2010
• TCTW Teacher Survey will be Web-based and must be completed by February 19, 2010.
Southern
Regional
Education
Board
HSTW
Administering the Assessment
12. Return materialsPack student materials using enclosed instructions
• Completed answer documents will be packed in a different envelope and use a different return label than the test books and other materials
• If the necessary envelopes and labels are not included, you must call ETS (Lisa Rion at 609-734-5646) for replacement materials
• Teacher survey will be Web-based
All materials must be postmarked for return no later than February 19, 2010
Keep the receipt and tracking number!!!
Southern
Regional
Education
Board
HSTW
Important Dates to Remember Order window
September 1 – October 30, 2009
Administration materials available online September 1, 2009
Test materials arrive at sites January 20, 2010
Student and teacher administration window January 29 – February 19, 2010
Final return deadline February 19, 2010
Awards and student reports mailed to sites April 30, 2010
Payment due to SREB April 30, 2010
School reports mailed to sites June 30, 2010
Southern
Regional
Education
Board
HSTWMaking the 2010 Assessment
a Success
CommunicationLetters/informational sessions for
students and parentsAnnouncements to faculty and staffStress importance, intended use,
and value of assessment
Southern
Regional
Education
Board
HSTWMaking the 2010 Assessment
a Success
CooperationImportance of the assessment to the
center’s improvement goalsImportance of students,
administration and faculty taking it seriously
Handling make-up workCooperation from teachers whose
classes might be interrupted by the assessment
Southern
Regional
Education
Board
HSTWMaking the 2010 Assessment
a Success
Encourage all students to do their bestPromote the HSTW Award of Educational
AchievementRecognize those who receive the HSTW Award of
Educational AchievementExplain the new student readiness reports and how
it can help with their resumesBuild enthusiasmBe honest – explain how this helps the center and
future studentsMake students feel special for participating in the
assessment and thank them for their participation
Southern
Regional
Education
Board
HSTWFor More Information…
Go to SREB’s Web pages on assessment for more ideas and information!
http://www.sreb.org/programs/hstw/Assessment/assessindex.asp
**Please note SREB will be launching a new Web site this fall. The assessment direct link will be different but the new Web site
will be easier to navigate.
Allison Timberlake, Director of Assessment and [email protected]
(404) 879-5575
Fran Mathis, Research [email protected]
(404) 879-5611
Ann Benson, Director of Technology Centers That [email protected]