2009-2010 Site Assessment Leader Training - Benchmarks - Welcome to a New Year!!

1

Today’s Topics:I. Test DevelopmentII. Test AdministrationIII. After the Test

2009-2010Site Assessment Leader

Training- Benchmarks -

Welcome to a New Year!!

2

Test D

evelo

pm

en

tPurpose

Purpose: Provide information to guide instruction

by measuring student proficiency on state standards and curriculum learning objectives

Secondary Purpose: Measure student growth

Information to Share

3

Test D

evelo

pm

en

t

Test Development Industry standard process

Developed by teachers and facilitators with the support of central office.

Yearly item-analysis and revision Reviewed by teachers and facilitators.

Alignment 2-5 Math: Aligned to Learning Goals in

the Curriculum 6-8 Math & 2-8 Literacy: Aligned to

State Standards


4

Item difficulty

Item difficulty carefully monitored. Data from last year’s test Classroom teachers feedback on

difficulty More easy items on Test 1 v. Test 3.

Rationale: Instructional value Performance bands set accordingly.

Test D

evelo

pm

en

tInformation to Share

5

Content Areas

Reading and Writing – Grades 2-8 Spanish versions available (except for Middle School.)

Middle School ELLs (English Language Learners) who cannot access reading and writing tests should take Shining Star ELD tests.

All students must take either Benchmark or ELD test.

Grade 2 – Spring test is mandatory. Fall and Winter tests are optional.

Math – Grades 2-8 Spanish versions available Grade 2 –

Spring test is mandatory. Fall and Winter tests are optional.

Test D

evelo

pm

en

tInformation to Share

6

Test

Ad

min

istra

tion

Window Begins

WindowEnds

Scanning Due

By

Round 1 9/8 9/17 9/22

Round 2 11/30 12/11 12/15

Round 3 4/26 5/6 5/11

Test Administration: Testing Windows

All Benchmark tests must be administered during the first week of each assessment window.

The second week is reserved for make-ups.


7

Test Administration: Which students to test…

All eligible students should be tested.

Special populations to consider CSAPA eligible students are not

required to participate in Benchmark assessments.

ELA students— Which test will provide the teacher

useful instructional information?

Test

Ad

min

istra

tion

8

Test Administration:Criteria for Spanish version of a Benchmark test

Round 1: Primary guiding questions: What is the student’s primary language of instruction? Which version would glean the most useful

information for making instructional decisions?

Rounds 2 & 3: Consider the following criteria: What is the student’s primary language of instruction?

AND Has the student been enrolled in a Colorado public

school for less than 3 years (starting in 1st grade)?

Student Growth Objective (SGO) Cautions e.g., Test 1: Spanish, Test 3: English

Scan only one test per student per content area.

Test

Ad

min

istra

tion


9

Test Administration:No Off-Grade Level Testing (e.g., a 3rd grader taking a 4th grade math test)

Students must take the test that corresponds to the grade level in which they are enrolled

Students receiving off-grade level instruction Can take off-grade level test second,

but it can not be scanned into Edusoft

Test

Ad

min

istra

tion


10

Test materials preparation

Gathering/organizing materials Printing answer sheets

Test Security Measures System for distributing/collecting

materials

Test

Ad

min

istra

tion

11Return to Table of Contents

Testing Materials

Student Materials Student Test Booklets (secure documents) Multiple Choice Answer Sheets

Teacher Materials Teacher Editions (secure documents) Procedures Manual Administration Instructions Constructed Response Answer Sheets Summary Sheet

SAL Materials Summary Sheet Testing Lists Request for Additional Materials Form

Test

Ad

min

istra

tion


12

Test Booklets

When students receive their test

booklets, they must complete the blank lines on the front

cover.

Test

Ad

min

istra

tion


13

Answer Sheets

Student answer sheet MC only Accommodations DO NOT use English answer sheets for Spanish

tests Teacher answer sheet

CR only Transcribing

Highly recommended for 2nd Grade, Test 1 (29% non-response on Test 1)

Test

Ad

min

istra

tion


14

Test

Ad

min

istra

tion

Answer Documents

Students must write their first and last name on the line provided.

Students must mark the bubble next to their name.

Note: Constructed response items will appear on a separate page for students in grades 2-8.

Teacher bubbles accommodations provided for student.

-and-


15

Proctoring vs. Teaching

Teachers’ goal – student learning. Individualize support for students at

different levels. Proctors’ goal – consistent testing

environment (standardization). Provide a uniform testing experience

for all students. Monitor your “teacher” instincts

when proctoring.

Test

Ad

min

istra

tion


16

Proctoring suggestions

Do’s Familiarize: Know what’s required

Directions: Word for word! Cover/remove classroom material that could

give answers. Active Proctoring

Know what’s happening in the room at all times.

Don’ts No hints

“Do your best.” No prompting to complete or change answers.

Test

Ad

min

istra

tion

What happens in your room should be exactly what happens in all other testing rooms.


17

Test Administration: Teacher Tips

Motivating Students Seating charts Content decisions Others?

Specific to Test 1 Let students know material will be

challenging 2nd Grade: Practice

Bubbling Editing

Test

Ad

min

istra

tion


18

Test administration formats

Reading Grade 2: Two 30-minute sessions Grades 3-8: One 70-minute session

Writing Grade 2: Two 25-minute sessions Grade 3-8: Two 45-minute sessions

Math Grade 2: One 45-minute session Grades 3-8: One 60-minute

sessions

Test

Ad

min

istra

tion

Make sure your teachers have the Administration Instructions for the tests they are administering. (NOT just the Teacher Edition)

Find detailed information in the Manual.

19

Test security

Before: SAL Store in a secure location

During: Test administrator No scratch paper except for Writing Test

Reminder: CSAP does NOT allow scratch paper No cell phones

After: SAL Test materials must be returned to the Test

Processing Center one month after testing has concluded

Allowed to keep one blank Teacher Edition from each test in a secure location

Test

Ad

min

istra

tion


20

Scoring – constructed response

“Potential Minimum Full Credit Response” Not exhaustive Use professional judgment.

Benefits of collaborative scoring More accurate scores 2008-2009 Correlation Reports in School

Folders correspondence with CSAP

Recording scores On separate sheet for class.

Afte

r the T

est


21

Scanning I Prevent mis-scans

Student names bubbled No stray marks, folds, tears or tape

Benefits of “Auditing” – Prevent misleading information

Look for missing grade levels and/or content areas students with only half of the test (either MC or

CR) scanned Use checklist forms on A&R site – view forms

Be aware of scanning deadlines – view due dates

Afte

r the T

est

22

Divider Sheet

Answer Sheets

Fourth Grade Math Tests

Divider Sheet

Answer Sheets

Answer Sheets

Fourth Grade Reading Tests

Divider Sheet

Answer Sheets

Third Grade Math Tests

Divider Sheet

Answer Sheets

Third Grade Writing Tests

Divider Sheet

Answer Sheets

Returning Benchmark Materials

1. Begin by placing all unused materials and additional resources at the bottom of the last box.

2. Place a divider sheet on top of the unused materials.

3. Choose one content area from the highest grade level in the school. Pack all completed answer sheets then all completed tests.

4. Place a divider sheet and pack the next content area.

5. Pack the next highest grade.

6. The Processing Center will provide green labels for all boxes used to return test materials.

Third Grade Reading Tests

Fourth Grade Writing Tests

All benchmark test materials, including completed tests, must be returned to the processing center within one month after the administration window closes.

Unused Materials

Afte

r the T

est

23

Scanning II: Reminders Scan only one answer sheet

per student per content. Different languages Off-grade level

Invalidated tests cannot be scanned. e.g., non-standardized

administrations

Afte

r the T

est

24

Checklist Forms for AuditingSAL Checklist

Teacher Checklist

Information to ShareA

fter th

e T

est

25

Test results—Instruction!

For teacher Test 1: Plan areas of emphasis/focus Test 2: How’d I do? What must be revisited? Test 3: Looking to next year… Use caution when comparing performance on

assessment objectives/frameworks! (Small number of items = less reliable score!)

For students Test 1: Preview of year’s content

Set individual goals (motivational) Tests 2 & 3: Review progress and adjust individual

goals

Afte

r the T

est


26

Test results—Growth

SGO’s (Student Growth Objectives)

Test 1 and Test 3 Only performance bands (not raw score or

percent correct)

Test 1 vs Test 3 More easy points on Test 1 Reason: Instructional information

Difficulty corrected with performance bands

Set using end-of-year expectations for both tests.

Afte

r the T

est


27

Resources: Assessment and Research Website

Benchmark Link

Message Board

Staff Directory

Scoring Resources

http://testing.dpsk12.org/


28

Questions Related To…

Administration Assessment & Research website http://testing.dpsk12.org/ Assessment Instructional Specialists Assessment & Research hotline: 720.423.3736

Assessment Materials Processing Center Phone: 720.423.4260 Processing Center Fax: 720.423.4269

Edusoft Website Kari French: [email protected] 720-891-0544

Feedback Feedback regarding the Benchmark Assessment Program is

strongly encouraged and appreciated. Please direct all comments & concerns to Steve Lehman or Teresa Hernandez.


29

Who do I contact for help when I have a question? Network Assessment Specialists

Network 1: Kate Greeley Network 2: Katie Shaw Network 3: Suzie Moore Network 4: Lee Cooper Network 5: Kim Nusbaum K-8 Network : Sharon Hicks Middle School Network: Kent Epperson HS Network: Ann Cobb

Assessment & Research support – A&R directory Processing Center– A&R directory EduSoft: Kari French [email protected]

When are Assessments Given? 2009-2010 Testing Calendar

What do I need to know…and where do I find it?Resources

2009-2010 Site Assessment Leader Training - Benchmarks - Welcome to a New Year!!

Documents

Transcript of 2009-2010 Site Assessment Leader Training - Benchmarks - Welcome to a New Year!!