CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school...

74
CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District

Transcript of CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school...

Page 1: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

CRT Training2011-2012

Jami-Jon M. Pearson, Ph.D.Research & Assessment Coordinator

Canyons school District

Page 2: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

CRT Training OverviewO Quick Definition of TermsO Testing CalendarO Security and EthicsO Testing LogsO Data Administration System - DASO Proctor Test Workstation - PTWO Student Test Workstation -STWO Preliminary Score ReportO Test Coordinator ResponsibilitiesO Test Scheduling OptionO Quiz

Page 3: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Key Terms for CRT Testing

O 9+2 – teacher cactus id with an 01 put at end if elementary or class period if secondary

O DAS – main system for CRT administration

O ELL - English language learners

O GO – starts test for students

O Group – class tested O IEP and 504 - special

education O LEA number – Canyons

district number (SKYWARD) O Live Session - using your

student's real logins and ids for real testing

O Practice Session - using fake students' logins and id's to practice testing

O Proctor – website where the CRT test is given

O PTW – where test is given O Receipts - report showing all

students tested O Section – Parts of CRT test. All

tests have 2 sections but Sec ELA, (3)

O Session – when students are testing

O SSID – the unique number from the state

O Student Logs - lists of the students that are signed up for test

O STW – where students sit and take test

O TAM – state manual with Teacher Prompt (Pol/Pro & subject)

O Teacher Prompt – what teacher reads through test

O Test Coordinator – manager of CRT tests

O Tickets – students login and password

Page 4: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Spring Important Dates:

March 20 & 23: Principals CRT training

March 22: Secondary schools pre-prints due

(NO ELEMENTARIES NEEDED)

March 30: Lab testing schedule due

March 30: Student Logs sent to schools

Current - May: CBT Practice Session available

Apr 23 - June 1: Core CRT Testing window

Page 5: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Spring CRT Overview (Pg. 5)

Test Security – O CRTs are high stakes testing.O Only qualified staff have access to CBT

system. O Test Access Codes (TAC) protected.O Test materials including Preliminary Score

Reports must be secured.

Testing Ethics –O Passages/test questions only read to

students with IEP, ELL, or 504 plan.

O NO actual questions be taught or reviewed.O No reproducing the test via

electronic/paper.

Page 6: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Ethics (Pg. 5)O For further information regarding

testing ethics and test security, see the Utah State Board of Education-approved Standard Test Administration and Testing Ethics Policy. This document is available at the following URL (will not open in Firefox, use other internet providers):

O http://www.schools.utah.gov/assessment/Testing-Director-Resources/TD_Ethics_ Policypdf.aspx.

Page 7: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Testing Logs

O Sent out March 30th

O DO NOT RETURNO Use as a reference for students O To be addedO Have accommodations

added

Page 8: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

**Students listed here are preloaded into the Testing System. These forms do not need to be returned to the district.

DO NOT NEED TO BE RETURNED

Page 9: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

I. Data Administrative System(DAS)

II. Proctor Test Workstation(PTW)

III. Student Test Workstation (STW)

Page 10: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

1. Use “Proctor a Training Test” to proctor practice tests

2. Use “Go to Training DAS Site” to set up practice tests

3. Use “Proctor a Live Test” to proctor live tests

4. Use “Go to Live DAS Site” to set up live tests

http://utah.measuredprogress.org

Test Coordinator Testing Website

Page 11: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

I. Data Administration System

(DAS)

Requires a login & password Manage student & staff

accounts Create student login tickets Monitor test progress Generate reports

Page 12: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

12

Page 13: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Assign Proctor /Teacher (with ONLY proctor rites)

O Log into the MP website &click “Go to Training DAS Site”

O Type USERNAME & PASSWORD

O Click “Manage”& then “Staff Accounts”

Page 14: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

✤ Enter user name (CANNOT CHANGE THIS), password (6 letters/numbers), email

✤ Click “Tests” button & choose the tests they can proctor

✤ Click “Groups”& choose the groups they can proctor

✤ Select the “Role” as Administrator or Proctor from the drop down arrow

Assign Proctor /Teacher (with ONLY proctor rites)

Page 15: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

✴ Click “Edit” (it will change to Update/Cancel)✴ You can change any info here except the username✴ When you are done click “Update” to your left

Edit Teacher/Proctor

Page 16: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Manage Student Data

O Select “Student List”

O Select “Grade” on the right

O To Filter click icon

O To add select “Add Student”Reporting Groups

Page 17: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Add New Student/Test/Accommodations

O Click Add Student, add information, click “Validate Student.”

O Assign Testing Session, Name, Reporting Group, Participation Status for student in each subject.

O Click “ADD STUDENT & TEST”, then “CLOSE”

Page 18: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Adjust Student’s Participation (Pg. 18-19)

O Click “View” next to student’s name & then “Edit” by Testing Session. Enter changes

O Click “Update” at the bottom of the page.

Page 19: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

For non-standard participation select:O “Accommodated (IEP/LEP)”.Pg. 20)O “Private or Home School”O “Modified (IEP team)”

For non-participation select:O “Absent—Unable to make up test” O “Excused—Medical Emergency” O “Unknown Student” O “Officially withdrawn from class/school”O “ELL First Year in U.S. Before April 15”O “ELL First Year in U.S. April 15 or Later” O “Private or Home School non-participantO “Refused to Test (RT)” O “Utah Alternate Assessment (IEP Team)O “Paper-based”

Special Codes (TAM Pg. 22)

Page 20: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Special Codes (TAM Pg. 21)

English Language Learners

Page 21: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Manage Groups

O Click “Manage” and then “Reporting Groups.”

O To add group, edit alternate name, move students, or print tickets

Page 22: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Alternative name would be:

Ms. Jones 3 period Science

9+2 CACTUS ID + PERIOD

Period Elementary: always 01 Secondary: period #

Page 23: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Highlight student name

Click << or >> to move student across groups

Exit out by hitting red x in top right corner

Move StudentsX

Page 24: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

On the Navigation Bar, click on “Reporting” then “Monitor Test Progress”.

Select “Test Session”, and “Test” in the drop down.

CHOOSE the appropriate test.

Monitor Test Progress page

Page 25: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Choose “Group” from drop-down list

Click Progress or Receipt (explanation on next slide)

Click report type PDF, Excel, etc.

Click “Red Ticket” (example on slide 19)

Reports and Tickets

Page 26: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

PROGRESS

RECEIPT

Page 27: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Student Tickets (Pg.15)

Page 28: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Preliminary Score Reports

  Raw           (3/5)

Scale Score (160)

Ele. Language Arts   XEle. Math X  Ele. Science   XSec. Language Arts   XSec. Math   XSec. Science   X

Click on Reporting tab

Click on Preliminary Score Report

v

Page 29: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

II. Proctor Test

Workstation

(PTW)

CAN USE YOUR

ADMINISTRATOR’s LOGIN on

Proctor Test Workstation

Web application for administering

tests

Start, pause, and end test sections

Monitor student progress

Page 30: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

* Go to http://utah.measuredprogress.org

* Or go top right on DAS for PTW

* Type in your User Name/ Password then click, “Login”

Starting Test (Pg. 8)

Page 31: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Choose test (Pg. 9, 10, 16)

* WRITE “Test Access Code” ON THE BOARD

Page 32: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Teacher or Proctor: Monitor student progress (right side of screen).

O Teacher: From TAM (Teacher Administration Manual), read directions aloud. When finished, proctor OR teacher (if teacher is proctor) choose section (or all sections) and click “Go” button.

All sections

Test Coordinator/Teacher

Page 33: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

* Use “Pause Test” button in case of emergency (i.e., fire drill).

* 20 min. window from hit“Pause Test” until section

closes.

* If this happens, open new section to finish test.

Test Coordinator/Teacher

Page 34: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

When Section 1 completed, click next section in the test Navigation Window, then click “Go.”

When students have completed all sections of the test, click “End Session” button.

Test Coordinator/Teacher

Page 35: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

For live sessions, please print

these receipts & keep secure at

your school

Hit Done to finish.

Proctor/Teacher

Page 36: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Submitting Tests for Scoring

O When ALL sections are finishedO Go to “Reporting”O Click on “Monitoring Test Progress”O Select correct “Test Session” & “Test”

O Check beside students’ tests to be submitted

O Click “Submit”

Page 37: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

SCREEN READER accommodation

REMEMBER:

MUST ADD THIS ACCOMMODATION (number 5)!

MUST HAVE STUDENTS PRACTICE!

MUST BE IN STUDENT’S IEP or 504 PLAN!

Page 38: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

SCREEN READER accommodation

Student clicks green play button.

Places cursor at beginning of the sentence to read (double-click).

Reader will keep reading until play is hit or there is no more text.

It does not work on reference sheet.

Play button

Page 39: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

III. Student Test Workstation

(STW)

Web application for accessing test

content.

Students answer questions using

mouse and/or keyboard.

Secure application so other

programs cannot be accessed.

Answers automatically saved when

student selects the NEXT button.

Page 40: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Click on icon

Type in student Ticket login/ password and click the“Login” Button.

✦ Write “Test Access Code” on the board, and click “Start Test” button.

✦ Not case sensitive.

✦ Teacher reads prompt. When finished, student selects “Complete” then “Close.”

STUDENT (Pg.14)

Page 41: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

NEW TO THIS YEAR!!Test Administration Manuals

O There is NOW a POLICY & PROCEDURE TAM for administration help. The Training PPT’s page numbers (on slides) come from this TAM.

O The TEACHER’s PROMPT is in the specific COMPUTER ADMINISTRATION SUBJECT SPECIFIC TAM!!

O All TAMS are on the DAS and http://computerbasedtesting.wikispaces.com/

Page 42: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

EXAMPLE STUDENT TEST PAGE

Page 43: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

O Highlighter

O Strike Through

O Erasure

O Pointer

EXAMPLE:

STUDENT TEST QUESTION (Pg. 17)

Page 44: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Set Flag (to mark a question for later review)

Test Map (to show what questions have been answered)

Previous Button

Next Button

Text & background color choices

Font size choices

Stop button

STUDENT TOOLS (Pg. 17)

Page 45: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Reference Sheets (Math & Secondary Science)

Math Tools

Ruler

Protractor

5-Function calculator (+,-,x,√,÷)

Science Tool

5-Function calculator (+,-,x,√,÷)

STUDENT TOOLS

Page 46: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Test Coordinator

Responsibilities

Page 47: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Test Coordinator Responsibilities Outline

O Oversee all aspects of computer-based testing.

O Ensure that all policies/procedures are carried out.

O Ensure user names set up for the DAS (to manage student data, view reports) and/or PTW (to give CRTs).

O For Test Coordinators/Teachers, ensure user names have been assigned to administer identified CRTs.

O Compile documentation concerning unique student circumstances that affect testing.

Page 48: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Test Coordinator Responsibilities Outline

O Mark special codes, submit tests for scoring, and download Preliminary Score Reports. Refer to p.22 for details.

O Make sure Preliminary Score Reports are checked so all students are tested and that special codes are accurately marked.

O Ensure that all students are either submitted for scoring or have an appropriate nonparticipation code marked.

Page 49: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

Test Coordinator Responsibilities Outline

O Make sure:

O Student Login Tickets printed

O provide Test Access Codes

O Start and stop sessions

O Document any situations that affect testing (e.g., fire drills, technical issues).

O Call Jami-Jon 801-826-5134, Measured Progress 877-934-8378, or Cindy Perry 801-826-5029 to resolve issues with testing.

Page 50: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

PROCTOR Responsibilities (Pg. 13): Test Coordinator or Teacher

(Teachers need to be certified)

O Actively proctor testing.

O Follow all requirements outlined in the TAM.

O All tests submitted for scoring.

O only after all sections finished.

O Work with Ed Tech to resolve computer problems.

O Work with Test Coordinator/teacher for make-ups.

Page 51: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

CRT Roles & Responsibilities:

Page 52: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

O Principal, Test Coordinator, & Ed. Tech:

O Set up lab testing schedule

O Test Coordinator:

O All student icons clicked & ready to click (LIVE or TRAINING) site

O Add or modify staff/student accounts, special codes

O Print tickets & give teacher to hand out

O Submit tests for scoring

O Teachers:

O Open Proctor Test Workstation

O Choose test & write TEST ACCESS CODE on board

O Start test (choose Test Section & click GO) & End section

O Print Scoring Submission receipt & return to Test Coord.

Recommended Option 1

Page 53: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

2012 Test Coordinator Tips for CRT SuccessO STUDENTS

O All students are sent through CBT training only once.O Either science or math (recommended).

O TEACHERSO One big “teacher training” three weeks before live

CRT testing.O Give teachers login & password (use colored paper).O Mini-training to teachers on Friday prior test next

week.O All veteran teachers are paired up with new teachers.O Test coordinator goes to teachers the morning before

live testing, making sure computers are ready to go, etc.

O SUBJECTSO Each subject is tested in one week. O Each subject rotates each year on who is 1st, 2nd, 3rd.

Page 55: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

55

Pop Quiz: Question 1

O What do you do if you forget your log-in and/or password?

Page 56: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

56

Question 1: Answer

O Check your email

O Have someone else login & go to “Manage”

and “Staff Accounts”

O Call/email: Jami-Jon Pearson (801) 826-5134

[email protected]

Measured Progress 1-877-934-8378 [email protected].

Cindy Perry (801) 826-5029 [email protected]

Page 57: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

57

Question 2

O What must you do to start the test for

students?

Page 58: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

58

Question 2: Answer

O On PTW, click on the Section you want to give and then click GO.

Page 59: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

59

Question 3

O What do you do if there are no students

listed on the PTW?

Page 60: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

60

Question 3: Answer

O Click GO and wait for students to begin answering questions.

Page 61: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

61

Question 4

O After the last student is finished, what do you

do?

Page 62: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

62

Question 4: Answer

O Hit “End Session” OPrint Scoring Submission Receipt

and give to Test Coordinator.

Page 63: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

63

Question 5

O Do you return the testing logs provided prior administration?

Page 64: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

64

Question 5: Answer

O NO

Page 65: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

65

Question 6

O Do students with IEP or 504 for

SCREENREADER have to practice before the

live test?

Page 66: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

66

Question 6: Answer

O Yes. It is critical that the students can

customize the test.

Page 67: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

67

Question 7

O Where do you get the TEST ACCESS CODE and what do you do

with it?

Page 68: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

68

Question 7: Answer

O The TEST ACCESS CODE is given on the PTW when a testing section is

opened.

O It is written on the board for students to use to get into their test.

Page 69: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

69

Question 8

O What is the process in printing tickets?

Page 70: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

70

Question 8: Answer

O On the DAS site (2 options):

O Go to MANAGE-reporting GroupsO Go to REPORTING – Monitor Test

Progress (recommended)

Page 71: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

71

Question 9

O Who’s responsibility is it to submit tests?

Page 72: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

72

Question 9: Answer

O Test Coordinator. The Test Coordinator working with

the principal is responsible for 100% tested or marked

non-participant.

Page 73: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

73

Question 10

O What do you do if you enter a new student

and no SSID is found?

Page 74: CRT Training 2011-2012 Jami-Jon M. Pearson, Ph.D. Research & Assessment Coordinator Canyons school District.

74

Question 10: Answer

Email Cindy Perry [email protected]