EOCEP FALL/WINTER 2015–16 STC & TA TRAINING TOOL Located on eDIRECT under Documents/Presentations...

1

EOCEP FALL/WINTER 2015–16STC & TA TRAINING TOOL

Located on eDIRECT under Documents/Presentations

2

Test Administration Manual

Please read the EOCEP Test Administration Manual (TAM) carefully. The information in this presentation is intended to supplement, not replace, careful reading of the TAM.

3

Table of Contents

TOPIC SLIDE NUMBER

Key Dates Slide 4

Resources Slide 5

What’s New or Changed Slides 6–9

Test Security Slides 10–25

Test Security Scenarios Slides 16–25

STC Responsibilities Slides 27–32

TA Responsibilities Slides 33–36

Monitor Responsibilities Slides 37–39

Online Testing Slides 40–55

Paper/Pencil Testing Slides 56–81

Materials Return Procedures Slides 77–81

Reports Slide 82

4

Key Dates

DATE DELIVERABLE

Oct. 7 Test Administration Manuals arrive in districts

Nov. 2 Online Testing Software, OTTs, and Tutorials available

Nov. 16 Test Setup available in eDIRECT

Nov. 16 Secure materials – shipment 1 – delivered to districts

Nov. 25 Precode labels delivered to districts

Nov. 30 – Jan. 27

STATE TESTING WINDOW

Dec. 16 Secure materials – shipment 2 – delivered to districts

Jan. 29 Last day to return materials

Feb. 1 – Mar. 25

ALTERNATIVE TESTING WINDOW

Mar. 4 Data files, ISRs, and rosters available on eDIRECT

Mar. 18 ISRs and student labels delivered to districts

5

Resources

Test Administration

Manual for Online and Paper/Pencil

Testing(October 7)

STC/TA Training Tool

(October 21)

Online Testing Technology

Training Presentation(October 21)

DRC INSIGHT Technology User

Guide(November 2)

Electronic Security Checklists and Packing Lists

(November 11)

6

What’s New or Changed

GENERAL Updated Course Names

Algebra 1--4114 Intermediate Algebra--4117 English 1--3024

Test session durations in TAM Test durations for 95th percentile shown on page 17.

Biology: 1.75 hours USCH: 1.75 hours Algebra: 2.5 hours English: 3 hours

Afternoon test sessions must be scheduled with sufficient time to allow students to finish testing in one day

7


ONLINE TESTING DRC INSIGHT Test Engine update

Version 6.0.X More information in INSIGHT Technology User

Guide and in Technology Training Presentation (updated for FW 2015-16)

Seating charts May be returned to the SC Project Team by

either email or mail

8


ONLINE TESTING, cont. Actions for IEP violations that occur during online testing

Please see page 8 in the TAM for new clarification. Procedures for Unlocking Tests

See page B-26 in the TAM for actions to take It is not necessary to contact the SCDE if locking and

unlocking occur in the same day. Seating Charts

Must be returned to the DTC Supplemental Instructions posted to eDIRECT DTCs may returned seating charts via email or mail

Materials returned via email must not contain personally identifiable information (PII).

9


PAPER/PENCIL TESTING Electronic security checklists only

Paper (triplicate) copies no longer provided

May be returned to the SC Project Team by either email or mail

10 Test Security

11

Test Security

Test procedures are standardized. Administration directions must be read

as written in the TAM. Pages 2-4 of the TAM provide a list of

violations that could result in criminal prosecution and/or disciplinary action to an educator’s professional certificate.

12

Test Security

Most EOCEP materials are secure. Test materials must be kept in secure,

locked storage when not in use. Secure materials must not be stored in a

room that has a copy machine or fax machine.

13

Test Security

During testing, a trained TA must be present at all times in the classroom or computer lab.

If the TA must leave the room before testing begins, the test booklets, answer documents, and/or online student test tickets and test rosters must be stored securely or kept with the TA.

TAs should not discuss test questions with students at any time.

School personnel must not read test items at any time.

14

Test Security Agreement Forms All school and district personnel who will

have access to secure test materials are asked to sign an Agreement to Maintain Test Security and Confidentiality form.

Test security forms should be signed and returned to the DTC after each person has participated in EOCEP training.

Updated test security forms are for EOCEP only.

15

Test Security Violations

If a test security violation is observed within a school, it must be reported to the STC or DTC as soon as possible.

The STC and/or DTC must complete a Test Security Violation Action Form.

Send the completed form to Kathryn Rhodes at the SCDE.

16

Test Security – Case 1

During an EOCEP small group administration, a student told the administrator that she had reviewed a question with her teacher, Ms. Greene, the previous day.

When questioned, Ms. Greene indicated that she had reviewed ten questions from the previous year’s test with her students. She remembered the questions were ones that her students had difficulty with on last year’s exam.

17


Several months before the test, Mr. Bright was given worksheets by another teacher. The teacher told Mr. Bright that the materials would help his students prepare for the EOCEP Algebra 1 test.

Mr. Bright copied the worksheets and gave them to the other Algebra teachers in his school. The teachers used the worksheets with their students to review for the EOCEP test.

After testing, one of the teachers noticed that one page of the worksheet had a footer that stated “EOCEP: Secure Test”.

18


Mrs. Cross picked up her son, Lane, from Poet High School on a day in which he had taken the EOCEP English 1 test. She asked Lane how he had done on the test. Lane told his mom that she didn’t need to worry because his teacher had helped him.

Lane said his teacher walked around the room during the test, looking over the student’s shoulders at their computer screens. Occasionally, the teacher would point to an answer on the screen indicating that Lane should change his answer.

19


Ms. Dixon was a first-year teacher administering EOCEP to her high school students. She seated her students in the media lab according to the seating chart she had made. She then read the directions and passed out the online test tickets.

Ms. Dixon wanted to administer the test properly. Even though she had attended a pretest training workshop, she felt uncertain about whether she had delivered the directions properly.

She went to the teacher next door to ask about administration directions.

20


Ms. Douglas was a compassionate teacher. She wanted all of her students to do well on the EOCEP Algebra 1 test. She walked up and down the aisles during testing to check student progress and give them a “pat” of encouragement.

At one point, she saw that Sheila was only on number 15 and noticed that the student was not feeling well. She asked the student, “Is your arm hurting you?” Sheila said yes, so Ms. Douglas helped Sheila to exit the online test and then she took Sheila to the nurse’s office.

21


Mr. Edwards, a teacher at Springfield High School, is very thorough. He wants to make sure that students get as many points as possible on the EOCEP.

During testing, as each student finishes, he asks them to go to the Review/End Test screen. If he sees a blank response, he instructs the student to return to the item and answer it.

22


The STC told Mr. Jones to check the roster to determine the accommodations Lindsay would need when taking the online EOCEP English 1 test.

During testing, Mr. Jones forgot to pass out headphones to students who needed oral administration. Toward the end of the testing session, the STC stopped by Mr. Jones’ room and noticed that Lindsay was not wearing headphones. The roster indicated that oral administration was specified in her Individual Education Program (IEP).

23


Ms. Carboni, the TA, directed the monitor, Mrs. James, to answer student questions during the EOCEP Algebra 1 test. When one student raised his hand, Mrs. James read the question and the four answer choices to him. The student did not have an IEP or 504 Plan and was not an ESOL/LEP student.

24


Ms. Ortlund, the Test Administrator, began to read the Online Administration Directions for the EOCEP Biology test.

She read the section informing students that they may not have any electronic devices but she did not collect the students’ cell phones, nor had she asked the students to place their belongings at the front of the room before the test. During the test, she saw a student pull his cell phone out of his pocket and appear to be photographing the computer screen.

25


In order to save time, Mr. Fatica decided to have his students practice the Online Tools Training (OTT) immediately before the actual test administration.

To be efficient, he handed out the student Test Tickets as soon as the students were seated. The class then began to work on the OTT as a group, openly discussing the practice items. Four students mistakenly used their test tickets to login to their actual tests during the OTT session. At the end of the practice session they had nearly completed the entire test.

26 STC, TA, & Monitor Requirements

27

School Test Coordinator Requirements

STCs must be: Certified employees of the district Knowledgeable about test security and testing

policies STCs must attend a training session

conducted by the DTC. STCs must read and understand policies and

procedures outlined in the TAM. STCs must read and sign the appropriate

Agreement to Maintain Test Security and Confidentiality form.

28

School Test Coordinator (STC) Responsibilities

STCs must notify students and parents of the testing schedule.

The testing schedule should be posted on the school’s website.

STCs must hold training sessions for TAs and monitors.

STCs must distribute and collect signed Agreement to Maintain Test Security and Confidentiality forms.

If online testing, STCs must read the INSIGHT Technology User Guide, available on eDIRECT.

29

School Test Coordinator (STC) Responsibilities

Inventory test materials. Record any missing materials on the School

Security Checklists. Notify the DTC if any secure materials are:

damaged; missing; or if any additional materials are needed.

Note: Algebra reference sheets and graph paper are not provided in hard copy for online testers.

30

Handling Secure Materials

Store in a secure location. Prepare test materials for distribution. Distribute test materials to TAs on the

day of testing only.

31

Security Checklists

Paper security checklists will no longer be provided.

Electronic copies will be available on eDIRECT.

STCs email security checklists to their DTC.

An additional instructional document for using electronic security checklists is available in the eDIRECT documents.

32

STC Procedures During Test Administration

Ensure TAs receive all secure test materials they will need to administer the exam.

Make sure TAs receive reference sheets, graph paper, and other supplemental materials, if applicable.

33

Test Administrator Requirements

A TA must meet one of the following criteria: Certified employee Critical needs teacher Substitute teacher Certified teacher with an expired teaching

certificate Non-certified employee approved by the DTC

Attend a training session. Sign the Agreement to Maintain Test

Security and Confidentiality form.

34

TA Responsibilities Before the Test Administration

Read the Test Administration Manual. Understand all policies and procedures.

Make sure the classroom is ready for testing.

Assist with the coding of answer documents, if applicable, for paper/pencil testing.

Create a seating chart for each online test session.

35

TA Responsibilities During the Test Administration

Collect all prohibited electronic devices, or preferably, ask that students place their book bags and other belongings together at the front of the testing room.

Hand out student test tickets or test booklets and answer documents.

Follow the Administration Directions in the TAM. Ensure students are following the directions. Collect student test tickets or test booklets and

answer documents.

36

TA Responsibilities After the Test Administration

Complete answer document demographic information, as needed.

Place Braille materials into the plastic bag.

Sign in secure materials on the School Security Checklist.

37

Monitor Requirements

Use of monitors is recommended, and monitors must be trained.

Monitors must sign an Agreement to Maintain Test Security and Confidentiality form.

Monitors cannot be in rooms where their close relatives are being tested.

Monitors must not be left in charge of a test administration session.

38

Monitor Responsibilities

Distribute and collect test materials. Ensure students receive the correct answer

documents. During testing, ensure students:

Follow directions Mark their responses in the appropriate area of

the answer document Use only the allowable supplemental materials

specified in the TAM Do not give or receive help to or from other

students

39

Monitor Responsibilities

Help maintain test security. Refer all student questions to the TA. Check restrooms for reference materials

such as books or notes. Retrieve additional test materials from

the STC if needed during testing. Serve as a messenger between the TA

and the STC.

40 ONLINE TESTING

November 2 INSIGHT Software and TSM Updates Online Tools Training (OTT)Tutorial

November 16 Test Setup Available

November 30 – January 27

State Testing Window

February 1 – March 25 Alternative Testing Window

41

Online Testing

SEATING CHART Required for each online test session Include test session name, TA name, all student

first initials and last names, and seating locations Can be created using graph paper or other paper PowerPoint seating chart creator available on

eDIRECT Secure material; must be returned after testing STCs send completed seating charts to DTCs;

DTCs send via email or mail to SC Project Team

42

Online Testing– Training & Support

TUTORIAL Available via eDIRECT (no login required) Link available on INSIGHT homepage Includes audio narration Guides TAs and students through testing

experience, including testing tools and navigation

Highly recommended to be used prior to Online Tools Training (OTT) May be used in a large-group setting

43


ONLINE TOOLS TRAINING (OTT) Available within INSIGHT software

Regular and oral administration (HVA) versions available for all subjects

Public version available: https://wbte.drcedirect.com/SC/portals/sc Does not include audio for oral administration

Simulates the student testing experience Correct answers and scores not provided

Technology enhanced item types included for Algebra, English and Biology.

There are no TE items on the Fall/Winter Biology test, but they will be field tested in the spring.

Highly recommended that students review as much as needed prior to testing; opportunity to become familiar with online testing tools and functionality

https://wbte.drcedirect.com/SC/portals/sc

44


TAM – TEST SETUP (eDIRECT) Includes instructions and screen shots for

managing testing Student – profiles and demographic information Teachers Test Sessions Print rosters and test tickets Monitor testing

45

Precode

All student records from the precode update file will be loaded into eDIRECT and placed into a test session.

Students testing online Demographic information may be modified in eDIRECT

Students testing paper/pencil No action is needed in Test Setup Students do not need to be removed from test

sessions Paper/pencil testers can be changed to online

testers New students can be added, as needed

46

Prepare for Online Testing

Read the Test Administration Manual for Online and Paper/Pencil Testing

Read the INSIGHT Technology User Guide Schedule sessions for students and test

administrators to view the Tutorial Schedule sessions for students to use

the Online Tools Training (OTT) OTT sessions must be separate from and

prior to the operational testing session.

47

Online Testing Accommodations

ONLINE ACCOMMODATION

FEATURES

Oral Administration • Human Voice Audio (HVA) for directions, items, and passages (same audio as CD-ROM)

• Text-to-Speech (TTS) for tools and Help content

• Schools must provide headphones

Loose-Leaf • Same as regular Form A test• Paper test booklet also provided

Loose-Leaf + Oral Administration

• Same features as oral administration; student must also have loose-leaf accommodation


48

Online Testing Accommodations

ONLINE ACCOMMODATION

FEATURES

Large-Print • Fully scalable; students can view items in larger format by testing at workstation with larger monitor

• Same scaling of items using a 20-inch monitor versus a standard 15-in monitor

Large-Print + Oral Administration

• Same features as oral administration; student must also have large-print accommodation


Sign Language • Same Form C test a paper/pencil student would receive

• Video Sign Language (VSL) for ASL and PSE is not available for Fall/Winter 2015-16.

49

Human Voice Audio (HVA)

When audio is playing (stop/starting points/pause):

When audio is not playing (stop/starting points/play):

NOTE: DRC has identified some audio playback issues on DRC-certified Android devices. Therefore, DRC does not recommend HVA testing using Android devices at this time.

50

Test Setup – Rosters & Tickets STUDENT TEST ROSTER

Contains form number and username/password assigned to each student

Can be exported to Excel spreadsheet Should be used as security checklist to sign

in/sign out test tickets Secure material – must be distributed,

collected, accounted for, and securely destroyed following testing May not be transmitted via email or insecure fax

51

Test Setup – Rosters & Tickets STUDENT TEST TICKETS

Generated automatically Contain all login information needed to begin

testing Passwords are case sensitive

STC or TA prints tickets and roster prior to testing TA verifies that each student has the correct ticket Tests activated once a student logs in with

username and password printed on ticket Stagger logins to help avoid login issues due to

bandwidth Secure material – must be distributed, collected,

accounted for, and securely destroyed following testing

52

Test Setup – Tickets

53

Regenerating a Test

AUTOMATED PROCESS If a student’s accommodations are updated,

the ticket will be automatically updated, if needed.

eDIRECT message will tell user if a new ticket needs to be printed.

If accommodations are updated for a student who has started testing the ticket will not automatically regenerate. STCs should contact the DTC for any students who

start testing without the appropriate accommodations.

54

Restarting a Test

Students can “Pause” and then have 20 minutes to resume testing If student does not return within 20 minutes, student

can log in later the same day using the same test ticket Student responses, sticky notes, highlighters, flags,

and cross-offs will be saved A test may be exited due to inactivity (fire, drill,

student left without clicking “Pause”) If student does not return within 20 minutes, student

can log in later the same day using the same test ticket Student responses, sticky notes, highlighters, flags,

and cross-offs will be saved

55

Restarting a Test, continued

If the student does not resume testing that day, contact the SCDE and SC Project Team for approval to have the student’s test unlocked (see page B-26 of the TAM for scenarios and actions to take).

If a student submits a test by mistake: If testing is to resume the same day, contact the SC

Project Team to have the student’s test unlocked. If testing is to resume a different day, contact the

SCDE for approval to unlock the student’s test. Then contact the SC Project Team to have the test unlocked.

56 PAPER/PENCIL TESTING

December 1 – January 28

State Testing Window

February 2 – March 27 Alternative Testing Window

57

Test Booklets and Answer Documents

Students receive the following materials: One answer document for each subject One test booklet for each subject Customized test booklets, if required

58

IEP/504 Plan Accommodations

Setting Timing Scheduling Presentation (See Appendix C in TAM for additional

information)

59

IEP/504 Plan Accommodations,continued

Response Options Nonverbal indication of answer choices Dictation of responses Braille response options Responding in the test booklet

Supplemental Materials and Devices See TAM Appendix C for additional

information

60

ESOL/LEP Students

Accommodations Bilingual dictionary Reward and/or translate directions Oral administration (Algebra, Biology, and

U.S. History) Individual or Small Group

Administration/Setting Timing

See TAM Appendix D for additional information

61

Materials – Form A

REGULAR FORM A Test Booklet Answer Document Oral Administration Script

Use with base form (form number ends in zero) of Form A TB when oral admin is identified in IEP

Audio CD-ROM Use with base form of Form A TB when oral

admin is identified in IEP PC-compatible

62


LOOSE LEAF Test Booklet

Algebra, Biology, USHC – one question per page English – passage over multiple pages; multiple

items per page

Answer Document Not included in the test packet Answers must be recorded in an answer document

for scoring Oral Administration Script or Audio CD-ROM

Can be used with loose leaf test booklet

63


LARGE PRINT Test Booklet

Algebra – reference sheet, large print ruler, and graph paper also included

Answer Document Not included in the test packets Answers must be recorded in an answer

document for scoring

Oral Administration Script or Audio CD-ROM Can be used with large print test booklet

64

Materials – Form C

SIGN LANGUAGE Test Booklet Answer Document

Not included in the test packet Answers must be recorded in an answer document

for scoring Sign Language DVD

Use with Form C TB when signed admin is identified in IEP

ASL and PSE available on the same DVD Use with DVD player or computer with DVD

capabilities

65

Materials – Form C

BRAILLE Test Booklet

Print and brailled versions Braille TA notes also included Algebra – braille reference sheet and braille ruler

included Answer Document

Not included in the test packet Student may use a braillewriter or other method. TA

transcribes responses into answer document. Braille Oral Admin Script/Braille Audio CD-ROM

Use with Form C TB when oral admin is identified in IEP PC-compatible

66

Response Options – Responding in the Test Booklet

Responding in the test booklet is an IEP/504 standard accommodation.

TA must transfer the student’s multiple-choice responses from the test booklet into the answer document.

Monitor must verify responses were recorded accurately.

TA codes the “Response Options” bubble in the IEP/504 Standard Accommodations box on page 1 of the answer document.

67

Administering the Test

Administration directions include information to be read to students. TAs must read aloud the test that is printed

in the shaded boxes. TAs and monitors should distribute

materials when indicated in the Administration Directions.

68

Administering the Test

Four sets of administration directions are provided in the TAM. Algebra 1/Mathematics for Technologies 2

(TAM pages 76-79) Biology 1/Applied Biology 2

(TAM pages 80-82) English 1

(TAM pages 83-85) United States History and the Constitution

(TAM pages 86-88)

69

Labeling Answer Documents – Precode Labels

Precode labels are produced for students who have their online testing flag set to “N.”

Coding the student’s name by hand onto the answer document is not mandatory, but is strongly recommended. Districts can check hand-coded information that

is reported on the data file. The contractor also uses hand-coded

information as a double check if answer document information needs to be researched.

Hand-coding is mandatory when a precode label is not used.

70

Labeling Answer Documents – Precode Labels

71

Answer Documents

One per subject – Form A and Form C testers Students must record responses in an answer

document If IEP allows student to respond in the test booklet,

the TA and monitor must transcribe responses into an answer document

PS# and Student State ID – start coding at left; leading zeroes not necessary

Do not open unused, shrink-wrapped packages TA INITIALS – added to front of answer

document Instructions in TAM for students to code TA initials

72

Coding Answer Documents

73

Coding Answer Documents

74

School/Class Header Sheet

Complete one for each class and subject area

Use leading zeroes for section number

Ensure Tested Schooland Reported SchoolSIDNs are valid

Instructions for coding are located on back of header

75

School/Class Header Sheet

Discrepancies and Issues – may affect 36-Hour reporting

Student Information System (SIS) Code

incomplete

Multiple subjects under a

single header

Invalid tested or reported school

SIDN

Instructional Activity Code does not correspond with the answer documents

under the header

76

Labeling Answer Documents – Do Not Score Labels

Apply Do Not Score Labels to: Used or mislabeled answer documents that the

contractor should not score. Do Not Score Labels are white and are printed

10 per sheet. Return answer documents with Do Not Score

Labels in boxes designated as “nonscorable”. Do NOT apply Do Not Score Labels on:

Unused overage answer documents (Do not open unused, shrink-wrapped packages of answer documents).

Answer documents with the IEP Invalidation bubble marked.

77

STC Return Procedures

Verify every answer document is hand-coded correctly.

Verify every header is hand-coded correctly. Teacher name SIDN(s) SIS Code Number of answer documents returned

under header sheet Use, sign, and return security checklists.

78

STC Return Procedures

Ensure headers are placed with corresponding answer documents.

Classes/subjects may be mixed within boxes.

Place all scorable materials in the plastic bag provided by DRC.

79

Packaging Procedures

Place all scorable test materials in plastic return bags provided by the contractor, seal the bags tightly, and place them in the scorable boxes.

Place all nonscorable test materials in the nonscorable boxes. (Plastic bags are not needed for nonscorable materials).

80


Fill any empty space in the boxes with crumpled paper or bubble wrap ensuring that testing material does not shift during transit. Make sure voids are filled to the top of the box.

Fold the outer flaps (with old shipping labels) in, exposing the A & B flaps.

81


Tape boxes securely by using three pieces of packing tape on BOTH the top and bottom. Overlap the tape, and make sure it wraps around the sides at least two inches.

82

Reports

36-hour Reports – Web view and CSV Email to district and school when updated

Electronic reports posted to eDIRECT Data Files Individual Student Reports Summary Reports Rosters

Reports from fall/winter 2014-15 removed on March 4

ISRs and student labels arrive in districts on March 18

EOCEP FALL/WINTER 2015–16 STC & TA TRAINING TOOL Located on eDIRECT under Documents/Presentations...

Documents

Transcript of EOCEP FALL/WINTER 2015–16 STC & TA TRAINING TOOL Located on eDIRECT under Documents/Presentations...