Florida Department of Education John L. Winn, Commissioner Test Chairpersons Training March 26, 28,...
-
Upload
ruth-bridges -
Category
Documents
-
view
214 -
download
0
Transcript of Florida Department of Education John L. Winn, Commissioner Test Chairpersons Training March 26, 28,...
Florida Department of Education
John L. Winn, Commissioner
Test Chairpersons TrainingMarch 26, 28, and 29
Spring 2007 Comprehensive English Language Learning
Assessment (CELLA)
Florida Department of Education
John L. Winn, Commissioner
TRAINING OBJECTIVES
• Learn general information about the design and administration of CELLA and its uses
• Learn how to train test administrators to administer the CELLA group sessions
Florida Department of Education
John L. Winn, Commissioner
WHY ADMINISTER CELLA?
• CELLA measures the growth of students classified as English Language Learners (ELLs) in mastering the skills in English they will need to succeed in school
• CELLA provides evidence of program accountability in accordance with Title I and Title III of NCLB
Florida Department of Education
John L. Winn, Commissioner
Monitoring student progress over time Placement into, or exit from, English
for Speakers of Other Languages (ESOL) programs
Identifying students’ strengths and weaknesses in English
Results will NOT be used for Grade level placement Promotion or Retention decisions
HOW WILL THE RESULTS FROM CELLA BE USED?
Florida Department of Education
John L. Winn, Commissioner
WHAT’S NEW FOR 2007?
• 2007 Test Administration Manual (TAM) Revised to eliminate duplication of information.
• 2007 Directions for Administration (DFA) and Scoring Guides.
All levels (A-D) are included in one secure DFA.
• Answer sheet improved.• Supplemental order form revised.• Level A2 Reading/Writing cover
redesigned to avoid errors in administration.
Florida Department of Education
John L. Winn, Commissioner
CELLA SCHEDULE OF ACTIVITIES
January 12 Student identification information for ESOL students is submitted.
March 26, 28 and 29 CELLA training sessions for Test Chairpersons.
April 9-13 CELLA testing materials are delivered to schools via Comet Delivery Services.
April 16 – May 25 CELLA testing window.
Florida Department of Education
John L. Winn, Commissioner
CELLA SCHEDULE OF ACTIVITIES CONTINUED
April 16 - 20 Recommended window for CELLA group administered sessions in all senior high schools.
April 23 - 27 Recommended window for CELLA group administered sessions in all elementary, middle and K-8 centers.
April 30 – May 4 CELLA group-administered make-up sessions.
May 14 – May 25 OPEN window for return of CELLA testing materials to TDC.
May 29 and 30 Final return of CELLA testing materials to TDC.
August CELLA score reports provided to schools.
Florida Department of Education
John L. Winn, Commissioner
STUDENTS TO BE TESTED
• All students classified as ESOL at the time of CELLA testing are to be tested.
• All new students who respond affirmatively to the Home Language Survey must be assessed for English language proficiency using the OLPS within 20 days of entry to the district.
• (New) Any ESOL students who were exited from the ESOL program as of August 18, 2006 (classified as former Limited English Proficient (LEP)), must be included in the spring 2007 administration.
Florida Department of Education
John L. Winn, Commissioner
ESOL STUDENTS EXEMPTED FROM TESTING
• Students entering the school district on or after March 12, 2007 with affirmative responses to the Home Language survey would not be included in the Spring 2007 administration, even though the OLPS and placement may be completed prior to the end of the testing window.
• The 20-day requirement for assessment English language proficiency is waived for the period between March 12, 2007 and May 25.
Florida Department of Education
John L. Winn, Commissioner
OVERVIEW OF CELLA
Test Levels:Level A (Grades K-2)Level B (Grades 3-5)Level C (Grades 6-8)Level D (Grades 9-12)
Test Sections and Formats:Listening: Multiple Choice (MC)Speaking: Constructed Response (CR)Reading: MCWriting: MC and CR
Florida Department of Education
John L. Winn, Commissioner
TEST DOCUMENT CONFIGURATIONON GRADE LEVEL – ALL SECTIONS
Grade Level Test Materials
Kindergarten and Grades 1 & 2 • Level A Student Test Book
Grades 3, 4, and 5 • Level B Listening & Speaking Test Book• Level B Reading & Writing Test Book• Level B, C & D Answer Sheet
Grades 6, 7, and 8 • Level C Listening & Speaking Test Book• Level C Reading & Writing Test Book• Level B, C & D Answer Sheet
Grades 9, 10, 11 and 12 • Level D Listening & Speaking Test Book• Level D Reading & Writing Test Book• Level B, C & D Answer Sheet
Florida Department of Education
John L. Winn, Commissioner
TEST BOOKLET CONFIGURATIONON GRADE LEVEL – ALL SECTIONS
Level A: Grade K - 2
Level B: Grades 3 - 5
Level C: Grades 6 - 8
Level D: Grades 9 - 12
Florida Department of Education
John L. Winn, Commissioner
CELLA TEST SECURITY
• All CELLA testing materials are to be secured.
• Test administrators must account for ALL test materials assigned to them.
• Test administrators must sign the Florida CELLA Administration and Security Agreement
Florida Department of Education
John L. Winn, Commissioner
DETERMINING TEST LEVELS TO BE USED
Listening and Speaking: ESOL Levels 1-4 MUST be administered on grade level to ALL ESOL students in grades K-12
Reading and Writing: ESOL Levels 3-4On grade level for ALL ESOL
students in grades K-12Exception: a small number Special
Education (SPED) students Reading and Writing: ESOL Levels 1-2
Grades 3-12, test at 1 lower level.
Florida Department of Education
John L. Winn, Commissioner
DETERMINING LEVELS TO BE USEDCONTINED
• Example: An ESOL Level 1 student in grade 5 will take Level B, Listening and Speaking and record all answers in the Level B, C, and D Answer Sheet. The student must take the Level A Reading and Writing test, recording all responses in the Level A Reading and Writing
test book.
andand
Florida Department of Education
John L. Winn, Commissioner
CELLA TEST LEVELSFUNCTIONAL LEVEL TESTING
Grade Level ESOL Level Reading/Writing Level
Speaking/Listening Level
K-2 ALL A A
3-51-2 A
B3-4 B
6-81-2 B
C3-4 C
9-121-2 C
D3-4 D
Florida Department of Education
John L. Winn, Commissioner
LOCATOR TEST
• Will ONLY be used for some SPED students in ESOL Levels 3 and 4
• Testing the Reading & Writing sections at the student’s functional level
• Allows ESOL Level 3 and 4 SPED students in grades 3-12 to take a lower level if their literacy skills are at a more basic level
• The Locator Test can be used to determine which level is appropriate
Florida Department of Education
John L. Winn, Commissioner
LOCATOR TESTCONTINUED
Only for some SPED students in ESOL Levels 3 and 4
Directions for Administration
Locator Test Booklet
Florida Department of Education
John L. Winn, Commissioner
CONTACT INFORMATION
• For specific questions concerning the locator test and your SPED students ESOL Levels 3 or 4, please contact the Division of Special Education, at 305 274-8889.
Florida Department of Education
John L. Winn, Commissioner
CELLA ITEM TYPES LISTENING AND SPEAKING
Listening:• Listen & Match• Picture Description• Short Talks• Extended Listening
Speaking:• Oral Vocabulary• Speech Functions• Personal Opinion• Story Retelling• Graph Interpretation
Florida Department of Education
John L. Winn, Commissioner
CELLA ITEM TYPES READING
Vocabulary:• Synonym• Antonym• Idiom• Root & Affix
Comprehension:• Main Idea• Detail• Inference/Prediction• Reference• Rhetorical Elements• Vocabulary in Context
Florida Department of Education
John L. Winn, Commissioner
Multiple Choice:• Grammar, structure
& written expression
• Paragraph choices• Recognizing errors
CELLA ITEM TYPESWRITING
Constructed Response:• Writing sentences• Writing paragraphs
Florida Department of Education
John L. Winn, Commissioner
LEVEL A MATERIALS• Two Test Book Forms:
Level A Student Test Book, including the Core and the Extension (orange in color): Grades K-2 students
Level A Reading/Writing Book (green in color):Grades 3-5 ESOL levels 1-2 for functional level testing only
• Level A Listening and Speaking CD
• Directions for Administration and Scoring Guide Book
Level A section begins on page 5
Florida Department of Education
John L. Winn, Commissioner
ADMINISTERING LEVEL A
• All sessions should be individually administered to students in kindergarten.
• One-on-One (Speaking) is administered individually at all grade levels
• Grades 1 and 2 may take Listening, Reading and Writing in small groups.
• Grade 2 will take the “Extension Section” which includes additional items in Reading and Writing.
Florida Department of Education
John L. Winn, Commissioner
CELLA Sessions Level A Grades K-2
Grade
Listening Reading WritingOne-on-
One (Speakin
g)
K
15 Questions(approx. 15
minutes)Individually
Administered
CD required
15 Questions(approx. 15 minutes)
IndividuallyAdministered
7 Questions(approx.15 minutes)
IndividuallyAdministered
21 Questions(approx.15 minutes)
IndividuallyAdministered
1st
15 questions(approx. 5 minutes)
Administered in small groups
CD required
15 questions(approx. 15 minutes)
Administered in small groups
7 questions(approx. 15
minutes)
Administered in small groups
21 Questions(approx. 15
minutes)
Individually administered
2nd
15 questions(approx. 15
minutes)
Administered in small groups
CD required
25 questions(approx. 35 minutes)
Administered in small groups
16 questions(approx. 30
minutes)
Administered in small groups
21 Questions(approx. 15
minutes)
Individually administered
Florida Department of Education
John L. Winn, Commissioner
LEVEL A LISTENING
• The Listening section is divided into three parts and is paced by a script that can be delivered in 2 ways:
Recorded Delivery: playing the CD
Administrator Delivery: reading the
script aloud
Approximate testing time is 15 minutes.
Florida Department of Education
John L. Winn, Commissioner
Level A Reading
Core Level A items (1 – 15) are delivered by script and read aloud by the test administrator.
Approximate testing time is 15 minutes.
Extension Level A items (16 – 5)administered in Grade 2 only contain reading comprehension passages that are completed by the student independently.
Approximate testing time for both the Core and Extension is 30 minutes.
Florida Department of Education
John L. Winn, Commissioner
Level A Writing
Core Level A items (1-7) will take approximately 15 minutes to complete.
Extension Level A items (8-16) administered in Grade 2 only contains editing tasks and prompts to write sentences and paragraphs. Approximate testing time for both the Core and the Extension is 30 minutes.
Florida Department of Education
John L. Winn, Commissioner
When to use Level A Reading/Writing Test Booklet
• ESOL level students 1 and 2 in grades 3-5 will a need a Level A Reading and Writing Test Book
• These students will also need a Level B Listening and Speaking Test Book and a Level B-D Answer Sheet
Florida Department of Education
John L. Winn, Commissioner
Level B-D for Grades 3-12
Individually Administered:Speaking
Group Administered:ListeningReadingWriting
Florida Department of Education
John L. Winn, Commissioner
MATERIALS: LEVEL B-D
• B-D Answer Sheet
• Directions for Administration and
Scoring Guide Book
• Listening/Speaking Test Booklets for B,
C, and D
• Reading/Writing Test booklets for B, C,
and D
• Listening CDs for B, C, and D
Florida Department of Education
John L. Winn, Commissioner
CELLA SESSIONS LEVELS B-D GRADES 3-12
Levels Listening Reading* Writing*
One-on-One (Speaking)
BGrades
3-5
22 Questions(approx. 25
minutes)
CD required
26 Questions(approx. 45 minutes)
Administered in groups
25 Questions(approx. 70
minutes)
Administered in groups
14 Questions(approx.15 minutes)
IndividuallyAdministered
CGrades
6-8
22 questions(approx. 25
minutes)
Administered in groups
CD required
26 questions(approx. 45 minutes)
Administered in groups
25 questions(approx. 70
minutes)
Administered in groups
13 Questions(approx. 15
minutes)
Individually administered
DGrades
9-12
22 questions(approx. 25
minutes)
Administered in groups
CD required
26 questions(approx. 45 minutes)
Administered in groups
25 questions(approx. 70
minutes)
Administered in groups
13 Questions(approx. 15
minutes)
Individually administered
* DROP DOWN ONE LEVEL FOR ESOL LEVELS 1-2
Florida Department of Education
John L. Winn, Commissioner
ADMINISTERING LISTENING AT LEVELS B-D
Grade Levels: 3-5 (B)6-8 (C)9-12 (D)
• Test design is identical across levels for Listening
• Listening is all multiple-choice
Florida Department of Education
John L. Winn, Commissioner
LEVEL B-D LISTENING
• Divided into four parts• Script contains all of the test items
to which students must respond.• Script can be delivered in two ways:
Recorded Delivery: playing the CDAdministrator Delivery: reading the
script aloud
• Approximate testing time is 25 minutes.
Florida Department of Education
John L. Winn, Commissioner
LEVEL B-D READING
• Divided into two parts:Part one: Students answer
discrete vocabulary questions.Part two: Students read
passages and answer questions about each passage.
• Approximate testing time for the Reading section is 45 minutes.
Florida Department of Education
John L. Winn, Commissioner
LEVEL B-D WRITING
• Divided into four partsPart one and Part two contain
multiple-choice questionsParts three and four require
students to write sentences and paragraphs, respectively
• Approximate testing time for the Writing sections is 70 minutes
Florida Department of Education
John L. Winn, Commissioner
IMPORTANT REMINDER
• Students in grades 3-5 who are ESOL 1 and 2 use two answer documents:
• Level B Listening/Speaking answers will be recorded on the level B, C, and D Answer Sheet.
• BOX #22 of the answer sheet must be bubbled YES.
• Level A Reading/Writing answers will be recorded directly in the test book.
• Labels ‘link’ the two answer documents
Florida Department of Education
John L. Winn, Commissioner
IMPORTANT TEST ADMINISTRATION DETAILS
• Do not allow the students to use any extra paper or scratch paper.
• Only answers written in the spaces provided will be scored.
• All responses must be recorded with a No.2 pencil.
• If a student makes an error, ensure that they have erased it completely (do not use correction fluid).
• Thesauruses, dictionaries, or similar tools are not permitted.
Florida Department of Education
John L. Winn, Commissioner
Student Pre-ID Labels• Students entering after January 12,
2007, will not have pre-id labels. • Each student will have 3 pre-id labels
– Used to ‘link’ multiple answer documents if necessary
• The following information must be correct for a label to be used:
• Name, (First and Last)• Date of Birth• Grade• School• District
Florida Department of Education
John L. Winn, Commissioner
Incorrect or No Pre-ID Labels
If a student does not have a label, OR
If any of the printed information is incorrect, so that the label cannot be used,
THENAll demographic information must be bubbled in on the answer document.
Page 20-22 of the Test Administration Manual provides information on bubbling in the demographics information. All fields must be filled out.
Florida Department of Education
John L. Winn, Commissioner
LINKING LABELS
Required for: • ESOL level 1 and 2 students in grades 3-5; • Taking the Level A Reading and Writing; and
Level B Speaking and listening, and • Did not receive a Pre-ID label.
• Linking labels ensure the accurate match of the student’s two answer documents
• If such a student DOES have Pre-Id labels, use those instead.
Florida Department of Education
John L. Winn, Commissioner
SPECIAL ADMINISTRATIONS
The Division of Special Education, 305 274-8889, will provide assistance with questions concerning:
– Special accommodations and test administrations issues regarding
(Braille, large-print, deaf, and hard-of-hearing)
Reminder: No Braille version of Level A Test Books. CELLA will not be
administered to these students
Florida Department of Education
John L. Winn, Commissioner
DAMAGED OR SOILED ANSWER DOCUMENTS
School Coordinator transcribes the information from the damaged answer document onto a new document.
Mark the damaged documents with a large ’X’. Return damaged answer documents with the brown “Not To Be Scored” boxes.
Bundle the new transcribed answer document with the other “To Be Scored” materials for that grade.
Florida Department of Education
John L. Winn, Commissioner
Soiled Answer Documents
For soiled materials, call Student Assessment and Educational Testing at 305 995-7520. Provide the serial number, then destroy the soiled document.
Florida Department of Education
John L. Winn, Commissioner
Test Administration Irregularities
• Examples which may require invalidation upon completion of a full investigation:– Student(s) caught cheating– Student(s) very disruptive– Fire alarm or similar event occurs during the testing
session– Student becomes ill and is unable to finish– Student is removed by a parent prior to the end of the
allotted time for testing– Administration time limited (No CELLA sessions have
time limits)
• Each circumstance should be treated individually. – Call Student Assessment and Educational Testing,
(SAET) and report any such irregularities– If the incident involves a test security violation, a
written memorandum to SAET will also be required.
Florida Department of Education
John L. Winn, Commissioner
2007 Florida CELLA Test Irregularities Report Form
•Appendix A
This form should be used to report any security violations, misconduct, or other incidents.
Place all completed original forms inside on top of the first white box.
•
Florida Department of Education
John L. Winn, Commissioner
SCHOOL COORDINATOR ROLESMANAGE MATERIALS
Receipt of Materials Keep all boxes in which materials arrived. Request additional materials from TDC as soon as possible. Remove the shipping notice from Box 1. Verify the quantity of each item received.
Track Materials Ensure an internal tracking system is used to track all test
materials Directions for Administration and Scoring Guide Secure Test booklets and answer sheets CDs
Count and verify materials distributed to and received from test administrators Always store all testing materials in a secure locked
location.
Florida Department of Education
John L. Winn, Commissioner
SCHOOL COORDINATOR ROLESPREPARE FOR ADMINISTRATION
Train Test Administrators for Group Administration– Ensure the appropriate number of test
administrators and proctors are available
– Ensure that test administrators understand their roles and are prepared prior to testing
Coordinate individual administration with contracted employees
Florida Department of Education
John L. Winn, Commissioner
SCHOOL COORDINATOR ROLESDURING TESTING
Testing Environment– Rooms used for testing should provide the following:
• Good lighting
• Comfortable temperature
• Proper ventilation
• Freedom from noise and interruption
• “Do Not Disturb --- Testing in Progress” sign on the door
Supervision of Test Administration and Test Security– Monitor group and individual administration
Florida Department of Education
John L. Winn, Commissioner
Test Administrator Roles & Responsibilities
• Prior to testing• Must appropriately account for and protect
the security of the test materials. Test administrators can use the CELLA security log or a school developed security log.
• Need to become familiar with the Directions for Administration and Scoring Guide.
• Must maintain a record of exemptions, absences and invalidations.
Florida Department of Education
John L. Winn, Commissioner
Test Administrator Roles & Responsibilities
Continued
• During the Test Administration
• Post “Do Not Disturb --- Testing in Progress” sign on the door.
• Must make sure students are on task.
• After Testing• Be sure to report any problems to
the school’s test chairperson and complete a Florida CELLA Irregularity Report if necessary.
Florida Department of Education
John L. Winn, Commissioner
RETURN OF CELLA MATERIALS
Please refer to the return instructions provided in the training packet ONLY.
To Be Scored • Bundle answer documents by grade level.• Bundle documents by type (test books separate from
answer sheets within grade) in grades 3-5 if applicable.• Place a Grade Header on the top of each grade.• Secure bundles with paper bands.• Place a School Header at the top of all grades in Box #1.• Place originals of all forms on top of the School Headers.
Florida Department of Education
John L. Winn, Commissioner
NEW RETURN NEW RETURN PROCEDURESPROCEDURES
• CELLA materials will be picked up at the school sites.
• Fill out the 2007 Florida CELLA School Coordinator Materials Return Form
• Fax copies to ETS at 1-866-387-2598and Student Assessment and Educational Testing at 305 995-7522
• Call Eagle Logistics at 1-800-888-4949 for pick-up
Florida Department of Education
John L. Winn, Commissioner
NEW RETURN NEW RETURN PROCEDURESPROCEDURES
• Package materials according to the instructions in your packet.
• However . . .
• Do not return materials to TDC as instructed in your packet.
• Disregard return instructions in the CELLA manual.
Florida Department of Education
John L. Winn, Commissioner
RETURN OF CELLA MATERIALSCONTINUED
Not To Be Scored• Organize materials in the following order:
– All Florida CELLA School Coordinator’s or Test Administrator’s Suggestion Forms,
– All CDs,– Test Administration Manuals,– Directions for Administration and Scoring Guide,– Unused Level A answer books,– Test Booklets (Levels B, C, and D),– Unused answer sheets,– Unused linking labels or pre-id labels,– Damaged materials (answer sheets or test booklets),– Invalidations (answer sheets or test booklets), and– Absences (answer sheets or test booklets).
Florida Department of Education
John L. Winn, Commissioner
RETURN OF CELLA MATERIALSCONTINUED
• Wrap like materials with paper bands.
Return all To Be Scored and Not ToBe Scored materials to TDC
Open Window: May 14 – 25Final Return: May 29 - 30
Florida Department of Education
John L. Winn, Commissioner
District Level Training Contact Information
CELLA Program Dr. Joanne Urrutia, Administrative Director, Division of Bilingual Education and World Languages, 305 995-1945
Individual administrations of One – on – One or Speaking Sessions
Ms. Beatriz Pereira, Executive Director, Division of Bilingual Education and World Languages, 305 995-7430
Group Administered Sessions
Ms. Mayda Cabeza, Director I,Student Assessment and Educational Testing, 305 995-7520 [email protected]
Test Materials Ms. Magaly Hernandez, Supervisor I, Test Distribution Center, 305 995-374313135 SW 26 Street, Miami Fl. 33175Hours of Operation: 7:30a.m. – 3:30p.m.
Special Accommodations for SPED students
Ms. Rosalia Gallo, Instructional Supervisor, Division of Special Education, 305 274-8889 or [email protected]