Colorado English Language Acquisition

(CELA) Test2010 AdministrationWelcome,

Bienvenido, chào mừng, & Добро пожаловать

• Office of Standards and Assessments• Office of Language Culture and Equity • CTB/McGraw Hill

Questions

Office of Standards and Assessments

Office of Language Culture and Equity

How do I administer the test? What test materials do I need? What labels do I use? How long will each session take? Processes for getting clean valid data.

Who must take the test? How do I identify students? What do I do with the results? Instructional guidance…. What does Language Proficiency mean? Now that I have the data…. What next ?

Policy and Instruction for English Language

Learners(ELLS)

Joanna Bruno, Office of Language Culture and Equity

Email: bruno_j@cde.state.co.usPhone: 303-866-6870

CELApro Administration CSAP Accommodations for ELLs

CSAPA Adaptations for ELLs

Liliana Graham, Office of Standards and Assessments

Email: graham_l@cde.state.co.usPhone: 303-866-6634

Policy and Instruction for Students with Disabilities

Dena Coggins,Exceptional Student Leadership Unit

Email: coggins_d@cde.state.co.usPhone: 303-866-6681

CSAPA, Standard and Nonstandard Accommodations for CSAP

Mira Monroe, Office of Standards and Assessments

Email: monroe_m@cde.state.co.usPhone: 303-866-6709

Colorado Student Assessment SystemOffice of Standards and Assessments

Achievement(Colorado Model

Content Standards)

College Entrance National and State Trends

EnglishLanguage Acquisition

(Colorado ELD Standards)

Colorado Student Assessment Program

Colorado ACT National Assessment of Educational Progress

Colorado English Language Acquisition Program

CSAP

CSAPA

COACT NAEP CELApro

CELAplaceOLC&E

On December 18, 2006 Colorado received FULL Approval from the USDoE for our

Standards and Assessment System

Core Assessment Team

Office of Standards andAssessments

Core Assessment TeamELA, SPED, CBLA, Trainers

CTB McGraw-Hill

District AssessmentCoordinator

Test Examiners

Communication Protocol

CELApro• Standardized Assessment

• Las Links & Colorado Specific Items

• Aligned to Colorado’s ELD Standards

• Research Based and Field Tested

• Yearly Measure of English Language Development (Student and District)

• Required For Limited English Proficient students (NEP &LEP)

Who Takes CELApro?

• Non English Proficient(NEP) students

• Limited English Proficient (LEP) students

• CSAPA eligible English Language Learners (ELLs)

• Facilities, Dually Enrolled, Online, and Home-schooled ELLs

ELLs who take CSAPA• ALL NEP and LEP students are

required to take the CELApro• For CSAPA students an

educator who knows the student best should administer the CELApro

• CSAPA accommodations are not allowed on the CELApro

Standardized Assessment• All students will have the same test

content, resources, directions, testing conditions, and rating procedures.

• One score obtained by one student in a part of Colorado will mean the same as the same score obtained by another student in another part of Colorado.

Standard ConditionsDo not interact with students in a manner that will impact student responses.

Do not provide feedback. Do not clarify test items. Do not spell words for the student. Do not repeat questions/items. Do not read any portion of the test other than

what is included in the specific directions. Do not paraphrase, simplify, or add to the

script. Do not translate any part of the test or

directions.

Accommodations

• Only ELLs with an Individual Education Plan(IEP) or 504 Plan

• NO Linguistic Accommodations

For details regarding accommodations please refer to the revised Colorado Accommodations Manual at:

http://www.cde.state.co.us/cdeassess/documents/csap/manuals/

2010/2009-2010%20Colorado%20Accommodations%20Manual%20Final.pdf

AccommodationsAccommodation Speaking Listening Reading Writing

Braille versionYes

Needs transcribing

Yes

Needs transcribing

Yes

Needs transcribing

Yes

Needs transcribing

Large printYes

Needs transcribing

Yes

Needs transcribing

Yes

Needs transcribing

Yes

Needs transcribing

ScribeNot available.

Yes Yes

Signing Yes Yes Yes Yes

Assistive communicative device

Yes

Needs transcribing

Yes

Needs transcribing

Yes

Needs transcribing

Yes

Needs transcribing

Approved Non-standard Accommodations

Yes Yes Yes Yes

Teacher-read directions only

Not available. Directions are already read in the design for administration of the test.

Oral presentation (entire test)

Not available. Test design is oral presentation of entire test in regular administration

Special Populations

Braille• Version of CELApro• Test Examiner (TE) must be able to read

Braille. Contact:Tanni AnthonyExceptional Student Leadership UnitAnthony_l@cde.state.co.us303 866-6681

Transcribing•Torn or Damaged test book

•Braille

•Large Print For detailed instructions regarding

transcribing please refer to the revised Colorado Procedure Manual at:

http://www.cde.state.co.us/cdeassess/documents/csap/manuals/2010/2010_ProceduresMan_FINAL.pdf

Maintaining SecurityALL CELApro materials are secure. Documented chain of custody must be

maintained. No student responses are to be recorded

anywhere other than in the student book or answer book.

No cell phones, digital cameras or video cameras are permitted in the testing environment.

SECURITYStudent Response

• It is NOT allowable to record student responses in any manner (cassette or otherwise).

• Rating must be done at the time of the student testing.

• All materials including student responses are SECURE materials.

Security Requirements for

Test Examiners• Require a Confidentiality or Ethical Practices form be signed by Test Examiners.

• Remind TEs that the copying of audio files onto computer or any other device is not allowed.

CELApro Testing Window

January 4, 2010 through

February 2, 2010

CELApro Training Materials

Available at http://www.cde.state.co.us/cdeassess/index_cela.html• PowerPoint

Presentation

• 3pt Rubric

• 4pt Rubric

• Acronym List

• Confidentiality Form (Audio & DVD)

• Video Scoring Practice Sheet

• Movie clips on Navigator

CELApro Domains and Subtests

CELA Proficiency Test

Subtests•Use Conventions

•Write About•Write Why•Write in Detail

Speaking Subtests •Speak in Words

•Speak in Sentences

•Make Conversation

•Tell a Story

ListeningSubtests•Listen for Information

•Listen in the Classroom

•Listen and Comprehend

ReadingSubtests•Analyze Words•Read Words•Read for Understanding

Writing

Timing Estimates

DomainESTIMATED

TimeAdministrati

on Mode

Speaking 10 minutes Individual

Listening 20 minutesGroup

or Individual

Reading 45 minutesGroup

or Individual

Writing35 minutes –K &145 minutes –2-12

Group or Individual

Grade Span Student Material Examiner Material

K12

3-5

• Student Book(Student records responses)

• Student Book for Examiner (Examiner may fill in bubbles for K-2)

• Examiner’s Guide (Examiner reads test directions and item scripts)

• Cue Book (K-2)(3-5)

(Examiner shows pictures)

• Listening Audio CD (Examiner plays prompts for Listening Items)

6-89-12

• Student Book (Access to test items/cues)

• Answer Book (Student records responses)

• Student Book for TE (Examiner shows pictures)

• Examiner’s Guide (Examiner reads directions and item scripts)

• Listening Audio CD (Examiner plays Listening item prompts)

Examiners read directions from Guide and play the required audio CD with items. DO NOT repeat practice items, listening passages or test questions.

Bubble in Student Book (K-5)Answer Book (6-12)

Group or Individual

Additional proctors as needed(one proctor per 20 students)

Mode Procedure

Materials

Examiner’s Guide

Listening Audio CD

Student Book (K-5)

Answer Book (6-12)

#2 pencil with eraser

Do not disturb sign

Audio CD player

Listening Overview

Conventions in Directions

Listening

Item Types - Listening -

Subtest Titles

Listen for Information

Listen in Classroom

Listen and Comprehend

Three Types

•Students listen to instructions, varying in length from one to three sentences•Students choose which of three answer choices best restates the instructions

Listen for Information

Example:

* Number 1. When you come into the classroom, get your book off the shelf and take your seat. What were you told to do?

Put your book on the shelf next to your seat.

Stand by your seat when you enter the room.

Get your book from the shelf and take a seat.

Mark your answer.

•Students hear two short exchanges typical of classroom discussions. •Students respond to three questions, with three answer choices, about what they heard.

Listen in Classroom

Example:

*

*

“John Goes to the Office”

Ms. Black is speaking to her students.“Who wants to go to the office?” she asks.Everybody raises their hands.“I need one person to take this book to the office,” she explains.All her students continue to raise their hands.Ms. Black says, “John, do you know how to get there?”“Yes, I know! You go downstairs and turn right. Can I take it?” says John.“Yes, thank you,” says Ms. Black

Number 3. Where is the office?

Down the hallDown the stairsDown the road

Mark your answer.

•Students listen to a longer passage on CD.

•On CD questions are orally given to students about main ideas, details, inferences and idioms.

•Students respond to four questions about what they heard, each with three answer choices.

Listen and Comprehend

Students/Test Examiners mark their responses:

A, B, or C,

in the

Student Book (K, 1, 2) (3-5)

or

Student Answer Book (6-8) (9-12).

Marking Answers Listening

Listening Video Clip

• Listening 6-12

Reading Overview

Group or Individual

Additional proctors as needed.(One proctor per 20 students)

Mode Procedure

Read directions and samples from Examiner’s Guide

Bubble inStudent Book (K-5)

Answer Book (6-12)

Materials

Examiner’s Guide

Student Book (K-5)Answer Book (6-12)

#2 pencil with eraser

Do not disturb sign

Item Types-Reading-

Subtest Title

Analyze Words

Read Words

Read for Understanding

Three types

Students respond to items such as: • identifying rhyming words, • applying letter-sound relationships, and• applying knowledge of morphemes & syntax to word meaning

Analyze Words

K,1 examples:_____________________

Find the letter that you hear at the beginning of the word sun.

_______________________

Mark the word with the same vowel sound as man.

- pot - nap - tip

Examples:Which shows the word player divided correctly into root word and suffix?

play / er

pla / yer

pl /ayer

If distribute means to pass out items, then

redistribute means to

Not pass out items

Pass out items again

Pass out items quickly

•Students choose synonyms or antonyms and/or choose words that complete a sentence. •Grades K and 1 students select words to match pictures or to match words.

Read Words

K, 1 Examples:

_____________________

Find the word sun.

_______________________

Find the word that means about the same thing as light.

Examples: Some animals are larger than three horses. They are __________!

John must have a library card in order to check out a _____.

report

book

newspaper

smaller

numerous

enormous

•Students respond to questions about a passage. •Questions address three tasks: reading comprehension, identifying literary features and applying learning strategies to interpretation.

Read for Understanding

6-12 example: Finding information on the internet

The internet is a good place to find information for schoolwork and to play games. To find information, use a computer and type in the words that describe what you are looking for or ask your teacher for help. Enter the words you are looking for in the space at the top of the page and hit the enter key. The computer shows you a list of information. Print this out or write it down on a piece of paper.

To explain how to get information from the internet

To explain what internet games are about

To show that everybody enjoys using the computer

To tell you about a school project

What is the main idea of this article?

Marking Answers -Reading-

Students mark their responses:

A, B, or C,

in the

Student Book (K-2) (3-5) or

Student Answer Book (6-8) (9-12).

Reading Video Clip

• Reading K-5• Reading 6-12

Writing Overview

Group or Individual Administration

Test Examiner may have additional proctors as needed. (one proctor per 20 students)

Examiner reads directions and samples from Guide.

Students listen and respond in Test Book(K-5)Answer Book(6-12)

Mode Procedure Materials

Examiner’s Guide

Test Book (K-5)Answer Book (6-12)

(# 2 pencil with eraser)

Do not disturb sign

Item Types - Writing - Four types

Subtest Title

Use Conventions

Write About

Write Why

Write in Detail

•Grammar •Capitalization •Punctuation •Sentence structure

Use Conventions Examples: Lisa _______ her favorite game.

playing

plays

play

My sisters enjoy the amusement park, so I will take ____.

Bubbling Answers-Use Conventions -

Students mark their responses:

A, B, or C,

in the

Student Book (K,1, 2) (3-5)

or Answer Book (6-8) (9-12)

•Students write about a picture and are asked to use correct capital letters, periods, commas, and question marks•Kindergarten and Grade 1 write one sentence•Grade 2-12 write two complete sentences

-Write About -

Students make a choice between two alternatives and write reasons to explain their choice.

•Grades K, 1 write one reason, one sentence •Grade 2-12 write two reasons, two sentences

- Write Why -

Example:

If you could go on vacation, where would you go? Circle one.

Disneyland Grandparent’s house

Students write longer responses responding to a written prompt.

•Asked to organize their ideas •Asked to write sentences •Grade 2 has a sequence of four pictures prompt. •Grades K and 1 do not take this section.

- Write in Detail -

Example:Write some sentences to explain how to make a snowman. Be sure to include all the steps in the correct order. Use details and check your work.

Writing Video Clip

• K-5 Writing• 6-12 Writing

Speaking Overview

TE reads and administers test from - Student Book (K-5)- Student Answer Book (6-12)

TE points to pictures in - Cue Picture Book (K-5) OR

- Student Book (6-12)

TE rates student responses during testing and bubbles

- Student Book (K-5)- Student Answer Book(6-12)

Individual Administration

Student and TE in a quiet place.

Mode: Procedure: Materials:

Examiner’s Guide

Cue Picture Book

(K-5)

Student Book (6-12)

(#2 pencil with eraser)

Do not disturb sign

SECURITYStudent Response

• It is NOT allowable to record student responses in any manner (cassette or otherwise).

• Rating must be done at the time of the student testing.

• All materials including student responses are SECURE materials.

Item Types - Speaking -

Subtest TitleExaminer

Rating Scale

Speak in Words Correct, Incorrect, or No Response

Speak in SentencesUse 3-Point Rating Scale

(Rate 0-3)

Make ConversationUse 3-PointRating Scale(Rate 0-3)

Tell a StoryUse 4-Point

Rating Scale (Rate 0-4)

Four types:

Requirements of Test Examiner(TE) for CELApro Speaking test

• Speaking section is individually administered by TEs that model clear pronunciation of English phonemes which impact student responses.

• Follow the script exactly. Do not repeat any test items.

• Must be trained annually and demonstrate ability to accurately rate student responses.

• Rate and mark student responses as the student is speaking.

Conventions in Directions

-Speaking-

Speak in WordsTest Design - Content

• Words are simple to complex.• Academic vocabulary is assessed.• Students label objects and answer questions

related to those objects using nouns, verbs, adjectives or adverbs.

• Any action verbs need to be in the form of an action…reading, looking, walking etc.

Test Examiner points to objects cue pictures and asks questions :What is this? What is it used for?Students respond with single words or short phrases.

Practice A and B

-Speak in Words –

1 and 2 3 and 4

silla

Para sentarse

write

letters?

umbrella

To keep you dry.

Examiner marks each response: (C)Correct,(I)Incorrect, or (NR)No Response

Bubbling Responses - Speak in Words -

C = Correct

I = Incorrect

NR = No Response

pencil

writing

eye

seeing

Speak in Words Video Clip & Practice

• K-5• 6-12

Speak in SentencesTest Design - Content

Prompt has been designed to elicit a response in sentence form.

Examiners need to determine if the student is able to create a complete sentence.

Do NOT re-prompt or re-phrase the test item.

Examiner points to each cue picture and directs the student to respond to prompts such as:

“Tell me what is happening in the picture.”

0-3 RUBRIC

Example:

- Speak in Sentences -

Writing

Girl writing

The girl is writing.

Girl

Una niña

SAY* : Tell me what is happening in this picture.

1 1

3

1

0

2

Speak in Sentences Video Clip & Practice

• K-5• 6-12

Make Conversation Test Design - Content

•Items ask for students to restate the idea in the prompt.

•Four types of items:

Tell, Ask, Describe, Explain

Examiners must consider: Does response need to be in question form?

Students respond to the TE’s prompts such as:

Describe how you return something to the store.

-Make Conversation –Example:

1

3Teacher, can I go to the library to check out a book?

2Teacher may you like me to go to the library to check out a book

1Teacher the book library

Now let’s begin. Tell your teacher that you would like to go to the library to check out a book.

SAY*:

Make Conversation Video Clip & Practice

• K-5• 6-12

Tell a StoryTest Design - Content

Examiners are listening for student’s response: Can the student produce a story with some organization of ideas?

Students produce multiple sentences explaining what is happening in a series of four pictures. The examiner starts the story.

Grades K-12: Tell A Story Rubric

-Tell a Story –Example

4The mailman delivered a box at this girl’s house. The girl opened the door and looked at the box. She got the package. Then she took it inside and opened it. She fount a really nice dress in it.

3Then there was a mailman. He delivered a box, and then she can’t take it the box. She unwrapped it and she find out there was a dress in it.

2The mailman left sh.. ..a.. this girl a birthday present. She went out … She got the present.

1The mailman gave .. to her.. like...

Tell a Story Video Clip & Practice

• K-5• 6-12

OSA

TE

Office of Standards and Assessment

Communication/Materials• CELApro Assessment Materials and Shipping

CTB/McGraw-Hill Help Desk800-994-8557celahelpdesk@ctb.com

• Assessment Administration QuestionsOffice of Standards and Assessment(303) 866-6929rieple_m@cde.state.co.us

• Policy Questions Office of Language Culture and Equity (303) 866-6963escobar_l@cde.state.co.us