Hope Tesh-Blum Division of Accountability Services Testing Section EC Conference/July 2001

22
1 North Carolina Department of Public Instruction Division of Accountability Services July 24, 2001 Hope Tesh-Blum Division of Accountability Services Testing Section EC Conference/July 2001 The North Carolina Alternate Assessment Academic Inventory

description

The North Carolina Alternate Assessment Academic Inventory. Hope Tesh-Blum Division of Accountability Services Testing Section EC Conference/July 2001. Why was it developed? Who ’s Eligible? History and Timeline What is it? When is it completed?. How to complete it? - PowerPoint PPT Presentation

Transcript of Hope Tesh-Blum Division of Accountability Services Testing Section EC Conference/July 2001

1

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

Hope Tesh-Blum

Division of Accountability Services

Testing Section

EC Conference/July 2001

The North Carolina Alternate Assessment Academic Inventory

2

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

What will I cover today?

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 20, 2001

• Why was it developed?

• Who’s Eligible?

• History and Timeline

• What is it?

• When is it completed?

• How to complete it?

• Where do you get it?

• Changes for 2001-02 school year

• ABCs

3

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

• Individuals with Disabilities Education Act (IDEA) of 1997– All students, including those with IEPs or

Section 504 plans, must participate in the statewide testing program.

– NC Alternate Assessment Portfolio (NCAAP)– NC Computerized Adaptive Testing System

(NCCATS) Accommodation

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 20, 2001

Why was the NCAAAI Developed?

4

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

Which students are Eligible?

• Must have a current Individualized Education Program (IEP) or Section 504 Plan

• Must be following the NC Standard Course of Study (NCSCS) {important}

• Unable to access statewide testing with or without accommodations {important}

• Must have an assigned grade level of 3-8

5

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

Who decides?

• The IEP TeamIEP Team determines student participation in the NCAAAI and the grade level at which the student will be assessed.

• Different options

6

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

History of the NCAAAI

• Late Fall 2000– It was determined that a small group of students

could not be supported by the NCAAP or NCCATs

– Late December 2000/Development began– Discussion/Conflict concerning implementation

dates (Spring 2001 vs. Fall 2001)

7

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

Examples of Students needing a separate

Alternate Assessment:

• Newly-blinded students who have not mastered Braille

• Students with learning disabilities needing assessment below the third grade

• Students with serious physical disabilities that prevent participation

8

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

Who Helped in the Development and Improvement?

• NCDPI Exceptional Children Division

• NCDPI Division of Instructional Services

• NCDPI Division of Accountability Services/Testing Section

• Regional Accountability Coordinators• Assessor Input (NCAAAI Review Sheet)

{important}

• Technical Outreach for Public Schools (NCSU)

9

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

Timeline for the NCAAAI• March 2001

– Inventories available on-line (TNN)

– Order system up• April 2001

– Intact notebooks are shipped

• June 2001– Notebooks returned to the

NCDPI• July 2001

– 2001-02 Inventories available on-line (TNN)

• August 2001– Reports and Notebooks returned

to LEAs– 2001-02 shipped

10

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

What will be Different in 2001-02 from 2000-01?• Teacher/Assessor feedback

• Descriptors/Scales

• Less repetition/Fewer forms

• More training/More detailed Administrative Guide

• LEAs do not return the notebooks

• No Grade 10 Inventory for HSCT

11

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

What is the NCAAAI?

• Checklist of competencies scored using individual scales for each content area (new)– Reading (Grades K-8)– Mathematics (Grades K-8)– Writing (Grades 4 & 7)

• Notebook (binder) format

• Collection of evidence to support scores

12

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

When are the Inventories Scored?

• Three times per year– First month of school=Baseline data– First month of the second semester of

school=Mid-Year Winter data– Last month of school=Final Spring data

• Evidence is collected to support Final Spring scores.

13

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

How is the Inventory Scored?

• The assessor uses the Description of Student Performance for a particular content area to give each competency a score from 1-8 or NA (not applicable).

• Using the individual competency scores, determine the subheading score(s).

• Using the subheading score(s), determine the Overall Score.

14

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

MATHEMATICS SKILLSNorth Carolina Testing Program

North Carolina Alternate Assessment Academic InventoryDescription of Student Performance

Descriptors Description of Performance

Distinguished8 – High7 – Low

Student consistently demonstrates mastery beyond grade-level skills,strategies, competencies, and expectations.

Student makes applications and extensions beyond grade level.

Proficient6 – High5 – Low

Student consistently demonstrates mastery of grade-level skills,strategies, and competencies.

Student responds with appropriate answers or procedures.

Apprentice4 – High3 – Low

Student occasionally demonstrates mastery of grade-level skills,strategies, and competencies.

Student sometimes responds with appropriate answers or procedures.

Novice2 – High1 – Low

Student rarely or never demonstrates mastery of grade-level skills,strategies, and competencies.

Student frequently responds with inappropriate answers and/orprocedures.

ScaleNovice Apprentice Proficient Distinguished

1 2 3 4 5 6 7 8

15

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

Achievement Levels: Final Spring Overall Score• Assessed On-Grade

Level:– Level 4 (7-8)– Level 3 (5-6)– Level 2 (3-4)– Level 1 (1-2)

• Assessed Off-Grade Level:– Student may only

receive a Level 1 or Level 2

16

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

Examples of Evidence

• Local Tests (LT)

• Samples of Student Work (SW)

• Teacher Observations (TO)

• Teacher-Made Tests (TT)

• Audio Tapes (AN)

• Other (specify)

17

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

Data Collection 2001-02

• Scores will be transferred to student scannable sheets during the last month of school

• Local Test Coordinators will scan the sheets

• Data will be transferred to the NCDPI during the end-of-year process

• Student Notebooks will be stored locally for six months (randomly request)

18

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

How do LEAs order the NCAAAI?

• Local procedure to collect information (number participating)

– Number of notebook binders

– Number of inventories by content area (R, M, or W) and assessed grade level (K-8)

• Information is passed to the LEA Test Coordinator who orders on-line (TNN)

• Materials will be shipped to the LEA TC

• School distribution (by secure means) is a local procedure

19

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

Training?

• Train-the-Trainer Model• NCDPI Trains Regional Accountability

Coordinators (RACs)• RACs train the LEA Test Coordinator• LEA TC trains the EC Director• Training for local staff is a collaboration

between Testing and EC personnel (local decision)

20

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

NCAAAI and the ABCs

2000-012000-01• Pilot Study• Not included in

School Accountability• Number of students

participating will be included in Volume II.

2001-20022001-2002• Operational

administration• Pending data analysis

– Performance Composite

– Growth Component

21

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

NCAAAI and Student Accountability

2000-012000-01• Pilot Study• Not used for Student

Accountability Standard at Grade 5

2001-20022001-2002• Operational

administration• Pending data analysis• Not yet determined for

Grades 3, 5 & 8

22

North Carolina Department of Public InstructionDivision of Accountability ServicesJuly 24, 2001

More Information

• Testing Section Website:

www.NCPublicSchools.org/accountability/testing

• LEA Test Coordinator may contact Regional Accountability Coordinator for questions