Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

33
1 Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction Division of Accountability Services/Testing Section North Carolina High School Exit Exam: Overview and Update

description

North Carolina High School Exit Exam: Overview and Update. Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction Division of Accountability Services/Testing Section. North Carolina Department of Public Instruction - PowerPoint PPT Presentation

Transcript of Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

Page 1: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

1

Sarah McManus and Hope Tesh-Blum

North Carolina Department of Public Instruction

Division of Accountability Services/Testing Section

North Carolina High School Exit Exam:

Overview and Update

Page 2: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

2

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Competency Tests: History &What will happen?

Old Competency Minimum performance levels in areas of Math, Reading, and Writing(prior to 1994-95)

New Competency Levels of performance in Reading and Math (during or after 1994-1995)

Page 3: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

3

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

GATEWAYS

•Statewide Student Accountability Standards

Grades 3, 5, 8, and 12

•New Student Promotion StandardsAPA Policy 16CAC6D.0305Approved by SBE 4/1/99

Page 4: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

4

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Measurement Goals

•Essential Skills•Higher Order Thinking Skills •Integration•Application•Evaluation

•Big Concepts/Ideas•Math •Science•Social Studies•English

Page 5: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

5

Gateways

GradeLevel

MeasurementTool

EffectiveDate forStandard

Grade 3 End-of-GradeGrade 3 (in place)

2001-02

Grade 5 End-of-GradeGrade 5 (in place)

2000-01

Grade 8 End-of-GradeGrade 8 (in place)

2001-02

Grade 12 Exit Exam (indevelopment)

* GraduatingClass of 2005

* State Board Decision February 2, 2001

Page 6: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

6

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Six Domains

•Communication

•Processing Information

•Problem Solving

•Using Numbers and Data

•Technology

•Team Work

Page 7: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

7

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Development of Learning Objectives (for each domain)

•Division of Instruction Services

•Division of Accountability Services/Testing

Section

•Research

•Previous studies of what students should

know and be able to do

Page 8: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

8

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

NCHSEE Key Characteristics

•Active Involvement

•Scenarios and Situations

•Real-World Applications

•Use of Primary Source Materials

•Variety of Presentations (i.e., not simply reading or math)

•Integration of Content (i.e., not facts tested in isolation)

Page 9: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

9

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Who’s on the

Development Team?

Page 10: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

10

Test Development Team:

Riverside Publishing Company

Producing items, tests, technical documents, & resource materials

Standard setting

Page 11: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

11

NCHSEE CommitteeApproves all of Riverside’s Work

• Division of Accountability Services

• Division of Instructional Services

• Division of Exceptional Children

Page 12: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

12

NCHSEE Advisory Boardprovides feedback and advice to NCHSEE Committee about

administrative procedures, etc.

• NCAE

• Test Coordinators

• Principals

• Central office staff

• Division of Accountability Services

• Division of Instructional Services

• Division of Exceptional Children

Page 13: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

13

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Technical Advisory Committee

•Purpose: To provide advice about field test

design, standard setting, etc.UNC-Chapel HillUniversity of MichiganUNC-GreensboroAmerican Institute of Research

Page 14: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

14

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Item Development

•N.C. Educators, Curriculum Specialists and

professional item writers

•NCDPI Instructional Services

•NCDPI Accountability Services/Testing

•NCDPI Exceptional Children

•Riverside Publishing Company

Page 15: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

15

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

November 2001

•NC State Board of Education approves

several changes to the test format of the Exit

Exam

•Delay in funding and the need to reduce

amount of time spent testing

Page 16: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

16

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Exit Exam Format Revisions

Original Format•Multiple-Choice•Four separate tests• 60-80 items per test •Two hours test time per test / 4 days

Revised Format•Multiple-Choice•One test/Four sections• @100 items total (25 per section) •Three hours total test time / one day

Page 17: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

17

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

What four sections

(domains) are tested?

Page 18: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

18

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Four Assessed Domains

•Communication

•Processing Information

•Problem Solving

•Using Numbers and Data

Page 19: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

19

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Communication Section

Two types of items:

•Embedded Error: Evaluate critically and

analyze printed material

•Scenarios: Understand and apply

accurately the rules of Standard English

•LISTENING ITEM REMOVED

Page 20: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

20

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Processing Information Section

Requires Students to:

•Process multiple Types of data

•Interpret, analyze, synthesize

•Make appropriate inferences, predictions,

or plans

Page 21: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

21

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Problem Solving Section

Requires Students to:

•Analyze and evaluate problems in a variety

of scenarios

•Identify potential solutions or choices

Page 22: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

22

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Using Numbers and Data Section

Requires Students to:

•Apply mathematical and data analysis skills

and concepts to solve problems in a variety

of contexts

Page 23: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

23

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Timeline (as of February 18, 2002)

2000-2001: Item Tryout (all 11th graders)

2001-2002: Field Test (*@34,000 11th graders)

2002-2003: Field Test (*All 11th graders)

2003-2004: Operational (*All 11th graders)

2004-2005: *Graduation Requirement for

Class of 2005* 11th grade students following the C/U Prep, C/T Prep, or Career Prep Courses of Study.

Page 24: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

24

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Samples for Testing (as of February 18, 2002)

2001 Item Tryout

•Every High School•All 11th grade students•@ 64,000 students •Accommodations•Scored by contractor•2 hours per test

2002 Field Test

•Sample of High Schools•All 11th grade students in a selected high school•@34,000 students•Accommodations•Scored by contractor•180 min. total test adm. time

Page 25: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

25

All students should be given sufficient time to complete the tests.

NOTE: A few minutes of additional time will be needed at the end of the testing period to check answer sheets, complete coding, and collect test materials.

Estimated Test Administration Time

Estimated TestAdministration Time

Test Activity

15 minutes Assemble students, distributetesting materials, providegeneral instructions, and codestudent background information

60 minutes (180 minutes total) Three test sessions continuouswith stretch breaks

3 minutes (6 minutes total) Two stretch breaks

201 minutes (3hr, 21 min.) Estimated Total Testing Time

Page 26: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

26

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Other Test Materials

• Calculator Use:

›Graphing Calculator is required for the

entire test

• Blank Paper

X No Graph paper

Page 27: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

27

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Real Deal: Class of 2005 and Beyond

•Administered to all 11th grade students in

Spring of 2004

•Class of 2005 must pass this test to receive

a diploma

•Retesting opportunities available

Page 28: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

28

Re-testing Opportunities

• Summer School (Junior year)

• Fall (Senior year)• Spring (Senior

year)• Last month (Senior

year)• Age 21

Page 29: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

29

Students Following C/U Prep., C/T Prep., or Career Prep. Courses of Study:To Receive a

Diploma (Class of 2005 and beyond)

• Local Requirements

• Existing State Requirements

• Passing score on exit exam (class of 2005)

• Passing score on computer skills tests

Page 30: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

30

North Carolina Department of Public InstructionDivision of Accountability Services/Testing SectionFebruary, 2002/Accountability Conference

Resource Materials

•Information Guide/Brochure (February

2002)

•Student Handbook (February 2002)

•NCDPI Websites (Testing and Instructional

Services)

Page 31: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

31

Testing Website:

http://www.NCPublicSchools.org/ accountability/testing/ highschoolexitexam/

Page 32: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

32

Instructional Services Website:

http://www.learnnc.org/dpi/instserv.nsf/Category11/

Page 33: Sarah McManus and Hope Tesh-Blum North Carolina Department of Public Instruction

33

Questions?