Assessing the Long-Term Impact of ... - rusmp.rice.edu

20
Assessing the Long-Term Impact of Professional Development on Classroom Practices of High School Math Teachers Yasemin Copur-Gencturk University of Houston

Transcript of Assessing the Long-Term Impact of ... - rusmp.rice.edu

Page 1: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Assessing the Long-Term Impact of

Professional Development on

Classroom Practices of High School

Math Teachers

Yasemin Copur-Gencturk University of Houston

Page 2: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Outline

Introduction

Program Description

Data Collection

Results

Discussion

Questions & Answers

Introduction Program Description

Data Collection Results Discussion Q & A

Page 3: Assessing the Long-Term Impact of ... - rusmp.rice.edu

RUSMP

Program Description

Data Collection Results Discussion Q & A

Page 4: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Introduction

Teachers the key to student success

Effective instruction critical for promoting students’ conceptual understanding

Standards-based teaching distributed inequitably across school contexts

• Teachers in low-socioeconomic-status and high-minority schools more often relying on rote instructional methods

Program Description

Data Collection Results Discussion Q & A

Page 5: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Key Features of High-Quality PD

Content and pedagogical content focus

Active learning experience

Connections to teacher work

Program duration

Program Description

Data Collection Results Discussion Q & A

Page 6: Assessing the Long-Term Impact of ... - rusmp.rice.edu

What is missing?

Limited research on the sustainability of the effects of PD

Most studies based on teachers’ self-reported data

Limited focus on changes in various aspects of mathematics instruction

Program Description

Data Collection Results Discussion Q & A

Page 7: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Project

Funded by the NSF MSP program-Grant no: 0412072

Partnership between Rice University and two urban school districts that mainly serve low-income students or students of color

Designed to provide PD, support, and leadership experiences for high school teachers

79 teachers in 3 cohorts

Introduction Data Collection Results Discussion Q & A

Page 8: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Project Goals

Deepening subject-matter knowledge specific for teaching

Improving teachers’ understanding how students learn and difficulties associated with mastery

Improving teachers’ understanding of equity and how to address better in their teaching.

Introduction Data Collection Results Discussion Q & A

Page 9: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Program Details

• 4-week long for two consecutive summers

• Mathematics focus: algebra and geometry during the 1st summer & combinatorics and statistics during the 2nd summer

Summer institutes

• Monthly meetings

• Individualized support through site visits and electronic communication

Academic year

activities

Introduction Data Collection Results Discussion Q & A

Page 10: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Participants

49 high-school mathematics teachers from Cohorts I & II

All teachers certified

36 held master’s degrees

Years of experience ranged from 1 to 49 years (mean = 14.1; median = 12)

0

10

20

30

40

50

60

70

80

90

100

Gender Race

M F B W

Introduction Program Description

Results Discussion Q & A

Page 11: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Classroom Observation Instrument

Developed by the research team of RUSMP

Designed to capture various aspects of and factors related to instruction

Composed of 20 dichotomous items as well as 25 items on a 6-point frequency

Items capturing teacher behaviors as well as student behaviors on a 6-point Likert scale

Items capturing the materials used, the content focus, and the classroom culture dichotomous.

Introduction Program Description

Results Discussion Q & A

Page 12: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Classroom Observation Instrument

External evaluators conducted classroom observations beginning in fall 2005 after Cohort I completed the 1st summer program

Classroom observations continued through spring 2010

Two separate factor analyses for the items on binary and Likert scales

Introduction Program Description

Results Discussion Q & A

Page 13: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Classroom Observation Instrument

Scale Reliability Estimate # of Items

.87 5

.75 4

.81 3

.79 6

.74 4

Student Interactions

Instructional Clarity

Mathematical Discourse

Mathematical Habit of Mind

Hands-on Materials

Students discussed and explained their understandings of each question with a

partner or within a small group.

Teacher used probing questions to deepen students’ mathematical

understanding.

Teacher provided explicit expectations for group activity and product(s).

Students were actively engaged in thought-provoking activities that often involved the critical assessment of procedures.

Teacher’s questions triggered divergent modes of thinking among students.

Students used a variety of means to represent concepts (e.g., models, drawings, graphs, manipulatives).

Introduction Program Description

Results Discussion Q & A

Page 14: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Data Analysis

Level 3: Cohorts

Level 2: Teachers • # of graduate-credit

hours • Content knowledge

Level 1: Time • Time in the program

• Years of teaching

experience

Introduction Program Description

Results Discussion Q & A

Page 15: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Results

-0.10

0.10

0.30

0.50

0.70

0.90

1.10

1.30

0 1 2 3 4 5 6 7Stan

dar

diz

ed

Pre

dic

ted

Ch

ange

s

Time (semester in the program)

Student Interactions Mathematical Discourse Instructional Clarity

Introduction Program Description

Data Collection Discussion Q & A

Page 16: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Results Cont.

Introduction Program Description

Data Collection Discussion Q & A

-0.5

-0.3

-0.1

0.1

0.3

0.5

0.7

0.9

1.1

0 1 2 3 4 5 6 7Sta

nd

ard

ize

d P

red

icte

d C

ha

ng

es

Time (semester in the program)

Mathematical Habit of Mind Hands-on Materials Hands-on Materials

Page 17: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Results Cont.

Introduction Program Description

Data Collection Discussion Q & A

Instructional Clarity

Mathematical Discourse

Hands-on Materials

Mathematical Habit of Mind

Student Interactions Credit

Experience

Page 18: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Discussion

Limitations

• Convenient sample

• Local instruments

• Measurement error

• Number of observations

Mathematical Discourse

Mathematical Habit of Mind

Instructional Clarity

Student Interactions

Hands-on Materials

Introduction Program Description

Data Collection Results Q & A

Page 19: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Discussion Cont.

Certain instructional practices apt to change whereas others not

Teachers continue to grow with appropriate support

Lack of incorporation of concrete materials into instruction

Introduction Program Description

Data Collection Results Q & A

Page 20: Assessing the Long-Term Impact of ... - rusmp.rice.edu

Thanks!