Building Leaders Evaluations in KEEP

June 7, 2013 at Manhattan; Bill Bagshaw, KSDE; Kayeri Akweks, KSDE; Mick Lowe

Available online at http://www.ksde.org/Default.aspx?tabid=4400

WAIVER - Principle 3 Supporting Effective Instruction and Leadership

Implement teacher and principal evaluation and support systems that:

• Are used for continual improvement of instruction

• Use at least 3 performance levels

• Use multiple measures including student growth as significant factor

• Are used to evaluate on a regular basis

• Provide clear, timely, and useful feedback

• Are used to inform personnel decisions

As of June 3, 2013 –

278 districts have submitted their Assurances Form

267 districts have had their Assurances Form approved

93 districts will be using the KEEP Repository

146 districts will be using vendors

46 districts will be using locally created evaluation systems

Districts Have Chosen Their Evaluation Systems for 2013-2014

Evaluation Systems per Districts as of 6-4-2013

1. Multiple Measures

2. Inter-Rater Reliability

3. Evaluation Goal Selection

4. Evaluating the Building Leader

5. KEEP Repository

5 Topics to Prioritize

Multiple Measures

• Consider state assessments as expected

• Include assessment measures currently in use in your district

• Shared credit/responsibility for student growth

• Time for student growth 1-3 years

Sample Measures by KSDE from the Field

Academic Measures – State Assessments

Academic Measures – Not State Assessments

Other Student Knowledge and Skills Measures

• History and Government State Assessment

• ESOL State

Assessment • Reading State

Assessment • Mathematics State Assessment • Science State

Assessment • Writing State

Assessment

Common Academic Assessments • ACT/SAT scores • Aimsweb • AP scores • CETE Formative Assessments • DIBELS • District wide Common

Assessments • Fitness Grams • Lexile Scores • Measures of Academic Progress

(MAP)

Other Academic Assessments • Student constructed response

with rubric for assessment • KWIET portfolio • Performance based measures • Project Rubrics

College and Career Ready Measures • Industrial Certifications

assessments (Technical Skills) • Interpersonal communication

skills (Interpersonal Qualities) • WorkKeys (Career Interest

Development)

Other Non Academic Measures • Sportsmanship rubric • Life skills (nutrition, physical

activity) • Occupational therapy skills • 21st century skills • Library usage (using library tools

to find resources)

Sample Measures for Building Leaders Evaluation • Percent of growth of Program-

Enrollment/Participation • Amount of time engaged with data

material online products • Anecdotal Notes • Artifacts • Attendance Data • Awards and Accomplishments • PE Attendance • Career Readiness/Success Rates

past Graduation • Building test Scores • Report Card Data • Classroom Observations Preformed • Climate Surveys • Communication of Professional

Information

• Contact Log • Discipline Data • Dual Credit Course Enrollment • Engagement with families • Extended Learning Opportunities • Graduation Rates • Increased # of research-based

instructional practices implemented

• Instructional Coach - # of times in the classroom

• Involvement in professional organizations

• # of student involved in extra-curricular activities

• Number of students who went to college

• Parent Involvement

Multiple Measures Recent Developments

• Focus Groups provided a list of

possible measures

• KSDE collaborates with REL to modify list of measures - Collected

• KSDE will identify a “default list” of measures – See Measures Chart

• KSDE will identify a “default matrix” of significant – See Examples

• KSDE Flexibility Waiver work

Multiple Measures Currently Used Examples Should Coincide

Use Multiple Measures including student growth as significant factor.

State Assessments must be used.

Other Default Measures May Include:

Student Portfolio’s

Common Assessments

MAPS

Lexile Reading Scores

Other Multiple Measures

We are looking at data that measures more than just academic preparedness, such as 21st Century Skills

Critical Thinking

Employability

Technical Skills

SBoE has previously approved the College and Career Ready definition.

Builder Leaders and District Leaders Co-Construct the Educator Evaluation Multiple Measures

District Selections – from default list or KSDE other approved measures

Validation – REL, KSDE content area specialists, or LEA able to meet valid and reliable criteria

Significant Student Growth

Determining significant

– Matrix, Other Samples

Establishing timeline for growth

– Student Growth Percentile

Significance Definition

• The change in student achievement for an individual student between two points in time, determined using multiple measures

• To include gains and progress toward post-secondary and workforce readiness

• To include progress in academic and functional goals in an individualized education program or meeting academic student growth objectives

5th Grade Curriculum Standards 5.00

4.12 4.11

4.10 4.09 4.08

4.07 4.06

4.05 4.04

4.03 4.02 4.01

4.00 Aug Sept Oct Nov Dec Jan Feb March April May

85%

85%

Assuming 85% of students exiting 4th grade accomplished 4th grade curriculum, the expectation would be at least the same amount of growth would occur by completion of the 5th grade, or on any given measure used. Example: In a class of 24 students, 20 students would be above the Grade Level Expectation line by the end of the Academic Year. 24 x .85 = 20.2 This scenario would indicate significance. Reference: Blue Print for Reform

Graduation Rates/Attendance Rates

0%

10%

20%

30%

40%

50%

60%

70%

80%

90%

100%

High School 1 High School 2 High School 3 High School 4 High School 5 State GraduationRates

2009

2010

2011

2012

2013

16

Suggestions for Using Multiple Measures Note: Multiple Measures are only part of the Educator Evaluation

17

Evaluation Goal Selection

• District Goals

• Building Goals

• Individual Goals

• It is recommended that each Educator selects two goals per evaluation cycle:

• A district or building level goal,

• A personal goal mutually agreed upon by the Evaluator and the Evaluatee.

Multiple Measures and Significance Summary

• Teachers and Leaders evaluations include multiple measures as evidence.

• Significance refers to the need to demonstrate student growth using MORE than one measure.

• Must consider state assessments

• May include assessment measures currently in use in your district

• Significance must be pre-determined for any appropriate measure

• Districts determine credit/responsibility for student growth (This was asked of the TIK II Group)

• Time for student growth 1-4 years

Multiple Measures Summary

Inter-Rater Reliability

DEFINITION:

Reliability refers to the consistency of an assessment.

VALIDITY vs. RELIABILITY:

Factual vs. Consistent

EXPECTATION:

School district evaluators attend professional learning activities that address the issue of reliability relative to using the KEEP Rubrics.

The same expectations apply to districts using an evaluation system other than KEEP.

Evaluating the Building Leader

• Thinking through and discussing the Process - readiness per year?

• Multiple Measures selected?

• Timeline for Evaluation?

• 1 Cycle

• 2 Cycles

Building Leader Process

• May 2013 Handbook, page 32

• Required Steps

• Implementation Ideas

Building Leader Constructs

Building Leader Rubric

Repository Processes A Repository is NOT ______________________________???

ANSWER: NOT entire KEEP process.

How is a Data Repository used?

USES –

Holds DATA

Generates Reports

Access for Educator Involvement

Unified System

Organizational Tools

Building Leaders Assessment Rubric

Assessment Rubric Comments, File, Save and Print

Assessment Rubric with 1 Goal Checked and “I have completed my self assessment” checked

Assessment Rubric with Comments Box filled and Artifact Uploaded

Goals – Select Goals, Write Text for Expected Outcome, Add

Goals – After Adding, then Complete and Save, can Print

Artifacts – Select Component and Source of Evidence

Artifacts – Ready to Upload

Artifact Uploaded – in table

Cycles of Conferences - Beginning, Mid, End

Sum

mar

y R

atin

g Sh

eet

– C

on

stru

ct #

1

Summary Rating Sheet – Construct #2

Summary Rating Sheet – Construct #3

Summary Rating Sheet – Construct #4

Summary Rating Sheet – Signatures

NEW !! KEEP Guided Practice

• New Online Training

• Individualized and Repeatable

• Will include multiple forms of Learning

• Will be available from a link on the KEEP Webpage

• To be Released in July 2013

The KEEP Webpage

http://www.ksde.org/Default.aspx?tabid=4400

1. News and Announcements

2. KEEP Repository Registration

3. KEEP Training Materials and Schedule

4. Assurances Information

5. Kansas Flexibility Waiver Materials

6. Archives with Materials of Previous Trainings and Meetings

Questions ?? Contacts: Bill Bagshaw, Assistant Director Teacher Licensure & Accreditation bbagshaw@ksde.org 785.296.2198 Kayeri Akweks, Education Program Consultant Teacher Education and Licensure kakweks@ksde.org 785.296.5140