Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference...

23
Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Performance Management in Education: Education: A Call for Paradigm Reform in South A Call for Paradigm Reform in South Korea Korea Ju Ho Lee (KDI School of Public Policy and Management)

Transcript of Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference...

Page 1: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Issue: Performance Management

Topic 4: Performance Management in Education Sector

A Joint Conference of World Bank and KDI

Performance Management in Education:Performance Management in Education:A Call for Paradigm Reform in South KoreaA Call for Paradigm Reform in South Korea

Ju Ho Lee(KDI School of Public Policy and Management)

Page 2: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

The Structure of the paper

Intro. Q&A eBay’s

success Growth Labor Economics 2003 Fall Performance Management in Education: A Call for Paradigm Reform in South Kores

First, Overview of the performance in Education

Second, Overview of the performance management system in Education

Third, Propose reform agenda to improve the performance-management system

Page 3: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 1. Performance in Education

<Table 1> Average Test Scores

Korea Japan U.S U.K France Germany Sweden Canada Italy Mexico

Scientific

Literacy1 2 14 4 12 20 10 5 23 30

Math

Literacy2 1 19 8 10 20 15 6 26 30

Reading

literacy6 8 15 7 14 21 9 2 20 30

(Unit: Ranking out of 31)

Source: OECD “Knowledge and Skill for Life”, PISA 2000

Page 4: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 1. Performance in Education

<Table 1-1> Distribution of Test Scores: Reading literacy

Korea Japan U.S U.K France Germany Sweden Canada Italy Mexico

Below level 1 1 3 6 4 4 10 3 2 5 16

At level 1 5 7 12 9 11 13 9 7 14 28

At level 2 19 18 21 20 22 22 20 19 26 30

At level 3 39 33 27 27 31 27 30 28 31 19

At level 4 31 29 21 24 24 19 26 28 19 6

At level 5 6 10 12 16 8 9 11 17 5 1

(Unit:percentage)

Source: OECD “Knowledge and Skill for Life”, PISA 2000

Page 5: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 1. Performance in Education

<Table 2> Student Engagement

Korea Japan U.S U.K France Germany Sweden Canada Italy Mexico

Students with

Low sense of belonging

41 38 25 17 30 23 18 21 23 22

Students with

Low

Participation8 4 20 15 15 13 24 26 22 21

(Unit: percentage)

Source: OECD “Student Engagement at School”, PISA 2000

Page 6: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 1. Performance in Education

<Table 3> Student participation in educational courses outside school

OECD

AverageKorea Japan U.S U.K France Germany Sweden Canada Italy Mexico

Participation

[1]24.9 63.6 70.7 24.7 20.1 N.A. 10.4 7.8 14.4 5.6 51.4

Participation

[2]32.3 57.5 17.3 28.8 24.4 N.A. 36.2 7.8 31.6 48.0 47.1

(Unit: percentage)

Source: OECD “Knowledge and Skill for Life”, PISA 2000

1) Percent of students who have sometimes or regularly attended courses in the language of assessment, courses in other subjects, or extension or additional courses in the last three years

2) Percent of students who have sometimes or regularly attend courses in the language of assessment, remedial courses in other subjects, training to improve study skills or private tutoring in the last three years

Page 7: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 1. Performance in Education

<Table 4> Teacher Evaluation by Student

OECD

AverageKorea Japan U.S U.K France Germany Sweden Canada Italy Mexico

Mean 0.00 -0.67 -0.17 0.34 0.50 -0.20 -0.34 0.21 0.31 -0.28 0.07

Ranking - 27 18 4 1 19 24 7 6 21 13

(Unit: WARM estimator, Ranking out of 27)

Source: OECD “Knowledge and Skill for Life”, PISA 2000

Page 8: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 1. Performance in Education

<Table 4> Teacher Evaluation by Principle

OECD

AverageKorea Japan U.S U.K France Germany Sweden Canada Italy Mexico

Mean 0.00 -0.72 0.14 -0.04 0.02 N.A. -0.01 0.34 0.08 -0.69 0.39

Ranking - 26 10 18 13 N.A. 16 5 11 25 3

(Unit: WARM estimator, Ranking out of 27)

Source: OECD “Knowledge and Skill for Life”, PISA 2000

Page 9: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 2. Performance-Management in Education - Performance Monitoring

Scholastic achievement Evaluation in Korea

• To understand the academic achievement of students

• To assess the curriculum and pedagogical methodology

But, not directly used to strengthen the accountability of schools

The problem is,

- not use results of the scholastic achievement evaluation to hold schools accountable

- not disclose the results of the scholastic achievement evaluation

Page 10: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 2. Performance-Management in Education - Project Evaluations

<Table 5> Evaluation on Local Education Authorities by the Ministry of Education & Human Resources Development

Year Areas of Assessment Distribu

tionTotal

Point

1996• Education Policy

• Education Reform

100

100200

1997

• Class Reform/ Demand-Based School System

• Embodiment of Welfare

• Efficiency in Information and Distribution of Administrative and Financial Support System

• Will to Promote Education Reform

310

130

120

140

700

1998

• Classroom Innovation / Efficiency in Operating Finances

• Demand-Based School System

• Strengthening the Support System

260

120

120

500

Page 11: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 2. Performance-Management in Education - Project Evaluations

Year Areas of Assessment DistributionTotal

Point

1999

• New School Culture to Improve Classes

• Performance-Based Teachers

• Student and Parent-Based School

• Efficiency in Operating Finances

• Strengthening the Support System

160

60

140/115

100

140/165

600

2001

• Major National Policy Project

• Autonomy and Special Project of the City or Regional Office of Education

• General Policy Project

165

125

210

500

<Table 5> Evaluation on Local Education Authorities by the Ministry of Education & Human Resources Development

Page 12: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 2. Performance-Management in Education - Project Evaluations

<Table 6> Budget Distributed According to the Result of Evaluation on Local Education Authority by the Ministry of Education & Human Resources Development

1996 1997 1998 1999 2001

Total Subsidized Budget 500 800 1500 1,500 1000

Basic/Difference 250/250 100/700 150/1,350 150/1,350 200/800

City Average 33.63 52.76 82.35 82.35 67.09

Provincial Average 33.13 53.71 102.62 102.62 58.93

Total Average 33.33 53.33 93.75 93.75 62.5

(Units: Hundred Million Won)

Source: Committee of Evaluation on Local Education Authority(for each year)

Note: Basis for Distribution in 2001, (1) Basic Allotment (20%) + Allotment by Total Score Obtained (80%), (2) Index of Basic Allotment = Student (80%)

Page 13: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 2. Performance-Management in Education - Project Evaluations

<Table 7> Evaluation on Schools by the Ministry of Education & Human Resources Development(based on documents)

Areas Evaluation Criteria

Curriculum

Pedagogical Activity

Instruction through an emphasis on educational goals Pedagogical activity that reflects student characteristic Pedagogical activity that develops voluntary study skills

Outside the Curriculum

Pedagogical Activity

Searching and discovering one’s specialties Livelihood guidance / basic attitude toward democracy

Activities that Support Education

Disguising duty, communication, animosity among coworkers Assisting the development of a faithful environment. Elevating the specialties of the personnel Resources necessary to conduct educational activities Amicable communication between the school and parents and parents participation at school. Supporting and Utilizing regional resources

Page 14: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 2. Performance-Management in Education - Project Evaluations

Areas Evaluation Criteria

Scholastic Achievement

Studying methods, Communication skills Logic and creativity, Relationship with adults Ego-identity, Responsibility

Level of Satisfaction Student Parents Teachers and administrators

Education Policy

Degree of difficulty involved when administering the 7th Curriculum Class utilizing ICT Achievement Test Special ability / Aptitude education Reducing students per class School Administration Committee

Source: Ministry of Education and Human Resource Development and Korea Education Development (2003), “Reports on the Results of the Overall School Evaluation,” pp.14~17.

<Table 7> Evaluation on Schools by the Ministry of Education & Human Resources Development(based on documents)

Page 15: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 2. Performance-Management in Education - Project Evaluations

Areas Evaluation Criteria

Introduction of School What are the basic characteristics of the school(composition of personnel and surrounding environment)?

Curricular-Educational Activities

Do the personnel of the school agree with the goals and plans? Do the curricular-educational activities reflect each student’s specialty (student level, interests, abilities)? Are curricular-educational activities developing voluntary studying skills?

Outside the Curriculum

Pedagogical Activities

Are pedagogical activities outside the curriculum adequately exhibiting student skill and potential? Do pedagogical activities outside the curriculum help develop qualities possessed by democratic citizens?

<Table 8> Evaluation on Schools by the Ministry of Education & Human Resources Development(based on school-visits)

Page 16: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 2. Performance-Management in Education - Project Evaluations

Areas Major Questions

Activities that Support Education

Do pedagogical activities outside the curriculum help develop qualities possessed by democratic citizens? Is the school working to improve its teaching and quality? Does the school possess necessary facilities in conducting educational activities? Are the parents, school, and the local community cooperating to improve the quality of education?

Education Policy

While supervising the 7th Curriculum, to what degree has the school faced difficulties? Are ICT-Utilizing classes aiding student comprehension? Are special-skill classes helping the development of student quality? Is reducing class size helping to improve the school quality? Is the Student Administration Committee contributing to the democratic management of the school?

<Table 8> Evaluation on Schools by the Ministry of Education & Human Resources Development(based on school-visits)

Page 17: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 2. Performance-Management in Education - Project Evaluations

<Table 9> Evaluation on General High Schools by Seoul Metropolitan Office of Education

Area Distribution Evaluating Project

Internalizing Character Education based on

Family-Related Experiences

160(16%)

Revitalizing exchange and experience learning

Formulating an autonomous living environment

Creating a school without violence

Promoting thrifty spending and environmental education

Internalizing unification education

Education to develop special skills to fulfill

dreams 150(15%)

Activating enlightening activities

Invigorating special and unique skills

Internalizing science education

Systemizing career guidance

Strengthening physical education

Sustaining the innovation of classroom and

evaluation290(29%)

Improvement of class to increase creativity

Reforming evaluation to elevate logic and problem-solving skills

Establishment of guidance for responsibility to increase ability

Promoting effective reading

Page 18: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 2. Performance-Management in Education - Project Evaluations

Area Distribution Evaluating Project

Developing knowledge and information skills

120(12%)

Spreading English education

Increasing computer skills and educating information-technology ethics

Provoke information-utilizing skills for teachers

Use and developing a school homepage

Constructing a school community for all to

participate 280(28%)

Promoting an autonomous specialty project for each school

Increasing opportunities for parents to join school activities

Internalizing the management of the school’s administration committee

 Improving student welfare

 Developing teachers’ specialization and working conditions

Enforce an appropriate and efficient budgeting of school funds

Source: Seoul Metropolitan Office of Education (2004), “Report of School Evaluation for the 2003 Academic Year,” pp. 10~72.

<Table 9> Evaluation on General High Schools by Seoul Metropolitan Office of Education

Page 19: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 3. A Call for Raradigm Reform

Elevate the Education Performance Evaluation

First, Assessment of student achievement should be based on students evaluation on both cognitive and non-cognitive skills

Second, Utilize results of students achievement evaluation based on diverse methods:

(1) the absolute level of achievement of schools

(2) the change in achievement of schools

(3) the extent of improving student achievement of targeted students

Page 20: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 3. A Call for Raradigm Reform

Establish a New Accountability System

Accountability Schools :

Introduce different types of schools that allow school choices

Accountability Programs :

Improve student achievement for the students of low-income and

low-ability

Accountability Contests :

Promote competition among schools via Accountability Contests

Page 21: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 3. A Call for Raradigm Reform

Accountability Schools

Introduce different types of schools that allow school choices

- Diversifying the school system through the introduction of new types of schools - Allow school choice, autonomous school management, and financial assistance based on formula funding - Access Accountability Schools by Accountability Tests

For Accountability Schools

Page 22: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 3. A Call for Raradigm Reform

Accountability Programs

Improve student achievement for the students of low-income and low-ability

-Strengthen remedial education program to enhance the performance of low-income and low-performing students - Hold schools accountable based on the improvement of achievement of targeted students

For Accountability Programs

Page 23: Issue: Performance Management Topic 4: Performance Management in Education Sector A Joint Conference of World Bank and KDI Performance Management in Education:

Section 3. A Call for Raradigm Reform

Accountability Contests

Promote competition among schools via Accountability Contest

- Performance goals will be set by the Ministry, Local Education Authority…- Schools will voluntarily participate the contest- Participating schools will be allowed with more autonomy - Reward schools, teachers, and students that won the contest

For Accountability Contests