Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily,...

20
TEACHER EDUCATION INITIATIVE OF CEMCA FOR THREE YEAR PLAN (TYP) 2012-15 Programme Evaluation Report Prof.M.U.Paily RIE, Mysore

Transcript of Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily,...

Page 1: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

TEACHER EDUCATION INITIATIVE OF CEMCA FOR THREE YEAR PLAN (TYP) 2012-15

Programme Evaluation Report

Prof.M.U.PailyRIE, Mysore

Page 2: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

The Background

• Three year plan (2012-15), CEMCA had five initiatives ▫ open schooling, ▫ teacher education, ▫ higher education, ▫ technical and vocational skill development▫ community media/healthy communities.

Page 3: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Under Teacher Education

• Capacity building for teacher educators to integrate ICTs

• Promoting blended learning for teacher education

• Facilitating continuous professional development of teachers using ICTs

Page 4: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

• Under this initiative CEMCA promoted adoption of blended approach to ICT integration in continuous professional development of teacher educators. In 2012-13, 2013-14 and 2014-15, CEMCA organised/supported several workshops on ICT integrated Teacher Education and contributed towards building of a Community of Practice (CoP) for teacher educators.

Page 5: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore
Page 6: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Background• Within this framework, CEMCA has developed a Community of

Practice (CoP) for Teacher Educators with the support of IT for Change, Bangalore and DSERT

• The project was for enabling teacher educators to integrate ICTs into their professional development and develop a self-supporting and sustainable 'Communities of Practice (COP).

• ICT skill training is another component of the activity, and the assumption is that all those teacher educators trained will use the CoP regularly to help each other in a peer and collaborative learning mode to develop a “culture of sharing” best practices and experiences.

Page 7: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Objectives of the CoP1. Provide hands-on training on information and communication

technology (ICT) to teacher educators;2. Assist the teacher educators to use the WWW, Web 2.0, and the

CoP to develop teaching and learning resources and share with other teacher educators;

3. Develop a sense of sharing, peer learning and collaboration amongst the teacher educators; and

4. Share best practices in the use of learning materials available freely for improving school education.

Page 8: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Purpose of Evaluation

1. Carry out evaluation to address the Outcomes and Performance Indicators as articulated in the 2012-2015 TYP

2. Gather baseline data on the Performance Indicators to set as benchmark for evaluation

3. Facilitate the integration of gender by collecting gender-disaggregated data and tracking CEMCAs interventions on gender equality

4. Provide evidence on whether the use of technology and ICT advocated by CEMCA has been relevant to the outcomes sought.

Page 9: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Evaluation Framework

Inputs Activities Outputs Outcomes Indicators Impacts

7 workshops of five day duration for each group Participants – 163 teacher educators Cop web portal KOER platform Mailing lists Master resources persons (3 in each subjects of maths, science, language, and S.S(geography) Handouts, background notes, ICT books and chapters

Training in basic ICT skills Participating in COP platforms Accessing web resources Networking through mailing groups Exposure to educational tools such as Geogebra (link is external), Audacity, PhET, Marble, KGeography, Kalzium, and Freemind, video creating tool Record My Desktop, image editing tool GIMP Practised use of web tools such as search, maps, translate, books, videos on Youtube, digital albums etc. Exposure to OER in general and KOER in particular. Created personal digital resource libraries Collaborative readings, tutorials , demonstrations, hands on training, peer review

Model lessons Learning resources (audio, graphics, video, text) CoP through1.Mailing groups messages/postings 2.KOER pages and edits 3.Discussion groups Feedbacks collected

Teacher education institutions use emerging technologies and practices to support ODL policies, systems and quality materials development

Five institutions adopt ICT teachers' blended learning model for continous professional development

A sustainable and equitable increase in the number of citizens in commonwealth Asia acquiring the knowledge and skills for leading productive and healthy lives through formal and non-formal open and distance learning opportunities

Page 10: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

The target groupsSl. No. Date State Venue Number of Teacher

Educators

1 June 3­7,2013 Karnataka ITFC, Bangalore 232 11­15 June 2013 Karnaraka Dharwad DIET 193 21­25 October, 2013 Karnataka Rural DIET, Bangalore 294 11­15 November, 2013 Karnataka Dharwad DIET 25

5 10­14 March, 2014 Karnataka Urban DIET, Bangalore 216 January 20­24, 2015 Karnataka Rural DIET, Bangalore 257 February 03­07, 2015 Karnataka Rural DIET, Bangalore 21Teacher educators trained as Master Trainer. Total 163

Page 11: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

The Data• Data were collected involving various methods as given below

▫ Field visits and field notes: the investigator personally visited 8 DIETS, ITFC Office, and DSCERT and personally observed the facilities available and interacted with people and made feild notes.

▫ Focus groups: focus group interviews were conducted with ITFC personal, DSCERT officials, and teacher educators from 8 DIETS

▫ Questionnaire and survey: a questionnaire was developed (appendix-) and digitised and administered using Google form to the teacher educators. Forty six teacher educators responded to the survey

▫ Document Analysis: an analysis of various reports by ITFC and CEMCA, analysis of activities, resource materials etc. were taken up

▫ Analysis of online interaction logs, frequency of interaction, quantity and quality of online contributions

Page 12: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Major Findings

• Low Awareness in general• Various aspects of the training were found to be

good• Relevant course content• ICT skills before and after the training-

significant improvement• Extend of ICT use before, immediately after and

current• Output during and after the training programme

Page 13: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Major Findings

• Achievement of objectives• Factors influencing technology use

▫ Lack of time▫ Too much administrative tasks▫ Lack of technical support

• Duration –suggestions, more hands on practical sessions

• More emphasis on pedagogical integration• CoP was well appreciated but much to progress

Page 14: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Major Findings

• Realisation among the participants that the technology is accessible and user friendly provided one has interest and commitment

• Genuine involvement and insider encouragement was observed

• Gender continues to remains an issue. Though there is an increasing participation from women, it is still much below the 50% marks and this need to be addressed.

Page 15: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Major Findings

• Linkage between the nature of work and the kinds of current engagement

• No provision for repeat workshops and expectation to develop equal competencies

• Duration of five day workshop• Inadequacy in conducting cascade model• Helped in self directed CPD

Page 16: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Major Findings

• There is shallow understanding of ICT and its implication in general and to the education in particular

• Increased awareness about FOSS tools• Greater appreciation as the KOER material is

available in Kannada• Sharing of many other materials• Greater involvement since they have to train

others in a cascade model

Page 17: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Recommendations

• Institutional capacity development-adoption of DIET

• Long term continuous engagement from CEMCA• More detailed programme logic model and

evaluation framework

Page 18: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Recommendations • Baseline data- It is also important to note that all the changes

reported cannot be attributed only to ITFC and CEMCA initiatives since most of them are also exposed to many other training programmes. detailed and thorough baseline data is essential before the start of the programme to establish the exclusive effects of such interventions in the future.

• Necessity of need assessment• Use of various tools in teacher education and school context• Demonstrations of technology integrated lessons of various formats• Requirement of further handholding in organizing full fledged

training in cascade model

Page 19: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Recommendations

• Need for quality assurance structure/mechanism in place for KOER

• Well established CoP among teachers. However among teacher educators-more efforts needed

• Conscious effort to create more resources for teacher educators in KOER

• Re-looking in to the role and functions of teacher educators in DIETS- academicians rather than inspectors

Page 20: Evaluation of teacher education initiative of CEMCA for three year plan2012 15, prof. M U Paily, Professor, RIE Mysore

Recommendations

• Technology integration research by DIET faculty• Technology integration of routine administrative

work• Interesting trend- BYOD. However financial

scheme to support this move• May have to focus more on in-service

programmes considering the current state of DEd enrollment