March 23, 2006 Comité Institucional para la Elaboración de Instrumentos de Evaluación del...

March 23, 2006

Comité Institucional para la Elaboración de Instrumentos de Evaluación

del Personal Docente

PROGRESS REPORT

Objectives of this OrientationObjectives of this Orientation

Inform the university community, Inform the university community, especially the Personnel Committees, of a especially the Personnel Committees, of a new proposal about what and how to new proposal about what and how to evaluate the academic personnelevaluate the academic personnel

Gather opinions, suggestions, or Gather opinions, suggestions, or comments about the Committee’s comments about the Committee’s proposalproposal

Who are We?Who are We?

Comité Institucional para la Elaboración Comité Institucional para la Elaboración de Instrumentos de Evaluación del de Instrumentos de Evaluación del Personal Docente (CIEIEPD) Personal Docente (CIEIEPD)

Committee appointed by the Committee appointed by the Chancellor, comissioned by the Chancellor, comissioned by the Academic SenateAcademic Senate

To complete previous work related to a To complete previous work related to a new system of evaluation for the RUM new system of evaluation for the RUM academic personnelacademic personnel

Who belongs to this Committee?Who belongs to this Committee?

Prof. María de los A. MedinaProf. María de los A. Medina

(Business Administration)(Business Administration)

Prof. Baldomero Lloréns Prof. Baldomero Lloréns

(Engineering)(Engineering)

Dr. Darnyd Ortíz SedaDr. Darnyd Ortíz Seda

(Arts and Sciences)(Arts and Sciences)

Dr. Angel Custodio Dr. Angel Custodio

(Agricultural Sciences)(Agricultural Sciences)

Dr. Nidia S. LópezDr. Nidia S. López (Department of Orientation)(Department of Orientation)

Prof. Irma N. RamírezProf. Irma N. Ramírez (Library)(Library)

Dr. Doris Ramírez SotoDr. Doris Ramírez Soto (Office of the Dean of Academic Affairs)(Office of the Dean of Academic Affairs)

(Student Representative)(Student Representative)

Dr. Andrés Collazo Dr. Andrés Collazo (Consultant in Educational Psychology)(Consultant in Educational Psychology)

Who belongs to this Committee?Who belongs to this Committee?

Objectives of the CommitteeObjectives of the Committee

Develop an effective system to evaluate the Develop an effective system to evaluate the performance of the academic personnel in RUMperformance of the academic personnel in RUM

Create procedures that would allow the use of Create procedures that would allow the use of the evaluation of the academic personnel in the the evaluation of the academic personnel in the decisions related to the hiring, promotion, and decisions related to the hiring, promotion, and tenure of said personneltenure of said personnel

Establish an evaluation process that would Establish an evaluation process that would lead to identify the academic personnel’s lead to identify the academic personnel’s strengths and areas to be improved with the strengths and areas to be improved with the purpose of fostering professional development.purpose of fostering professional development.

Objectives of the CommitteeObjectives of the Committee

BackgroundBackground

Actual Instrument of EvaluationActual Instrument of Evaluation (Certification Number 86-87-476 JA)(Certification Number 86-87-476 JA)

Academic YearAcademic Year 1995-96 1995-96Comité Institucional de Evaluación y Desarrollo Comité Institucional de Evaluación y Desarrollo del Personal Docente del RUM is constituted by del Personal Docente del RUM is constituted by the Junta Administrativathe Junta Administrativa

(Presided by Prof. Marta Colón).(Presided by Prof. Marta Colón).


1998 – The aforementioned committee 1998 – The aforementioned committee presented a Model for an Evaluation presented a Model for an Evaluation System and Development of Academic System and Development of Academic Personnel based on Personnel based on “Developing a “Developing a Comprehensive Faculty Evaluation System”- Dr. Comprehensive Faculty Evaluation System”- Dr. Raoul Arreola.Raoul Arreola.

BackgroundBackgroundSummary of the Proposed Model for Summary of the Proposed Model for Professors in 1998Professors in 1998

5 main functions with maximum and 5 main functions with maximum and minimum weightsminimum weights– TeachingTeaching– Research/Creative workResearch/Creative work– Other academic endeavorsOther academic endeavors– Service to the UniversityService to the University– Service to the Community Service to the Community

The librarians, researchers, and The librarians, researchers, and extentionists would have their own model.extentionists would have their own model.


Summary of the Proposed Model for Summary of the Proposed Model for Professors in 1998 (cont.)Professors in 1998 (cont.)

Student Evaluation – Acquire the Student Evaluation – Acquire the instrument created by Dr. L. Aleamoni- instrument created by Dr. L. Aleamoni- Univ. ArizonaUniv. Arizona

Evaluation by: Director, Peers and Self – Evaluation by: Director, Peers and Self – Drafts of Instruments (in different stages of Drafts of Instruments (in different stages of development) development)


October 2001-August 2002October 2001-August 2002 Comité Institucional para la Elaboración Comité Institucional para la Elaboración de Instrumentos de Evaluación del de Instrumentos de Evaluación del Personal Docente, presided by Dr. Doris Personal Docente, presided by Dr. Doris RamírezRamírez

August 2002August 2002The committee presents a report The committee presents a report emphasizing its work to improve Module H emphasizing its work to improve Module H – Module for the Evaluation of Teaching – Module for the Evaluation of Teaching by Studentsby Students


October 2002October 2002Dr. Antonio González, Director of the Dr. Antonio González, Director of the Institutional Research and Planning Office Institutional Research and Planning Office (Oficina de Investigación Institucional y (Oficina de Investigación Institucional y Planificación -OIIP), is appointed to continue the Planificación -OIIP), is appointed to continue the work of the Committee.work of the Committee.

November 2004November 2004Comité Institucional (actual committee) is Comité Institucional (actual committee) is activated.activated.

How does our Committee decide to How does our Committee decide to work?work?

Revise Module H (Module for the Revise Module H (Module for the Evaluation of Teaching by Students)Evaluation of Teaching by Students)

Submit a report to the Academic Submit a report to the Academic Senate Senate

Continue to work with Dr. Janet Bonilla Continue to work with Dr. Janet Bonilla and OIIP and OIIP

Pilot studies in paper and on linePilot studies in paper and on line

Draft a “Proposal for a System of Draft a “Proposal for a System of Evaluation for the RUM Academic Evaluation for the RUM Academic Personnel” that:Personnel” that:

Would consider the work of previous Would consider the work of previous committees.committees.Would be uniform for all academic Would be uniform for all academic personnel.personnel.Would be flexible to attend to the Would be flexible to attend to the peculiarites of the different faculties.peculiarites of the different faculties.


Would be consonant with the Would be consonant with the institution’s actual vision and mission.institution’s actual vision and mission.

Would include the participation of all Would include the participation of all academic personnel.academic personnel.

Would reflect the consensus of the Would reflect the consensus of the academic personnel.academic personnel.


General Description of the SystemGeneral Description of the System

It offers the academic personnel the opportunity to establish, in accordance with their supervisor, a work plan that would allow the professor’s professional goals to be aligned with the department’s strategic planThe work plan allows the

combination of the different areas of academia.

Its purpose is to achieve that the Its purpose is to achieve that the evaluation of the academic personnel be evaluation of the academic personnel be intrinsically related with their professional intrinsically related with their professional development and their contribution to the development and their contribution to the education process in the institution. education process in the institution.

One model for all academic personnel in One model for all academic personnel in RUM.RUM.



Areas in which the academic personnel Areas in which the academic personnel will be evaluated are:will be evaluated are:

General Academia (Docencia)General Academia (Docencia)

TeachingTeaching

Research and Creative WorkResearch and Creative Work

ServiceService


All academic personnel will be evaluated in the All academic personnel will be evaluated in the General Academia area and in at least two of General Academia area and in at least two of the other three areas: Teaching, Research and the other three areas: Teaching, Research and Creative Work, and Service.Creative Work, and Service.

The weight in the evaluation for the area of The weight in the evaluation for the area of General Academia will be of 20%.General Academia will be of 20%.

The weight of the other areas will be relative to The weight of the other areas will be relative to the professor’s academic schedule but none will the professor’s academic schedule but none will be less than be less than 10%.10%.


For each one of the four areas the For each one of the four areas the Committee has defined Committee has defined

Components – specific aspects or spheres Components – specific aspects or spheres of action in which the academic personnel of action in which the academic personnel will be evaluated.will be evaluated.

Criteria -Criteria - properties or characteristics of properties or characteristics of the action to be evaluatedthe action to be evaluated

Explanatory Diagram with ExampleExplanatory Diagram with ExampleAREA COMPONENTES CRI TERI OS

ENSENANZA

CALIDAD DELCONTENIDO DE LA

ENSENANZA

DESTREZAS DEDISENO

DESTREZAS DEPRESENTACION

PRODUCCION DEM ATERIALESDIDACTICOS

ADM INISTRACIONDE LA ENSENANZA

ACTUALIZACIONDEL CONTENIDO

PROFUNDIDAD DEACUERDO ALNIVEL DE LAENSENANZA

REPRESENT ACIO NDE DIVERSOS

PUNTOS DE VISTA

PERT IENCIA DELCO NT ENIDO PARA

LAS M ET AS DELCURRICULO

GENERAL ACADEMIA AREAGENERAL ACADEMIA AREA

This area includes general aspects This area includes general aspects related to the performance of the related to the performance of the academic personnel in any of the academic personnel in any of the teaching, research and creative work, teaching, research and creative work, or service areas.or service areas.

The components of this area are based The components of this area are based on the Reglamento General of the on the Reglamento General of the University of Puerto Rico.University of Puerto Rico.

Fulfillment of duties

Professional development

Professional attitude

Awards and recognitions

Contribution to the functioning of the institution

Components of the Components of the General Academia AreaGeneral Academia Area

GENERAL ACADEMIA AREAGENERAL ACADEMIA AREA

COMPONENTCOMPONENT CRITERIACRITERIA

Professional developmentProfessional development Examples:Examples:

Affiliation to academic Affiliation to academic or professional or professional associations associations

Attendance to activities Attendance to activities related to teaching, related to teaching, research or service research or service rendered (workshops, rendered (workshops, conferences, congresses, conferences, congresses, among others).among others).

TEACHING AREATEACHING AREA

Tasks associated with the design and Tasks associated with the design and the presentation of teaching-learning the presentation of teaching-learning activities with the purpose of achieving activities with the purpose of achieving a change in the knowledge, attitudes, a change in the knowledge, attitudes, skills or the adoption of practices in the skills or the adoption of practices in the students.students.

Specifically, this refers to the presential Specifically, this refers to the presential and non-presential teaching in the and non-presential teaching in the classroom.classroom.

Quality of the content of teaching

Design skills

Presentation skills

Production of didactic materials

Course management

Components of the Teaching AComponents of the Teaching Arearea

TEACHING AREATEACHING AREA

COMPONENTCOMPONENT CRITERIACRITERIADesign skillsDesign skills Examples:Examples:

Clear goals and objectives Clear goals and objectives and achievable in accordance and achievable in accordance with the students’ levelwith the students’ level

Methods and activities in Methods and activities in accordance with the accordance with the objectivesobjectives

Level of difficulty of activities Level of difficulty of activities and assigned tasks, in and assigned tasks, in accordance with the available accordance with the available time and the students’ level.time and the students’ level.

RESEARCH AND CREATIVE WORK AREARESEARCH AND CREATIVE WORK AREA

Includes the systematic actions that the Includes the systematic actions that the academic personnel do with the academic personnel do with the purpose of:purpose of:

Broadening knowledge in their Broadening knowledge in their discipline.discipline.

Looking for solutions to problems of Looking for solutions to problems of application and practice.application and practice.

Producing new works or products.Producing new works or products.

Research and creative work must be Research and creative work must be related to the professor’s area of related to the professor’s area of specialization, the teaching of the specialization, the teaching of the subject matter the professor teaches subject matter the professor teaches or the service that the professor or the service that the professor renders.renders.


Components of the Research and Components of the Research and Creative Work ACreative Work Arearea

ProductivityProductivityQuality of research and creative workQuality of research and creative workDivulgation of research and creative Divulgation of research and creative workworkIntegration of research and creative Integration of research and creative work to teaching work to teaching



ProductivityProductivity Examples:Examples:

Proposals prepared, Proposals prepared, approved, and financedapproved, and financed

Drafts submitted for Drafts submitted for publicationpublication

Theses and Theses and dissertations directeddissertations directed

Application that academic personnel Application that academic personnel does of the knowledge and skills of does of the knowledge and skills of their area of expertise with the purpose their area of expertise with the purpose of:of:

Benefitting the functioning of the Benefitting the functioning of the institution and the development of institution and the development of students.students.Benefitting people, groups, Benefitting people, groups, agencies or community institutions.agencies or community institutions.Strengthening or developing their Strengthening or developing their profession or discipline.profession or discipline.

SERVICE AREASERVICE AREA

Categories of the Service AreaCategories of the Service Area

Service to the institutionService to the institution

Service to the communityService to the community

Service to the professionService to the profession

Services of informationServices of information

Services for student development and Services for student development and learninglearning

Services of Agricultural ExtensionServices of Agricultural Extension

Services of academic administrationServices of academic administration


1.1. Service to the institutionService to the institution

Actions taken by the academic personnel Actions taken by the academic personnel leading to:leading to:

Benefit the functioning of the institution Benefit the functioning of the institution and the students’ developmentand the students’ development

Not directly related with teaching or with Not directly related with teaching or with the administrative tasks of academic the administrative tasks of academic management.management.

2.2. Service to the communityService to the community

Actions taken by the academic personnel with the Actions taken by the academic personnel with the purpose of:purpose of:

Benefitting people, groups, agencies or Benefitting people, groups, agencies or community institutions, beyond the university community institutions, beyond the university community.community.

Includes social, psychological, educational Includes social, psychological, educational services or any other service of a different services or any other service of a different nature.nature.

Does not include services from Agricultural Does not include services from Agricultural ExtensionExtension


3. Service to the profession3. Service to the profession

Actions taken by the academic personnel within Actions taken by the academic personnel within organizations related to their profession, organizations related to their profession, directed towards the strengthening and directed towards the strengthening and developing of their profession.developing of their profession.


4. Services of information4. Services of information

Actions taken by the academic personnel that Actions taken by the academic personnel that occupy a position of librarian leading to:occupy a position of librarian leading to:

Development and management of the Development and management of the information resources and services. information resources and services.

Development of the information Development of the information competencies of students, faculty, and competencies of students, faculty, and other people.other people.


5.5. Services for student development Services for student development and learningand learning

Actions taken by the academic personnel Actions taken by the academic personnel of professional counseling, social work or of professional counseling, social work or psychology directed towards the psychology directed towards the academic, personal and career academic, personal and career development of the students.development of the students.


6.6. Services of Agricultural ExtensionServices of Agricultural ExtensionActions taken by the academic personnel of Actions taken by the academic personnel of the Service of Agricultural Extension to the Service of Agricultural Extension to educate in the recommended practices with educate in the recommended practices with the purpose of :the purpose of :

Sustaining a prosperous agricultureSustaining a prosperous agriculture

Improving the quality of family life Improving the quality of family life

Providing orientation and guidance to Providing orientation and guidance to our youth and the development of our youth and the development of community resourcescommunity resources


7.7. Services of academic administrationServices of academic administration Includes the functions and tasks performed by some Includes the functions and tasks performed by some members of the academic personnel that occupy members of the academic personnel that occupy academic-administrative positions such as:academic-administrative positions such as:

deandean

associate deanassociate dean

assistant deanassistant dean

department directordepartment director

director of an academic programdirector of an academic program

project director, among others.project director, among others.


Components of Services to the Institution, Components of Services to the Institution, the Community and the Professionthe Community and the Profession

ProductivityProductivity

Importance of the serviceImportance of the service

Quality of the ServiceQuality of the Service

DivulgationDivulgation

AREAS OF SERVICES TO THE INSTITUTION, THE AREAS OF SERVICES TO THE INSTITUTION, THE COMMUNITY AND THE PROFESSIONCOMMUNITY AND THE PROFESSION


Importance of the serviceImportance of the service Examples:Examples:

Degree in which the Degree in which the service contributes to the service contributes to the achievement of the achievement of the mission and goals of mission and goals of RUM in general, the RUM in general, the faculty and the faculty and the departmentdepartment

Benefit for the persons Benefit for the persons receiving the servicereceiving the service

Components of the Components of the Services of Information *Services of Information *

(Librarians)(Librarians)GeneralGeneralDevelopment and management of collections Development and management of collections Services of referenceServices of referenceDevelopment, application and management of Development, application and management of electronic resources and services electronic resources and services Application and management of multimediaApplication and management of multimedia

*Pending approval by the CIEIPDCIEIPD

Components of the Services for the Components of the Services for the Students Development and Learning Students Development and Learning

and Agricultural Extensionand Agricultural Extension

The components of the Services for the The components of the Services for the Students Development and Learning and Students Development and Learning and Agricultural Extension are in the process Agricultural Extension are in the process of development.of development.

Service of Academic Administration*Service of Academic Administration*

Academic LeadershipAcademic Leadership

Communication and interpersonal relationsCommunication and interpersonal relations

Administrative ability Administrative ability

Ability to manage finances Ability to manage finances

*Pending the approval of the Committee

Future Activities of the CommitteeFuture Activities of the Committee

The faculty representatives will present the The faculty representatives will present the “Proposal for the System of Evaluation” to “Proposal for the System of Evaluation” to the personnel committees of their faculties the personnel committees of their faculties and the departmental committees.and the departmental committees.

– Attain consensus about the Evaluation Attain consensus about the Evaluation Model, its areas, components and criteria.Model, its areas, components and criteria.


Create working groups by area to Create working groups by area to generate instruments of evaluation generate instruments of evaluation (available list of possible questions or (available list of possible questions or reactives). reactives).


Study based on the Theory of Social Judgment Study based on the Theory of Social Judgment Profiles of the performance of 20 fictitious Profiles of the performance of 20 fictitious

members of the academic personnel. Data of the members of the academic personnel. Data of the academic personnel is examined in each area and, academic personnel is examined in each area and, through a scale, the general performance of each through a scale, the general performance of each member is assigned in each area. member is assigned in each area.

Individual and group analysis to infer the assigned Individual and group analysis to infer the assigned weights for the components. weights for the components.

Establish, at the institutional level, the relative Establish, at the institutional level, the relative weights of each component within each of the weights of each component within each of the four areas. four areas.

Activity with the department directors, members of Activity with the department directors, members of the departmental personnel committees. the departmental personnel committees.

How to Communicate with the How to Communicate with the Committee?Committee?

Through your representativeThrough your representative

Through our webpageThrough our webpage

http://www.uprm.edu/evaluaciondocente/http://www.uprm.edu/evaluaciondocente/

DeadlineDeadline

March 10, 2006March 10, 2006

Comments or questions?Comments or questions?

March 23, 2006 Comité Institucional para la Elaboración de Instrumentos de Evaluación del...

Documents

Transcript of March 23, 2006 Comité Institucional para la Elaboración de Instrumentos de Evaluación del...