Curriculum ReformCurriculum Reformpart 2part 2

QUALITY ASSURANCE QUALITY ASSURANCE ASPECTS -ASPECTS -

Medical FacultyMedical Faculty

University of NišUniversity of Niš

Prof. dr Gordana KocićProf. dr Gordana Kocić

The Bologna Declaration makes

explicit reference to quality assurance including the promotion of European co-operation in quality assurance, with a view to developing

comparable criteria and methodologies. 

Q A

CV Reform

ECTS

PBL

Electives

Internal QA System - Internal QA System - PrinciplesPrinciples

Commitment to Commitment to quality improvementquality improvement

Focus on Focus on student needsstudent needs

Coherent and transparentCoherent and transparent system structuresystem structure

Efficiency, Efficiency, sustainabilitysustainability

Promotion ofPromotion of quality culturequality culture

A proposal for the internal quality assurance system at the Faculty of Medicine in Nis was prepared including the following elements :

•     Students’ program evaluation• Students’ course evaluation•      Monitoring of teaching procedure•      Internal quality evaluation (self-evaluation).

Based to the Articles 218-222 of the Statute of the Faculty of Medicine in Niš, after the proposition of the Commission for Undergraduate Studies, the Board for Science and Education on its session held November 15, 2005 puts forth the following

DECISIONIAt the Faculty of Medicine, University of

Niš, the Center for Monitoring, Assurance, Improvement and Development of Quality of the study programs and teaching is herewith established.

IIIn order to effectuate its purpose, the Center

forms the following commissions:Commission for study programs reformCommission for appropriation of ECTS, modes

of credit accumulation and student-burdenCommission for education efficacy analysisCommission for teaching quality control and

assurance The Center, if necessary, will form other

commissions and boards.

Developmental guidelines of the Centre are an integral part of the systematic,

already initiated activities and changes in the period of inclusion of the Faculty of

Medicine into the Bologna process, aiming basically at establishing a well integrated

educational area of Europe.

Regarding high standards adoption and maintenance of the Faculty of Medicine University of Niš in education, research and services, the Center will realize its

objectives through the activities of appropriate commissions and boards for internal quality control, with mandatory

student participation.

Multi-level harmonization of the activities of these commissions and

work-groups results in the evaluation reports on study programs and working conditions in all study

groups, adopted by the Board for Science and Education twice a year

(after I and II semesters).

The composition, domains of work, election modes, mandate duration, modes of decision-making of commissions and boards is established in the Faculty Statute.

The decision is to be given to: Teaching Dept., Dept. for Legal and General Affairs

and faculty Archive.No: 14-6870-2/3

In Niš, 15 November, 2005

Based on the Article 219 of its Statute, the Faculty

adopted the Act on the Quality of Teaching

at the Faculty of Medicine in Niš.

Previous acts

The Act on the Quality of Teaching at the Faculty of Medicine in Niš is based on the following priciples:

• that the quality assurance system has a student focus;

• that it is supportive and to assist students & staff; • that it is ‘open’ and well documented, with

information easily available to staff, who can participate fully and receive extensive feedback;

• that it satisfies the quality assurance requirements of the university and any external quality assurance agency which the university must satisfy;

• that it is based on the principle that each member of staff is responsible for his work;

• that the system itself is kept under review

The Quality Control Commission comprises 15 members of full-time academic staff together with 4 students and a permanent team secretary. The constitution is as follows:

Members:Members: 15, out of which 11 full-15, out of which 11 full-time Faculty employees time Faculty employees and 4 student membersand 4 student members

Secretary:Secretary: Chief of Student Chief of Student Administrative Office Administrative Office (nominated by the (nominated by the DeanDean) )

As required, Audit Team As required, Audit Team work is supported by the work is supported by the Faculty Faculty VVice-ice-DDean for ean for teaching and student teaching and student vice-deanvice-dean

The Quality Control Commission of the Faculty of Medicine in Niš has the following tasks:

• control of actual performance all types of

teaching activities and examinations• monitoring of students objections• anonymous questionnaires concerning

performed teaching activities• monitoring of student accomplishments for

each teaching subject• monitoring of the proportion of students

passing or failing exams for each teaching subject

• control of the departmental teaching & exam documentation

Report of theReport of the Control Quality Control Quality Commission Commission

In the In the yearyear 2004 2004 the the TeamTeam held 6 meetings. At held 6 meetings. At its 2nd meeting the its 2nd meeting the Team was divided into 3 Team was divided into 3 subgroups, each with special tasks from the subgroups, each with special tasks from the Regulations on Teaching Quality Control. Regulations on Teaching Quality Control.

The subgroups had their own separate meetings The subgroups had their own separate meetings 2-3 times a month and meetings with the 2-3 times a month and meetings with the Commission President (coordination). Commission President (coordination).

The President had meetings with the subgroup The President had meetings with the subgroup presidents for the report submission.presidents for the report submission.

Practical teaching control at the study Practical teaching control at the study groups of medicine and dentistry was groups of medicine and dentistry was performed commissionally (2 professors)performed commissionally (2 professors)

Selected courses and time were randomly Selected courses and time were randomly chosen.chosen.

Examination control was performed by Examination control was performed by way of objections monitoring during the way of objections monitoring during the summer term in accordance with Article 11 summer term in accordance with Article 11 of the Regulations on Quality Control at of the Regulations on Quality Control at the Faculty of Medicine in Nis; the the Faculty of Medicine in Nis; the following issues were noted:following issues were noted:

Examiners are not randomly selected Examiners are not randomly selected (drawn) before the exam for all (drawn) before the exam for all coursescourses

Exam questions are not randomly Exam questions are not randomly selected (drawn) before the exam for selected (drawn) before the exam for all coursesall courses

Minimal knowledge for each exam Minimal knowledge for each exam question was not determinedquestion was not determined

Variability of the reports demonstrated that Variability of the reports demonstrated that most of the responsible teachers and dept. most of the responsible teachers and dept. chiefs chiefs had not had a clear vision on had not had a clear vision on the way the report should have been the way the report should have been deviseddevised

The Commission concluded that a The Commission concluded that a clear clear written manualwritten manual (form) should be devised (form) should be devised

The forms enabled two-way communication The forms enabled two-way communication of the Commission and faculty management of the Commission and faculty management with the faculty departments.with the faculty departments.

It was noted that the teaching It was noted that the teaching organisation (practical & organisation (practical & theoretical) is well done for the theoretical) is well done for the institute-based courses and at the institute-based courses and at the dentistry study group, which dentistry study group, which cannot be said for all clinical cannot be said for all clinical courses at the study group of courses at the study group of medicine.medicine.

Based on the Article 219 of the Statute of the Based on the Article 219 of the Statute of the Faculty of Medicine in NiFaculty of Medicine in Niš, Board for Science and š, Board for Science and Education, after the suggestion of the Education, after the suggestion of the Undergraduate Undergraduate Education Board, put forward the Education Board, put forward the Act about the Act about the

Regulations on Preparing & Performing Regulations on Preparing & Performing of the Written Test as a mandatory part of of the Written Test as a mandatory part of the examination (containing 27 Articles).the examination (containing 27 Articles).

Basic parts are given as an annexBasic parts are given as an annex

The number of test questions is determined in The number of test questions is determined in accordance with the needs and characteristics of accordance with the needs and characteristics of the course.the course.

The Written test could be eliminatory or qualifying.

The test must not have less than 30 and The test must not have less than 30 and more than 80 questions.more than 80 questions.

The results achieved at the qualifying test The results achieved at the qualifying test (closed type) are translated into the appropriate (closed type) are translated into the appropriate mark based on the number of points realised, mark based on the number of points realised, which significantly influences the final mark.which significantly influences the final mark.

The questions in the test have to be The questions in the test have to be contained in the programme contained in the programme

TThe list of exam questions for the he list of exam questions for the appropriate course, and answers have to appropriate course, and answers have to be contained in the literature adopted for be contained in the literature adopted for the course by the Board for Science and the course by the Board for Science and Education. Education.

The confidentiality of the The confidentiality of the question bank has to be question bank has to be strictly preserved by all the strictly preserved by all the teachers and associates, teachers and associates, with Chief and Secretary of with Chief and Secretary of the course Department.the course Department.

Before the marks are assigned, the Before the marks are assigned, the minimal knowledge necessary for minimal knowledge necessary for passing the test should be passing the test should be determined (the passing threshold). determined (the passing threshold).

The threshold should exceed The threshold should exceed 5555% if % if the test is not divided into subunits the test is not divided into subunits (course areas).(course areas).

The mode of grading was determined by The mode of grading was determined by the point listthe point list

more than 55-64more than 55-64% of % of correct answerscorrect answers

grade 6grade 6

6655-7-744% of correct % of correct answersanswers

grade 7grade 7

7755-8-844% of correct % of correct answersanswers

grade 8grade 8

8855-9-944% of correct % of correct answersanswers

grade 9grade 9

9955-100% of correct -100% of correct answersanswers

grade 10grade 10

The student passing the final exam for the The student passing the final exam for the course through the test and not satisfied course through the test and not satisfied with with the the results results can take the oral exam. can take the oral exam.

In that case the student can get even the In that case the student can get even the lower grade on oral exam (not less than 6, lower grade on oral exam (not less than 6, though).though).

After the test is performed, its analysis is After the test is performed, its analysis is performed. The success, get-through rate performed. The success, get-through rate and degree of difficulty were assessed. and degree of difficulty were assessed. The test analysis is performed continually The test analysis is performed continually for the improvement purposes. for the improvement purposes.

Based on the analysis the question types Based on the analysis the question types are altered, the questions are eliminated are altered, the questions are eliminated or amended. or amended.

The bank of questions has to be regularly The bank of questions has to be regularly amended & supplemented.amended & supplemented.

If the get-through rate was too If the get-through rate was too small based on the test results small based on the test results (either as the final exam test or as (either as the final exam test or as a part of the exam), the get-a part of the exam), the get-through threshold as well as the through threshold as well as the marking may be corrected for that marking may be corrected for that exam term. exam term.

The relevant decisions on these The relevant decisions on these issues are made by the Dean.issues are made by the Dean.

Departments are encouraged in developing their own quality assurance systems which involve:

•Registry of theoretical teaching (title of the methodical unit, name of the teacher, number of lessons and number of attending students)•Registry of practical teaching (title of the methodical unit, name of the teacher, number of practical training classes and number of attending students)•Main examination registry (special registry for each study group) containing numbers of students examined, examination questions and grades obtained)

.

The most useful instrument is a questionnaire, which is filled out by students at the end of every semester. A questionnaire was made and distributed A questionnaire was made and distributed to the students to assess their oppinion to the students to assess their oppinion concerning above mentioned parts of concerning above mentioned parts of curriculum reform. curriculum reform.

At present, the questionaire contains the questions concerning course evaluation.

Students could state the Students could state the elements of their education elements of their education they are not satisfied with:they are not satisfied with:

Teaching organisationTeaching organisationLiteratureLiteratureFaculty administrationFaculty administration

IIIIAfter the Quality Assurance After the Quality Assurance

Commission request, the Commission request, the questionnaire was conducted on the questionnaire was conducted on the studentstudentss

The students gave marks 1-5 and The students gave marks 1-5 and answered the questionsanswered the questions,,where 1 where 1 denoted “complete disagreement” denoted “complete disagreement” and 5 “complete agreement”.and 5 “complete agreement”.

IIIIII

The questionnaire was The questionnaire was completely anonymous and completely anonymous and enrolled medical and enrolled medical and dentistry students. dentistry students.

At the Institute of Biochemistry the questionnaire At the Institute of Biochemistry the questionnaire on the teaching reform was applied. The on the teaching reform was applied. The questions referred to:questions referred to:

opinions on the introduction of seminaries as a opinions on the introduction of seminaries as a part of teachingpart of teaching

opinions on partial-colloquial examsopinions on partial-colloquial exams opinions on cummulative, continual grading opinions on cummulative, continual grading

through the whole school yearthrough the whole school year student satisfaction with the teachers and student satisfaction with the teachers and

associatesassociates

I

Out of 120 students attending their second study year

36.23% were very satisfied with seminars

94.02% very satisfied with partial coloquial exam

62.31% satisfied with continual assesment.

biochemistry 4.2 +/- 0.5biochemistry 4.2 +/- 0.5

3.23 (3.00-3.46) –3.23 (3.00-3.46) –Knowledge acquired agree Knowledge acquired agree

well with expectations on admissionwell with expectations on admission

3.41 (2.8-4.03) – 3.41 (2.8-4.03) –

Enough timeEnough time

to prepare for to prepare for

lectures and examinationslectures and examinations

3.02 (2.59-3.44) 3.02 (2.59-3.44) – – Regular attendance Regular attendance

to lecturesto lectures

Student attendanceStudent attendance and opinion about time and opinion about time and acquired knowledge and time for preparing lecturesand acquired knowledge and time for preparing lectures

II

A students questionnaire about the acquired A students questionnaire about the acquired knowledge at the Medical Faculty of Nisknowledge at the Medical Faculty of Nis

3.40Faculty offers

full preparation for the

professional work

3.82Faculty offers

adequate theoretical knowledge

2.99Faculty offers

adequate practical knowledge

3.21Well organized

Faculty administration

1 5 Completely agreeCompletely disagree

III

3.87 (3.25-4.50) –3.87 (3.25-4.50) –Professors well prepared Professors well prepared

for lecturesfor lectures

3.68 (3.17-4.20) – 3.68 (3.17-4.20) – Professors adequately respond Professors adequately respond

to additional questionsto additional questions

3.85 (3.50-4.20) –3.85 (3.50-4.20) – Professors are always present for consultations with studentsProfessors are always present for consultations with students

4.25 (3.75-4.75) – Professors are not late 4.25 (3.75-4.75) – Professors are not late for lectures and practical classesfor lectures and practical classes

3.57 (3.15-4.00) –3.57 (3.15-4.00) – Professors encourage active Professors encourage active

student participationstudent participation

Teaching staff:Teaching staff: IV

Before a new course can be developed, it must first gain initial approval from the relevant School Board and from the Pro-Vice-Chancellor (Academic). The purpose of this process is to ensure that:-the proposed course is in line with the School's development plan and the its overall mission; - the Faculty is likely to be able to provide adequate physical and human resources to support the course; - the proposed course is likely to be financially viable.

V

After the Reform Commission request, the After the Reform Commission request, the questionnaire was conducted on the satisfaction questionnaire was conducted on the satisfaction of students with the new courseof students with the new course

“ “Introduction into clinical practice” (15T + 15P)Introduction into clinical practice” (15T + 15P)

Out of 100 examinees, all 100Out of 100 examinees, all 100%% were very were very satisfied with early contacts with clinical work & satisfied with early contacts with clinical work & patients andpatients and

all of them requested more classes.all of them requested more classes.

All given suggestions can take into account the realistic potential of the department.

The results shoud be checked at the next evaluation after CV Reform programm implemented.

The QA system is now tightly linked to Faculty management as integral part of the institution’s strategic work in the CV reform process.

QACV Reform

Continual Assesment Electives Seminars

ECTS

Test

Practicalknowledge