Training Seminar for Chairpersons and Paper Setters December · PDF fileTraining Seminar for...
Transcript of Training Seminar for Chairpersons and Paper Setters December · PDF fileTraining Seminar for...
MATSEC Seminar 2010MATSEC Seminar 2010
Training SeminarTraining Seminar
for Chairpersons and Paper Settersfor Chairpersons and Paper Setters
December 2010December 2010
Basic PrinciplesBasic Principles
Quality examinations Quality examinations fit the purposefit the purpose for which for which they are set.they are set.
What is the purpose of MATSEC examinations?What is the purpose of MATSEC examinations? The purpose of the examination is to give an The purpose of the examination is to give an
opportunity to opportunity to allall candidates to demonstrate what candidates to demonstrate what they know, understand and can do in a particular they know, understand and can do in a particular subject. subject.
How can this purpose beHow can this purpose beachieved by means of theachieved by means of the
examination papers?examination papers?
By maximizing the validity of the examinationBy maximizing the validity of the examination Content validity (coverage of the 2011 syllabus Content validity (coverage of the 2011 syllabus
content and skills, range of difficulty especially in the content and skills, range of difficulty especially in the differentiated papers at SEC level)differentiated papers at SEC level)
Face validity (type of questions; language, symbols Face validity (type of questions; language, symbols and conventions used in questions)and conventions used in questions)
Consequential validity (high stakes exam for Consequential validity (high stakes exam for individuals; wash back effect on teaching and individuals; wash back effect on teaching and learning; credibility MATSEC examinations)learning; credibility MATSEC examinations)
Specification gridsSpecification grids are needed to check validityare needed to check validity
Reliability and ExaminationReliability and ExaminationPapersPapers
Freedom from bias Freedom from bias –– the context, the language, the examples the context, the language, the examples and illustrations used in questions may be sources of bias that and illustrations used in questions may be sources of bias that should be avoided.should be avoided.
Inclusiveness and equity Inclusiveness and equity –– all members of society should be all members of society should be treated with equal respect, irrespective of their gender, abilittreated with equal respect, irrespective of their gender, ability, y, cultural and religious backgrounds.cultural and religious backgrounds.
Differentiation and discrimination Differentiation and discrimination –– the examination should the examination should cater for the whole ability range yet it should also discriminatcater for the whole ability range yet it should also discriminate e between different achievement levels.between different achievement levels.
Options must be of comparable difficulty.Options must be of comparable difficulty.
Mark SchemesMark Schemes help in maximizing the reliability of help in maximizing the reliability of examinations.examinations.
Checking Examination PapersChecking Examination Papersand Mark Schemesand Mark Schemes
ChecklistsChecklists
Use the ChairpersonsUse the Chairpersons’’ Checklist before Checklist before sending the examination papers and mark sending the examination papers and mark scheme to the Reviser.scheme to the Reviser.
Make modifications agreed with the Make modifications agreed with the Reviser.Reviser.
MATSEC Support Unit staff will vet the MATSEC Support Unit staff will vet the papers and may suggest amendments.papers and may suggest amendments.
MEETINGS TO PREPARE PAPERS + MARK SCHEME
+ SPECIFICATION GRID(CHAIR + PAPER
SETTERS)
APPOINTMENT OF PAPER SETTERS’PANEL (CHAIR +
PAPER SETTERS + REVISER)
PAPERS + MARK SCHEME +
SPECIFICATION GRID SEEN, WORKED OUT,
CHECKED BY REVISER
CHAIR & PAPER SETTERS GO
THROUGH REVISER’S COMMENTS
PAPERS + MARK SCHEME + SPECIFICATION GRID
GIVEN TO PSAO AT MATSEC SUPPORT UNIT
PAPER VETTED BY PSAO
PRINTING OF PAPER
MEETING OF PSAO & CHAIR TO FINALISE
PAPER FOR PRINTING
Great Caution!!!
Exam takenConversion of Index Number
to Office Number
Preparation ofpapers in batches
for Markers
Moderation MeetingChair + Markers
Correction
Collection ofS B A marks
Grade boundariesmeeting: Chair &MATSEC staff
Publicationof results
Appointment ofMarkers Panel
Moderationof S B A
Fine tuning ofmarking scheme
ModerationBy Chair
Compilation ofresults by Chair
Oral exammarks
Examiners’Report
MATSEC Seminar 2010MATSEC Seminar 2010
Reference is made to Reference is made to the the Guidelines for Guidelines for MATSEC Examination MATSEC Examination Panels, 2007Panels, 2007
MATSEC Seminar 2010MATSEC Seminar 2010
SPECIFICATION GRIDS & MARKING SCHEMESSPECIFICATION GRIDS & MARKING SCHEMES
PurposePurpose –– Specification grids and marking Specification grids and marking schemes greatly increase the validity and reliability schemes greatly increase the validity and reliability of examinations.of examinations.
FormulationFormulation –– the preparing of specification the preparing of specification grids and marking schemes is a lengthy task that grids and marking schemes is a lengthy task that requires diligence, preparation and experience.requires diligence, preparation and experience.
MATSEC Seminar 2010MATSEC Seminar 2010
MARKING SCHEMESMARKING SCHEMES
The Chairperson is required to ensure that the panel adopts The Chairperson is required to ensure that the panel adopts procedures in the marking schemes to ensure that:procedures in the marking schemes to ensure that: questions & marking schemes are written at the same questions & marking schemes are written at the same time; time; marks are given for attainment allowing credit for marks are given for attainment allowing credit for knowledgeknowledge, , understandingunderstanding & & skillsskills;; marks are commensurate with the demands of the marks are commensurate with the demands of the question;question; marking schemes are marking schemes are clearclear, , consistentconsistent, , questionquestion--specificspecific, , accept justifiable accept justifiable alternativesalternatives & awards & awards workingsworkings of of calculation.calculation.
Guidelines to be followed by the MATSEC Examination Panels, 2007Guidelines to be followed by the MATSEC Examination Panels, 2007
MATSEC Seminar 2010MATSEC Seminar 2010
SPECIFICATION GRIDSSPECIFICATION GRIDS
The Panel is required to adopt specification grids to ensure The Panel is required to adopt specification grids to ensure that:that: the questions are the questions are within the syllabuswithin the syllabus & adequately cover & adequately cover the subject matter & the assessment objectives;the subject matter & the assessment objectives; standards are maintained & standards are maintained & questions are not repeatedquestions are not repeatedfrom one session to another;from one session to another; all all major topics in the syllabus are coveredmajor topics in the syllabus are covered..
Guidelines to be followed by the MATSEC Examination Panels, 2007Guidelines to be followed by the MATSEC Examination Panels, 2007
Question 10Question 10
1515151530304040Total MarksTotal Marks
Question 9Question 9
Question 8Question 8
Question 7Question 7
Question 6Question 6
Question 5Question 5
Question 4Question 4
Question 3Question 3
Question 2Question 2
Question 1Question 1
Practical Practical AssessmentAssessment
Design & Design & planning of planning of experimentsexperiments
Problem Problem SolvingSolving
Knowledge and Knowledge and UnderstandingUnderstanding
Specification Grid – Examination Paper
Speaking and ListeningCandidates will be expected to:O1. communicate clearly, structuring and organising their talk and adapting it to different situationsO2. listen to and understand spoken EnglishO3. interact in discussions and play a number of roles.Candidates will be required to:O4. explain, describe, narrateO5. explore, imagine and possibly analyseO6. discuss, argue and/or persuade in a variety of formal and/or informal contexts.
ReadingCandidates will be expected to:O7. read and understand different text typesO8. evaluate information presented textually, visually or graphically, and select what is relevantO9. follow an argument or trend of thought, identifying implicationsO10. analyse the writer’s intentions and attitudes through the use of language.
WritingCandidates will be expected to:O11. select, order and present information, ideas and opinionsO12. express what is thought, felt or imaginedO13. write with a sense of audience and purpose showing an awareness of style in a variety of situations.
ASSESSMENT OBJECTIVES FOR A LANGUAGE EXAMINATION
O9O9
O8O8
O7O7
O6O6
O5O5
O3O3
O10O10
O4O4
O2O2
O1O1
Q 10Q 10
Q 9Q 9
Q 8Q 8
Q7Q7
Q6Q6
Q5Q5
Q4Q4
Q3Q3
Q2Q2
Q1Q1
O13O13O12O12O11O11
Specification Grid according to learning objectives
Topic 4Topic 4Topic 3Topic 3Topic 2Topic 2Topic 1Topic 1
Question 10Question 10
Total MarksTotal Marks
Question 9Question 9
Question 8Question 8
Question 7Question 7
Question 6Question 6
Question 5Question 5
Question 4Question 4
Question 3Question 3
Question 2Question 2
Question 1Question 1
Topic 8Topic 8Topic 7Topic 7Topic 6Topic 6Topic 5Topic 5
Specification Grid – According to topic
MATSEC Seminar 2010MATSEC Seminar 2010
The Chairperson is expected to:The Chairperson is expected to:
organise the organise the standardization meetingstandardization meeting where a where a sample of scripts is marked by the markers & the sample of scripts is marked by the markers & the marking scheme is finalised;marking scheme is finalised; moderate a samplemoderate a sample of scripts to ensure that the of scripts to ensure that the marks are awarded consistently & according to the marks are awarded consistently & according to the marking scheme.marking scheme.
Guidelines to be followed by the MATSEC Examination Panels, 2007Guidelines to be followed by the MATSEC Examination Panels, 2007
Objectives: To write in a style appropriate to a formal letter.
Marking : Marking should be in accordance with the writing assessment scale. (Content - 4, Fluency - 3, Accuracy - 3)
Under content, credit should be given for the candidate’s creativity in presenting his/her own ideas, However, some of the following points may be included. Maximum of one mark is to be deducted from total for improper layout.
Layout includes sender’s address, date, editor's address, subject, salutation and complimentary close
NOTE: Refer to the writing assessment scale.
Value Points:− What adult education means− Need for such an education− How to implement it− Involvement of youngsters− Precautions
Marking scheme – Letter to the editor
Conduction is the transfer of heat energy between neighbouring molecules in a substance from a hot region to a colder one.
1 MARK
In order to show that water is a poor conductor of heat a long test tube with ice cold water is taken. Some ice cubes are put in the test tube and kept at the bottom with the help of a wire gauze. The water in the upper part of the test tube is heated. It will be observed that water at the top end starts boiling, but the ice at the bottom does not melt completely 2 MARKS
Water is a poor conductor of heat.
1 MARK
10. What is conduction? Describe with a diagram, an experiment to show whether water is a good conductor of heat. State if it is considered as a good or bad conductor.
7 MARKS
LABELLED DIAGRAM
2 MARKS DIAGRAM
1 MARK LABELLING
Write a story that ends with the phrase Write a story that ends with the phrase ‘…‘…I was so I was so lucky!lucky!’’
(30 marks)(30 marks)
6 marks6 marks7 marks7 marks5 marks5 marks12 marks12 marks
Orthography Orthography Grammar, Grammar, syntax, syntax, vocabulary, vocabulary, idiomatic idiomatic expressionsexpressions
Style and Style and structure structure (punctuation, (punctuation, link of link of paragraphs, paragraphs, presentation)presentation)
Ideas related to Ideas related to the subject the subject --creativitycreativity
Marking Scheme Marking Scheme –– 30 marks30 marks
Taxonomy of EducationalTaxonomy of EducationalObjectivesObjectives
KnowledgeKnowledge
ComprehensionComprehension
ApplicationApplication
AnalysisAnalysis
SynthesisSynthesis
EvaluationEvaluation
KnowledgeKnowledge
KnowledgeKnowledge is the remembering of previously learnt is the remembering of previously learnt material: material:
Recall of things and materials even from specific facts.Recall of things and materials even from specific facts.
Recall of structures, methods or processes.Recall of structures, methods or processes.
Terms to elicit Knowledge and understanding
•State••NameName
•Match•List
•Outline•Select
•Identify•Describe
•Reproduce•Define
ComprehensionComprehensionComprehension Comprehension is the ability to grasp the meaning of is the ability to grasp the meaning of
material, by translating material from one from to another material, by translating material from one from to another (words to numbers); by interpreting material (explaining or (words to numbers); by interpreting material (explaining or summarizing); by estimating future trends (predicting summarizing); by estimating future trends (predicting consequences or effects) consequences or effects)
Terms to elicit Comprehension
•Summarise••ReRe--writewrite
•Paraphrase••EstimateEstimate
•Give examples••DistinguishDistinguish
•Generalise•Defend
•Predict••ExplainExplain
•Extend•Convert
ApplicationApplication
Application Application is the ability to use learned material in new is the ability to use learned material in new and concrete situations such as the application of rules, and concrete situations such as the application of rules, methods, concepts, principles, laws and theories. methods, concepts, principles, laws and theories.
Terms to elicit application
•Solve••UseUse
•Relate••DiscoverDiscover
•Produce••DemonstrateDemonstrate
•Prepare•Compute
•Show••ModifyModify
•Predict•Change
SynthesisSynthesisSynthesis Synthesis –– the ability to put parts together to form a new pattern or the ability to put parts together to form a new pattern or
structure.structure.
Production of a unique communication (theme or speech)Production of a unique communication (theme or speech) A plan of operations (research proposal) A plan of operations (research proposal) A set of abstract relations (scheme for classifying information)A set of abstract relations (scheme for classifying information)
Terms to elicit synthesis
••WriteWrite
•Tell••SummarizeSummarize
•Re-write••ReviseRevise
•Recognise••RelateRelate
•Reconstruct••RearrangeRearrange
•modify••GenerateGenerate
•Explain••DesignDesign
•Device••CreateCreate
•Compose•Compile
•Plan••OrganiseOrganise
•Combine•Categorise
AnalysisAnalysisAnalysis, Analysis, the ability to break down material into its component parts so the ability to break down material into its component parts so
that its organisational structure maybe understood. that its organisational structure maybe understood. Identification of partsIdentification of parts Relationship between partsRelationship between parts Recognition of the organisational principles involved in a struRecognition of the organisational principles involved in a structure of cture of
work (such as art, music or a piece of writing) work (such as art, music or a piece of writing)
Terms to elicit analysis
•Separate••IdentifyIdentify
•Select••DistinguishDistinguish
•Relate••DiscriminateDiscriminate
•Point out•Differentiate
•Subdivided••IllustrateIllustrate
•Outline•Breakdown
EvaluationEvaluation
This is concerned with the ability to judge the material for a This is concerned with the ability to judge the material for a given given purpose. The judgement is to be based on definite criteria purpose. The judgement is to be based on definite criteria determined by the student or teacher. determined by the student or teacher.
Terms to elicit evaluation
•Interpret••JustifyJustify
•Explain••DiscriminateDiscriminate
•Describe••CriticizeCriticize
•Contrast•Conclude
•Summarize••RelateRelate
••CompareCompare•Appraise