2.2.test design test writing: plenary CTS-Academic
-
Upload
seltacademy -
Category
Education
-
view
435 -
download
3
description
Transcript of 2.2.test design test writing: plenary CTS-Academic
![Page 1: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/1.jpg)
Test design, test writing KAYSERI, 29-31 JANUARY 2014
![Page 2: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/2.jpg)
![Page 3: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/3.jpg)
Aims
! Procedures for test design ! Writing specifications ! Writing tests ! Effective instructions ! Good tests: the key ingredients
![Page 4: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/4.jpg)
Procedures for test design
![Page 5: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/5.jpg)
Objectives Specifications Item writing
Item trialling Item revision Assessment scales
Validating Handbook Training
![Page 6: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/6.jpg)
Defining our test objectives
1) What kind of test is it going to be? 2) What decisions do we need information for? 3) What abilities are tested? 4) How much detail do we need? 5) How accurate should our results be? 6) Is there any washback effect? 7) What are the practical constraints?
![Page 7: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/7.jpg)
Writing specifications
![Page 8: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/8.jpg)
Content
Structure
Timing
Medium
Techniques
Pass / fail levels
Marking and scoring
Administration procedure
![Page 9: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/9.jpg)
Writing tests
![Page 10: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/10.jpg)
WHAT IS THE DIFFERENCE? ! no support for students ! clearer ! simple, unambiguous instructions ! students familiar with task format and expectations ! if possible, more than one method to test a skill ! validation
Test writing vs exercise writing
![Page 11: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/11.jpg)
Test writing: where do you begin?
! Your own specifications, of course! ! NOT past papers
! NOT coursebook exercises ! NOT other people’s tests
! NOT tests for completely different objectives
![Page 12: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/12.jpg)
Test writing
specs texts items edit key
![Page 13: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/13.jpg)
Test writing: feedback and editing
![Page 14: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/14.jpg)
Effective instructions
Let’s look at an example of test instructions.
![Page 15: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/15.jpg)
Read the article about the future of electric cars. Then read the statements carefully.
Find the information about the statements in the article, and write the number of the paragraph (1-6) which contains the information.
There are statements which are confirmed by information in the article. Circle a for ‘true’ for these. There are statements which say something that is not confirmed by the article. Circle b for ‘false’ for these. There are statements about which there is information in the article. Circle c for ‘not given’ for these.
Effective instructions
example from the draft syllabus for a B1-level secondary school-leaving examination
![Page 16: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/16.jpg)
Effective instructions
Which five of the following adjectives would you use to describe effective test instructions?
![Page 17: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/17.jpg)
detailed
clear
familiar
brief
challenging
unambiguous
authentic
simple
![Page 18: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/18.jpg)
! simple, brief, clear and unambiguous ! should not test comprehension of instructions
! use Turkish if you can’t make it simple and brief
! that’s four adjectives - one more?
Effective instructions
![Page 19: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/19.jpg)
! simple, brief, clear and unambiguous ! should not test comprehension of instructions
! use Turkish if you can’t make it simple and brief
! task should be familiar to students ! use standardised instructions during practice
Effective instructions
![Page 20: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/20.jpg)
Familiar?
extract from the Hungarian school-leaving examination 2009
![Page 21: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/21.jpg)
! simple, brief, clear and unambiguous ! should not test comprehension of instructions
! use Turkish if you can’t make it simple and brief
! task should be familiar to students ! use standardised instructions during practice
! include an example where necessary ! with less familiar formats
! where students know different varieties of format
! where there is a danger of misunderstanding
Effective instructions
![Page 22: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/22.jpg)
![Page 23: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/23.jpg)
What’s the task here?
Read the sentence and decide which of the options: a, b, c, or d cannot be used to complete it.
Tourist can access the site of the castle by …
a) ferry from the sea terminal.
b) the regular local bus service.
c) foot across the bridge.
d) hired fishing boats from the village.
Will learners realise this in time?
![Page 24: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/24.jpg)
! simple, brief, clear and unambiguous ! should not test comprehension of instructions
! use Turkish if you can’t make it simple and brief
! task should be familiar to students ! use standardised instructions during practice
! include an example where necessary ! with less familiar formats
! where students know different varieties of format
! where there is a danger of misunderstanding ! use no terminology if possible
Effective instructions
![Page 25: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/25.jpg)
TO SUM UP ! simple, brief, clear and unambiguous ! familiar ! example ! no terminology AND CHECK your instructions with a colleague!
Effective instructions
![Page 26: 2.2.test design test writing: plenary CTS-Academic](https://reader033.fdocuments.in/reader033/viewer/2022051610/5494e6bbb47959b0428b4700/html5/thumbnails/26.jpg)
GOOD TESTS
clear aims
thorough specs
items that work
effective instructions
useful feedback
balanced assessment