11 Testing Reading

25
11 Testing Reading Gerardo Gamboa Aceves Paola Vega Garza Néstor López Ochoa Alejandro Navarro Villarreal

Transcript of 11 Testing Reading

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 1/25

11

Testing

ReadingGerardo Gamboa Aceves

Paola Vega GarzaNéstor López Ochoa

Alejandro Navarro Villarreal

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 2/25

Specifying what the candidateshould be able to do

Specify what we want to test

Content (Operations, types of text,adresses and topics)

Criteria levels of performance

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 3/25

Content

OPERATIONS

There aredifferent levelsof analysis

MACRO-SKILLS

MICRO-SKILLS

GRAMMARAND

LEXICALABILITIES

LOW-LEVEL

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 4/25

We have different macro-skills (related toneeds or to course objectives)

Scanning text Specific information Skimming text Obtain the gist

Identifying stages of an argument

Identifying examples presented in supportof an argument

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 5/25

We also have micro-skills 

Identifying referent of pronouns, etc.

Using context to guess meaning ofunfamiliar words

Understanding relations between parts oftexts.

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 6/25

What is the exercise of straight-forwardgrammatical and lexical abilities, such

as: Recognizing the significance of the use of

the present continuous with future time

adverbials Brother: Male sibling

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 7/25

Low-level operationsm = n

b = d

p = q

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 8/25

Readers will have different views as to

what goes into sucessful reading.

We will see the broad levels of readingprocesses at which testing is most usefully

carried out.

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 9/25

Low level operations are useful fordiagnostic purposes  No formal testing

Grammatical and lexical ability

 Diagnostic or grammar and vocabularytests  No reading tests

Micro-skills and Macro-skills  Reading

Tests!!!!It is when we have students to test readingabilities

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 10/25

Micro-skills  Achievement tests

Micro-skills are being taught not as anend in themselves but as means of

improving macro-skills. Micro-skills and macro-skills must be

balanced in an final achievement test andproficiency tests

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 11/25

TYPES OF TEXTSTextbook, novel, magazine, newspaper,academic journal, etc.1. They might be further specified(newspaper report), or described by test

designers2. We do not know that the different typesof texts actually present readers withdifferent tasks Rang of texts in the text

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 12/25

Backbash Reading of a narrow range oftext types

Authenticity: Use authentic texts dependson what it is intented to measure

RSA test of reading uses the same

extensive text for all levels of ability, butthe items are different.

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 13/25

ADDRESSES

Related to text types and not specifiedfurther.

-Intended audience

TOPICSIndicate the range of topics in only verygeneral terms

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 14/25

Guided Short Answers

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 15/25

The danger with short-answer questions is, ofcourse, that a student who has the answer inhis or her head after reading the relevant part

of the passage may not be able to express itwell (even the scoreer may get confused). Consider the question: “What changes have

taken place in the attitudes of many Europeanuniversities to different varieties of English?”  

Even without knowing the intended answer, one

suspects that it may create problems ofproduction unrelated to reading ability. In such cases the desired response can be

obatined by framing the item so that thecandidates have only to complete sentencespresented to them:

Complete the following, which is based on thefourth paragraph of the passage.

´Many universitiesin Europe used to insist hattheir students speak and write only _________Now many of them accept ________ as analternative, but not a _______ of the two.´

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 16/25

Summary Cloze

A reading passage is summerized by thetester, and then gaps are left in the

summary for completion by the candidate. This is really an extension of the guided

short answer technique and shares itsqualities.

It permits the setting of several reliablebut relevant items on a relaively shortpassage.

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 17/25

Information Transfer

One way of minimizing demands oncandidates‟ writing ability is to require

them to show successful completion of areading task by supplying simpleinfromation in a table, following a routeon a map, lablling a picture, and so on.

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 18/25

Techniques for

Particular PurposesIdentifying order of events, topics, or arguments.

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 19/25

The candidate may be required tonumber the events etc.

 In what order does the writer do the following in herarticle? To answer this, put the number 1 in theanswer column next to the one that appears first,and so on. If an idea does not appear in the article,

write N/A (not applicable) in the answer column. A) She gives some of the history of migraine. ___

B) She recommends specific drugs. ___

C) She recommends a herbal cure. ___

D) She describes migraine attacks. ___

E) She describes general advice to migraine sufferers. ___

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 20/25

Identifying referents

This is, to have the student find termswhich pronouns replace/to which

pronouns refer. For example: “What does the word „it‟

refer to in line 25?”  

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 21/25

Identifying the meaning ofunfamiliar words from context

The student must determine the meaningof a word from cues in the text and

question. The desired difficulty level willdetermine the depth of the question.

For example: “Find a single word in thepassage (between lines 1 and 22) whichhas the same meaning as „making oflaws‟(the word in the passage may end in–s or –ing).”  

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 22/25

In reading, isolated microskills cannot beevaluated. For example, when asking for

the meaning of a word, the context mustbe understood and referents must beused (otheriwise the question would notbe possible).

This suggests that these items hold aplace in final evaluations and achievementtests.

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 23/25

HOW TO DEVELOP A READINGTEST

The wording of items should be simple,direct and clear, ideally of a lower level

than the text provided. Items should notgive out details that make could answerthe question.

Sometimes, wording in the student‟s

native language might pose a betteroption for objective testing, but care mustbe taken to ensure that the wording doesnot divulge more than it should.

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 24/25

Procedures for writing items

The text should be fully understood. Notes ontopics, main arguments, special lexicon, and thesuch should be taken where needed.

Next, the level of items for evaluation should bedetermined, taking into account the students‟proficiency and the purpose of the evaluation(diagnostic or mid-term, for example).

Paragraph and line numbering, if needed, shouldbe added now. After this, the text and itemsshould be presented to a board of reviewers.Further modifications may be needed.

8/13/2019 11 Testing Reading

http://slidepdf.com/reader/full/11-testing-reading 25/25

Extra Advice

Items for a scanning test should bepresented in the order they are asked for.

Do not write items for which the answer canbe found without reading the text. Thismeans that both the question must be deepenough to necessitate reading the text andthe wording must be such that it does notgive out important information.

Scoring should only take in account thereaders‟ ability, not their vocabulary orgrammar in the answers. Multiple choicetests are excellent tools for this.