Wikia

Psychology Wiki

Testwiseness in educational psychology

Talk0
34,140pages on
this wiki

Assessment | Biopsychology | Comparative | Cognitive | Developmental | Language | Individual differences | Personality | Philosophy | Social |
Methods | Statistics | Clinical | Educational | Industrial | Professional items | World psychology |

Educational Psychology: Assessment · Issues · Theory & research · Techniques · Techniques X subject · Special Ed. · Pastoral


Modern systems of educational assessment require students to take many tests over their academic careers. When constructing tests there is a chance that part of what is assessed is not knowledge of the content but rather how good students are at taking tests (test-wiseness). This is particularly true with multiple-choice questions where students can guess the correct answer or narrow down the options based on things such as wording and grammar (secondary cues[1]) rather than knowledge of the topic being assessed.

For example, in answering the nonsensical multiple-choice question below, you can infer the correct answer by matching the end of the question stem ("an") with the beginning of the choices. The correct answer must be the one that starts with a vowel:

 A zieb always comes after an:
   a) burb
   b) kond
   c) arph
   d) rhoo

Test-wiseness Cues Edit

Here are some criteria[1][2][3][4] that may be used to make test questions less susceptible to test-wiseness:

Categorical Exclusive
Distracters contain words such as "all", "always", or "every." If a choice contains the word "all" or "every", a student may more easily rule it out. Try not to use those terms in the question or in the choices.
Phrase-Repeat
The correct answer contains a key sound, word, or phrase that is contained in the question’s stem.
Absurd/Implausible Answer
Distracters are unrelated to the stem. Some incorrect choices may be more obviously wrong and easier to eliminate.
Precision/Specificity
Correct answer is more precise, clear, or qualified than the distracters. It is very detailed and provides no room for ambiguity. That suggests it is the correct answer.
Length
Correct answer is longer than the distracters. Try to make each of the choices relatively equal in length.
Grammar
Distracters do not match the verb tense of the stem, or there is not a match between articles ("a", "an", "the").
Give-Away
Correct answer is given away by another item in the test. Sometimes the answer to question 2 can be found in the stem of question 1, for example.
Order of Answer
Don't use a predictable pattern for the answers (for example, making the correct answer usually be C).
Number of Options and Guessing
Out of a hundred multiple-choice items with three answer options each, a student with no knowledge of the content will get 33 correct simply by guessing blindly. However, the more choices you add, the more susceptible the question becomes to test-wiseness, hence four items is most common.[5]
Odd Man Out
If you make two or more choices difficult to distinguish from one another conceptually, that usually helps you rule them out. If three answers are very similar and one is very different, the different one may likely be the correct answer.
Spelling
Another one mentioned is that test authors are more likely to make spelling errors on incorrect choices, since they mainly review the correct answers.

Examples Edit

  1. Robert Runt has a webpage[3] with tips for students on taking tests. At the bottom of the page is a sample multiple-choice quiz illustrating many of the above principles.
  2. Gibb's 1964 dissertation[1] contains a 70 item Experimental Test of Testwiseness.
  3. Mahamed et al.[4] created a 20 item test-wiseness questionnaire for pharmaceutical students.


See alsoEdit

ReferencesEdit

  1. 1.0 1.1 1.2 Gibb B.G. (1964). Test-wiseness as secondary cue response. Doctoral Dissertation, Stanford University.
  2. Allen, Kirk, Stone, A., Rhoads, T.R., & Murphy, T.J. (2004). The Statistics Concepts Inventory: Developing a Valid and Reliable Instrument. Proceedings of the 2004 American Society for Engineering Education Annual Conference & Exposition.
  3. 3.0 3.1 Runt, Robert Tips for Taking Multiple Choice Tests. URL accessed on 2007-12-01.
  4. 4.0 4.1 Mahamed, Anisah, Gregory, P.A.M., & Austin, Z. (December 2006). "Testwiseness" Among International Pharmacy Graduates and Canadian Senior Pharmacy Students. American Journal of Pharmaceutical Education 70 (6): 131.
  5. Kuntz, Patricia (March 1982). Test-Wiseness Cues in the Options of Mathematics Items. Annual Meeting of the American Educational Research Association (66th, New York, NY).

This article incorporates text from the Citizendium, which is in the public domain.

Around Wikia's network

Random Wiki