Quantifying the Effects of Chance in Multiple Choice and True/False Tests: question selection and guessing of answers

Author: Burton R. F.

Source: Assessment & Evaluation in Higher Education, Volume 26, Number 1, 1 February 2001 , pp. 41-50(10)

Publisher: Routledge, part of the Taylor & Francis Group

Key:

- Free Content

- New Content

- Subscribed Content

- Free Trial Content

Abstract:

Multiple choice and true/false tests commonly contain only a small proportion of all the questions that could be asked, so that an examinee may be lucky or unlucky in the selection. Random guessing further reduces test reliability when it is not effectively discouraged. Four measures of test unreliability are described that quantify the effects of question selection and guessing, both separately and together - three chosen for immediacy and one for greater mathematical elegance. Their dependence on test length and on the number of answer options per question is quantified. Through one or both random effects, many multiple choice tests are too unreliable for their purpose as currently conducted. Ways of improving test reliability are discussed.

Language: English

Document Type: Research article

The full text electronic article is available for purchase. You will be able to download the full text electronic article after payment.

$38.49 plus tax Refund Policy