Reducing the need for guesswork in multiple-choice tests
Bush, M (2014). Reducing the need for guesswork in multiple-choice tests. Assessment and Evaluation in Higher Education. 40 (2), pp. 218 - 231.
© 2014, © 2014 Taylor & Francis.The humble multiple-choice test is very widely used within education at all levels, but its susceptibility to guesswork makes it a suboptimal assessment tool. The reliability of a multiple-choice test is partly governed by the number of items it contains; however, longer tests are more time consuming to take, and for some subject areas, it can be very hard to create new test items that are sufficiently distinct from previously used items. A number of more sophisticated multiple-choice test formats have been proposed dating back at least 60 years, many of which offer significantly improved test reliability. This paper offers a new way of comparing these alternative test formats, by modelling each one in terms of the range of possible test taker responses it enables. Looking at the test formats in this way leads to the realisation that the need for guesswork is reduced when test takers are given more freedom to express their beliefs. Indeed, guesswork is eliminated entirely when test takers are able to partially order the answer options within each test item. The paper aims to strengthen the argument for using more sophisticated multiple-choice test formats, especially for high-stakes summative assessment.
|Journal||Assessment and Evaluation in Higher Education|
|Journal citation||40 (2), pp. 218 - 231|
|Publisher||Taylor and Francis Group|
|Digital Object Identifier (DOI)||doi:10.1080/02602938.2014.902192|
|22 Mar 2014|
|Publication process dates|
|Deposited||13 Mar 2017|
|Accepted author manuscript|
CC BY 4.0
1views this month
3downloads this month