Journal article 248 views 37 downloads
Solving Not Answering. Validation of Guidance for Writing Higher-Order Multiple-Choice Questions in Medical Science Education
,
Phil Newton
Medical Science Educator, Volume: 34, Issue: 6, Pages: 1469 - 1477
Swansea University Author:
Phil Newton
-
PDF | Version of Record
© The Author(s) 2024. Open Access. This article is licensed under a Creative Commons Attribution 4.0 International License (CC-BY 4.0).
Download (1.15MB)
DOI (Published version): 10.1007/s40670-024-02140-7
Abstract
Problem-solving and higher-order learning are goals of higher education. It has been repeatedly suggested that multiple-choice questions (MCQs) can be used to test higher-order learning, although objective empirical evidence is lacking and MCQs are often criticised for assessing only lower-order, fa...
| Published in: | Medical Science Educator |
|---|---|
| ISSN: | 2156-8650 |
| Published: |
Springer Science and Business Media LLC
2024
|
| Online Access: |
Check full text
|
| URI: | https://cronfa.swan.ac.uk/Record/cronfa67367 |
| Abstract: |
Problem-solving and higher-order learning are goals of higher education. It has been repeatedly suggested that multiple-choice questions (MCQs) can be used to test higher-order learning, although objective empirical evidence is lacking and MCQs are often criticised for assessing only lower-order, factual, or ‘rote’ learning. These challenges are compounded by a lack of agreement on what constitutes higher order learning: it is normally defined subjectively using heavily criticised frameworks such as such as Bloom’s taxonomy. There is also a lack of agreement on how to write MCQs which assess higher order learning. Here we tested guidance for the creation of MCQs to assess higher-order learning, by evaluating the performance of students who were subject matter novices, vs experts. We found that questions written using the guidance were much harder to answer when students had no prior subject knowledge, whereas lower-order questions could be answered by simply searching online. These findings suggest that questions written using the guidance do indeed test higher-order learning, and such MCQs may be a valid alternative to other written assessment formats designed to test higher-order learning, such as essays, where reliability and cheating are a major concern. |
|---|---|
| Keywords: |
Digital education; Bloom’s taxonomy; Assessment; Higher-order learning |
| College: |
Faculty of Medicine, Health and Life Sciences |
| Funders: |
Swansea University |
| Issue: |
6 |
| Start Page: |
1469 |
| End Page: |
1477 |