Cargando…

Negatively-Marked MCQ Assessments That Reward Partial Knowledge Do Not Introduce Gender Bias Yet Increase Student Performance and Satisfaction and Reduce Anxiety

Multiple-choice question (MCQ) examinations are increasingly used as the assessment method of theoretical knowledge in large class-size modules in many life science degrees. MCQ-tests can be used to objectively measure factual knowledge, ability and high-level learning outcomes, but may also introdu...

Descripción completa

Detalles Bibliográficos
Autores principales: Bond, A. Elizabeth, Bodger, Owen, Skibinski, David O. F., Jones, D. Hugh, Restall, Colin J., Dudley, Edward, van Keulen, Geertje
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2013
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3577794/
https://www.ncbi.nlm.nih.gov/pubmed/23437081
http://dx.doi.org/10.1371/journal.pone.0055956
_version_ 1782259974016073728
author Bond, A. Elizabeth
Bodger, Owen
Skibinski, David O. F.
Jones, D. Hugh
Restall, Colin J.
Dudley, Edward
van Keulen, Geertje
author_facet Bond, A. Elizabeth
Bodger, Owen
Skibinski, David O. F.
Jones, D. Hugh
Restall, Colin J.
Dudley, Edward
van Keulen, Geertje
author_sort Bond, A. Elizabeth
collection PubMed
description Multiple-choice question (MCQ) examinations are increasingly used as the assessment method of theoretical knowledge in large class-size modules in many life science degrees. MCQ-tests can be used to objectively measure factual knowledge, ability and high-level learning outcomes, but may also introduce gender bias in performance dependent on topic, instruction, scoring and difficulty. The ‘Single Answer’ (SA) test is often used in which students choose one correct answer, in which they are unable to demonstrate partial knowledge. Negatively marking eliminates the chance element of guessing but may be considered unfair. Elimination testing (ET) is an alternative form of MCQ, which discriminates between all levels of knowledge, while rewarding demonstration of partial knowledge. Comparisons of performance and gender bias in negatively marked SA and ET tests have not yet been performed in the life sciences. Our results show that life science students were significantly advantaged by answering the MCQ test in elimination format compared to single answer format under negative marking conditions by rewarding partial knowledge of topics. Importantly, we found no significant difference in performance between genders in either cohort for either MCQ test under negative marking conditions. Surveys showed that students generally preferred ET-style MCQ testing over SA-style testing. Students reported feeling more relaxed taking ET MCQ and more stressed when sitting SA tests, while disagreeing with being distracted by thinking about best tactics for scoring high. Students agreed ET testing improved their critical thinking skills. We conclude that appropriately-designed MCQ tests do not systematically discriminate between genders. We recommend careful consideration in choosing the type of MCQ test, and propose to apply negative scoring conditions to each test type to avoid the introduction of gender bias. The student experience could be improved through the incorporation of the elimination answering methods in MCQ tests via rewarding partial and full knowledge.
format Online
Article
Text
id pubmed-3577794
institution National Center for Biotechnology Information
language English
publishDate 2013
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-35777942013-02-22 Negatively-Marked MCQ Assessments That Reward Partial Knowledge Do Not Introduce Gender Bias Yet Increase Student Performance and Satisfaction and Reduce Anxiety Bond, A. Elizabeth Bodger, Owen Skibinski, David O. F. Jones, D. Hugh Restall, Colin J. Dudley, Edward van Keulen, Geertje PLoS One Research Article Multiple-choice question (MCQ) examinations are increasingly used as the assessment method of theoretical knowledge in large class-size modules in many life science degrees. MCQ-tests can be used to objectively measure factual knowledge, ability and high-level learning outcomes, but may also introduce gender bias in performance dependent on topic, instruction, scoring and difficulty. The ‘Single Answer’ (SA) test is often used in which students choose one correct answer, in which they are unable to demonstrate partial knowledge. Negatively marking eliminates the chance element of guessing but may be considered unfair. Elimination testing (ET) is an alternative form of MCQ, which discriminates between all levels of knowledge, while rewarding demonstration of partial knowledge. Comparisons of performance and gender bias in negatively marked SA and ET tests have not yet been performed in the life sciences. Our results show that life science students were significantly advantaged by answering the MCQ test in elimination format compared to single answer format under negative marking conditions by rewarding partial knowledge of topics. Importantly, we found no significant difference in performance between genders in either cohort for either MCQ test under negative marking conditions. Surveys showed that students generally preferred ET-style MCQ testing over SA-style testing. Students reported feeling more relaxed taking ET MCQ and more stressed when sitting SA tests, while disagreeing with being distracted by thinking about best tactics for scoring high. Students agreed ET testing improved their critical thinking skills. We conclude that appropriately-designed MCQ tests do not systematically discriminate between genders. We recommend careful consideration in choosing the type of MCQ test, and propose to apply negative scoring conditions to each test type to avoid the introduction of gender bias. The student experience could be improved through the incorporation of the elimination answering methods in MCQ tests via rewarding partial and full knowledge. Public Library of Science 2013-02-20 /pmc/articles/PMC3577794/ /pubmed/23437081 http://dx.doi.org/10.1371/journal.pone.0055956 Text en © 2013 Bond et al http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
spellingShingle Research Article
Bond, A. Elizabeth
Bodger, Owen
Skibinski, David O. F.
Jones, D. Hugh
Restall, Colin J.
Dudley, Edward
van Keulen, Geertje
Negatively-Marked MCQ Assessments That Reward Partial Knowledge Do Not Introduce Gender Bias Yet Increase Student Performance and Satisfaction and Reduce Anxiety
title Negatively-Marked MCQ Assessments That Reward Partial Knowledge Do Not Introduce Gender Bias Yet Increase Student Performance and Satisfaction and Reduce Anxiety
title_full Negatively-Marked MCQ Assessments That Reward Partial Knowledge Do Not Introduce Gender Bias Yet Increase Student Performance and Satisfaction and Reduce Anxiety
title_fullStr Negatively-Marked MCQ Assessments That Reward Partial Knowledge Do Not Introduce Gender Bias Yet Increase Student Performance and Satisfaction and Reduce Anxiety
title_full_unstemmed Negatively-Marked MCQ Assessments That Reward Partial Knowledge Do Not Introduce Gender Bias Yet Increase Student Performance and Satisfaction and Reduce Anxiety
title_short Negatively-Marked MCQ Assessments That Reward Partial Knowledge Do Not Introduce Gender Bias Yet Increase Student Performance and Satisfaction and Reduce Anxiety
title_sort negatively-marked mcq assessments that reward partial knowledge do not introduce gender bias yet increase student performance and satisfaction and reduce anxiety
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3577794/
https://www.ncbi.nlm.nih.gov/pubmed/23437081
http://dx.doi.org/10.1371/journal.pone.0055956
work_keys_str_mv AT bondaelizabeth negativelymarkedmcqassessmentsthatrewardpartialknowledgedonotintroducegenderbiasyetincreasestudentperformanceandsatisfactionandreduceanxiety
AT bodgerowen negativelymarkedmcqassessmentsthatrewardpartialknowledgedonotintroducegenderbiasyetincreasestudentperformanceandsatisfactionandreduceanxiety
AT skibinskidavidof negativelymarkedmcqassessmentsthatrewardpartialknowledgedonotintroducegenderbiasyetincreasestudentperformanceandsatisfactionandreduceanxiety
AT jonesdhugh negativelymarkedmcqassessmentsthatrewardpartialknowledgedonotintroducegenderbiasyetincreasestudentperformanceandsatisfactionandreduceanxiety
AT restallcolinj negativelymarkedmcqassessmentsthatrewardpartialknowledgedonotintroducegenderbiasyetincreasestudentperformanceandsatisfactionandreduceanxiety
AT dudleyedward negativelymarkedmcqassessmentsthatrewardpartialknowledgedonotintroducegenderbiasyetincreasestudentperformanceandsatisfactionandreduceanxiety
AT vankeulengeertje negativelymarkedmcqassessmentsthatrewardpartialknowledgedonotintroducegenderbiasyetincreasestudentperformanceandsatisfactionandreduceanxiety