Cargando…

Item analysis and optimizing multiple-choice questions for a viable question bank in ophthalmology: A cross-sectional study

PURPOSE: Multiple-choice questions (MCQs) are useful in assessing student performance, covering a wide range of topics in an objective way. Its reliability and validity depend upon how well it is constructed. Defective Item detected by item analysis must be looked for item writing flaws and optimize...

Descripción completa

Detalles Bibliográficos
Autores principales: Bhat, Subrahmanya K, Prasad, Kishan HL
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Wolters Kluwer - Medknow 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7933874/
https://www.ncbi.nlm.nih.gov/pubmed/33463588
http://dx.doi.org/10.4103/ijo.IJO_1610_20
_version_ 1783660708177641472
author Bhat, Subrahmanya K
Prasad, Kishan HL
author_facet Bhat, Subrahmanya K
Prasad, Kishan HL
author_sort Bhat, Subrahmanya K
collection PubMed
description PURPOSE: Multiple-choice questions (MCQs) are useful in assessing student performance, covering a wide range of topics in an objective way. Its reliability and validity depend upon how well it is constructed. Defective Item detected by item analysis must be looked for item writing flaws and optimized. The aim of this study was to evaluate the MCQs for difficulty levels, discriminating power with functional distractors by item analysis, analyze poor items for writing flaws, and optimize. METHODS: This was a prospective cross-sectional study involving 120 MBBS students writing formative assessment in Ophthalmology. It comprised 40 single response MCQs as a part of 3-h paper for 20 marks. Items were categorized according to their difficulty index, discrimination index, and distractor efficiency with simple proportions, mean, standard deviation, and correlation. The defective items were analyzed for proper construction and optimized. RESULTS: The mean score of the study group was 13.525 ± 2.617. Mean difficulty index, discrimination index, and distractor efficiency were 53.22, 0.26, and 78.32, respectively. Among 40 MCQs, twenty-five MCQs did not have non-functioning distractor; 7 had one, 5 had two, and 3 had three. Of the 20 defective items, 17 were optimized and added to the question bank, two were added without modification, and one was dropped. CONCLUSION: Item analysis is a valuable tool in detecting poor MCQs, and optimizing them is a critical step. The defective items identified should be optimized and not dropped so that the content area covered by the defective item is not kept of the assessment.
format Online
Article
Text
id pubmed-7933874
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Wolters Kluwer - Medknow
record_format MEDLINE/PubMed
spelling pubmed-79338742021-03-08 Item analysis and optimizing multiple-choice questions for a viable question bank in ophthalmology: A cross-sectional study Bhat, Subrahmanya K Prasad, Kishan HL Indian J Ophthalmol Original Article PURPOSE: Multiple-choice questions (MCQs) are useful in assessing student performance, covering a wide range of topics in an objective way. Its reliability and validity depend upon how well it is constructed. Defective Item detected by item analysis must be looked for item writing flaws and optimized. The aim of this study was to evaluate the MCQs for difficulty levels, discriminating power with functional distractors by item analysis, analyze poor items for writing flaws, and optimize. METHODS: This was a prospective cross-sectional study involving 120 MBBS students writing formative assessment in Ophthalmology. It comprised 40 single response MCQs as a part of 3-h paper for 20 marks. Items were categorized according to their difficulty index, discrimination index, and distractor efficiency with simple proportions, mean, standard deviation, and correlation. The defective items were analyzed for proper construction and optimized. RESULTS: The mean score of the study group was 13.525 ± 2.617. Mean difficulty index, discrimination index, and distractor efficiency were 53.22, 0.26, and 78.32, respectively. Among 40 MCQs, twenty-five MCQs did not have non-functioning distractor; 7 had one, 5 had two, and 3 had three. Of the 20 defective items, 17 were optimized and added to the question bank, two were added without modification, and one was dropped. CONCLUSION: Item analysis is a valuable tool in detecting poor MCQs, and optimizing them is a critical step. The defective items identified should be optimized and not dropped so that the content area covered by the defective item is not kept of the assessment. Wolters Kluwer - Medknow 2021-02 2021-01-18 /pmc/articles/PMC7933874/ /pubmed/33463588 http://dx.doi.org/10.4103/ijo.IJO_1610_20 Text en Copyright: © 2021 Indian Journal of Ophthalmology http://creativecommons.org/licenses/by-nc-sa/4.0 This is an open access journal, and articles are distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 License, which allows others to remix, tweak, and build upon the work non-commercially, as long as appropriate credit is given and the new creations are licensed under the identical terms.
spellingShingle Original Article
Bhat, Subrahmanya K
Prasad, Kishan HL
Item analysis and optimizing multiple-choice questions for a viable question bank in ophthalmology: A cross-sectional study
title Item analysis and optimizing multiple-choice questions for a viable question bank in ophthalmology: A cross-sectional study
title_full Item analysis and optimizing multiple-choice questions for a viable question bank in ophthalmology: A cross-sectional study
title_fullStr Item analysis and optimizing multiple-choice questions for a viable question bank in ophthalmology: A cross-sectional study
title_full_unstemmed Item analysis and optimizing multiple-choice questions for a viable question bank in ophthalmology: A cross-sectional study
title_short Item analysis and optimizing multiple-choice questions for a viable question bank in ophthalmology: A cross-sectional study
title_sort item analysis and optimizing multiple-choice questions for a viable question bank in ophthalmology: a cross-sectional study
topic Original Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7933874/
https://www.ncbi.nlm.nih.gov/pubmed/33463588
http://dx.doi.org/10.4103/ijo.IJO_1610_20
work_keys_str_mv AT bhatsubrahmanyak itemanalysisandoptimizingmultiplechoicequestionsforaviablequestionbankinophthalmologyacrosssectionalstudy
AT prasadkishanhl itemanalysisandoptimizingmultiplechoicequestionsforaviablequestionbankinophthalmologyacrosssectionalstudy