Cargando…
The Effect of a One-Day Workshop on the Quality of Framing Multiple Choice Questions in Physiology in a Medical College in India
Background Multiple choice questions (MCQs) are commonly used in medical exams for more objectivity in assessment. However, the quality of the questions should be optimum for a proper assessment of the students. A faculty development program (FDP) may improve the quality of MCQs. The effect of a one...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Cureus
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10517710/ https://www.ncbi.nlm.nih.gov/pubmed/37746478 http://dx.doi.org/10.7759/cureus.44049 |
_version_ | 1785109380781309952 |
---|---|
author | Dhanvijay, Anup Kumar D Dhokane, Nitin Balgote, Santosh Kumari, Anita Juhi, Ayesha Mondal, Himel Gupta, Pratima |
author_facet | Dhanvijay, Anup Kumar D Dhokane, Nitin Balgote, Santosh Kumari, Anita Juhi, Ayesha Mondal, Himel Gupta, Pratima |
author_sort | Dhanvijay, Anup Kumar D |
collection | PubMed |
description | Background Multiple choice questions (MCQs) are commonly used in medical exams for more objectivity in assessment. However, the quality of the questions should be optimum for a proper assessment of the students. A faculty development program (FDP) may improve the quality of MCQs. The effect of a one-day workshop on framing MCQ as a part of a FDP has not been explored in our institution. Aim This study aimed to evaluate the quality of MCQ in the subject of physiology before and after a one-day workshop on framing MCQ as a part of a FDP. Methods This was a retrospective study conducted in the Department of Physiology, All India Institute of Medical Sciences, Deoghar, Jharkhand, India. A one-day workshop on framing MCQ as a part of a FDP was conducted in March 2022. We took 100 MCQs and responses from the students from examinations conducted before the workshop and 100 MCQs and responses from the students after the workshop. In pre-workshop and post-workshop, the same five faculties framed the questions. Post-validation item analysis including difficulty index (DIFI), discrimination index (DI), distractor effectiveness (DE), and Kuder-Richardson Formula 20 (KR-20) for internal consistency was calculated. Results Pre-workshop and post-workshop quality of the MCQ remain equal in terms of DIFI (chi-square {3} = 2.42, P = 0.29), DI (chi-square {3} = 2.44, P = 0.49), and DE (chi-square {3} = 4.97, P = 0.17). The KR-20 in pre-workshop and post-workshop was 0.65 and 0.87, respectively. Both had acceptable internal consistency. Conclusion The one-day workshop on framing MCQs as a part of a FDP did not have a significant impact on the quality of the MCQs as measured by the three indices of item quality but did improve the internal consistency of the MCQs. Further educational programs and research are required to find out what measures can improve the quality of MCQs. |
format | Online Article Text |
id | pubmed-10517710 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Cureus |
record_format | MEDLINE/PubMed |
spelling | pubmed-105177102023-09-24 The Effect of a One-Day Workshop on the Quality of Framing Multiple Choice Questions in Physiology in a Medical College in India Dhanvijay, Anup Kumar D Dhokane, Nitin Balgote, Santosh Kumari, Anita Juhi, Ayesha Mondal, Himel Gupta, Pratima Cureus Medical Education Background Multiple choice questions (MCQs) are commonly used in medical exams for more objectivity in assessment. However, the quality of the questions should be optimum for a proper assessment of the students. A faculty development program (FDP) may improve the quality of MCQs. The effect of a one-day workshop on framing MCQ as a part of a FDP has not been explored in our institution. Aim This study aimed to evaluate the quality of MCQ in the subject of physiology before and after a one-day workshop on framing MCQ as a part of a FDP. Methods This was a retrospective study conducted in the Department of Physiology, All India Institute of Medical Sciences, Deoghar, Jharkhand, India. A one-day workshop on framing MCQ as a part of a FDP was conducted in March 2022. We took 100 MCQs and responses from the students from examinations conducted before the workshop and 100 MCQs and responses from the students after the workshop. In pre-workshop and post-workshop, the same five faculties framed the questions. Post-validation item analysis including difficulty index (DIFI), discrimination index (DI), distractor effectiveness (DE), and Kuder-Richardson Formula 20 (KR-20) for internal consistency was calculated. Results Pre-workshop and post-workshop quality of the MCQ remain equal in terms of DIFI (chi-square {3} = 2.42, P = 0.29), DI (chi-square {3} = 2.44, P = 0.49), and DE (chi-square {3} = 4.97, P = 0.17). The KR-20 in pre-workshop and post-workshop was 0.65 and 0.87, respectively. Both had acceptable internal consistency. Conclusion The one-day workshop on framing MCQs as a part of a FDP did not have a significant impact on the quality of the MCQs as measured by the three indices of item quality but did improve the internal consistency of the MCQs. Further educational programs and research are required to find out what measures can improve the quality of MCQs. Cureus 2023-08-24 /pmc/articles/PMC10517710/ /pubmed/37746478 http://dx.doi.org/10.7759/cureus.44049 Text en Copyright © 2023, Dhanvijay et al. https://creativecommons.org/licenses/by/3.0/This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Medical Education Dhanvijay, Anup Kumar D Dhokane, Nitin Balgote, Santosh Kumari, Anita Juhi, Ayesha Mondal, Himel Gupta, Pratima The Effect of a One-Day Workshop on the Quality of Framing Multiple Choice Questions in Physiology in a Medical College in India |
title | The Effect of a One-Day Workshop on the Quality of Framing Multiple Choice Questions in Physiology in a Medical College in India |
title_full | The Effect of a One-Day Workshop on the Quality of Framing Multiple Choice Questions in Physiology in a Medical College in India |
title_fullStr | The Effect of a One-Day Workshop on the Quality of Framing Multiple Choice Questions in Physiology in a Medical College in India |
title_full_unstemmed | The Effect of a One-Day Workshop on the Quality of Framing Multiple Choice Questions in Physiology in a Medical College in India |
title_short | The Effect of a One-Day Workshop on the Quality of Framing Multiple Choice Questions in Physiology in a Medical College in India |
title_sort | effect of a one-day workshop on the quality of framing multiple choice questions in physiology in a medical college in india |
topic | Medical Education |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10517710/ https://www.ncbi.nlm.nih.gov/pubmed/37746478 http://dx.doi.org/10.7759/cureus.44049 |
work_keys_str_mv | AT dhanvijayanupkumard theeffectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia AT dhokanenitin theeffectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia AT balgotesantosh theeffectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia AT kumarianita theeffectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia AT juhiayesha theeffectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia AT mondalhimel theeffectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia AT guptapratima theeffectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia AT dhanvijayanupkumard effectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia AT dhokanenitin effectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia AT balgotesantosh effectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia AT kumarianita effectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia AT juhiayesha effectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia AT mondalhimel effectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia AT guptapratima effectofaonedayworkshoponthequalityofframingmultiplechoicequestionsinphysiologyinamedicalcollegeinindia |