Structured oral examination in pharmacology for undergraduate medical students: Factors influencing its implementation

OBJECTIVES: The study aims to understand the process and factors influencing the implementation of structured oral examination (SOE) for undergraduate medical students; in comparison with conventional oral examination (COE) in pharmacology. METHODS: In a randomized, parallel group study, 123 students of pharmacology were divided into two groups, SOE (n = 63) and COE (n = 60). Students of each group were subdivided into two, and four examiners took viva voce individually. Three sets of questionnaires from autonomic nervous system were prepared, each having 15 items with increasing difficulty levels and were validated by subject experts and pretested. Ten minutes were allotted for each student for each viva. Feedback of students and faculty about the novel method was obtained. RESULTS: SOE yielded significantly lower marks as compared to COE. There were significant inter-examiner variations in marks awarded in SOE and COE. Other factors influencing implementation were difficulty in structuring viva, rigid time limits, lack of flexibility in knowledge content, monotony, and fatigue. The students perceived this format not different from COE but felt that it required in-depth preparation of topic. Faculty opined that SOE led to less drift from main topic and provided uniform coverage of topics in given time. CONCLUSION: Conducting SOE is a resource-intensive exercise. Despite structuring, inter-examiner variability was not completely eliminated. The students’ performance was depended on factors related to examiners such as teaching experience, vernacular language used, and lack of training. Orientation and training of examiners in assessment strategies is necessary. Standardization of questionnaire is necessary before the implementation of SOE for summative assessment.