Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5

Introduction:  This study aims to evaluate the performance of ChatGPT-4, an advanced artificial intelligence (AI) language model, on the Ophthalmology Knowledge Assessment Program (OKAP) examination compared to its predecessor, ChatGPT-3.5. Methods:  Both models were tested on 180 OKAP practice ques...

Descripción completa

Detalles Bibliográficos
Autores principales: Teebagy, Sean, Colwell, Lauren, Wood, Emma, Yaghy, Antonio, Faustina, Misha
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Thieme Medical Publishers, Inc. 2023
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10495224/
https://www.ncbi.nlm.nih.gov/pubmed/37701862
http://dx.doi.org/10.1055/s-0043-1774399
Descripción
Sumario:Introduction:  This study aims to evaluate the performance of ChatGPT-4, an advanced artificial intelligence (AI) language model, on the Ophthalmology Knowledge Assessment Program (OKAP) examination compared to its predecessor, ChatGPT-3.5. Methods:  Both models were tested on 180 OKAP practice questions covering various ophthalmology subject categories. Results:  ChatGPT-4 significantly outperformed ChatGPT-3.5 (81% vs. 57%; p <0.001), indicating improvements in medical knowledge assessment. Discussion:  The superior performance of ChatGPT-4 suggests potential applicability in ophthalmologic education and clinical decision support systems. Future research should focus on refining AI models, ensuring a balanced representation of fundamental and specialized knowledge, and determining the optimal method of integrating AI into medical education and practice.

Ejemplares similares