Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models

We evaluated the performance of a large language model called ChatGPT on the United States Medical Licensing Exam (USMLE), which consists of three exams: Step 1, Step 2CK, and Step 3. ChatGPT performed at or near the passing threshold for all three exams without any specialized training or reinforce...

Descripción completa

Detalles Bibliográficos
Autores principales: Kung, Tiffany H., Cheatham, Morgan, Medenilla, Arielle, Sillos, Czarina, De Leon, Lorie, Elepaño, Camille, Madriaga, Maria, Aggabao, Rimel, Diaz-Candido, Giezel, Maningo, James, Tseng, Victor
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2023
Materias:
Research Article
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9931230/
https://www.ncbi.nlm.nih.gov/pubmed/36812645
http://dx.doi.org/10.1371/journal.pdig.0000198
Descripción
Sumario:We evaluated the performance of a large language model called ChatGPT on the United States Medical Licensing Exam (USMLE), which consists of three exams: Step 1, Step 2CK, and Step 3. ChatGPT performed at or near the passing threshold for all three exams without any specialized training or reinforcement. Additionally, ChatGPT demonstrated a high level of concordance and insight in its explanations. These results suggest that large language models may have the potential to assist with medical education, and potentially, clinical decision-making.

Ejemplares similares