Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5

Introduction:  This study aims to evaluate the performance of ChatGPT-4, an advanced artificial intelligence (AI) language model, on the Ophthalmology Knowledge Assessment Program (OKAP) examination compared to its predecessor, ChatGPT-3.5. Methods:  Both models were tested on 180 OKAP practice ques...

Descripción completa

Detalles Bibliográficos
Autores principales: Teebagy, Sean, Colwell, Lauren, Wood, Emma, Yaghy, Antonio, Faustina, Misha
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Thieme Medical Publishers, Inc. 2023
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10495224/
https://www.ncbi.nlm.nih.gov/pubmed/37701862
http://dx.doi.org/10.1055/s-0043-1774399
_version_ 1785104845077741568
author Teebagy, Sean
Colwell, Lauren
Wood, Emma
Yaghy, Antonio
Faustina, Misha
author_facet Teebagy, Sean
Colwell, Lauren
Wood, Emma
Yaghy, Antonio
Faustina, Misha
author_sort Teebagy, Sean
collection PubMed
description Introduction:  This study aims to evaluate the performance of ChatGPT-4, an advanced artificial intelligence (AI) language model, on the Ophthalmology Knowledge Assessment Program (OKAP) examination compared to its predecessor, ChatGPT-3.5. Methods:  Both models were tested on 180 OKAP practice questions covering various ophthalmology subject categories. Results:  ChatGPT-4 significantly outperformed ChatGPT-3.5 (81% vs. 57%; p <0.001), indicating improvements in medical knowledge assessment. Discussion:  The superior performance of ChatGPT-4 suggests potential applicability in ophthalmologic education and clinical decision support systems. Future research should focus on refining AI models, ensuring a balanced representation of fundamental and specialized knowledge, and determining the optimal method of integrating AI into medical education and practice.
format Online
Article
Text
id pubmed-10495224
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Thieme Medical Publishers, Inc.
record_format MEDLINE/PubMed
spelling pubmed-104952242023-09-12 Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5 Teebagy, Sean Colwell, Lauren Wood, Emma Yaghy, Antonio Faustina, Misha J Acad Ophthalmol (2017) Introduction:  This study aims to evaluate the performance of ChatGPT-4, an advanced artificial intelligence (AI) language model, on the Ophthalmology Knowledge Assessment Program (OKAP) examination compared to its predecessor, ChatGPT-3.5. Methods:  Both models were tested on 180 OKAP practice questions covering various ophthalmology subject categories. Results:  ChatGPT-4 significantly outperformed ChatGPT-3.5 (81% vs. 57%; p <0.001), indicating improvements in medical knowledge assessment. Discussion:  The superior performance of ChatGPT-4 suggests potential applicability in ophthalmologic education and clinical decision support systems. Future research should focus on refining AI models, ensuring a balanced representation of fundamental and specialized knowledge, and determining the optimal method of integrating AI into medical education and practice. Thieme Medical Publishers, Inc. 2023-09-11 /pmc/articles/PMC10495224/ /pubmed/37701862 http://dx.doi.org/10.1055/s-0043-1774399 Text en The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. ( https://creativecommons.org/licenses/by-nc-nd/4.0/ ) https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License, which permits unrestricted reproduction and distribution, for non-commercial purposes only; and use and reproduction, but not distribution, of adapted material for non-commercial purposes only, provided the original work is properly cited.
spellingShingle Teebagy, Sean
Colwell, Lauren
Wood, Emma
Yaghy, Antonio
Faustina, Misha
Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5
title Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5
title_full Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5
title_fullStr Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5
title_full_unstemmed Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5
title_short Improved Performance of ChatGPT-4 on the OKAP Examination: A Comparative Study with ChatGPT-3.5
title_sort improved performance of chatgpt-4 on the okap examination: a comparative study with chatgpt-3.5
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10495224/
https://www.ncbi.nlm.nih.gov/pubmed/37701862
http://dx.doi.org/10.1055/s-0043-1774399
work_keys_str_mv AT teebagysean improvedperformanceofchatgpt4ontheokapexaminationacomparativestudywithchatgpt35
AT colwelllauren improvedperformanceofchatgpt4ontheokapexaminationacomparativestudywithchatgpt35
AT woodemma improvedperformanceofchatgpt4ontheokapexaminationacomparativestudywithchatgpt35
AT yaghyantonio improvedperformanceofchatgpt4ontheokapexaminationacomparativestudywithchatgpt35
AT faustinamisha improvedperformanceofchatgpt4ontheokapexaminationacomparativestudywithchatgpt35

Ejemplares similares