Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study

This study aimed to compare the knowledge and interpretation ability of ChatGPT, a language model of artificial general intelligence, with those of medical students in Korea by administering a parasitology examination to both ChatGPT and medical students. The examination consisted of 79 items and wa...

Descripción completa

Detalles Bibliográficos
Autor principal: Huh, Sun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Korea Health Personnel Licensing Examination Institute 2023
Materias:
Brief Report
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9905868/
https://www.ncbi.nlm.nih.gov/pubmed/36627845
http://dx.doi.org/10.3352/jeehp.2023.20.1
_version_ 1784883894701522944
author Huh, Sun
author_facet Huh, Sun
author_sort Huh, Sun
collection PubMed
description This study aimed to compare the knowledge and interpretation ability of ChatGPT, a language model of artificial general intelligence, with those of medical students in Korea by administering a parasitology examination to both ChatGPT and medical students. The examination consisted of 79 items and was administered to ChatGPT on January 1, 2023. The examination results were analyzed in terms of ChatGPT’s overall performance score, its correct answer rate by the items’ knowledge level, and the acceptability of its explanations of the items. ChatGPT’s performance was lower than that of the medical students, and ChatGPT’s correct answer rate was not related to the items’ knowledge level. However, there was a relationship between acceptable explanations and correct answers. In conclusion, ChatGPT’s knowledge and interpretation ability for this parasitology examination were not yet comparable to those of medical students in Korea.
format Online
Article
Text
id pubmed-9905868
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Korea Health Personnel Licensing Examination Institute
record_format MEDLINE/PubMed
spelling pubmed-99058682023-02-16 Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study Huh, Sun J Educ Eval Health Prof Brief Report This study aimed to compare the knowledge and interpretation ability of ChatGPT, a language model of artificial general intelligence, with those of medical students in Korea by administering a parasitology examination to both ChatGPT and medical students. The examination consisted of 79 items and was administered to ChatGPT on January 1, 2023. The examination results were analyzed in terms of ChatGPT’s overall performance score, its correct answer rate by the items’ knowledge level, and the acceptability of its explanations of the items. ChatGPT’s performance was lower than that of the medical students, and ChatGPT’s correct answer rate was not related to the items’ knowledge level. However, there was a relationship between acceptable explanations and correct answers. In conclusion, ChatGPT’s knowledge and interpretation ability for this parasitology examination were not yet comparable to those of medical students in Korea. Korea Health Personnel Licensing Examination Institute 2023-01-11 /pmc/articles/PMC9905868/ /pubmed/36627845 http://dx.doi.org/10.3352/jeehp.2023.20.1 Text en © 2023 Korea Health Personnel Licensing Examination Institute https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Brief Report
Huh, Sun
Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study
title Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study
title_full Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study
title_fullStr Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study
title_full_unstemmed Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study
title_short Are ChatGPT’s knowledge and interpretation ability comparable to those of medical students in Korea for taking a parasitology examination?: a descriptive study
title_sort are chatgpt’s knowledge and interpretation ability comparable to those of medical students in korea for taking a parasitology examination?: a descriptive study
topic Brief Report
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9905868/
https://www.ncbi.nlm.nih.gov/pubmed/36627845
http://dx.doi.org/10.3352/jeehp.2023.20.1
work_keys_str_mv AT huhsun arechatgptsknowledgeandinterpretationabilitycomparabletothoseofmedicalstudentsinkoreafortakingaparasitologyexaminationadescriptivestudy

Ejemplares similares