Cargando…

Leveraging Large Language Models (LLM) for the Plastic Surgery Resident Training: Do They Have a Role?

Introduction  Large language models (LLMs) are designed for recognizing, summarizing, translating, predicting, and generating text-based content from knowledge gained from extensive data sets. ChatGPT4 (Generative Pre-trained Transformer 4) (OpenAI, San Francisco, California, United States) is a tra...

Descripción completa

Detalles Bibliográficos
Autores principales: Mohapatra, Devi Prasad, Thiruvoth, Friji Meethale, Tripathy, Satyaswarup, Rajan, Sheeja, Vathulya, Madhubari, Lakshmi, Palukuri, Singh, Veena K., Haq, Ansar Ul
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Thieme Medical and Scientific Publishers Pvt. Ltd. 2023
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10663077/
https://www.ncbi.nlm.nih.gov/pubmed/38026769
http://dx.doi.org/10.1055/s-0043-1772704
_version_ 1785138318469496832
author Mohapatra, Devi Prasad
Thiruvoth, Friji Meethale
Tripathy, Satyaswarup
Rajan, Sheeja
Vathulya, Madhubari
Lakshmi, Palukuri
Singh, Veena K.
Haq, Ansar Ul
author_facet Mohapatra, Devi Prasad
Thiruvoth, Friji Meethale
Tripathy, Satyaswarup
Rajan, Sheeja
Vathulya, Madhubari
Lakshmi, Palukuri
Singh, Veena K.
Haq, Ansar Ul
author_sort Mohapatra, Devi Prasad
collection PubMed
description Introduction  Large language models (LLMs) are designed for recognizing, summarizing, translating, predicting, and generating text-based content from knowledge gained from extensive data sets. ChatGPT4 (Generative Pre-trained Transformer 4) (OpenAI, San Francisco, California, United States) is a transformer-based LLM model pretrained on public data as well as data obtained from third-party sources using deep learning techniques of fine tuning and reinforcement learning from human feedback to predict the next text. We wanted to explore the role of LLM as a teaching assistant (TA) in plastic surgery. Material and Methods  TA roles were first identified in available literature, and based on the roles, a list of suitable tasks was created where LLM could be used to perform the task. Prompts designed to be fed in to the LLM (specifically ChatGPT) to generate appropriate output, were then created and fed to the ChatGPT model. The outputs generated were scored by evaluators and compared for interobserver agreement. Results  A final set of eight TA roles were identified where a LLM could be utilized to generate content. These contents were scored for usefulness and accuracy. These were scored independently by the eight study authors in a scoring sheet created for the study. Interobserver agreements for content accuracy, usefulness, and clarity were 100% for content generated for the following: interactive case studies (generation), simulation of preoperative consultations, and generation of ethical considerations. Discussion  LLMs in general and ChatGPT (on which this study is based) in specific, can generate answers to questions and prompts based on huge amount of text fed into the model for training the underlying language model. The answers generated have been found to be accurate, readable, and even indistinguishable from human-generated text. This capability of automated content synthesis can be exploited to generate summaries to text, answer short and long answers, and generate case scenarios. We could identify a few such scenarios where the LLM could in general be utilized to play the role of a TA and aid plastic surgery residents in particular. In addition, these models could also be used by students to obtain feedback and gain reflection which itself stimulates critical thinking. Conclusion  Incorporating LLMs into the educational arsenal of plastic surgery residency programs can provide a dynamic, interactive, and individualized learning experience for residents and prove to be worthy TAs of future.
format Online
Article
Text
id pubmed-10663077
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Thieme Medical and Scientific Publishers Pvt. Ltd.
record_format MEDLINE/PubMed
spelling pubmed-106630772023-08-01 Leveraging Large Language Models (LLM) for the Plastic Surgery Resident Training: Do They Have a Role? Mohapatra, Devi Prasad Thiruvoth, Friji Meethale Tripathy, Satyaswarup Rajan, Sheeja Vathulya, Madhubari Lakshmi, Palukuri Singh, Veena K. Haq, Ansar Ul Indian J Plast Surg Introduction  Large language models (LLMs) are designed for recognizing, summarizing, translating, predicting, and generating text-based content from knowledge gained from extensive data sets. ChatGPT4 (Generative Pre-trained Transformer 4) (OpenAI, San Francisco, California, United States) is a transformer-based LLM model pretrained on public data as well as data obtained from third-party sources using deep learning techniques of fine tuning and reinforcement learning from human feedback to predict the next text. We wanted to explore the role of LLM as a teaching assistant (TA) in plastic surgery. Material and Methods  TA roles were first identified in available literature, and based on the roles, a list of suitable tasks was created where LLM could be used to perform the task. Prompts designed to be fed in to the LLM (specifically ChatGPT) to generate appropriate output, were then created and fed to the ChatGPT model. The outputs generated were scored by evaluators and compared for interobserver agreement. Results  A final set of eight TA roles were identified where a LLM could be utilized to generate content. These contents were scored for usefulness and accuracy. These were scored independently by the eight study authors in a scoring sheet created for the study. Interobserver agreements for content accuracy, usefulness, and clarity were 100% for content generated for the following: interactive case studies (generation), simulation of preoperative consultations, and generation of ethical considerations. Discussion  LLMs in general and ChatGPT (on which this study is based) in specific, can generate answers to questions and prompts based on huge amount of text fed into the model for training the underlying language model. The answers generated have been found to be accurate, readable, and even indistinguishable from human-generated text. This capability of automated content synthesis can be exploited to generate summaries to text, answer short and long answers, and generate case scenarios. We could identify a few such scenarios where the LLM could in general be utilized to play the role of a TA and aid plastic surgery residents in particular. In addition, these models could also be used by students to obtain feedback and gain reflection which itself stimulates critical thinking. Conclusion  Incorporating LLMs into the educational arsenal of plastic surgery residency programs can provide a dynamic, interactive, and individualized learning experience for residents and prove to be worthy TAs of future. Thieme Medical and Scientific Publishers Pvt. Ltd. 2023-08-28 /pmc/articles/PMC10663077/ /pubmed/38026769 http://dx.doi.org/10.1055/s-0043-1772704 Text en Association of Plastic Surgeons of India. This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. ( https://creativecommons.org/licenses/by-nc-nd/4.0/ ) https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License, which permits unrestricted reproduction and distribution, for non-commercial purposes only; and use and reproduction, but not distribution, of adapted material for non-commercial purposes only, provided the original work is properly cited.
spellingShingle Mohapatra, Devi Prasad
Thiruvoth, Friji Meethale
Tripathy, Satyaswarup
Rajan, Sheeja
Vathulya, Madhubari
Lakshmi, Palukuri
Singh, Veena K.
Haq, Ansar Ul
Leveraging Large Language Models (LLM) for the Plastic Surgery Resident Training: Do They Have a Role?
title Leveraging Large Language Models (LLM) for the Plastic Surgery Resident Training: Do They Have a Role?
title_full Leveraging Large Language Models (LLM) for the Plastic Surgery Resident Training: Do They Have a Role?
title_fullStr Leveraging Large Language Models (LLM) for the Plastic Surgery Resident Training: Do They Have a Role?
title_full_unstemmed Leveraging Large Language Models (LLM) for the Plastic Surgery Resident Training: Do They Have a Role?
title_short Leveraging Large Language Models (LLM) for the Plastic Surgery Resident Training: Do They Have a Role?
title_sort leveraging large language models (llm) for the plastic surgery resident training: do they have a role?
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10663077/
https://www.ncbi.nlm.nih.gov/pubmed/38026769
http://dx.doi.org/10.1055/s-0043-1772704
work_keys_str_mv AT mohapatradeviprasad leveraginglargelanguagemodelsllmfortheplasticsurgeryresidenttrainingdotheyhavearole
AT thiruvothfrijimeethale leveraginglargelanguagemodelsllmfortheplasticsurgeryresidenttrainingdotheyhavearole
AT tripathysatyaswarup leveraginglargelanguagemodelsllmfortheplasticsurgeryresidenttrainingdotheyhavearole
AT rajansheeja leveraginglargelanguagemodelsllmfortheplasticsurgeryresidenttrainingdotheyhavearole
AT vathulyamadhubari leveraginglargelanguagemodelsllmfortheplasticsurgeryresidenttrainingdotheyhavearole
AT lakshmipalukuri leveraginglargelanguagemodelsllmfortheplasticsurgeryresidenttrainingdotheyhavearole
AT singhveenak leveraginglargelanguagemodelsllmfortheplasticsurgeryresidenttrainingdotheyhavearole
AT haqansarul leveraginglargelanguagemodelsllmfortheplasticsurgeryresidenttrainingdotheyhavearole