Cargando…

Feedback from artificial intelligence improved the learning of junior endoscopists on histology prediction of gastric lesions

Background and study aims  Artificial intelligence (AI)-assisted image classification has been shown to have high accuracy on endoscopic diagnosis. We evaluated the potential effects of use of an AI-assisted image classifier on training of junior endoscopists for histological prediction of gastric l...

Descripción completa

Detalles Bibliográficos
Autores principales: Lui, Thomas K.L., Wong, Kenneth K.Y., Mak, Loey L.Y., To, Elvis W.P., Tsui, Vivien W.M., Deng, Zijie, Guo, Jiaqi, Ni, Li, Cheung, Michael K.S., Leung, Wai K.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: © Georg Thieme Verlag KG 2020
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6976335/
https://www.ncbi.nlm.nih.gov/pubmed/32010746
http://dx.doi.org/10.1055/a-1036-6114
_version_ 1783490319337127936
author Lui, Thomas K.L.
Wong, Kenneth K.Y.
Mak, Loey L.Y.
To, Elvis W.P.
Tsui, Vivien W.M.
Deng, Zijie
Guo, Jiaqi
Ni, Li
Cheung, Michael K.S.
Leung, Wai K.
author_facet Lui, Thomas K.L.
Wong, Kenneth K.Y.
Mak, Loey L.Y.
To, Elvis W.P.
Tsui, Vivien W.M.
Deng, Zijie
Guo, Jiaqi
Ni, Li
Cheung, Michael K.S.
Leung, Wai K.
author_sort Lui, Thomas K.L.
collection PubMed
description Background and study aims  Artificial intelligence (AI)-assisted image classification has been shown to have high accuracy on endoscopic diagnosis. We evaluated the potential effects of use of an AI-assisted image classifier on training of junior endoscopists for histological prediction of gastric lesions. Methods  An AI image classifier was built on a convolutional neural network with five convolutional layers and three fully connected layers A Resnet backbone was trained by 2,000 non-magnified endoscopic gastric images. The independent validation set consisted of another 1,000 endoscopic images from 100 gastric lesions. The first part of the validation set was reviewed by six junior endoscopists and the prediction of AI was then disclosed to three of them (Group A) while the remaining three (Group B) were not provided this information. All endoscopists reviewed the second part of the validation set independently. Results  The overall accuracy of AI was 91.0 % (95 % CI: 89.2–92.7 %) with 97.1 % sensitivity (95 % CI: 95.6–98.7%), 85.9 % specificity (95 % CI: 83.0–88.4 %) and 0.91 area under the ROC (AUROC) (95 % CI: 0.89–0.93). AI was superior to all junior endoscopists in accuracy and AUROC in both validation sets. The performance of Group A endoscopists but not Group B endoscopists improved on the second validation set (accuracy 69.3 % to 74.7 %; P  = 0.003). Conclusion  The trained AI image classifier can accurately predict presence of neoplastic component of gastric lesions. Feedback from the AI image classifier can also hasten the learning curve of junior endoscopists in predicting histology of gastric lesions.
format Online
Article
Text
id pubmed-6976335
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher © Georg Thieme Verlag KG
record_format MEDLINE/PubMed
spelling pubmed-69763352020-02-01 Feedback from artificial intelligence improved the learning of junior endoscopists on histology prediction of gastric lesions Lui, Thomas K.L. Wong, Kenneth K.Y. Mak, Loey L.Y. To, Elvis W.P. Tsui, Vivien W.M. Deng, Zijie Guo, Jiaqi Ni, Li Cheung, Michael K.S. Leung, Wai K. Endosc Int Open Background and study aims  Artificial intelligence (AI)-assisted image classification has been shown to have high accuracy on endoscopic diagnosis. We evaluated the potential effects of use of an AI-assisted image classifier on training of junior endoscopists for histological prediction of gastric lesions. Methods  An AI image classifier was built on a convolutional neural network with five convolutional layers and three fully connected layers A Resnet backbone was trained by 2,000 non-magnified endoscopic gastric images. The independent validation set consisted of another 1,000 endoscopic images from 100 gastric lesions. The first part of the validation set was reviewed by six junior endoscopists and the prediction of AI was then disclosed to three of them (Group A) while the remaining three (Group B) were not provided this information. All endoscopists reviewed the second part of the validation set independently. Results  The overall accuracy of AI was 91.0 % (95 % CI: 89.2–92.7 %) with 97.1 % sensitivity (95 % CI: 95.6–98.7%), 85.9 % specificity (95 % CI: 83.0–88.4 %) and 0.91 area under the ROC (AUROC) (95 % CI: 0.89–0.93). AI was superior to all junior endoscopists in accuracy and AUROC in both validation sets. The performance of Group A endoscopists but not Group B endoscopists improved on the second validation set (accuracy 69.3 % to 74.7 %; P  = 0.003). Conclusion  The trained AI image classifier can accurately predict presence of neoplastic component of gastric lesions. Feedback from the AI image classifier can also hasten the learning curve of junior endoscopists in predicting histology of gastric lesions. © Georg Thieme Verlag KG 2020-02 2020-01-22 /pmc/articles/PMC6976335/ /pubmed/32010746 http://dx.doi.org/10.1055/a-1036-6114 Text en https://creativecommons.org/licenses/by-nc-nd/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives License, which permits unrestricted reproduction and distribution, for non-commercial purposes only; and use and reproduction, but not distribution, of adapted material for non-commercial purposes only, provided the original work is properly cited.
spellingShingle Lui, Thomas K.L.
Wong, Kenneth K.Y.
Mak, Loey L.Y.
To, Elvis W.P.
Tsui, Vivien W.M.
Deng, Zijie
Guo, Jiaqi
Ni, Li
Cheung, Michael K.S.
Leung, Wai K.
Feedback from artificial intelligence improved the learning of junior endoscopists on histology prediction of gastric lesions
title Feedback from artificial intelligence improved the learning of junior endoscopists on histology prediction of gastric lesions
title_full Feedback from artificial intelligence improved the learning of junior endoscopists on histology prediction of gastric lesions
title_fullStr Feedback from artificial intelligence improved the learning of junior endoscopists on histology prediction of gastric lesions
title_full_unstemmed Feedback from artificial intelligence improved the learning of junior endoscopists on histology prediction of gastric lesions
title_short Feedback from artificial intelligence improved the learning of junior endoscopists on histology prediction of gastric lesions
title_sort feedback from artificial intelligence improved the learning of junior endoscopists on histology prediction of gastric lesions
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6976335/
https://www.ncbi.nlm.nih.gov/pubmed/32010746
http://dx.doi.org/10.1055/a-1036-6114
work_keys_str_mv AT luithomaskl feedbackfromartificialintelligenceimprovedthelearningofjuniorendoscopistsonhistologypredictionofgastriclesions
AT wongkennethky feedbackfromartificialintelligenceimprovedthelearningofjuniorendoscopistsonhistologypredictionofgastriclesions
AT makloeyly feedbackfromartificialintelligenceimprovedthelearningofjuniorendoscopistsonhistologypredictionofgastriclesions
AT toelviswp feedbackfromartificialintelligenceimprovedthelearningofjuniorendoscopistsonhistologypredictionofgastriclesions
AT tsuivivienwm feedbackfromartificialintelligenceimprovedthelearningofjuniorendoscopistsonhistologypredictionofgastriclesions
AT dengzijie feedbackfromartificialintelligenceimprovedthelearningofjuniorendoscopistsonhistologypredictionofgastriclesions
AT guojiaqi feedbackfromartificialintelligenceimprovedthelearningofjuniorendoscopistsonhistologypredictionofgastriclesions
AT nili feedbackfromartificialintelligenceimprovedthelearningofjuniorendoscopistsonhistologypredictionofgastriclesions
AT cheungmichaelks feedbackfromartificialintelligenceimprovedthelearningofjuniorendoscopistsonhistologypredictionofgastriclesions
AT leungwaik feedbackfromartificialintelligenceimprovedthelearningofjuniorendoscopistsonhistologypredictionofgastriclesions