Cargando…

Clinical Decision Support System for All Stages of Gastric Carcinogenesis in Real-Time Endoscopy: Model Establishment and Validation Study

BACKGROUND: Our research group previously established a deep-learning–based clinical decision support system (CDSS) for real-time endoscopy-based detection and classification of gastric neoplasms. However, preneoplastic conditions, such as atrophy and intestinal metaplasia (IM) were not taken into a...

Descripción completa

Detalles Bibliográficos
Autores principales: Gong, Eun Jeong, Bang, Chang Seok, Lee, Jae Jun, Jeong, Hae Min, Baik, Gwang Ho, Jeong, Jae Hoon, Dick, Sigmund, Lee, Gi Hun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: JMIR Publications 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10644184/
https://www.ncbi.nlm.nih.gov/pubmed/37902818
http://dx.doi.org/10.2196/50448
_version_ 1785134498925510656
author Gong, Eun Jeong
Bang, Chang Seok
Lee, Jae Jun
Jeong, Hae Min
Baik, Gwang Ho
Jeong, Jae Hoon
Dick, Sigmund
Lee, Gi Hun
author_facet Gong, Eun Jeong
Bang, Chang Seok
Lee, Jae Jun
Jeong, Hae Min
Baik, Gwang Ho
Jeong, Jae Hoon
Dick, Sigmund
Lee, Gi Hun
author_sort Gong, Eun Jeong
collection PubMed
description BACKGROUND: Our research group previously established a deep-learning–based clinical decision support system (CDSS) for real-time endoscopy-based detection and classification of gastric neoplasms. However, preneoplastic conditions, such as atrophy and intestinal metaplasia (IM) were not taken into account, and there is no established model that classifies all stages of gastric carcinogenesis. OBJECTIVE: This study aims to build and validate a CDSS for real-time endoscopy for all stages of gastric carcinogenesis, including atrophy and IM. METHODS: A total of 11,868 endoscopic images were used for training and internal testing. The primary outcomes were lesion classification accuracy (6 classes: advanced gastric cancer, early gastric cancer, dysplasia, atrophy, IM, and normal) and atrophy and IM lesion segmentation rates for the segmentation model. The following tests were carried out to validate the performance of lesion classification accuracy: (1) external testing using 1282 images from another institution and (2) evaluation of the classification accuracy of atrophy and IM in real-world procedures in a prospective manner. To estimate the clinical utility, 2 experienced endoscopists were invited to perform a blind test with the same data set. A CDSS was constructed by combining the established 6-class lesion classification model and the preneoplastic lesion segmentation model with the previously established lesion detection model. RESULTS: The overall lesion classification accuracy (95% CI) was 90.3% (89%-91.6%) in the internal test. For the performance validation, the CDSS achieved 85.3% (83.4%-97.2%) overall accuracy. The per-class external test accuracies for atrophy and IM were 95.3% (92.6%-98%) and 89.3% (85.4%-93.2%), respectively. CDSS-assisted endoscopy showed an accuracy of 92.1% (88.8%-95.4%) for atrophy and 95.5% (92%-99%) for IM in the real-world application of 522 consecutive screening endoscopies. There was no significant difference in the overall accuracy between the invited endoscopists and established CDSS in the prospective real-clinic evaluation (P=.23). The CDSS demonstrated a segmentation rate of 93.4% (95% CI 92.4%-94.4%) for atrophy or IM lesion segmentation in the internal testing. CONCLUSIONS: The CDSS achieved high performance in terms of computer-aided diagnosis of all stages of gastric carcinogenesis and demonstrated real-world application potential.
format Online
Article
Text
id pubmed-10644184
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher JMIR Publications
record_format MEDLINE/PubMed
spelling pubmed-106441842023-10-30 Clinical Decision Support System for All Stages of Gastric Carcinogenesis in Real-Time Endoscopy: Model Establishment and Validation Study Gong, Eun Jeong Bang, Chang Seok Lee, Jae Jun Jeong, Hae Min Baik, Gwang Ho Jeong, Jae Hoon Dick, Sigmund Lee, Gi Hun J Med Internet Res Original Paper BACKGROUND: Our research group previously established a deep-learning–based clinical decision support system (CDSS) for real-time endoscopy-based detection and classification of gastric neoplasms. However, preneoplastic conditions, such as atrophy and intestinal metaplasia (IM) were not taken into account, and there is no established model that classifies all stages of gastric carcinogenesis. OBJECTIVE: This study aims to build and validate a CDSS for real-time endoscopy for all stages of gastric carcinogenesis, including atrophy and IM. METHODS: A total of 11,868 endoscopic images were used for training and internal testing. The primary outcomes were lesion classification accuracy (6 classes: advanced gastric cancer, early gastric cancer, dysplasia, atrophy, IM, and normal) and atrophy and IM lesion segmentation rates for the segmentation model. The following tests were carried out to validate the performance of lesion classification accuracy: (1) external testing using 1282 images from another institution and (2) evaluation of the classification accuracy of atrophy and IM in real-world procedures in a prospective manner. To estimate the clinical utility, 2 experienced endoscopists were invited to perform a blind test with the same data set. A CDSS was constructed by combining the established 6-class lesion classification model and the preneoplastic lesion segmentation model with the previously established lesion detection model. RESULTS: The overall lesion classification accuracy (95% CI) was 90.3% (89%-91.6%) in the internal test. For the performance validation, the CDSS achieved 85.3% (83.4%-97.2%) overall accuracy. The per-class external test accuracies for atrophy and IM were 95.3% (92.6%-98%) and 89.3% (85.4%-93.2%), respectively. CDSS-assisted endoscopy showed an accuracy of 92.1% (88.8%-95.4%) for atrophy and 95.5% (92%-99%) for IM in the real-world application of 522 consecutive screening endoscopies. There was no significant difference in the overall accuracy between the invited endoscopists and established CDSS in the prospective real-clinic evaluation (P=.23). The CDSS demonstrated a segmentation rate of 93.4% (95% CI 92.4%-94.4%) for atrophy or IM lesion segmentation in the internal testing. CONCLUSIONS: The CDSS achieved high performance in terms of computer-aided diagnosis of all stages of gastric carcinogenesis and demonstrated real-world application potential. JMIR Publications 2023-10-30 /pmc/articles/PMC10644184/ /pubmed/37902818 http://dx.doi.org/10.2196/50448 Text en ©Eun Jeong Gong, Chang Seok Bang, Jae Jun Lee, Hae Min Jeong, Gwang Ho Baik, Jae Hoon Jeong, Sigmund Dick, Gi Hun Lee. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 30.10.2023. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.
spellingShingle Original Paper
Gong, Eun Jeong
Bang, Chang Seok
Lee, Jae Jun
Jeong, Hae Min
Baik, Gwang Ho
Jeong, Jae Hoon
Dick, Sigmund
Lee, Gi Hun
Clinical Decision Support System for All Stages of Gastric Carcinogenesis in Real-Time Endoscopy: Model Establishment and Validation Study
title Clinical Decision Support System for All Stages of Gastric Carcinogenesis in Real-Time Endoscopy: Model Establishment and Validation Study
title_full Clinical Decision Support System for All Stages of Gastric Carcinogenesis in Real-Time Endoscopy: Model Establishment and Validation Study
title_fullStr Clinical Decision Support System for All Stages of Gastric Carcinogenesis in Real-Time Endoscopy: Model Establishment and Validation Study
title_full_unstemmed Clinical Decision Support System for All Stages of Gastric Carcinogenesis in Real-Time Endoscopy: Model Establishment and Validation Study
title_short Clinical Decision Support System for All Stages of Gastric Carcinogenesis in Real-Time Endoscopy: Model Establishment and Validation Study
title_sort clinical decision support system for all stages of gastric carcinogenesis in real-time endoscopy: model establishment and validation study
topic Original Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10644184/
https://www.ncbi.nlm.nih.gov/pubmed/37902818
http://dx.doi.org/10.2196/50448
work_keys_str_mv AT gongeunjeong clinicaldecisionsupportsystemforallstagesofgastriccarcinogenesisinrealtimeendoscopymodelestablishmentandvalidationstudy
AT bangchangseok clinicaldecisionsupportsystemforallstagesofgastriccarcinogenesisinrealtimeendoscopymodelestablishmentandvalidationstudy
AT leejaejun clinicaldecisionsupportsystemforallstagesofgastriccarcinogenesisinrealtimeendoscopymodelestablishmentandvalidationstudy
AT jeonghaemin clinicaldecisionsupportsystemforallstagesofgastriccarcinogenesisinrealtimeendoscopymodelestablishmentandvalidationstudy
AT baikgwangho clinicaldecisionsupportsystemforallstagesofgastriccarcinogenesisinrealtimeendoscopymodelestablishmentandvalidationstudy
AT jeongjaehoon clinicaldecisionsupportsystemforallstagesofgastriccarcinogenesisinrealtimeendoscopymodelestablishmentandvalidationstudy
AT dicksigmund clinicaldecisionsupportsystemforallstagesofgastriccarcinogenesisinrealtimeendoscopymodelestablishmentandvalidationstudy
AT leegihun clinicaldecisionsupportsystemforallstagesofgastriccarcinogenesisinrealtimeendoscopymodelestablishmentandvalidationstudy