Cargando…

Revealing the Boundaries of Selected Gastro-Intestinal (GI) Organs by Implementing CNNs in Endoscopic Capsule Images

Purpose: The detection of where an organ starts and where it ends is achievable and, since this information can be delivered in real time, it could be quite important for several reasons. For one, by having the practical knowledge of the Wireless Endoscopic Capsule (WEC) transition through an organ’...

Descripción completa

Detalles Bibliográficos
Autores principales: Athanasiou, Sofia A., Sergaki, Eleftheria S., Polydorou, Andreas A., Polydorou, Alexios A., Stavrakakis, George S., Afentakis, Nikolaos M., Vardiambasis, Ioannis O., Zervakis, Michail E.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10000441/
https://www.ncbi.nlm.nih.gov/pubmed/36900009
http://dx.doi.org/10.3390/diagnostics13050865
_version_ 1784903877308448768
author Athanasiou, Sofia A.
Sergaki, Eleftheria S.
Polydorou, Andreas A.
Polydorou, Alexios A.
Stavrakakis, George S.
Afentakis, Nikolaos M.
Vardiambasis, Ioannis O.
Zervakis, Michail E.
author_facet Athanasiou, Sofia A.
Sergaki, Eleftheria S.
Polydorou, Andreas A.
Polydorou, Alexios A.
Stavrakakis, George S.
Afentakis, Nikolaos M.
Vardiambasis, Ioannis O.
Zervakis, Michail E.
author_sort Athanasiou, Sofia A.
collection PubMed
description Purpose: The detection of where an organ starts and where it ends is achievable and, since this information can be delivered in real time, it could be quite important for several reasons. For one, by having the practical knowledge of the Wireless Endoscopic Capsule (WEC) transition through an organ’s domain, we are able to align and control the endoscopic operation with any other possible protocol, i.e., delivering some form of treatment on the spot. Another is having greater anatomical topography information per session, therefore treating the individual in detail (not “in general”). Even the fact that by gathering more accurate information for a patient by merely implementing clever software procedures is a task worth exploiting, since the problems we have to overcome in real-time processing of the capsule findings (i.e., wireless transfer of images to another unit that will apply the necessary real time computations) are still challenging. This study proposes a computer-aided detection (CAD) tool, a CNN algorithm deployed to run on field programmable gate array (FPGA), able to automatically track the capsule transitions through the entrance (gate) of esophagus, stomach, small intestine and colon, in real time. The input data are the wireless transmitted image shots of the capsule’s camera (while the endoscopy capsule is operating). Methods: We developed and evaluated three distinct multiclass classification CNNs, trained on the same dataset of total 5520 images extracted by 99 capsule videos (total 1380 frames from each organ of interest). The proposed CNNs differ in size and number of convolution filters. The confusion matrix is obtained by training each classifier and evaluating the trained model on an independent test dataset comprising 496 images extracted by 39 capsule videos, 124 from each GI organ. The test dataset was further evaluated by one endoscopist, and his findings were compared with CNN-based results. The statistically significant of predictions between the four classes of each model and the comparison between the three distinct models is evaluated by calculating the p-values and chi-square test for multi class. The comparison between the three models is carried out by calculating the macro average F1 score and Mattheus correlation coefficient (MCC). The quality of the best CNN model is estimated by calculations of sensitivity and specificity. Results: Our experimental results of independent validation demonstrate that the best of our developed models addressed this topological problem by exhibiting an overall sensitivity (96.55%) and specificity of (94.73%) in the esophagus, (81.08% sensitivity and 96.55% specificity) in the stomach, (89.65% sensitivity and 97.89% specificity) in the small intestine and (100% sensitivity and 98.94% specificity) in the colon. The average macro accuracy is 95.56%, the average macro sensitivity is 91.82%.
format Online
Article
Text
id pubmed-10000441
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-100004412023-03-11 Revealing the Boundaries of Selected Gastro-Intestinal (GI) Organs by Implementing CNNs in Endoscopic Capsule Images Athanasiou, Sofia A. Sergaki, Eleftheria S. Polydorou, Andreas A. Polydorou, Alexios A. Stavrakakis, George S. Afentakis, Nikolaos M. Vardiambasis, Ioannis O. Zervakis, Michail E. Diagnostics (Basel) Article Purpose: The detection of where an organ starts and where it ends is achievable and, since this information can be delivered in real time, it could be quite important for several reasons. For one, by having the practical knowledge of the Wireless Endoscopic Capsule (WEC) transition through an organ’s domain, we are able to align and control the endoscopic operation with any other possible protocol, i.e., delivering some form of treatment on the spot. Another is having greater anatomical topography information per session, therefore treating the individual in detail (not “in general”). Even the fact that by gathering more accurate information for a patient by merely implementing clever software procedures is a task worth exploiting, since the problems we have to overcome in real-time processing of the capsule findings (i.e., wireless transfer of images to another unit that will apply the necessary real time computations) are still challenging. This study proposes a computer-aided detection (CAD) tool, a CNN algorithm deployed to run on field programmable gate array (FPGA), able to automatically track the capsule transitions through the entrance (gate) of esophagus, stomach, small intestine and colon, in real time. The input data are the wireless transmitted image shots of the capsule’s camera (while the endoscopy capsule is operating). Methods: We developed and evaluated three distinct multiclass classification CNNs, trained on the same dataset of total 5520 images extracted by 99 capsule videos (total 1380 frames from each organ of interest). The proposed CNNs differ in size and number of convolution filters. The confusion matrix is obtained by training each classifier and evaluating the trained model on an independent test dataset comprising 496 images extracted by 39 capsule videos, 124 from each GI organ. The test dataset was further evaluated by one endoscopist, and his findings were compared with CNN-based results. The statistically significant of predictions between the four classes of each model and the comparison between the three distinct models is evaluated by calculating the p-values and chi-square test for multi class. The comparison between the three models is carried out by calculating the macro average F1 score and Mattheus correlation coefficient (MCC). The quality of the best CNN model is estimated by calculations of sensitivity and specificity. Results: Our experimental results of independent validation demonstrate that the best of our developed models addressed this topological problem by exhibiting an overall sensitivity (96.55%) and specificity of (94.73%) in the esophagus, (81.08% sensitivity and 96.55% specificity) in the stomach, (89.65% sensitivity and 97.89% specificity) in the small intestine and (100% sensitivity and 98.94% specificity) in the colon. The average macro accuracy is 95.56%, the average macro sensitivity is 91.82%. MDPI 2023-02-23 /pmc/articles/PMC10000441/ /pubmed/36900009 http://dx.doi.org/10.3390/diagnostics13050865 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Athanasiou, Sofia A.
Sergaki, Eleftheria S.
Polydorou, Andreas A.
Polydorou, Alexios A.
Stavrakakis, George S.
Afentakis, Nikolaos M.
Vardiambasis, Ioannis O.
Zervakis, Michail E.
Revealing the Boundaries of Selected Gastro-Intestinal (GI) Organs by Implementing CNNs in Endoscopic Capsule Images
title Revealing the Boundaries of Selected Gastro-Intestinal (GI) Organs by Implementing CNNs in Endoscopic Capsule Images
title_full Revealing the Boundaries of Selected Gastro-Intestinal (GI) Organs by Implementing CNNs in Endoscopic Capsule Images
title_fullStr Revealing the Boundaries of Selected Gastro-Intestinal (GI) Organs by Implementing CNNs in Endoscopic Capsule Images
title_full_unstemmed Revealing the Boundaries of Selected Gastro-Intestinal (GI) Organs by Implementing CNNs in Endoscopic Capsule Images
title_short Revealing the Boundaries of Selected Gastro-Intestinal (GI) Organs by Implementing CNNs in Endoscopic Capsule Images
title_sort revealing the boundaries of selected gastro-intestinal (gi) organs by implementing cnns in endoscopic capsule images
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10000441/
https://www.ncbi.nlm.nih.gov/pubmed/36900009
http://dx.doi.org/10.3390/diagnostics13050865
work_keys_str_mv AT athanasiousofiaa revealingtheboundariesofselectedgastrointestinalgiorgansbyimplementingcnnsinendoscopiccapsuleimages
AT sergakieleftherias revealingtheboundariesofselectedgastrointestinalgiorgansbyimplementingcnnsinendoscopiccapsuleimages
AT polydorouandreasa revealingtheboundariesofselectedgastrointestinalgiorgansbyimplementingcnnsinendoscopiccapsuleimages
AT polydoroualexiosa revealingtheboundariesofselectedgastrointestinalgiorgansbyimplementingcnnsinendoscopiccapsuleimages
AT stavrakakisgeorges revealingtheboundariesofselectedgastrointestinalgiorgansbyimplementingcnnsinendoscopiccapsuleimages
AT afentakisnikolaosm revealingtheboundariesofselectedgastrointestinalgiorgansbyimplementingcnnsinendoscopiccapsuleimages
AT vardiambasisioanniso revealingtheboundariesofselectedgastrointestinalgiorgansbyimplementingcnnsinendoscopiccapsuleimages
AT zervakismichaile revealingtheboundariesofselectedgastrointestinalgiorgansbyimplementingcnnsinendoscopiccapsuleimages