Cargando…
A joint convolutional-recurrent neural network with an attention mechanism for detecting intracranial hemorrhage on noncontrast head CT
To investigate the performance of a joint convolutional neural networks-recurrent neural networks (CNN-RNN) using an attention mechanism in identifying and classifying intracranial hemorrhage (ICH) on a large multi-center dataset; to test its performance in a prospective independent sample consistin...
Autores principales: | , , , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8826390/ https://www.ncbi.nlm.nih.gov/pubmed/35136123 http://dx.doi.org/10.1038/s41598-022-05872-x |
_version_ | 1784647422271553536 |
---|---|
author | Alis, Deniz Alis, Ceren Yergin, Mert Topel, Cagdas Asmakutlu, Ozan Bagcilar, Omer Senli, Yeseren Deniz Ustundag, Ahmet Salt, Vefa Dogan, Sebahat Nacar Velioglu, Murat Selcuk, Hakan Hatem Kara, Batuhan Ozer, Caner Oksuz, Ilkay Kizilkilic, Osman Karaarslan, Ercan |
author_facet | Alis, Deniz Alis, Ceren Yergin, Mert Topel, Cagdas Asmakutlu, Ozan Bagcilar, Omer Senli, Yeseren Deniz Ustundag, Ahmet Salt, Vefa Dogan, Sebahat Nacar Velioglu, Murat Selcuk, Hakan Hatem Kara, Batuhan Ozer, Caner Oksuz, Ilkay Kizilkilic, Osman Karaarslan, Ercan |
author_sort | Alis, Deniz |
collection | PubMed |
description | To investigate the performance of a joint convolutional neural networks-recurrent neural networks (CNN-RNN) using an attention mechanism in identifying and classifying intracranial hemorrhage (ICH) on a large multi-center dataset; to test its performance in a prospective independent sample consisting of consecutive real-world patients. All consecutive patients who underwent emergency non-contrast-enhanced head CT in five different centers were retrospectively gathered. Five neuroradiologists created the ground-truth labels. The development dataset was divided into the training and validation set. After the development phase, we integrated the deep learning model into an independent center’s PACS environment for over six months for assessing the performance in a real clinical setting. Three radiologists created the ground-truth labels of the testing set with a majority voting. A total of 55,179 head CT scans of 48,070 patients, 28,253 men (58.77%), with a mean age of 53.84 ± 17.64 years (range 18–89) were enrolled in the study. The validation sample comprised 5211 head CT scans, with 991 being annotated as ICH-positive. The model's binary accuracy, sensitivity, and specificity on the validation set were 99.41%, 99.70%, and 98.91, respectively. During the prospective implementation, the model yielded an accuracy of 96.02% on 452 head CT scans with an average prediction time of 45 ± 8 s. The joint CNN-RNN model with an attention mechanism yielded excellent diagnostic accuracy in assessing ICH and its subtypes on a large-scale sample. The model was seamlessly integrated into the radiology workflow. Though slightly decreased performance, it provided decisions on the sample of consecutive real-world patients within a minute. |
format | Online Article Text |
id | pubmed-8826390 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-88263902022-02-10 A joint convolutional-recurrent neural network with an attention mechanism for detecting intracranial hemorrhage on noncontrast head CT Alis, Deniz Alis, Ceren Yergin, Mert Topel, Cagdas Asmakutlu, Ozan Bagcilar, Omer Senli, Yeseren Deniz Ustundag, Ahmet Salt, Vefa Dogan, Sebahat Nacar Velioglu, Murat Selcuk, Hakan Hatem Kara, Batuhan Ozer, Caner Oksuz, Ilkay Kizilkilic, Osman Karaarslan, Ercan Sci Rep Article To investigate the performance of a joint convolutional neural networks-recurrent neural networks (CNN-RNN) using an attention mechanism in identifying and classifying intracranial hemorrhage (ICH) on a large multi-center dataset; to test its performance in a prospective independent sample consisting of consecutive real-world patients. All consecutive patients who underwent emergency non-contrast-enhanced head CT in five different centers were retrospectively gathered. Five neuroradiologists created the ground-truth labels. The development dataset was divided into the training and validation set. After the development phase, we integrated the deep learning model into an independent center’s PACS environment for over six months for assessing the performance in a real clinical setting. Three radiologists created the ground-truth labels of the testing set with a majority voting. A total of 55,179 head CT scans of 48,070 patients, 28,253 men (58.77%), with a mean age of 53.84 ± 17.64 years (range 18–89) were enrolled in the study. The validation sample comprised 5211 head CT scans, with 991 being annotated as ICH-positive. The model's binary accuracy, sensitivity, and specificity on the validation set were 99.41%, 99.70%, and 98.91, respectively. During the prospective implementation, the model yielded an accuracy of 96.02% on 452 head CT scans with an average prediction time of 45 ± 8 s. The joint CNN-RNN model with an attention mechanism yielded excellent diagnostic accuracy in assessing ICH and its subtypes on a large-scale sample. The model was seamlessly integrated into the radiology workflow. Though slightly decreased performance, it provided decisions on the sample of consecutive real-world patients within a minute. Nature Publishing Group UK 2022-02-08 /pmc/articles/PMC8826390/ /pubmed/35136123 http://dx.doi.org/10.1038/s41598-022-05872-x Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Alis, Deniz Alis, Ceren Yergin, Mert Topel, Cagdas Asmakutlu, Ozan Bagcilar, Omer Senli, Yeseren Deniz Ustundag, Ahmet Salt, Vefa Dogan, Sebahat Nacar Velioglu, Murat Selcuk, Hakan Hatem Kara, Batuhan Ozer, Caner Oksuz, Ilkay Kizilkilic, Osman Karaarslan, Ercan A joint convolutional-recurrent neural network with an attention mechanism for detecting intracranial hemorrhage on noncontrast head CT |
title | A joint convolutional-recurrent neural network with an attention mechanism for detecting intracranial hemorrhage on noncontrast head CT |
title_full | A joint convolutional-recurrent neural network with an attention mechanism for detecting intracranial hemorrhage on noncontrast head CT |
title_fullStr | A joint convolutional-recurrent neural network with an attention mechanism for detecting intracranial hemorrhage on noncontrast head CT |
title_full_unstemmed | A joint convolutional-recurrent neural network with an attention mechanism for detecting intracranial hemorrhage on noncontrast head CT |
title_short | A joint convolutional-recurrent neural network with an attention mechanism for detecting intracranial hemorrhage on noncontrast head CT |
title_sort | joint convolutional-recurrent neural network with an attention mechanism for detecting intracranial hemorrhage on noncontrast head ct |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8826390/ https://www.ncbi.nlm.nih.gov/pubmed/35136123 http://dx.doi.org/10.1038/s41598-022-05872-x |
work_keys_str_mv | AT alisdeniz ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT alisceren ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT yerginmert ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT topelcagdas ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT asmakutluozan ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT bagcilaromer ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT senliyeserendeniz ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT ustundagahmet ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT saltvefa ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT dogansebahatnacar ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT velioglumurat ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT selcukhakanhatem ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT karabatuhan ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT ozercaner ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT oksuzilkay ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT kizilkilicosman ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT karaarslanercan ajointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT alisdeniz jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT alisceren jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT yerginmert jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT topelcagdas jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT asmakutluozan jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT bagcilaromer jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT senliyeserendeniz jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT ustundagahmet jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT saltvefa jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT dogansebahatnacar jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT velioglumurat jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT selcukhakanhatem jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT karabatuhan jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT ozercaner jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT oksuzilkay jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT kizilkilicosman jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct AT karaarslanercan jointconvolutionalrecurrentneuralnetworkwithanattentionmechanismfordetectingintracranialhemorrhageonnoncontrastheadct |