Cargando…

Deep learning-based classification of DSA image sequences of patients with acute ischemic stroke

PURPOSE: Recently, a large number of patients with acute ischemic stroke benefited from the use of thrombectomy, a minimally invasive intervention technique for mechanically removing thrombi from the cerebrovasculature. During thrombectomy, 2D digital subtraction angiography (DSA) image sequences ar...

Descripción completa

Detalles Bibliográficos
Autores principales: Mittmann, Benjamin J., Braun, Michael, Runck, Frank, Schmitz, Bernd, Tran, Thuy N., Yamlahi, Amine, Maier-Hein, Lena, Franz, Alfred M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer International Publishing 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9463240/
https://www.ncbi.nlm.nih.gov/pubmed/35604489
http://dx.doi.org/10.1007/s11548-022-02654-8
_version_ 1784787353585319936
author Mittmann, Benjamin J.
Braun, Michael
Runck, Frank
Schmitz, Bernd
Tran, Thuy N.
Yamlahi, Amine
Maier-Hein, Lena
Franz, Alfred M.
author_facet Mittmann, Benjamin J.
Braun, Michael
Runck, Frank
Schmitz, Bernd
Tran, Thuy N.
Yamlahi, Amine
Maier-Hein, Lena
Franz, Alfred M.
author_sort Mittmann, Benjamin J.
collection PubMed
description PURPOSE: Recently, a large number of patients with acute ischemic stroke benefited from the use of thrombectomy, a minimally invasive intervention technique for mechanically removing thrombi from the cerebrovasculature. During thrombectomy, 2D digital subtraction angiography (DSA) image sequences are acquired simultaneously from the posterior-anterior and the lateral view to control whether thrombus removal was successful, and to possibly detect newly occluded areas caused by thrombus fragments split from the main thrombus. However, such new occlusions, which would be treatable by thrombectomy, may be overlooked during the intervention. To prevent this, we developed a deep learning-based approach to automatic classification of DSA sequences into thrombus-free and non-thrombus-free sequences. METHODS: We performed a retrospective study based on the single-center DSA data of thrombectomy patients. For classifying the DSA sequences, we applied Long Short-Term Memory or Gated Recurrent Unit networks and combined them with different Convolutional Neural Networks used as feature extractor. These network variants were trained on the DSA data by using five-fold cross-validation. The classification performance was determined on a test data set with respect to the Matthews correlation coefficient (MCC) and the area under the curve (AUC). Finally, we evaluated our models on patient cases, in which overlooking thrombi during thrombectomy had happened. RESULTS: Depending on the specific model configuration used, we obtained a performance of up to 0.77[Formula: see text] 0.94 for the MCC[Formula: see text] AUC, respectively. Additionally, overlooking thrombi could have been prevented in the reported patient cases, as our models would have classified the corresponding DSA sequences correctly. CONCLUSION: Our deep learning-based approach to thrombus identification in DSA sequences yielded high accuracy on our single-center test data set. External validation is now required to investigate the generalizability of our method. As demonstrated, using this new approach may help reduce the incident risk of overlooking thrombi during thrombectomy in the future. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s11548-022-02654-8.
format Online
Article
Text
id pubmed-9463240
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Springer International Publishing
record_format MEDLINE/PubMed
spelling pubmed-94632402022-09-11 Deep learning-based classification of DSA image sequences of patients with acute ischemic stroke Mittmann, Benjamin J. Braun, Michael Runck, Frank Schmitz, Bernd Tran, Thuy N. Yamlahi, Amine Maier-Hein, Lena Franz, Alfred M. Int J Comput Assist Radiol Surg Original Article PURPOSE: Recently, a large number of patients with acute ischemic stroke benefited from the use of thrombectomy, a minimally invasive intervention technique for mechanically removing thrombi from the cerebrovasculature. During thrombectomy, 2D digital subtraction angiography (DSA) image sequences are acquired simultaneously from the posterior-anterior and the lateral view to control whether thrombus removal was successful, and to possibly detect newly occluded areas caused by thrombus fragments split from the main thrombus. However, such new occlusions, which would be treatable by thrombectomy, may be overlooked during the intervention. To prevent this, we developed a deep learning-based approach to automatic classification of DSA sequences into thrombus-free and non-thrombus-free sequences. METHODS: We performed a retrospective study based on the single-center DSA data of thrombectomy patients. For classifying the DSA sequences, we applied Long Short-Term Memory or Gated Recurrent Unit networks and combined them with different Convolutional Neural Networks used as feature extractor. These network variants were trained on the DSA data by using five-fold cross-validation. The classification performance was determined on a test data set with respect to the Matthews correlation coefficient (MCC) and the area under the curve (AUC). Finally, we evaluated our models on patient cases, in which overlooking thrombi during thrombectomy had happened. RESULTS: Depending on the specific model configuration used, we obtained a performance of up to 0.77[Formula: see text] 0.94 for the MCC[Formula: see text] AUC, respectively. Additionally, overlooking thrombi could have been prevented in the reported patient cases, as our models would have classified the corresponding DSA sequences correctly. CONCLUSION: Our deep learning-based approach to thrombus identification in DSA sequences yielded high accuracy on our single-center test data set. External validation is now required to investigate the generalizability of our method. As demonstrated, using this new approach may help reduce the incident risk of overlooking thrombi during thrombectomy in the future. SUPPLEMENTARY INFORMATION: The online version contains supplementary material available at 10.1007/s11548-022-02654-8. Springer International Publishing 2022-05-23 2022 /pmc/articles/PMC9463240/ /pubmed/35604489 http://dx.doi.org/10.1007/s11548-022-02654-8 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Original Article
Mittmann, Benjamin J.
Braun, Michael
Runck, Frank
Schmitz, Bernd
Tran, Thuy N.
Yamlahi, Amine
Maier-Hein, Lena
Franz, Alfred M.
Deep learning-based classification of DSA image sequences of patients with acute ischemic stroke
title Deep learning-based classification of DSA image sequences of patients with acute ischemic stroke
title_full Deep learning-based classification of DSA image sequences of patients with acute ischemic stroke
title_fullStr Deep learning-based classification of DSA image sequences of patients with acute ischemic stroke
title_full_unstemmed Deep learning-based classification of DSA image sequences of patients with acute ischemic stroke
title_short Deep learning-based classification of DSA image sequences of patients with acute ischemic stroke
title_sort deep learning-based classification of dsa image sequences of patients with acute ischemic stroke
topic Original Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9463240/
https://www.ncbi.nlm.nih.gov/pubmed/35604489
http://dx.doi.org/10.1007/s11548-022-02654-8
work_keys_str_mv AT mittmannbenjaminj deeplearningbasedclassificationofdsaimagesequencesofpatientswithacuteischemicstroke
AT braunmichael deeplearningbasedclassificationofdsaimagesequencesofpatientswithacuteischemicstroke
AT runckfrank deeplearningbasedclassificationofdsaimagesequencesofpatientswithacuteischemicstroke
AT schmitzbernd deeplearningbasedclassificationofdsaimagesequencesofpatientswithacuteischemicstroke
AT tranthuyn deeplearningbasedclassificationofdsaimagesequencesofpatientswithacuteischemicstroke
AT yamlahiamine deeplearningbasedclassificationofdsaimagesequencesofpatientswithacuteischemicstroke
AT maierheinlena deeplearningbasedclassificationofdsaimagesequencesofpatientswithacuteischemicstroke
AT franzalfredm deeplearningbasedclassificationofdsaimagesequencesofpatientswithacuteischemicstroke