Cargando…

Multiple instance learning based classification of diabetic retinopathy in weakly-labeled widefield OCTA en face images

Diabetic retinopathy (DR), a pathologic change of the human retinal vasculature, is the leading cause of blindness in working-age adults with diabetes mellitus. Optical coherence tomography angiography (OCTA), a functional extension of optical coherence tomography, has shown potential as a tool for...

Descripción completa

Detalles Bibliográficos
Autores principales: Matten, Philipp, Scherer, Julius, Schlegl, Thomas, Nienhaus, Jonas, Stino, Heiko, Niederleithner, Michael, Schmidt-Erfurth, Ursula M., Leitgeb, Rainer A., Drexler, Wolfgang, Pollreisz, Andreas, Schmoll, Tilman
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10226980/
https://www.ncbi.nlm.nih.gov/pubmed/37248309
http://dx.doi.org/10.1038/s41598-023-35713-4
_version_ 1785050671788064768
author Matten, Philipp
Scherer, Julius
Schlegl, Thomas
Nienhaus, Jonas
Stino, Heiko
Niederleithner, Michael
Schmidt-Erfurth, Ursula M.
Leitgeb, Rainer A.
Drexler, Wolfgang
Pollreisz, Andreas
Schmoll, Tilman
author_facet Matten, Philipp
Scherer, Julius
Schlegl, Thomas
Nienhaus, Jonas
Stino, Heiko
Niederleithner, Michael
Schmidt-Erfurth, Ursula M.
Leitgeb, Rainer A.
Drexler, Wolfgang
Pollreisz, Andreas
Schmoll, Tilman
author_sort Matten, Philipp
collection PubMed
description Diabetic retinopathy (DR), a pathologic change of the human retinal vasculature, is the leading cause of blindness in working-age adults with diabetes mellitus. Optical coherence tomography angiography (OCTA), a functional extension of optical coherence tomography, has shown potential as a tool for early diagnosis of DR through its ability to visualize the retinal vasculature in all spatial dimensions. Previously introduced deep learning-based classifiers were able to support the detection of DR in OCTA images, but require expert labeling at the pixel level, a labor-intensive and expensive process. We present a multiple instance learning-based network, MIL-ResNet,14 that is capable of detecting biomarkers in an OCTA dataset with high accuracy, without the need for annotations other than the information whether a scan is from a diabetic patient or not. The dataset we used for this study was acquired with a diagnostic ultra-widefield swept-source OCT device with a MHz A-scan rate. We were able to show that our proposed method outperforms previous state-of-the-art networks for this classification task, ResNet14 and VGG16. In addition, our network pays special attention to clinically relevant biomarkers and is robust against adversarial attacks. Therefore, we believe that it could serve as a powerful diagnostic decision support tool for clinical ophthalmic screening.
format Online
Article
Text
id pubmed-10226980
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-102269802023-05-31 Multiple instance learning based classification of diabetic retinopathy in weakly-labeled widefield OCTA en face images Matten, Philipp Scherer, Julius Schlegl, Thomas Nienhaus, Jonas Stino, Heiko Niederleithner, Michael Schmidt-Erfurth, Ursula M. Leitgeb, Rainer A. Drexler, Wolfgang Pollreisz, Andreas Schmoll, Tilman Sci Rep Article Diabetic retinopathy (DR), a pathologic change of the human retinal vasculature, is the leading cause of blindness in working-age adults with diabetes mellitus. Optical coherence tomography angiography (OCTA), a functional extension of optical coherence tomography, has shown potential as a tool for early diagnosis of DR through its ability to visualize the retinal vasculature in all spatial dimensions. Previously introduced deep learning-based classifiers were able to support the detection of DR in OCTA images, but require expert labeling at the pixel level, a labor-intensive and expensive process. We present a multiple instance learning-based network, MIL-ResNet,14 that is capable of detecting biomarkers in an OCTA dataset with high accuracy, without the need for annotations other than the information whether a scan is from a diabetic patient or not. The dataset we used for this study was acquired with a diagnostic ultra-widefield swept-source OCT device with a MHz A-scan rate. We were able to show that our proposed method outperforms previous state-of-the-art networks for this classification task, ResNet14 and VGG16. In addition, our network pays special attention to clinically relevant biomarkers and is robust against adversarial attacks. Therefore, we believe that it could serve as a powerful diagnostic decision support tool for clinical ophthalmic screening. Nature Publishing Group UK 2023-05-29 /pmc/articles/PMC10226980/ /pubmed/37248309 http://dx.doi.org/10.1038/s41598-023-35713-4 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Matten, Philipp
Scherer, Julius
Schlegl, Thomas
Nienhaus, Jonas
Stino, Heiko
Niederleithner, Michael
Schmidt-Erfurth, Ursula M.
Leitgeb, Rainer A.
Drexler, Wolfgang
Pollreisz, Andreas
Schmoll, Tilman
Multiple instance learning based classification of diabetic retinopathy in weakly-labeled widefield OCTA en face images
title Multiple instance learning based classification of diabetic retinopathy in weakly-labeled widefield OCTA en face images
title_full Multiple instance learning based classification of diabetic retinopathy in weakly-labeled widefield OCTA en face images
title_fullStr Multiple instance learning based classification of diabetic retinopathy in weakly-labeled widefield OCTA en face images
title_full_unstemmed Multiple instance learning based classification of diabetic retinopathy in weakly-labeled widefield OCTA en face images
title_short Multiple instance learning based classification of diabetic retinopathy in weakly-labeled widefield OCTA en face images
title_sort multiple instance learning based classification of diabetic retinopathy in weakly-labeled widefield octa en face images
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10226980/
https://www.ncbi.nlm.nih.gov/pubmed/37248309
http://dx.doi.org/10.1038/s41598-023-35713-4
work_keys_str_mv AT mattenphilipp multipleinstancelearningbasedclassificationofdiabeticretinopathyinweaklylabeledwidefieldoctaenfaceimages
AT schererjulius multipleinstancelearningbasedclassificationofdiabeticretinopathyinweaklylabeledwidefieldoctaenfaceimages
AT schleglthomas multipleinstancelearningbasedclassificationofdiabeticretinopathyinweaklylabeledwidefieldoctaenfaceimages
AT nienhausjonas multipleinstancelearningbasedclassificationofdiabeticretinopathyinweaklylabeledwidefieldoctaenfaceimages
AT stinoheiko multipleinstancelearningbasedclassificationofdiabeticretinopathyinweaklylabeledwidefieldoctaenfaceimages
AT niederleithnermichael multipleinstancelearningbasedclassificationofdiabeticretinopathyinweaklylabeledwidefieldoctaenfaceimages
AT schmidterfurthursulam multipleinstancelearningbasedclassificationofdiabeticretinopathyinweaklylabeledwidefieldoctaenfaceimages
AT leitgebrainera multipleinstancelearningbasedclassificationofdiabeticretinopathyinweaklylabeledwidefieldoctaenfaceimages
AT drexlerwolfgang multipleinstancelearningbasedclassificationofdiabeticretinopathyinweaklylabeledwidefieldoctaenfaceimages
AT pollreiszandreas multipleinstancelearningbasedclassificationofdiabeticretinopathyinweaklylabeledwidefieldoctaenfaceimages
AT schmolltilman multipleinstancelearningbasedclassificationofdiabeticretinopathyinweaklylabeledwidefieldoctaenfaceimages