Cargando…
Artificial Intelligence Software for Diabetic Eye Screening: Diagnostic Performance and Impact of Stratification
Aim: To evaluate the MONA.health artificial intelligence screening software for detecting referable diabetic retinopathy (DR) and diabetic macular edema (DME), including subgroup analysis. Methods: The algorithm’s threshold value was fixed at the 90% sensitivity operating point on the receiver opera...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9967595/ https://www.ncbi.nlm.nih.gov/pubmed/36835942 http://dx.doi.org/10.3390/jcm12041408 |
_version_ | 1784897304031920128 |
---|---|
author | Peeters, Freya Rommes, Stef Elen, Bart Gerrits, Nele Stalmans, Ingeborg Jacob, Julie De Boever, Patrick |
author_facet | Peeters, Freya Rommes, Stef Elen, Bart Gerrits, Nele Stalmans, Ingeborg Jacob, Julie De Boever, Patrick |
author_sort | Peeters, Freya |
collection | PubMed |
description | Aim: To evaluate the MONA.health artificial intelligence screening software for detecting referable diabetic retinopathy (DR) and diabetic macular edema (DME), including subgroup analysis. Methods: The algorithm’s threshold value was fixed at the 90% sensitivity operating point on the receiver operating curve to perform the disease classification. Diagnostic performance was appraised on a private test set and publicly available datasets. Stratification analysis was executed on the private test set considering age, ethnicity, sex, insulin dependency, year of examination, camera type, image quality, and dilatation status. Results: The software displayed an area under the curve (AUC) of 97.28% for DR and 98.08% for DME on the private test set. The specificity and sensitivity for combined DR and DME predictions were 94.24 and 90.91%, respectively. The AUC ranged from 96.91 to 97.99% on the publicly available datasets for DR. AUC values were above 95% in all subgroups, with lower predictive values found for individuals above the age of 65 (82.51% sensitivity) and Caucasians (84.03% sensitivity). Conclusion: We report good overall performance of the MONA.health screening software for DR and DME. The software performance remains stable with no significant deterioration of the deep learning models in any studied strata. |
format | Online Article Text |
id | pubmed-9967595 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-99675952023-02-27 Artificial Intelligence Software for Diabetic Eye Screening: Diagnostic Performance and Impact of Stratification Peeters, Freya Rommes, Stef Elen, Bart Gerrits, Nele Stalmans, Ingeborg Jacob, Julie De Boever, Patrick J Clin Med Article Aim: To evaluate the MONA.health artificial intelligence screening software for detecting referable diabetic retinopathy (DR) and diabetic macular edema (DME), including subgroup analysis. Methods: The algorithm’s threshold value was fixed at the 90% sensitivity operating point on the receiver operating curve to perform the disease classification. Diagnostic performance was appraised on a private test set and publicly available datasets. Stratification analysis was executed on the private test set considering age, ethnicity, sex, insulin dependency, year of examination, camera type, image quality, and dilatation status. Results: The software displayed an area under the curve (AUC) of 97.28% for DR and 98.08% for DME on the private test set. The specificity and sensitivity for combined DR and DME predictions were 94.24 and 90.91%, respectively. The AUC ranged from 96.91 to 97.99% on the publicly available datasets for DR. AUC values were above 95% in all subgroups, with lower predictive values found for individuals above the age of 65 (82.51% sensitivity) and Caucasians (84.03% sensitivity). Conclusion: We report good overall performance of the MONA.health screening software for DR and DME. The software performance remains stable with no significant deterioration of the deep learning models in any studied strata. MDPI 2023-02-10 /pmc/articles/PMC9967595/ /pubmed/36835942 http://dx.doi.org/10.3390/jcm12041408 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Peeters, Freya Rommes, Stef Elen, Bart Gerrits, Nele Stalmans, Ingeborg Jacob, Julie De Boever, Patrick Artificial Intelligence Software for Diabetic Eye Screening: Diagnostic Performance and Impact of Stratification |
title | Artificial Intelligence Software for Diabetic Eye Screening: Diagnostic Performance and Impact of Stratification |
title_full | Artificial Intelligence Software for Diabetic Eye Screening: Diagnostic Performance and Impact of Stratification |
title_fullStr | Artificial Intelligence Software for Diabetic Eye Screening: Diagnostic Performance and Impact of Stratification |
title_full_unstemmed | Artificial Intelligence Software for Diabetic Eye Screening: Diagnostic Performance and Impact of Stratification |
title_short | Artificial Intelligence Software for Diabetic Eye Screening: Diagnostic Performance and Impact of Stratification |
title_sort | artificial intelligence software for diabetic eye screening: diagnostic performance and impact of stratification |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9967595/ https://www.ncbi.nlm.nih.gov/pubmed/36835942 http://dx.doi.org/10.3390/jcm12041408 |
work_keys_str_mv | AT peetersfreya artificialintelligencesoftwarefordiabeticeyescreeningdiagnosticperformanceandimpactofstratification AT rommesstef artificialintelligencesoftwarefordiabeticeyescreeningdiagnosticperformanceandimpactofstratification AT elenbart artificialintelligencesoftwarefordiabeticeyescreeningdiagnosticperformanceandimpactofstratification AT gerritsnele artificialintelligencesoftwarefordiabeticeyescreeningdiagnosticperformanceandimpactofstratification AT stalmansingeborg artificialintelligencesoftwarefordiabeticeyescreeningdiagnosticperformanceandimpactofstratification AT jacobjulie artificialintelligencesoftwarefordiabeticeyescreeningdiagnosticperformanceandimpactofstratification AT deboeverpatrick artificialintelligencesoftwarefordiabeticeyescreeningdiagnosticperformanceandimpactofstratification |