Cargando…
Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study
PURPOSE: To assess whether the predictive accuracy of machine learning algorithms using Kalman filtering for forecasting future values of global indices on perimetry can be enhanced by adding global retinal nerve fiber layer (RNFL) data and whether model performance is influenced by the racial compo...
Autores principales: | , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Elsevier
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9560647/ https://www.ncbi.nlm.nih.gov/pubmed/36246178 http://dx.doi.org/10.1016/j.xops.2021.100097 |
_version_ | 1784807798229434368 |
---|---|
author | Zhalechian, Mohammad Van Oyen, Mark P. Lavieri, Mariel S. De Moraes, Carlos Gustavo Girkin, Christopher A. Fazio, Massimo A. Weinreb, Robert N. Bowd, Christopher Liebmann, Jeffrey M. Zangwill, Linda M. Andrews, Christopher A. Stein, Joshua D. |
author_facet | Zhalechian, Mohammad Van Oyen, Mark P. Lavieri, Mariel S. De Moraes, Carlos Gustavo Girkin, Christopher A. Fazio, Massimo A. Weinreb, Robert N. Bowd, Christopher Liebmann, Jeffrey M. Zangwill, Linda M. Andrews, Christopher A. Stein, Joshua D. |
author_sort | Zhalechian, Mohammad |
collection | PubMed |
description | PURPOSE: To assess whether the predictive accuracy of machine learning algorithms using Kalman filtering for forecasting future values of global indices on perimetry can be enhanced by adding global retinal nerve fiber layer (RNFL) data and whether model performance is influenced by the racial composition of the training and testing sets. DESIGN: Retrospective, longitudinal cohort study. PARTICIPANTS: Patients with open-angle glaucoma (OAG) or glaucoma suspects enrolled in the African Descent and Glaucoma Evaluation Study or Diagnostic Innovation in Glaucoma Study. METHODS: We developed a Kalman filter (KF) with tonometry and perimetry data (KF-TP) and another KF with tonometry, perimetry, and global RNFL data (KF-TPO), comparing these models with one another and with 2 linear regression (LR) models for predicting mean deviation (MD) and pattern standard deviation values 36 months into the future for patients with OAG and glaucoma suspects. We also compared KF model performance when trained on individuals of European and African descent and tested on patients of the same versus the other race. MAIN OUTCOME MEASURES: Predictive accuracy (percentage of MD values forecasted within the 95% repeatability interval) differences among the models. RESULTS: Among 362 eligible patients, the mean ± standard deviation age at baseline was 71.3 ± 10.4 years; 196 patients (54.1%) were women; 202 patients (55.8%) were of European descent, and 139 (38.4%) were of African descent. Among patients with OAG (n = 296), the predictive accuracy for 36 months in the future was higher for the KF models (73.5% for KF-TP, 71.2% for KF-TPO) than for the LR models (57.5%, 58.0%). Predictive accuracy did not differ significantly between KF-TP and KF-TPO (P = 0.20). If the races of the training and testing set patients were aligned (versus nonaligned), the mean absolute prediction error of future MD improved 0.39 dB for KF-TP and 0.48 dB for KF-TPO. CONCLUSIONS: Adding global RNFL data to existing KFs minimally improved their predictive accuracy. Although KFs attained better predictive accuracy when the races of the training and testing sets were aligned, these improvements were modest. These findings will help to guide implementation of KFs in clinical practice. |
format | Online Article Text |
id | pubmed-9560647 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Elsevier |
record_format | MEDLINE/PubMed |
spelling | pubmed-95606472022-10-14 Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study Zhalechian, Mohammad Van Oyen, Mark P. Lavieri, Mariel S. De Moraes, Carlos Gustavo Girkin, Christopher A. Fazio, Massimo A. Weinreb, Robert N. Bowd, Christopher Liebmann, Jeffrey M. Zangwill, Linda M. Andrews, Christopher A. Stein, Joshua D. Ophthalmol Sci Original Article PURPOSE: To assess whether the predictive accuracy of machine learning algorithms using Kalman filtering for forecasting future values of global indices on perimetry can be enhanced by adding global retinal nerve fiber layer (RNFL) data and whether model performance is influenced by the racial composition of the training and testing sets. DESIGN: Retrospective, longitudinal cohort study. PARTICIPANTS: Patients with open-angle glaucoma (OAG) or glaucoma suspects enrolled in the African Descent and Glaucoma Evaluation Study or Diagnostic Innovation in Glaucoma Study. METHODS: We developed a Kalman filter (KF) with tonometry and perimetry data (KF-TP) and another KF with tonometry, perimetry, and global RNFL data (KF-TPO), comparing these models with one another and with 2 linear regression (LR) models for predicting mean deviation (MD) and pattern standard deviation values 36 months into the future for patients with OAG and glaucoma suspects. We also compared KF model performance when trained on individuals of European and African descent and tested on patients of the same versus the other race. MAIN OUTCOME MEASURES: Predictive accuracy (percentage of MD values forecasted within the 95% repeatability interval) differences among the models. RESULTS: Among 362 eligible patients, the mean ± standard deviation age at baseline was 71.3 ± 10.4 years; 196 patients (54.1%) were women; 202 patients (55.8%) were of European descent, and 139 (38.4%) were of African descent. Among patients with OAG (n = 296), the predictive accuracy for 36 months in the future was higher for the KF models (73.5% for KF-TP, 71.2% for KF-TPO) than for the LR models (57.5%, 58.0%). Predictive accuracy did not differ significantly between KF-TP and KF-TPO (P = 0.20). If the races of the training and testing set patients were aligned (versus nonaligned), the mean absolute prediction error of future MD improved 0.39 dB for KF-TP and 0.48 dB for KF-TPO. CONCLUSIONS: Adding global RNFL data to existing KFs minimally improved their predictive accuracy. Although KFs attained better predictive accuracy when the races of the training and testing sets were aligned, these improvements were modest. These findings will help to guide implementation of KFs in clinical practice. Elsevier 2021-12-21 /pmc/articles/PMC9560647/ /pubmed/36246178 http://dx.doi.org/10.1016/j.xops.2021.100097 Text en © 2022 Published by Elsevier Inc. on behalf of the American Academy of Ophthalmology. https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). |
spellingShingle | Original Article Zhalechian, Mohammad Van Oyen, Mark P. Lavieri, Mariel S. De Moraes, Carlos Gustavo Girkin, Christopher A. Fazio, Massimo A. Weinreb, Robert N. Bowd, Christopher Liebmann, Jeffrey M. Zangwill, Linda M. Andrews, Christopher A. Stein, Joshua D. Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study |
title | Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study |
title_full | Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study |
title_fullStr | Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study |
title_full_unstemmed | Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study |
title_short | Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study |
title_sort | augmenting kalman filter machine learning models with data from oct to predict future visual field loss: an analysis using data from the african descent and glaucoma evaluation study and the diagnostic innovation in glaucoma study |
topic | Original Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9560647/ https://www.ncbi.nlm.nih.gov/pubmed/36246178 http://dx.doi.org/10.1016/j.xops.2021.100097 |
work_keys_str_mv | AT zhalechianmohammad augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy AT vanoyenmarkp augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy AT lavierimariels augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy AT demoraescarlosgustavo augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy AT girkinchristophera augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy AT faziomassimoa augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy AT weinrebrobertn augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy AT bowdchristopher augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy AT liebmannjeffreym augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy AT zangwilllindam augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy AT andrewschristophera augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy AT steinjoshuad augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy |