Cargando…

Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study

PURPOSE: To assess whether the predictive accuracy of machine learning algorithms using Kalman filtering for forecasting future values of global indices on perimetry can be enhanced by adding global retinal nerve fiber layer (RNFL) data and whether model performance is influenced by the racial compo...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhalechian, Mohammad, Van Oyen, Mark P., Lavieri, Mariel S., De Moraes, Carlos Gustavo, Girkin, Christopher A., Fazio, Massimo A., Weinreb, Robert N., Bowd, Christopher, Liebmann, Jeffrey M., Zangwill, Linda M., Andrews, Christopher A., Stein, Joshua D.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Elsevier 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9560647/
https://www.ncbi.nlm.nih.gov/pubmed/36246178
http://dx.doi.org/10.1016/j.xops.2021.100097
_version_ 1784807798229434368
author Zhalechian, Mohammad
Van Oyen, Mark P.
Lavieri, Mariel S.
De Moraes, Carlos Gustavo
Girkin, Christopher A.
Fazio, Massimo A.
Weinreb, Robert N.
Bowd, Christopher
Liebmann, Jeffrey M.
Zangwill, Linda M.
Andrews, Christopher A.
Stein, Joshua D.
author_facet Zhalechian, Mohammad
Van Oyen, Mark P.
Lavieri, Mariel S.
De Moraes, Carlos Gustavo
Girkin, Christopher A.
Fazio, Massimo A.
Weinreb, Robert N.
Bowd, Christopher
Liebmann, Jeffrey M.
Zangwill, Linda M.
Andrews, Christopher A.
Stein, Joshua D.
author_sort Zhalechian, Mohammad
collection PubMed
description PURPOSE: To assess whether the predictive accuracy of machine learning algorithms using Kalman filtering for forecasting future values of global indices on perimetry can be enhanced by adding global retinal nerve fiber layer (RNFL) data and whether model performance is influenced by the racial composition of the training and testing sets. DESIGN: Retrospective, longitudinal cohort study. PARTICIPANTS: Patients with open-angle glaucoma (OAG) or glaucoma suspects enrolled in the African Descent and Glaucoma Evaluation Study or Diagnostic Innovation in Glaucoma Study. METHODS: We developed a Kalman filter (KF) with tonometry and perimetry data (KF-TP) and another KF with tonometry, perimetry, and global RNFL data (KF-TPO), comparing these models with one another and with 2 linear regression (LR) models for predicting mean deviation (MD) and pattern standard deviation values 36 months into the future for patients with OAG and glaucoma suspects. We also compared KF model performance when trained on individuals of European and African descent and tested on patients of the same versus the other race. MAIN OUTCOME MEASURES: Predictive accuracy (percentage of MD values forecasted within the 95% repeatability interval) differences among the models. RESULTS: Among 362 eligible patients, the mean ± standard deviation age at baseline was 71.3 ± 10.4 years; 196 patients (54.1%) were women; 202 patients (55.8%) were of European descent, and 139 (38.4%) were of African descent. Among patients with OAG (n = 296), the predictive accuracy for 36 months in the future was higher for the KF models (73.5% for KF-TP, 71.2% for KF-TPO) than for the LR models (57.5%, 58.0%). Predictive accuracy did not differ significantly between KF-TP and KF-TPO (P = 0.20). If the races of the training and testing set patients were aligned (versus nonaligned), the mean absolute prediction error of future MD improved 0.39 dB for KF-TP and 0.48 dB for KF-TPO. CONCLUSIONS: Adding global RNFL data to existing KFs minimally improved their predictive accuracy. Although KFs attained better predictive accuracy when the races of the training and testing sets were aligned, these improvements were modest. These findings will help to guide implementation of KFs in clinical practice.
format Online
Article
Text
id pubmed-9560647
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Elsevier
record_format MEDLINE/PubMed
spelling pubmed-95606472022-10-14 Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study Zhalechian, Mohammad Van Oyen, Mark P. Lavieri, Mariel S. De Moraes, Carlos Gustavo Girkin, Christopher A. Fazio, Massimo A. Weinreb, Robert N. Bowd, Christopher Liebmann, Jeffrey M. Zangwill, Linda M. Andrews, Christopher A. Stein, Joshua D. Ophthalmol Sci Original Article PURPOSE: To assess whether the predictive accuracy of machine learning algorithms using Kalman filtering for forecasting future values of global indices on perimetry can be enhanced by adding global retinal nerve fiber layer (RNFL) data and whether model performance is influenced by the racial composition of the training and testing sets. DESIGN: Retrospective, longitudinal cohort study. PARTICIPANTS: Patients with open-angle glaucoma (OAG) or glaucoma suspects enrolled in the African Descent and Glaucoma Evaluation Study or Diagnostic Innovation in Glaucoma Study. METHODS: We developed a Kalman filter (KF) with tonometry and perimetry data (KF-TP) and another KF with tonometry, perimetry, and global RNFL data (KF-TPO), comparing these models with one another and with 2 linear regression (LR) models for predicting mean deviation (MD) and pattern standard deviation values 36 months into the future for patients with OAG and glaucoma suspects. We also compared KF model performance when trained on individuals of European and African descent and tested on patients of the same versus the other race. MAIN OUTCOME MEASURES: Predictive accuracy (percentage of MD values forecasted within the 95% repeatability interval) differences among the models. RESULTS: Among 362 eligible patients, the mean ± standard deviation age at baseline was 71.3 ± 10.4 years; 196 patients (54.1%) were women; 202 patients (55.8%) were of European descent, and 139 (38.4%) were of African descent. Among patients with OAG (n = 296), the predictive accuracy for 36 months in the future was higher for the KF models (73.5% for KF-TP, 71.2% for KF-TPO) than for the LR models (57.5%, 58.0%). Predictive accuracy did not differ significantly between KF-TP and KF-TPO (P = 0.20). If the races of the training and testing set patients were aligned (versus nonaligned), the mean absolute prediction error of future MD improved 0.39 dB for KF-TP and 0.48 dB for KF-TPO. CONCLUSIONS: Adding global RNFL data to existing KFs minimally improved their predictive accuracy. Although KFs attained better predictive accuracy when the races of the training and testing sets were aligned, these improvements were modest. These findings will help to guide implementation of KFs in clinical practice. Elsevier 2021-12-21 /pmc/articles/PMC9560647/ /pubmed/36246178 http://dx.doi.org/10.1016/j.xops.2021.100097 Text en © 2022 Published by Elsevier Inc. on behalf of the American Academy of Ophthalmology. https://creativecommons.org/licenses/by-nc-nd/4.0/This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/).
spellingShingle Original Article
Zhalechian, Mohammad
Van Oyen, Mark P.
Lavieri, Mariel S.
De Moraes, Carlos Gustavo
Girkin, Christopher A.
Fazio, Massimo A.
Weinreb, Robert N.
Bowd, Christopher
Liebmann, Jeffrey M.
Zangwill, Linda M.
Andrews, Christopher A.
Stein, Joshua D.
Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study
title Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study
title_full Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study
title_fullStr Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study
title_full_unstemmed Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study
title_short Augmenting Kalman Filter Machine Learning Models with Data from OCT to Predict Future Visual Field Loss: An Analysis Using Data from the African Descent and Glaucoma Evaluation Study and the Diagnostic Innovation in Glaucoma Study
title_sort augmenting kalman filter machine learning models with data from oct to predict future visual field loss: an analysis using data from the african descent and glaucoma evaluation study and the diagnostic innovation in glaucoma study
topic Original Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9560647/
https://www.ncbi.nlm.nih.gov/pubmed/36246178
http://dx.doi.org/10.1016/j.xops.2021.100097
work_keys_str_mv AT zhalechianmohammad augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy
AT vanoyenmarkp augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy
AT lavierimariels augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy
AT demoraescarlosgustavo augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy
AT girkinchristophera augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy
AT faziomassimoa augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy
AT weinrebrobertn augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy
AT bowdchristopher augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy
AT liebmannjeffreym augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy
AT zangwilllindam augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy
AT andrewschristophera augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy
AT steinjoshuad augmentingkalmanfiltermachinelearningmodelswithdatafromocttopredictfuturevisualfieldlossananalysisusingdatafromtheafricandescentandglaucomaevaluationstudyandthediagnosticinnovationinglaucomastudy