Cargando…
Machine Learning to Predict Faricimab Treatment Outcome in Neovascular Age-Related Macular Degeneration
PURPOSE: To develop machine learning (ML) models to predict, at baseline, treatment outcomes at month 9 in patients with neovascular age-related macular degeneration (nAMD) receiving faricimab. DESIGN: Retrospective proof of concept study. PARTICIPANTS: Patients enrolled in the phase II AVENUE trial...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Elsevier
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10585644/ https://www.ncbi.nlm.nih.gov/pubmed/37868796 http://dx.doi.org/10.1016/j.xops.2023.100385 |
_version_ | 1785122997030354944 |
---|---|
author | Kikuchi, Yusuke Kawczynski, Michael G. Anegondi, Neha Neubert, Ales Dai, Jian Ferrara, Daniela Quezada-Ruiz, Carlos |
author_facet | Kikuchi, Yusuke Kawczynski, Michael G. Anegondi, Neha Neubert, Ales Dai, Jian Ferrara, Daniela Quezada-Ruiz, Carlos |
author_sort | Kikuchi, Yusuke |
collection | PubMed |
description | PURPOSE: To develop machine learning (ML) models to predict, at baseline, treatment outcomes at month 9 in patients with neovascular age-related macular degeneration (nAMD) receiving faricimab. DESIGN: Retrospective proof of concept study. PARTICIPANTS: Patients enrolled in the phase II AVENUE trial (NCT02484690) of faricimab in nAMD. METHODS: Baseline characteristics and spectral domain-OCT (SD-OCT) image data from 185 faricimab-treated eyes were split into 80% training and 20% test sets at the patient level. Input variables were baseline age, sex, best-corrected visual acuity (BCVA), central subfield thickness (CST), low luminance deficit, treatment arm, and SD-OCT images. A regression problem (BCVA) and a binary classification problem (reduction of CST by 35%) were considered. Overall, 10 models were developed and tested for each problem. Benchmark classical ML models (linear, random forest, extreme gradient boosting) were trained on baseline characteristics; benchmark deep neural networks (DNNs) were trained on baseline SD-OCT B-scans. Baseline characteristics and SD-OCT data were merged using 2 approaches: model stacking (using DNN prediction as an input feature for classical ML models) and model averaging (which averaged predictions from the DNN using SD-OCT volume and from classical ML models using baseline characteristics). MAIN OUTCOME MEASURES: Treatment outcomes were defined by 2 target variables: functional (BCVA letter score) and anatomical (percent decrease in CST from baseline) outcomes at month 9. RESULTS: The best-performing BCVA regression model with respect to the test coefficient of determination (R(2)) was the linear model in the model-stacking approach with R(2) of 0.31. The best-performing CST classification model with respect to test area under receiver operating characteristics (AUROC) was the benchmark linear model with AUROC of 0.87. A post hoc analysis showed the baseline BCVA and the baseline CST had the most effect in the all-model prediction for BCVA regression and CST classification, respectively. CONCLUSIONS: Promising signals for predicting treatment outcomes from baseline characteristics were detected; however, the predictive benefit of baseline images was unclear in this proof-of-concept study. Further testing and validation with larger, independent datasets is required to fully explore the predictive capacity of ML models using baseline imaging data. FINANCIAL DISCLOSURE(S): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article. |
format | Online Article Text |
id | pubmed-10585644 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Elsevier |
record_format | MEDLINE/PubMed |
spelling | pubmed-105856442023-10-20 Machine Learning to Predict Faricimab Treatment Outcome in Neovascular Age-Related Macular Degeneration Kikuchi, Yusuke Kawczynski, Michael G. Anegondi, Neha Neubert, Ales Dai, Jian Ferrara, Daniela Quezada-Ruiz, Carlos Ophthalmol Sci Original Article PURPOSE: To develop machine learning (ML) models to predict, at baseline, treatment outcomes at month 9 in patients with neovascular age-related macular degeneration (nAMD) receiving faricimab. DESIGN: Retrospective proof of concept study. PARTICIPANTS: Patients enrolled in the phase II AVENUE trial (NCT02484690) of faricimab in nAMD. METHODS: Baseline characteristics and spectral domain-OCT (SD-OCT) image data from 185 faricimab-treated eyes were split into 80% training and 20% test sets at the patient level. Input variables were baseline age, sex, best-corrected visual acuity (BCVA), central subfield thickness (CST), low luminance deficit, treatment arm, and SD-OCT images. A regression problem (BCVA) and a binary classification problem (reduction of CST by 35%) were considered. Overall, 10 models were developed and tested for each problem. Benchmark classical ML models (linear, random forest, extreme gradient boosting) were trained on baseline characteristics; benchmark deep neural networks (DNNs) were trained on baseline SD-OCT B-scans. Baseline characteristics and SD-OCT data were merged using 2 approaches: model stacking (using DNN prediction as an input feature for classical ML models) and model averaging (which averaged predictions from the DNN using SD-OCT volume and from classical ML models using baseline characteristics). MAIN OUTCOME MEASURES: Treatment outcomes were defined by 2 target variables: functional (BCVA letter score) and anatomical (percent decrease in CST from baseline) outcomes at month 9. RESULTS: The best-performing BCVA regression model with respect to the test coefficient of determination (R(2)) was the linear model in the model-stacking approach with R(2) of 0.31. The best-performing CST classification model with respect to test area under receiver operating characteristics (AUROC) was the benchmark linear model with AUROC of 0.87. A post hoc analysis showed the baseline BCVA and the baseline CST had the most effect in the all-model prediction for BCVA regression and CST classification, respectively. CONCLUSIONS: Promising signals for predicting treatment outcomes from baseline characteristics were detected; however, the predictive benefit of baseline images was unclear in this proof-of-concept study. Further testing and validation with larger, independent datasets is required to fully explore the predictive capacity of ML models using baseline imaging data. FINANCIAL DISCLOSURE(S): Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article. Elsevier 2023-08-18 /pmc/articles/PMC10585644/ /pubmed/37868796 http://dx.doi.org/10.1016/j.xops.2023.100385 Text en © 2023 by the American Academy of Ophthalmology. https://creativecommons.org/licenses/by/4.0/This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Original Article Kikuchi, Yusuke Kawczynski, Michael G. Anegondi, Neha Neubert, Ales Dai, Jian Ferrara, Daniela Quezada-Ruiz, Carlos Machine Learning to Predict Faricimab Treatment Outcome in Neovascular Age-Related Macular Degeneration |
title | Machine Learning to Predict Faricimab Treatment Outcome in Neovascular Age-Related Macular Degeneration |
title_full | Machine Learning to Predict Faricimab Treatment Outcome in Neovascular Age-Related Macular Degeneration |
title_fullStr | Machine Learning to Predict Faricimab Treatment Outcome in Neovascular Age-Related Macular Degeneration |
title_full_unstemmed | Machine Learning to Predict Faricimab Treatment Outcome in Neovascular Age-Related Macular Degeneration |
title_short | Machine Learning to Predict Faricimab Treatment Outcome in Neovascular Age-Related Macular Degeneration |
title_sort | machine learning to predict faricimab treatment outcome in neovascular age-related macular degeneration |
topic | Original Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10585644/ https://www.ncbi.nlm.nih.gov/pubmed/37868796 http://dx.doi.org/10.1016/j.xops.2023.100385 |
work_keys_str_mv | AT kikuchiyusuke machinelearningtopredictfaricimabtreatmentoutcomeinneovascularagerelatedmaculardegeneration AT kawczynskimichaelg machinelearningtopredictfaricimabtreatmentoutcomeinneovascularagerelatedmaculardegeneration AT anegondineha machinelearningtopredictfaricimabtreatmentoutcomeinneovascularagerelatedmaculardegeneration AT neubertales machinelearningtopredictfaricimabtreatmentoutcomeinneovascularagerelatedmaculardegeneration AT daijian machinelearningtopredictfaricimabtreatmentoutcomeinneovascularagerelatedmaculardegeneration AT ferraradaniela machinelearningtopredictfaricimabtreatmentoutcomeinneovascularagerelatedmaculardegeneration AT quezadaruizcarlos machinelearningtopredictfaricimabtreatmentoutcomeinneovascularagerelatedmaculardegeneration |