Cargando…

Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression

PURPOSE: To develop and test machine learning classifiers (MLCs) for determining visual field progression. METHODS: In total, 90,713 visual fields from 13,156 eyes were included. Six different progression algorithms (linear regression of mean deviation, linear regression of the visual field index, A...

Descripción completa

Detalles Bibliográficos
Autores principales: Saeedi, Osamah, Boland, Michael V., D'Acunto, Loris, Swamy, Ramya, Hegde, Vikram, Gupta, Surabhi, Venjara, Amin, Tsai, Joby, Myers, Jonathan S., Wellik, Sarah R., DeMoraes, Gustavo, Pasquale, Louis R., Shen, Lucy Q., Li, Yangjiani, Elze, Tobias
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Association for Research in Vision and Ophthalmology 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8237084/
https://www.ncbi.nlm.nih.gov/pubmed/34157101
http://dx.doi.org/10.1167/tvst.10.7.27
_version_ 1783714661055594496
author Saeedi, Osamah
Boland, Michael V.
D'Acunto, Loris
Swamy, Ramya
Hegde, Vikram
Gupta, Surabhi
Venjara, Amin
Tsai, Joby
Myers, Jonathan S.
Wellik, Sarah R.
DeMoraes, Gustavo
Pasquale, Louis R.
Shen, Lucy Q.
Li, Yangjiani
Elze, Tobias
author_facet Saeedi, Osamah
Boland, Michael V.
D'Acunto, Loris
Swamy, Ramya
Hegde, Vikram
Gupta, Surabhi
Venjara, Amin
Tsai, Joby
Myers, Jonathan S.
Wellik, Sarah R.
DeMoraes, Gustavo
Pasquale, Louis R.
Shen, Lucy Q.
Li, Yangjiani
Elze, Tobias
author_sort Saeedi, Osamah
collection PubMed
description PURPOSE: To develop and test machine learning classifiers (MLCs) for determining visual field progression. METHODS: In total, 90,713 visual fields from 13,156 eyes were included. Six different progression algorithms (linear regression of mean deviation, linear regression of the visual field index, Advanced Glaucoma Intervention Study algorithm, Collaborative Initial Glaucoma Treatment Study algorithm, pointwise linear regression [PLR], and permutation of PLR) were applied to classify each eye as progressing or stable. Six MLCs were applied (logistic regression, random forest, extreme gradient boosting, support vector classifier, convolutional neural network, fully connected neural network) using a training and testing set. For MLC input, visual fields for a given eye were divided into the first and second half and each location averaged over time within each half. Each algorithm was tested for accuracy, sensitivity, positive predictive value, and class bias with a subset of visual fields labeled by a panel of three experts from 161 eyes. RESULTS: MLCs had similar performance metrics as some of the conventional algorithms and ranged from 87% to 91% accurate with sensitivity ranging from 0.83 to 0.88 and specificity from 0.92 to 0.96. All conventional algorithms showed significant class bias, meaning each individual algorithm was more likely to grade uncertain cases as either progressing or stable (P ≤ 0.01). Conversely, all MLCs were balanced, meaning they were equally likely to grade uncertain cases as either progressing or stable (P ≥ 0.08). CONCLUSIONS: MLCs showed a moderate to high level of accuracy, sensitivity, and specificity and were more balanced than conventional algorithms. TRANSLATIONAL RELEVANCE: MLCs may help to determine visual field progression.
format Online
Article
Text
id pubmed-8237084
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher The Association for Research in Vision and Ophthalmology
record_format MEDLINE/PubMed
spelling pubmed-82370842021-07-03 Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression Saeedi, Osamah Boland, Michael V. D'Acunto, Loris Swamy, Ramya Hegde, Vikram Gupta, Surabhi Venjara, Amin Tsai, Joby Myers, Jonathan S. Wellik, Sarah R. DeMoraes, Gustavo Pasquale, Louis R. Shen, Lucy Q. Li, Yangjiani Elze, Tobias Transl Vis Sci Technol Article PURPOSE: To develop and test machine learning classifiers (MLCs) for determining visual field progression. METHODS: In total, 90,713 visual fields from 13,156 eyes were included. Six different progression algorithms (linear regression of mean deviation, linear regression of the visual field index, Advanced Glaucoma Intervention Study algorithm, Collaborative Initial Glaucoma Treatment Study algorithm, pointwise linear regression [PLR], and permutation of PLR) were applied to classify each eye as progressing or stable. Six MLCs were applied (logistic regression, random forest, extreme gradient boosting, support vector classifier, convolutional neural network, fully connected neural network) using a training and testing set. For MLC input, visual fields for a given eye were divided into the first and second half and each location averaged over time within each half. Each algorithm was tested for accuracy, sensitivity, positive predictive value, and class bias with a subset of visual fields labeled by a panel of three experts from 161 eyes. RESULTS: MLCs had similar performance metrics as some of the conventional algorithms and ranged from 87% to 91% accurate with sensitivity ranging from 0.83 to 0.88 and specificity from 0.92 to 0.96. All conventional algorithms showed significant class bias, meaning each individual algorithm was more likely to grade uncertain cases as either progressing or stable (P ≤ 0.01). Conversely, all MLCs were balanced, meaning they were equally likely to grade uncertain cases as either progressing or stable (P ≥ 0.08). CONCLUSIONS: MLCs showed a moderate to high level of accuracy, sensitivity, and specificity and were more balanced than conventional algorithms. TRANSLATIONAL RELEVANCE: MLCs may help to determine visual field progression. The Association for Research in Vision and Ophthalmology 2021-06-22 /pmc/articles/PMC8237084/ /pubmed/34157101 http://dx.doi.org/10.1167/tvst.10.7.27 Text en Copyright 2021 The Authors https://creativecommons.org/licenses/by-nc-nd/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
spellingShingle Article
Saeedi, Osamah
Boland, Michael V.
D'Acunto, Loris
Swamy, Ramya
Hegde, Vikram
Gupta, Surabhi
Venjara, Amin
Tsai, Joby
Myers, Jonathan S.
Wellik, Sarah R.
DeMoraes, Gustavo
Pasquale, Louis R.
Shen, Lucy Q.
Li, Yangjiani
Elze, Tobias
Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression
title Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression
title_full Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression
title_fullStr Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression
title_full_unstemmed Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression
title_short Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression
title_sort development and comparison of machine learning algorithms to determine visual field progression
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8237084/
https://www.ncbi.nlm.nih.gov/pubmed/34157101
http://dx.doi.org/10.1167/tvst.10.7.27
work_keys_str_mv AT saeediosamah developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT bolandmichaelv developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT dacuntoloris developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT swamyramya developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT hegdevikram developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT guptasurabhi developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT venjaraamin developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT tsaijoby developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT myersjonathans developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT welliksarahr developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT demoraesgustavo developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT pasqualelouisr developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT shenlucyq developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT liyangjiani developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression
AT elzetobias developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression