Cargando…
Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression
PURPOSE: To develop and test machine learning classifiers (MLCs) for determining visual field progression. METHODS: In total, 90,713 visual fields from 13,156 eyes were included. Six different progression algorithms (linear regression of mean deviation, linear regression of the visual field index, A...
Autores principales: | , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
The Association for Research in Vision and Ophthalmology
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8237084/ https://www.ncbi.nlm.nih.gov/pubmed/34157101 http://dx.doi.org/10.1167/tvst.10.7.27 |
_version_ | 1783714661055594496 |
---|---|
author | Saeedi, Osamah Boland, Michael V. D'Acunto, Loris Swamy, Ramya Hegde, Vikram Gupta, Surabhi Venjara, Amin Tsai, Joby Myers, Jonathan S. Wellik, Sarah R. DeMoraes, Gustavo Pasquale, Louis R. Shen, Lucy Q. Li, Yangjiani Elze, Tobias |
author_facet | Saeedi, Osamah Boland, Michael V. D'Acunto, Loris Swamy, Ramya Hegde, Vikram Gupta, Surabhi Venjara, Amin Tsai, Joby Myers, Jonathan S. Wellik, Sarah R. DeMoraes, Gustavo Pasquale, Louis R. Shen, Lucy Q. Li, Yangjiani Elze, Tobias |
author_sort | Saeedi, Osamah |
collection | PubMed |
description | PURPOSE: To develop and test machine learning classifiers (MLCs) for determining visual field progression. METHODS: In total, 90,713 visual fields from 13,156 eyes were included. Six different progression algorithms (linear regression of mean deviation, linear regression of the visual field index, Advanced Glaucoma Intervention Study algorithm, Collaborative Initial Glaucoma Treatment Study algorithm, pointwise linear regression [PLR], and permutation of PLR) were applied to classify each eye as progressing or stable. Six MLCs were applied (logistic regression, random forest, extreme gradient boosting, support vector classifier, convolutional neural network, fully connected neural network) using a training and testing set. For MLC input, visual fields for a given eye were divided into the first and second half and each location averaged over time within each half. Each algorithm was tested for accuracy, sensitivity, positive predictive value, and class bias with a subset of visual fields labeled by a panel of three experts from 161 eyes. RESULTS: MLCs had similar performance metrics as some of the conventional algorithms and ranged from 87% to 91% accurate with sensitivity ranging from 0.83 to 0.88 and specificity from 0.92 to 0.96. All conventional algorithms showed significant class bias, meaning each individual algorithm was more likely to grade uncertain cases as either progressing or stable (P ≤ 0.01). Conversely, all MLCs were balanced, meaning they were equally likely to grade uncertain cases as either progressing or stable (P ≥ 0.08). CONCLUSIONS: MLCs showed a moderate to high level of accuracy, sensitivity, and specificity and were more balanced than conventional algorithms. TRANSLATIONAL RELEVANCE: MLCs may help to determine visual field progression. |
format | Online Article Text |
id | pubmed-8237084 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | The Association for Research in Vision and Ophthalmology |
record_format | MEDLINE/PubMed |
spelling | pubmed-82370842021-07-03 Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression Saeedi, Osamah Boland, Michael V. D'Acunto, Loris Swamy, Ramya Hegde, Vikram Gupta, Surabhi Venjara, Amin Tsai, Joby Myers, Jonathan S. Wellik, Sarah R. DeMoraes, Gustavo Pasquale, Louis R. Shen, Lucy Q. Li, Yangjiani Elze, Tobias Transl Vis Sci Technol Article PURPOSE: To develop and test machine learning classifiers (MLCs) for determining visual field progression. METHODS: In total, 90,713 visual fields from 13,156 eyes were included. Six different progression algorithms (linear regression of mean deviation, linear regression of the visual field index, Advanced Glaucoma Intervention Study algorithm, Collaborative Initial Glaucoma Treatment Study algorithm, pointwise linear regression [PLR], and permutation of PLR) were applied to classify each eye as progressing or stable. Six MLCs were applied (logistic regression, random forest, extreme gradient boosting, support vector classifier, convolutional neural network, fully connected neural network) using a training and testing set. For MLC input, visual fields for a given eye were divided into the first and second half and each location averaged over time within each half. Each algorithm was tested for accuracy, sensitivity, positive predictive value, and class bias with a subset of visual fields labeled by a panel of three experts from 161 eyes. RESULTS: MLCs had similar performance metrics as some of the conventional algorithms and ranged from 87% to 91% accurate with sensitivity ranging from 0.83 to 0.88 and specificity from 0.92 to 0.96. All conventional algorithms showed significant class bias, meaning each individual algorithm was more likely to grade uncertain cases as either progressing or stable (P ≤ 0.01). Conversely, all MLCs were balanced, meaning they were equally likely to grade uncertain cases as either progressing or stable (P ≥ 0.08). CONCLUSIONS: MLCs showed a moderate to high level of accuracy, sensitivity, and specificity and were more balanced than conventional algorithms. TRANSLATIONAL RELEVANCE: MLCs may help to determine visual field progression. The Association for Research in Vision and Ophthalmology 2021-06-22 /pmc/articles/PMC8237084/ /pubmed/34157101 http://dx.doi.org/10.1167/tvst.10.7.27 Text en Copyright 2021 The Authors https://creativecommons.org/licenses/by-nc-nd/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License. |
spellingShingle | Article Saeedi, Osamah Boland, Michael V. D'Acunto, Loris Swamy, Ramya Hegde, Vikram Gupta, Surabhi Venjara, Amin Tsai, Joby Myers, Jonathan S. Wellik, Sarah R. DeMoraes, Gustavo Pasquale, Louis R. Shen, Lucy Q. Li, Yangjiani Elze, Tobias Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression |
title | Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression |
title_full | Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression |
title_fullStr | Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression |
title_full_unstemmed | Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression |
title_short | Development and Comparison of Machine Learning Algorithms to Determine Visual Field Progression |
title_sort | development and comparison of machine learning algorithms to determine visual field progression |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8237084/ https://www.ncbi.nlm.nih.gov/pubmed/34157101 http://dx.doi.org/10.1167/tvst.10.7.27 |
work_keys_str_mv | AT saeediosamah developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT bolandmichaelv developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT dacuntoloris developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT swamyramya developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT hegdevikram developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT guptasurabhi developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT venjaraamin developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT tsaijoby developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT myersjonathans developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT welliksarahr developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT demoraesgustavo developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT pasqualelouisr developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT shenlucyq developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT liyangjiani developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression AT elzetobias developmentandcomparisonofmachinelearningalgorithmstodeterminevisualfieldprogression |