Cargando…
Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks
Whenever a visual scene is cast onto the retina, much of it will appear degraded due to poor resolution in the periphery; moreover, optical defocus can cause blur in central vision. However, the pervasiveness of blurry or degraded input is typically overlooked in the training of convolutional neural...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Cold Spring Harbor Laboratory
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10418076/ https://www.ncbi.nlm.nih.gov/pubmed/37577646 http://dx.doi.org/10.1101/2023.07.29.551089 |
_version_ | 1785088190333321216 |
---|---|
author | Jang, Hojin Tong, Frank |
author_facet | Jang, Hojin Tong, Frank |
author_sort | Jang, Hojin |
collection | PubMed |
description | Whenever a visual scene is cast onto the retina, much of it will appear degraded due to poor resolution in the periphery; moreover, optical defocus can cause blur in central vision. However, the pervasiveness of blurry or degraded input is typically overlooked in the training of convolutional neural networks (CNNs). We hypothesized that the absence of blurry training inputs may cause CNNs to rely excessively on high spatial frequency information for object recognition, thereby causing systematic deviations from biological vision. We evaluated this hypothesis by comparing standard CNNs with CNNs trained on a combination of clear and blurry images. We show that blur-trained CNNs outperform standard CNNs at predicting neural responses to objects across a variety of viewing conditions. Moreover, blur-trained CNNs acquire increased sensitivity to shape information and greater robustness to multiple forms of visual noise, leading to improved correspondence with human perception. Our results provide novel neurocomputational evidence that blurry visual experiences are very important for conferring robustness to biological visual systems. |
format | Online Article Text |
id | pubmed-10418076 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Cold Spring Harbor Laboratory |
record_format | MEDLINE/PubMed |
spelling | pubmed-104180762023-08-12 Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks Jang, Hojin Tong, Frank bioRxiv Article Whenever a visual scene is cast onto the retina, much of it will appear degraded due to poor resolution in the periphery; moreover, optical defocus can cause blur in central vision. However, the pervasiveness of blurry or degraded input is typically overlooked in the training of convolutional neural networks (CNNs). We hypothesized that the absence of blurry training inputs may cause CNNs to rely excessively on high spatial frequency information for object recognition, thereby causing systematic deviations from biological vision. We evaluated this hypothesis by comparing standard CNNs with CNNs trained on a combination of clear and blurry images. We show that blur-trained CNNs outperform standard CNNs at predicting neural responses to objects across a variety of viewing conditions. Moreover, blur-trained CNNs acquire increased sensitivity to shape information and greater robustness to multiple forms of visual noise, leading to improved correspondence with human perception. Our results provide novel neurocomputational evidence that blurry visual experiences are very important for conferring robustness to biological visual systems. Cold Spring Harbor Laboratory 2023-07-31 /pmc/articles/PMC10418076/ /pubmed/37577646 http://dx.doi.org/10.1101/2023.07.29.551089 Text en https://creativecommons.org/licenses/by-nc-nd/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (https://creativecommons.org/licenses/by-nc-nd/4.0/) , which allows reusers to copy and distribute the material in any medium or format in unadapted form only, for noncommercial purposes only, and only so long as attribution is given to the creator. |
spellingShingle | Article Jang, Hojin Tong, Frank Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks |
title | Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks |
title_full | Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks |
title_fullStr | Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks |
title_full_unstemmed | Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks |
title_short | Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks |
title_sort | improved modeling of human vision by incorporating robustness to blur in convolutional neural networks |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10418076/ https://www.ncbi.nlm.nih.gov/pubmed/37577646 http://dx.doi.org/10.1101/2023.07.29.551089 |
work_keys_str_mv | AT janghojin improvedmodelingofhumanvisionbyincorporatingrobustnesstoblurinconvolutionalneuralnetworks AT tongfrank improvedmodelingofhumanvisionbyincorporatingrobustnesstoblurinconvolutionalneuralnetworks |