Cargando…

Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks

Whenever a visual scene is cast onto the retina, much of it will appear degraded due to poor resolution in the periphery; moreover, optical defocus can cause blur in central vision. However, the pervasiveness of blurry or degraded input is typically overlooked in the training of convolutional neural...

Descripción completa

Detalles Bibliográficos
Autores principales: Jang, Hojin, Tong, Frank
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Cold Spring Harbor Laboratory 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10418076/
https://www.ncbi.nlm.nih.gov/pubmed/37577646
http://dx.doi.org/10.1101/2023.07.29.551089
_version_ 1785088190333321216
author Jang, Hojin
Tong, Frank
author_facet Jang, Hojin
Tong, Frank
author_sort Jang, Hojin
collection PubMed
description Whenever a visual scene is cast onto the retina, much of it will appear degraded due to poor resolution in the periphery; moreover, optical defocus can cause blur in central vision. However, the pervasiveness of blurry or degraded input is typically overlooked in the training of convolutional neural networks (CNNs). We hypothesized that the absence of blurry training inputs may cause CNNs to rely excessively on high spatial frequency information for object recognition, thereby causing systematic deviations from biological vision. We evaluated this hypothesis by comparing standard CNNs with CNNs trained on a combination of clear and blurry images. We show that blur-trained CNNs outperform standard CNNs at predicting neural responses to objects across a variety of viewing conditions. Moreover, blur-trained CNNs acquire increased sensitivity to shape information and greater robustness to multiple forms of visual noise, leading to improved correspondence with human perception. Our results provide novel neurocomputational evidence that blurry visual experiences are very important for conferring robustness to biological visual systems.
format Online
Article
Text
id pubmed-10418076
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Cold Spring Harbor Laboratory
record_format MEDLINE/PubMed
spelling pubmed-104180762023-08-12 Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks Jang, Hojin Tong, Frank bioRxiv Article Whenever a visual scene is cast onto the retina, much of it will appear degraded due to poor resolution in the periphery; moreover, optical defocus can cause blur in central vision. However, the pervasiveness of blurry or degraded input is typically overlooked in the training of convolutional neural networks (CNNs). We hypothesized that the absence of blurry training inputs may cause CNNs to rely excessively on high spatial frequency information for object recognition, thereby causing systematic deviations from biological vision. We evaluated this hypothesis by comparing standard CNNs with CNNs trained on a combination of clear and blurry images. We show that blur-trained CNNs outperform standard CNNs at predicting neural responses to objects across a variety of viewing conditions. Moreover, blur-trained CNNs acquire increased sensitivity to shape information and greater robustness to multiple forms of visual noise, leading to improved correspondence with human perception. Our results provide novel neurocomputational evidence that blurry visual experiences are very important for conferring robustness to biological visual systems. Cold Spring Harbor Laboratory 2023-07-31 /pmc/articles/PMC10418076/ /pubmed/37577646 http://dx.doi.org/10.1101/2023.07.29.551089 Text en https://creativecommons.org/licenses/by-nc-nd/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (https://creativecommons.org/licenses/by-nc-nd/4.0/) , which allows reusers to copy and distribute the material in any medium or format in unadapted form only, for noncommercial purposes only, and only so long as attribution is given to the creator.
spellingShingle Article
Jang, Hojin
Tong, Frank
Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks
title Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks
title_full Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks
title_fullStr Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks
title_full_unstemmed Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks
title_short Improved modeling of human vision by incorporating robustness to blur in convolutional neural networks
title_sort improved modeling of human vision by incorporating robustness to blur in convolutional neural networks
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10418076/
https://www.ncbi.nlm.nih.gov/pubmed/37577646
http://dx.doi.org/10.1101/2023.07.29.551089
work_keys_str_mv AT janghojin improvedmodelingofhumanvisionbyincorporatingrobustnesstoblurinconvolutionalneuralnetworks
AT tongfrank improvedmodelingofhumanvisionbyincorporatingrobustnesstoblurinconvolutionalneuralnetworks