Cargando…

Convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing

Although convolutional neural networks (CNNs) provide a promising model for understanding human vision, most CNNs lack robustness to challenging viewing conditions, such as image blur, whereas human vision is much more reliable. Might robustness to blur be attributable to vision during infancy, give...

Descripción completa

Detalles Bibliográficos
Autores principales: Jang, Hojin, Tong, Frank
Formato: Online Artículo Texto
Lenguaje:English
Publicado: The Association for Research in Vision and Ophthalmology 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8590164/
https://www.ncbi.nlm.nih.gov/pubmed/34767621
http://dx.doi.org/10.1167/jov.21.12.6
_version_ 1784598896496869376
author Jang, Hojin
Tong, Frank
author_facet Jang, Hojin
Tong, Frank
author_sort Jang, Hojin
collection PubMed
description Although convolutional neural networks (CNNs) provide a promising model for understanding human vision, most CNNs lack robustness to challenging viewing conditions, such as image blur, whereas human vision is much more reliable. Might robustness to blur be attributable to vision during infancy, given that acuity is initially poor but improves considerably over the first several months of life? Here, we evaluated the potential consequences of such early experiences by training CNN models on face and object recognition tasks while gradually reducing the amount of blur applied to the training images. For CNNs trained on blurry to clear faces, we observed sustained robustness to blur, consistent with a recent report by Vogelsang and colleagues (2018). By contrast, CNNs trained with blurry to clear objects failed to retain robustness to blur. Further analyses revealed that the spatial frequency tuning of the two CNNs was profoundly different. The blurry to clear face-trained network successfully retained a preference for low spatial frequencies, whereas the blurry to clear object-trained CNN exhibited a progressive shift toward higher spatial frequencies. Our findings provide novel computational evidence showing how face recognition, unlike object recognition, allows for more holistic processing. Moreover, our results suggest that blurry vision during infancy is insufficient to account for the robustness of adult vision to blurry objects.
format Online
Article
Text
id pubmed-8590164
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher The Association for Research in Vision and Ophthalmology
record_format MEDLINE/PubMed
spelling pubmed-85901642021-11-23 Convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing Jang, Hojin Tong, Frank J Vis Article Although convolutional neural networks (CNNs) provide a promising model for understanding human vision, most CNNs lack robustness to challenging viewing conditions, such as image blur, whereas human vision is much more reliable. Might robustness to blur be attributable to vision during infancy, given that acuity is initially poor but improves considerably over the first several months of life? Here, we evaluated the potential consequences of such early experiences by training CNN models on face and object recognition tasks while gradually reducing the amount of blur applied to the training images. For CNNs trained on blurry to clear faces, we observed sustained robustness to blur, consistent with a recent report by Vogelsang and colleagues (2018). By contrast, CNNs trained with blurry to clear objects failed to retain robustness to blur. Further analyses revealed that the spatial frequency tuning of the two CNNs was profoundly different. The blurry to clear face-trained network successfully retained a preference for low spatial frequencies, whereas the blurry to clear object-trained CNN exhibited a progressive shift toward higher spatial frequencies. Our findings provide novel computational evidence showing how face recognition, unlike object recognition, allows for more holistic processing. Moreover, our results suggest that blurry vision during infancy is insufficient to account for the robustness of adult vision to blurry objects. The Association for Research in Vision and Ophthalmology 2021-11-12 /pmc/articles/PMC8590164/ /pubmed/34767621 http://dx.doi.org/10.1167/jov.21.12.6 Text en Copyright 2021 The Authors https://creativecommons.org/licenses/by-nc-nd/4.0/This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
spellingShingle Article
Jang, Hojin
Tong, Frank
Convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing
title Convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing
title_full Convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing
title_fullStr Convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing
title_full_unstemmed Convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing
title_short Convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing
title_sort convolutional neural networks trained with a developmental sequence of blurry to clear images reveal core differences between face and object processing
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8590164/
https://www.ncbi.nlm.nih.gov/pubmed/34767621
http://dx.doi.org/10.1167/jov.21.12.6
work_keys_str_mv AT janghojin convolutionalneuralnetworkstrainedwithadevelopmentalsequenceofblurrytoclearimagesrevealcoredifferencesbetweenfaceandobjectprocessing
AT tongfrank convolutionalneuralnetworkstrainedwithadevelopmentalsequenceofblurrytoclearimagesrevealcoredifferencesbetweenfaceandobjectprocessing