Cargando…
Emergence of Visual Center-Periphery Spatial Organization in Deep Convolutional Neural Networks
Research at the intersection of computer vision and neuroscience has revealed hierarchical correspondence between layers of deep convolutional neural networks (DCNNs) and cascade of regions along human ventral visual cortex. Recently, studies have uncovered emergence of human interpretable concepts...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7070097/ https://www.ncbi.nlm.nih.gov/pubmed/32170209 http://dx.doi.org/10.1038/s41598-020-61409-0 |
_version_ | 1783505907915685888 |
---|---|
author | Mohsenzadeh, Yalda Mullin, Caitlin Lahner, Benjamin Oliva, Aude |
author_facet | Mohsenzadeh, Yalda Mullin, Caitlin Lahner, Benjamin Oliva, Aude |
author_sort | Mohsenzadeh, Yalda |
collection | PubMed |
description | Research at the intersection of computer vision and neuroscience has revealed hierarchical correspondence between layers of deep convolutional neural networks (DCNNs) and cascade of regions along human ventral visual cortex. Recently, studies have uncovered emergence of human interpretable concepts within DCNNs layers trained to identify visual objects and scenes. Here, we asked whether an artificial neural network (with convolutional structure) trained for visual categorization would demonstrate spatial correspondences with human brain regions showing central/peripheral biases. Using representational similarity analysis, we compared activations of convolutional layers of a DCNN trained for object and scene categorization with neural representations in human brain visual regions. Results reveal a brain-like topographical organization in the layers of the DCNN, such that activations of layer-units with central-bias were associated with brain regions with foveal tendencies (e.g. fusiform gyrus), and activations of layer-units with selectivity for image backgrounds were associated with cortical regions showing peripheral preference (e.g. parahippocampal cortex). The emergence of a categorical topographical correspondence between DCNNs and brain regions suggests these models are a good approximation of the perceptual representation generated by biological neural networks. |
format | Online Article Text |
id | pubmed-7070097 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-70700972020-03-22 Emergence of Visual Center-Periphery Spatial Organization in Deep Convolutional Neural Networks Mohsenzadeh, Yalda Mullin, Caitlin Lahner, Benjamin Oliva, Aude Sci Rep Article Research at the intersection of computer vision and neuroscience has revealed hierarchical correspondence between layers of deep convolutional neural networks (DCNNs) and cascade of regions along human ventral visual cortex. Recently, studies have uncovered emergence of human interpretable concepts within DCNNs layers trained to identify visual objects and scenes. Here, we asked whether an artificial neural network (with convolutional structure) trained for visual categorization would demonstrate spatial correspondences with human brain regions showing central/peripheral biases. Using representational similarity analysis, we compared activations of convolutional layers of a DCNN trained for object and scene categorization with neural representations in human brain visual regions. Results reveal a brain-like topographical organization in the layers of the DCNN, such that activations of layer-units with central-bias were associated with brain regions with foveal tendencies (e.g. fusiform gyrus), and activations of layer-units with selectivity for image backgrounds were associated with cortical regions showing peripheral preference (e.g. parahippocampal cortex). The emergence of a categorical topographical correspondence between DCNNs and brain regions suggests these models are a good approximation of the perceptual representation generated by biological neural networks. Nature Publishing Group UK 2020-03-13 /pmc/articles/PMC7070097/ /pubmed/32170209 http://dx.doi.org/10.1038/s41598-020-61409-0 Text en © The Author(s) 2020 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Mohsenzadeh, Yalda Mullin, Caitlin Lahner, Benjamin Oliva, Aude Emergence of Visual Center-Periphery Spatial Organization in Deep Convolutional Neural Networks |
title | Emergence of Visual Center-Periphery Spatial Organization in Deep Convolutional Neural Networks |
title_full | Emergence of Visual Center-Periphery Spatial Organization in Deep Convolutional Neural Networks |
title_fullStr | Emergence of Visual Center-Periphery Spatial Organization in Deep Convolutional Neural Networks |
title_full_unstemmed | Emergence of Visual Center-Periphery Spatial Organization in Deep Convolutional Neural Networks |
title_short | Emergence of Visual Center-Periphery Spatial Organization in Deep Convolutional Neural Networks |
title_sort | emergence of visual center-periphery spatial organization in deep convolutional neural networks |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7070097/ https://www.ncbi.nlm.nih.gov/pubmed/32170209 http://dx.doi.org/10.1038/s41598-020-61409-0 |
work_keys_str_mv | AT mohsenzadehyalda emergenceofvisualcenterperipheryspatialorganizationindeepconvolutionalneuralnetworks AT mullincaitlin emergenceofvisualcenterperipheryspatialorganizationindeepconvolutionalneuralnetworks AT lahnerbenjamin emergenceofvisualcenterperipheryspatialorganizationindeepconvolutionalneuralnetworks AT olivaaude emergenceofvisualcenterperipheryspatialorganizationindeepconvolutionalneuralnetworks |