Cargando…

Sparse deep predictive coding captures contour integration capabilities of the early visual system

Both neurophysiological and psychophysical experiments have pointed out the crucial role of recurrent and feedback connections to process context-dependent information in the early visual cortex. While numerous models have accounted for feedback effects at either neural or representational level, no...

Descripción completa

Detalles Bibliográficos
Autores principales: Boutin, Victor, Franciosini, Angelo, Chavane, Frederic, Ruffier, Franck, Perrinet, Laurent
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7864399/
https://www.ncbi.nlm.nih.gov/pubmed/33497381
http://dx.doi.org/10.1371/journal.pcbi.1008629
_version_ 1783647654227476480
author Boutin, Victor
Franciosini, Angelo
Chavane, Frederic
Ruffier, Franck
Perrinet, Laurent
author_facet Boutin, Victor
Franciosini, Angelo
Chavane, Frederic
Ruffier, Franck
Perrinet, Laurent
author_sort Boutin, Victor
collection PubMed
description Both neurophysiological and psychophysical experiments have pointed out the crucial role of recurrent and feedback connections to process context-dependent information in the early visual cortex. While numerous models have accounted for feedback effects at either neural or representational level, none of them were able to bind those two levels of analysis. Is it possible to describe feedback effects at both levels using the same model? We answer this question by combining Predictive Coding (PC) and Sparse Coding (SC) into a hierarchical and convolutional framework applied to realistic problems. In the Sparse Deep Predictive Coding (SDPC) model, the SC component models the internal recurrent processing within each layer, and the PC component describes the interactions between layers using feedforward and feedback connections. Here, we train a 2-layered SDPC on two different databases of images, and we interpret it as a model of the early visual system (V1 & V2). We first demonstrate that once the training has converged, SDPC exhibits oriented and localized receptive fields in V1 and more complex features in V2. Second, we analyze the effects of feedback on the neural organization beyond the classical receptive field of V1 neurons using interaction maps. These maps are similar to association fields and reflect the Gestalt principle of good continuation. We demonstrate that feedback signals reorganize interaction maps and modulate neural activity to promote contour integration. Third, we demonstrate at the representational level that the SDPC feedback connections are able to overcome noise in input images. Therefore, the SDPC captures the association field principle at the neural level which results in a better reconstruction of blurred images at the representational level.
format Online
Article
Text
id pubmed-7864399
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-78643992021-02-12 Sparse deep predictive coding captures contour integration capabilities of the early visual system Boutin, Victor Franciosini, Angelo Chavane, Frederic Ruffier, Franck Perrinet, Laurent PLoS Comput Biol Research Article Both neurophysiological and psychophysical experiments have pointed out the crucial role of recurrent and feedback connections to process context-dependent information in the early visual cortex. While numerous models have accounted for feedback effects at either neural or representational level, none of them were able to bind those two levels of analysis. Is it possible to describe feedback effects at both levels using the same model? We answer this question by combining Predictive Coding (PC) and Sparse Coding (SC) into a hierarchical and convolutional framework applied to realistic problems. In the Sparse Deep Predictive Coding (SDPC) model, the SC component models the internal recurrent processing within each layer, and the PC component describes the interactions between layers using feedforward and feedback connections. Here, we train a 2-layered SDPC on two different databases of images, and we interpret it as a model of the early visual system (V1 & V2). We first demonstrate that once the training has converged, SDPC exhibits oriented and localized receptive fields in V1 and more complex features in V2. Second, we analyze the effects of feedback on the neural organization beyond the classical receptive field of V1 neurons using interaction maps. These maps are similar to association fields and reflect the Gestalt principle of good continuation. We demonstrate that feedback signals reorganize interaction maps and modulate neural activity to promote contour integration. Third, we demonstrate at the representational level that the SDPC feedback connections are able to overcome noise in input images. Therefore, the SDPC captures the association field principle at the neural level which results in a better reconstruction of blurred images at the representational level. Public Library of Science 2021-01-26 /pmc/articles/PMC7864399/ /pubmed/33497381 http://dx.doi.org/10.1371/journal.pcbi.1008629 Text en © 2021 Boutin et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Boutin, Victor
Franciosini, Angelo
Chavane, Frederic
Ruffier, Franck
Perrinet, Laurent
Sparse deep predictive coding captures contour integration capabilities of the early visual system
title Sparse deep predictive coding captures contour integration capabilities of the early visual system
title_full Sparse deep predictive coding captures contour integration capabilities of the early visual system
title_fullStr Sparse deep predictive coding captures contour integration capabilities of the early visual system
title_full_unstemmed Sparse deep predictive coding captures contour integration capabilities of the early visual system
title_short Sparse deep predictive coding captures contour integration capabilities of the early visual system
title_sort sparse deep predictive coding captures contour integration capabilities of the early visual system
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7864399/
https://www.ncbi.nlm.nih.gov/pubmed/33497381
http://dx.doi.org/10.1371/journal.pcbi.1008629
work_keys_str_mv AT boutinvictor sparsedeeppredictivecodingcapturescontourintegrationcapabilitiesoftheearlyvisualsystem
AT franciosiniangelo sparsedeeppredictivecodingcapturescontourintegrationcapabilitiesoftheearlyvisualsystem
AT chavanefrederic sparsedeeppredictivecodingcapturescontourintegrationcapabilitiesoftheearlyvisualsystem
AT ruffierfranck sparsedeeppredictivecodingcapturescontourintegrationcapabilitiesoftheearlyvisualsystem
AT perrinetlaurent sparsedeeppredictivecodingcapturescontourintegrationcapabilitiesoftheearlyvisualsystem