Cargando…

Population response magnitude variation in inferotemporal cortex predicts image memorability

Most accounts of image and object encoding in inferotemporal cortex (IT) focus on the distinct patterns of spikes that different images evoke across the IT population. By analyzing data collected from IT as monkeys performed a visual memory task, we demonstrate that variation in a complementary codi...

Descripción completa

Detalles Bibliográficos
Autores principales: Jaegle, Andrew, Mehrpour, Vahid, Mohsenzadeh, Yalda, Meyer, Travis, Oliva, Aude, Rust, Nicole
Formato: Online Artículo Texto
Lenguaje:English
Publicado: eLife Sciences Publications, Ltd 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6715346/
https://www.ncbi.nlm.nih.gov/pubmed/31464687
http://dx.doi.org/10.7554/eLife.47596
_version_ 1783447218127110144
author Jaegle, Andrew
Mehrpour, Vahid
Mohsenzadeh, Yalda
Meyer, Travis
Oliva, Aude
Rust, Nicole
author_facet Jaegle, Andrew
Mehrpour, Vahid
Mohsenzadeh, Yalda
Meyer, Travis
Oliva, Aude
Rust, Nicole
author_sort Jaegle, Andrew
collection PubMed
description Most accounts of image and object encoding in inferotemporal cortex (IT) focus on the distinct patterns of spikes that different images evoke across the IT population. By analyzing data collected from IT as monkeys performed a visual memory task, we demonstrate that variation in a complementary coding scheme, the magnitude of the population response, can largely account for how well images will be remembered. To investigate the origin of IT image memorability modulation, we probed convolutional neural network models trained to categorize objects. We found that, like the brain, different natural images evoked different magnitude responses from these networks, and in higher layers, larger magnitude responses were correlated with the images that humans and monkeys find most memorable. Together, these results suggest that variation in IT population response magnitude is a natural consequence of the optimizations required for visual processing, and that this variation has consequences for visual memory.
format Online
Article
Text
id pubmed-6715346
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher eLife Sciences Publications, Ltd
record_format MEDLINE/PubMed
spelling pubmed-67153462019-08-30 Population response magnitude variation in inferotemporal cortex predicts image memorability Jaegle, Andrew Mehrpour, Vahid Mohsenzadeh, Yalda Meyer, Travis Oliva, Aude Rust, Nicole eLife Neuroscience Most accounts of image and object encoding in inferotemporal cortex (IT) focus on the distinct patterns of spikes that different images evoke across the IT population. By analyzing data collected from IT as monkeys performed a visual memory task, we demonstrate that variation in a complementary coding scheme, the magnitude of the population response, can largely account for how well images will be remembered. To investigate the origin of IT image memorability modulation, we probed convolutional neural network models trained to categorize objects. We found that, like the brain, different natural images evoked different magnitude responses from these networks, and in higher layers, larger magnitude responses were correlated with the images that humans and monkeys find most memorable. Together, these results suggest that variation in IT population response magnitude is a natural consequence of the optimizations required for visual processing, and that this variation has consequences for visual memory. eLife Sciences Publications, Ltd 2019-08-29 /pmc/articles/PMC6715346/ /pubmed/31464687 http://dx.doi.org/10.7554/eLife.47596 Text en © 2019, Jaegle et al http://creativecommons.org/licenses/by/4.0/ http://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use and redistribution provided that the original author and source are credited.
spellingShingle Neuroscience
Jaegle, Andrew
Mehrpour, Vahid
Mohsenzadeh, Yalda
Meyer, Travis
Oliva, Aude
Rust, Nicole
Population response magnitude variation in inferotemporal cortex predicts image memorability
title Population response magnitude variation in inferotemporal cortex predicts image memorability
title_full Population response magnitude variation in inferotemporal cortex predicts image memorability
title_fullStr Population response magnitude variation in inferotemporal cortex predicts image memorability
title_full_unstemmed Population response magnitude variation in inferotemporal cortex predicts image memorability
title_short Population response magnitude variation in inferotemporal cortex predicts image memorability
title_sort population response magnitude variation in inferotemporal cortex predicts image memorability
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6715346/
https://www.ncbi.nlm.nih.gov/pubmed/31464687
http://dx.doi.org/10.7554/eLife.47596
work_keys_str_mv AT jaegleandrew populationresponsemagnitudevariationininferotemporalcortexpredictsimagememorability
AT mehrpourvahid populationresponsemagnitudevariationininferotemporalcortexpredictsimagememorability
AT mohsenzadehyalda populationresponsemagnitudevariationininferotemporalcortexpredictsimagememorability
AT meyertravis populationresponsemagnitudevariationininferotemporalcortexpredictsimagememorability
AT olivaaude populationresponsemagnitudevariationininferotemporalcortexpredictsimagememorability
AT rustnicole populationresponsemagnitudevariationininferotemporalcortexpredictsimagememorability