Cargando…

Multiple timescales of normalized value coding underlie adaptive choice behavior

Adaptation is a fundamental process crucial for the efficient coding of sensory information. Recent evidence suggests that similar coding principles operate in decision-related brain areas, where neural value coding adapts to recent reward history. However, the circuit mechanism for value adaptation...

Descripción completa

Detalles Bibliográficos
Autores principales: Zimmermann, Jan, Glimcher, Paul W., Louie, Kenway
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6086888/
https://www.ncbi.nlm.nih.gov/pubmed/30097577
http://dx.doi.org/10.1038/s41467-018-05507-8
_version_ 1783346579007078400
author Zimmermann, Jan
Glimcher, Paul W.
Louie, Kenway
author_facet Zimmermann, Jan
Glimcher, Paul W.
Louie, Kenway
author_sort Zimmermann, Jan
collection PubMed
description Adaptation is a fundamental process crucial for the efficient coding of sensory information. Recent evidence suggests that similar coding principles operate in decision-related brain areas, where neural value coding adapts to recent reward history. However, the circuit mechanism for value adaptation is unknown, and the link between changes in adaptive value coding and choice behavior is unclear. Here we show that choice behavior in nonhuman primates varies with the statistics of recent rewards. Consistent with efficient coding theory, decision-making shows increased choice sensitivity in lower variance reward environments. Both the average adaptation effect and across-session variability are explained by a novel multiple timescale dynamical model of value representation implementing divisive normalization. The model predicts empirical variance-driven changes in behavior despite having no explicit knowledge of environmental statistics, suggesting that distributional characteristics can be captured by dynamic model architectures. These findings highlight the importance of treating decision-making as a dynamic process and the role of normalization as a unifying computation for contextual phenomena in choice.
format Online
Article
Text
id pubmed-6086888
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-60868882018-08-13 Multiple timescales of normalized value coding underlie adaptive choice behavior Zimmermann, Jan Glimcher, Paul W. Louie, Kenway Nat Commun Article Adaptation is a fundamental process crucial for the efficient coding of sensory information. Recent evidence suggests that similar coding principles operate in decision-related brain areas, where neural value coding adapts to recent reward history. However, the circuit mechanism for value adaptation is unknown, and the link between changes in adaptive value coding and choice behavior is unclear. Here we show that choice behavior in nonhuman primates varies with the statistics of recent rewards. Consistent with efficient coding theory, decision-making shows increased choice sensitivity in lower variance reward environments. Both the average adaptation effect and across-session variability are explained by a novel multiple timescale dynamical model of value representation implementing divisive normalization. The model predicts empirical variance-driven changes in behavior despite having no explicit knowledge of environmental statistics, suggesting that distributional characteristics can be captured by dynamic model architectures. These findings highlight the importance of treating decision-making as a dynamic process and the role of normalization as a unifying computation for contextual phenomena in choice. Nature Publishing Group UK 2018-08-10 /pmc/articles/PMC6086888/ /pubmed/30097577 http://dx.doi.org/10.1038/s41467-018-05507-8 Text en © The Author(s) 2018 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Zimmermann, Jan
Glimcher, Paul W.
Louie, Kenway
Multiple timescales of normalized value coding underlie adaptive choice behavior
title Multiple timescales of normalized value coding underlie adaptive choice behavior
title_full Multiple timescales of normalized value coding underlie adaptive choice behavior
title_fullStr Multiple timescales of normalized value coding underlie adaptive choice behavior
title_full_unstemmed Multiple timescales of normalized value coding underlie adaptive choice behavior
title_short Multiple timescales of normalized value coding underlie adaptive choice behavior
title_sort multiple timescales of normalized value coding underlie adaptive choice behavior
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6086888/
https://www.ncbi.nlm.nih.gov/pubmed/30097577
http://dx.doi.org/10.1038/s41467-018-05507-8
work_keys_str_mv AT zimmermannjan multipletimescalesofnormalizedvaluecodingunderlieadaptivechoicebehavior
AT glimcherpaulw multipletimescalesofnormalizedvaluecodingunderlieadaptivechoicebehavior
AT louiekenway multipletimescalesofnormalizedvaluecodingunderlieadaptivechoicebehavior