Cargando…

Thalamocortical contribution to flexible learning in neural systems

Animal brains evolved to optimize behavior in dynamic environments, flexibly selecting actions that maximize future rewards in different contexts. A large body of experimental work indicates that such optimization changes the wiring of neural circuits, appropriately mapping environmental input onto...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Mien Brabeeba, Halassa, Michael M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MIT Press 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9976647/
https://www.ncbi.nlm.nih.gov/pubmed/36875011
http://dx.doi.org/10.1162/netn_a_00235
_version_ 1784899128438816768
author Wang, Mien Brabeeba
Halassa, Michael M.
author_facet Wang, Mien Brabeeba
Halassa, Michael M.
author_sort Wang, Mien Brabeeba
collection PubMed
description Animal brains evolved to optimize behavior in dynamic environments, flexibly selecting actions that maximize future rewards in different contexts. A large body of experimental work indicates that such optimization changes the wiring of neural circuits, appropriately mapping environmental input onto behavioral outputs. A major unsolved scientific question is how optimal wiring adjustments, which must target the connections responsible for rewards, can be accomplished when the relation between sensory inputs, action taken, and environmental context with rewards is ambiguous. The credit assignment problem can be categorized into context-independent structural credit assignment and context-dependent continual learning. In this perspective, we survey prior approaches to these two problems and advance the notion that the brain’s specialized neural architectures provide efficient solutions. Within this framework, the thalamus with its cortical and basal ganglia interactions serves as a systems-level solution to credit assignment. Specifically, we propose that thalamocortical interaction is the locus of meta-learning where the thalamus provides cortical control functions that parametrize the cortical activity association space. By selecting among these control functions, the basal ganglia hierarchically guide thalamocortical plasticity across two timescales to enable meta-learning. The faster timescale establishes contextual associations to enable behavioral flexibility, while the slower one enables generalization to new contexts.
format Online
Article
Text
id pubmed-9976647
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MIT Press
record_format MEDLINE/PubMed
spelling pubmed-99766472023-03-02 Thalamocortical contribution to flexible learning in neural systems Wang, Mien Brabeeba Halassa, Michael M. Netw Neurosci Focus Feature: Connectivity, Cognition, and Consciousness Animal brains evolved to optimize behavior in dynamic environments, flexibly selecting actions that maximize future rewards in different contexts. A large body of experimental work indicates that such optimization changes the wiring of neural circuits, appropriately mapping environmental input onto behavioral outputs. A major unsolved scientific question is how optimal wiring adjustments, which must target the connections responsible for rewards, can be accomplished when the relation between sensory inputs, action taken, and environmental context with rewards is ambiguous. The credit assignment problem can be categorized into context-independent structural credit assignment and context-dependent continual learning. In this perspective, we survey prior approaches to these two problems and advance the notion that the brain’s specialized neural architectures provide efficient solutions. Within this framework, the thalamus with its cortical and basal ganglia interactions serves as a systems-level solution to credit assignment. Specifically, we propose that thalamocortical interaction is the locus of meta-learning where the thalamus provides cortical control functions that parametrize the cortical activity association space. By selecting among these control functions, the basal ganglia hierarchically guide thalamocortical plasticity across two timescales to enable meta-learning. The faster timescale establishes contextual associations to enable behavioral flexibility, while the slower one enables generalization to new contexts. MIT Press 2022-10-01 /pmc/articles/PMC9976647/ /pubmed/36875011 http://dx.doi.org/10.1162/netn_a_00235 Text en © 2022 Massachusetts Institute of Technology https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. For a full description of the license, please visit https://creativecommons.org/licenses/by/4.0/.
spellingShingle Focus Feature: Connectivity, Cognition, and Consciousness
Wang, Mien Brabeeba
Halassa, Michael M.
Thalamocortical contribution to flexible learning in neural systems
title Thalamocortical contribution to flexible learning in neural systems
title_full Thalamocortical contribution to flexible learning in neural systems
title_fullStr Thalamocortical contribution to flexible learning in neural systems
title_full_unstemmed Thalamocortical contribution to flexible learning in neural systems
title_short Thalamocortical contribution to flexible learning in neural systems
title_sort thalamocortical contribution to flexible learning in neural systems
topic Focus Feature: Connectivity, Cognition, and Consciousness
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9976647/
https://www.ncbi.nlm.nih.gov/pubmed/36875011
http://dx.doi.org/10.1162/netn_a_00235
work_keys_str_mv AT wangmienbrabeeba thalamocorticalcontributiontoflexiblelearninginneuralsystems
AT halassamichaelm thalamocorticalcontributiontoflexiblelearninginneuralsystems