Cargando…
Thalamocortical contribution to flexible learning in neural systems
Animal brains evolved to optimize behavior in dynamic environments, flexibly selecting actions that maximize future rewards in different contexts. A large body of experimental work indicates that such optimization changes the wiring of neural circuits, appropriately mapping environmental input onto...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MIT Press
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9976647/ https://www.ncbi.nlm.nih.gov/pubmed/36875011 http://dx.doi.org/10.1162/netn_a_00235 |
_version_ | 1784899128438816768 |
---|---|
author | Wang, Mien Brabeeba Halassa, Michael M. |
author_facet | Wang, Mien Brabeeba Halassa, Michael M. |
author_sort | Wang, Mien Brabeeba |
collection | PubMed |
description | Animal brains evolved to optimize behavior in dynamic environments, flexibly selecting actions that maximize future rewards in different contexts. A large body of experimental work indicates that such optimization changes the wiring of neural circuits, appropriately mapping environmental input onto behavioral outputs. A major unsolved scientific question is how optimal wiring adjustments, which must target the connections responsible for rewards, can be accomplished when the relation between sensory inputs, action taken, and environmental context with rewards is ambiguous. The credit assignment problem can be categorized into context-independent structural credit assignment and context-dependent continual learning. In this perspective, we survey prior approaches to these two problems and advance the notion that the brain’s specialized neural architectures provide efficient solutions. Within this framework, the thalamus with its cortical and basal ganglia interactions serves as a systems-level solution to credit assignment. Specifically, we propose that thalamocortical interaction is the locus of meta-learning where the thalamus provides cortical control functions that parametrize the cortical activity association space. By selecting among these control functions, the basal ganglia hierarchically guide thalamocortical plasticity across two timescales to enable meta-learning. The faster timescale establishes contextual associations to enable behavioral flexibility, while the slower one enables generalization to new contexts. |
format | Online Article Text |
id | pubmed-9976647 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MIT Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-99766472023-03-02 Thalamocortical contribution to flexible learning in neural systems Wang, Mien Brabeeba Halassa, Michael M. Netw Neurosci Focus Feature: Connectivity, Cognition, and Consciousness Animal brains evolved to optimize behavior in dynamic environments, flexibly selecting actions that maximize future rewards in different contexts. A large body of experimental work indicates that such optimization changes the wiring of neural circuits, appropriately mapping environmental input onto behavioral outputs. A major unsolved scientific question is how optimal wiring adjustments, which must target the connections responsible for rewards, can be accomplished when the relation between sensory inputs, action taken, and environmental context with rewards is ambiguous. The credit assignment problem can be categorized into context-independent structural credit assignment and context-dependent continual learning. In this perspective, we survey prior approaches to these two problems and advance the notion that the brain’s specialized neural architectures provide efficient solutions. Within this framework, the thalamus with its cortical and basal ganglia interactions serves as a systems-level solution to credit assignment. Specifically, we propose that thalamocortical interaction is the locus of meta-learning where the thalamus provides cortical control functions that parametrize the cortical activity association space. By selecting among these control functions, the basal ganglia hierarchically guide thalamocortical plasticity across two timescales to enable meta-learning. The faster timescale establishes contextual associations to enable behavioral flexibility, while the slower one enables generalization to new contexts. MIT Press 2022-10-01 /pmc/articles/PMC9976647/ /pubmed/36875011 http://dx.doi.org/10.1162/netn_a_00235 Text en © 2022 Massachusetts Institute of Technology https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. For a full description of the license, please visit https://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Focus Feature: Connectivity, Cognition, and Consciousness Wang, Mien Brabeeba Halassa, Michael M. Thalamocortical contribution to flexible learning in neural systems |
title | Thalamocortical contribution to flexible learning in neural systems |
title_full | Thalamocortical contribution to flexible learning in neural systems |
title_fullStr | Thalamocortical contribution to flexible learning in neural systems |
title_full_unstemmed | Thalamocortical contribution to flexible learning in neural systems |
title_short | Thalamocortical contribution to flexible learning in neural systems |
title_sort | thalamocortical contribution to flexible learning in neural systems |
topic | Focus Feature: Connectivity, Cognition, and Consciousness |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9976647/ https://www.ncbi.nlm.nih.gov/pubmed/36875011 http://dx.doi.org/10.1162/netn_a_00235 |
work_keys_str_mv | AT wangmienbrabeeba thalamocorticalcontributiontoflexiblelearninginneuralsystems AT halassamichaelm thalamocorticalcontributiontoflexiblelearninginneuralsystems |