Cargando…
Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning
Although the cerebellum has been implicated in simple reward-based learning recently, the role of complex spikes (CS) and simple spikes (SS), their interaction and their relationship to complex reinforcement learning and decision making is still unclear. Here we show that in a context where a non-hu...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8578621/ https://www.ncbi.nlm.nih.gov/pubmed/34753927 http://dx.doi.org/10.1038/s41467-021-26338-0 |
_version_ | 1784596268563038208 |
---|---|
author | Sendhilnathan, Naveen Ipata, Anna Goldberg, Michael E. |
author_facet | Sendhilnathan, Naveen Ipata, Anna Goldberg, Michael E. |
author_sort | Sendhilnathan, Naveen |
collection | PubMed |
description | Although the cerebellum has been implicated in simple reward-based learning recently, the role of complex spikes (CS) and simple spikes (SS), their interaction and their relationship to complex reinforcement learning and decision making is still unclear. Here we show that in a context where a non-human primate learned to make novel visuomotor associations, classifying CS responses based on their SS properties revealed distinct cell-type specific encoding of the probability of failure after the stimulus onset and the non-human primate’s decision. In a different context, CS from the same cerebellar area also responded in a cell-type and learning independent manner to the stimulus that signaled the beginning of the trial. Both types of CS signals were independent of changes in any motor kinematics and were unlikely to instruct the concurrent SS activity through an error based mechanism, suggesting the presence of context dependent, flexible, multiple independent channels of neural encoding by CS and SS. This diversity in neural information encoding in the mid-lateral cerebellum, depending on the context and learning state, is well suited to promote exploration and acquisition of wide range of cognitive behaviors that entail flexible stimulus-action-reward relationships but not necessarily motor learning. |
format | Online Article Text |
id | pubmed-8578621 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-85786212021-11-15 Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning Sendhilnathan, Naveen Ipata, Anna Goldberg, Michael E. Nat Commun Article Although the cerebellum has been implicated in simple reward-based learning recently, the role of complex spikes (CS) and simple spikes (SS), their interaction and their relationship to complex reinforcement learning and decision making is still unclear. Here we show that in a context where a non-human primate learned to make novel visuomotor associations, classifying CS responses based on their SS properties revealed distinct cell-type specific encoding of the probability of failure after the stimulus onset and the non-human primate’s decision. In a different context, CS from the same cerebellar area also responded in a cell-type and learning independent manner to the stimulus that signaled the beginning of the trial. Both types of CS signals were independent of changes in any motor kinematics and were unlikely to instruct the concurrent SS activity through an error based mechanism, suggesting the presence of context dependent, flexible, multiple independent channels of neural encoding by CS and SS. This diversity in neural information encoding in the mid-lateral cerebellum, depending on the context and learning state, is well suited to promote exploration and acquisition of wide range of cognitive behaviors that entail flexible stimulus-action-reward relationships but not necessarily motor learning. Nature Publishing Group UK 2021-11-09 /pmc/articles/PMC8578621/ /pubmed/34753927 http://dx.doi.org/10.1038/s41467-021-26338-0 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Sendhilnathan, Naveen Ipata, Anna Goldberg, Michael E. Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning |
title | Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning |
title_full | Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning |
title_fullStr | Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning |
title_full_unstemmed | Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning |
title_short | Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning |
title_sort | mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8578621/ https://www.ncbi.nlm.nih.gov/pubmed/34753927 http://dx.doi.org/10.1038/s41467-021-26338-0 |
work_keys_str_mv | AT sendhilnathannaveen midlateralcerebellarcomplexspikesencodemultipleindependentrewardrelatedsignalsduringreinforcementlearning AT ipataanna midlateralcerebellarcomplexspikesencodemultipleindependentrewardrelatedsignalsduringreinforcementlearning AT goldbergmichaele midlateralcerebellarcomplexspikesencodemultipleindependentrewardrelatedsignalsduringreinforcementlearning |