Cargando…

Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning

Although the cerebellum has been implicated in simple reward-based learning recently, the role of complex spikes (CS) and simple spikes (SS), their interaction and their relationship to complex reinforcement learning and decision making is still unclear. Here we show that in a context where a non-hu...

Descripción completa

Detalles Bibliográficos
Autores principales: Sendhilnathan, Naveen, Ipata, Anna, Goldberg, Michael E.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8578621/
https://www.ncbi.nlm.nih.gov/pubmed/34753927
http://dx.doi.org/10.1038/s41467-021-26338-0
_version_ 1784596268563038208
author Sendhilnathan, Naveen
Ipata, Anna
Goldberg, Michael E.
author_facet Sendhilnathan, Naveen
Ipata, Anna
Goldberg, Michael E.
author_sort Sendhilnathan, Naveen
collection PubMed
description Although the cerebellum has been implicated in simple reward-based learning recently, the role of complex spikes (CS) and simple spikes (SS), their interaction and their relationship to complex reinforcement learning and decision making is still unclear. Here we show that in a context where a non-human primate learned to make novel visuomotor associations, classifying CS responses based on their SS properties revealed distinct cell-type specific encoding of the probability of failure after the stimulus onset and the non-human primate’s decision. In a different context, CS from the same cerebellar area also responded in a cell-type and learning independent manner to the stimulus that signaled the beginning of the trial. Both types of CS signals were independent of changes in any motor kinematics and were unlikely to instruct the concurrent SS activity through an error based mechanism, suggesting the presence of context dependent, flexible, multiple independent channels of neural encoding by CS and SS. This diversity in neural information encoding in the mid-lateral cerebellum, depending on the context and learning state, is well suited to promote exploration and acquisition of wide range of cognitive behaviors that entail flexible stimulus-action-reward relationships but not necessarily motor learning.
format Online
Article
Text
id pubmed-8578621
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-85786212021-11-15 Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning Sendhilnathan, Naveen Ipata, Anna Goldberg, Michael E. Nat Commun Article Although the cerebellum has been implicated in simple reward-based learning recently, the role of complex spikes (CS) and simple spikes (SS), their interaction and their relationship to complex reinforcement learning and decision making is still unclear. Here we show that in a context where a non-human primate learned to make novel visuomotor associations, classifying CS responses based on their SS properties revealed distinct cell-type specific encoding of the probability of failure after the stimulus onset and the non-human primate’s decision. In a different context, CS from the same cerebellar area also responded in a cell-type and learning independent manner to the stimulus that signaled the beginning of the trial. Both types of CS signals were independent of changes in any motor kinematics and were unlikely to instruct the concurrent SS activity through an error based mechanism, suggesting the presence of context dependent, flexible, multiple independent channels of neural encoding by CS and SS. This diversity in neural information encoding in the mid-lateral cerebellum, depending on the context and learning state, is well suited to promote exploration and acquisition of wide range of cognitive behaviors that entail flexible stimulus-action-reward relationships but not necessarily motor learning. Nature Publishing Group UK 2021-11-09 /pmc/articles/PMC8578621/ /pubmed/34753927 http://dx.doi.org/10.1038/s41467-021-26338-0 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Sendhilnathan, Naveen
Ipata, Anna
Goldberg, Michael E.
Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning
title Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning
title_full Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning
title_fullStr Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning
title_full_unstemmed Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning
title_short Mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning
title_sort mid-lateral cerebellar complex spikes encode multiple independent reward-related signals during reinforcement learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8578621/
https://www.ncbi.nlm.nih.gov/pubmed/34753927
http://dx.doi.org/10.1038/s41467-021-26338-0
work_keys_str_mv AT sendhilnathannaveen midlateralcerebellarcomplexspikesencodemultipleindependentrewardrelatedsignalsduringreinforcementlearning
AT ipataanna midlateralcerebellarcomplexspikesencodemultipleindependentrewardrelatedsignalsduringreinforcementlearning
AT goldbergmichaele midlateralcerebellarcomplexspikesencodemultipleindependentrewardrelatedsignalsduringreinforcementlearning