Cargando…

The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective

In this study, we explore the functional role of striatal cholinergic interneurons, hereinafter referred to as tonically active neurons (TANs), via computational modeling; specifically, we investigate the mechanistic relationship between TAN activity and dopamine variations and how changes in this r...

Descripción completa

Detalles Bibliográficos
Autores principales: Kim, Taegyo, Capps, Robert A., Hamade, Khaldoun C., Barnett, William H., Todorov, Dmitrii I., Latash, Elizaveta M., Markin, Sergey N., Rybak, Ilya A., Molkov, Yaroslav I.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6393383/
https://www.ncbi.nlm.nih.gov/pubmed/30846930
http://dx.doi.org/10.3389/fncir.2019.00010
_version_ 1783398676787363840
author Kim, Taegyo
Capps, Robert A.
Hamade, Khaldoun C.
Barnett, William H.
Todorov, Dmitrii I.
Latash, Elizaveta M.
Markin, Sergey N.
Rybak, Ilya A.
Molkov, Yaroslav I.
author_facet Kim, Taegyo
Capps, Robert A.
Hamade, Khaldoun C.
Barnett, William H.
Todorov, Dmitrii I.
Latash, Elizaveta M.
Markin, Sergey N.
Rybak, Ilya A.
Molkov, Yaroslav I.
author_sort Kim, Taegyo
collection PubMed
description In this study, we explore the functional role of striatal cholinergic interneurons, hereinafter referred to as tonically active neurons (TANs), via computational modeling; specifically, we investigate the mechanistic relationship between TAN activity and dopamine variations and how changes in this relationship affect reinforcement learning in the striatum. TANs pause their tonic firing activity after excitatory stimuli from thalamic and cortical neurons in response to a sensory event or reward information. During the pause striatal dopamine concentration excursions are observed. However, functional interactions between the TAN pause and striatal dopamine release are poorly understood. Here we propose a TAN activity-dopamine relationship model and demonstrate that the TAN pause is likely a time window to gate phasic dopamine release and dopamine variations reciprocally modulate the TAN pause duration. Furthermore, this model is integrated into our previously published model of reward-based motor adaptation to demonstrate how phasic dopamine release is gated by the TAN pause to deliver reward information for reinforcement learning in a timely manner. We also show how TAN-dopamine interactions are affected by striatal dopamine deficiency to produce poor performance of motor adaptation.
format Online
Article
Text
id pubmed-6393383
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-63933832019-03-07 The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective Kim, Taegyo Capps, Robert A. Hamade, Khaldoun C. Barnett, William H. Todorov, Dmitrii I. Latash, Elizaveta M. Markin, Sergey N. Rybak, Ilya A. Molkov, Yaroslav I. Front Neural Circuits Neuroscience In this study, we explore the functional role of striatal cholinergic interneurons, hereinafter referred to as tonically active neurons (TANs), via computational modeling; specifically, we investigate the mechanistic relationship between TAN activity and dopamine variations and how changes in this relationship affect reinforcement learning in the striatum. TANs pause their tonic firing activity after excitatory stimuli from thalamic and cortical neurons in response to a sensory event or reward information. During the pause striatal dopamine concentration excursions are observed. However, functional interactions between the TAN pause and striatal dopamine release are poorly understood. Here we propose a TAN activity-dopamine relationship model and demonstrate that the TAN pause is likely a time window to gate phasic dopamine release and dopamine variations reciprocally modulate the TAN pause duration. Furthermore, this model is integrated into our previously published model of reward-based motor adaptation to demonstrate how phasic dopamine release is gated by the TAN pause to deliver reward information for reinforcement learning in a timely manner. We also show how TAN-dopamine interactions are affected by striatal dopamine deficiency to produce poor performance of motor adaptation. Frontiers Media S.A. 2019-02-21 /pmc/articles/PMC6393383/ /pubmed/30846930 http://dx.doi.org/10.3389/fncir.2019.00010 Text en Copyright © 2019 Kim, Capps, Hamade, Barnett, Todorov, Latash, Markin, Rybak and Molkov. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Kim, Taegyo
Capps, Robert A.
Hamade, Khaldoun C.
Barnett, William H.
Todorov, Dmitrii I.
Latash, Elizaveta M.
Markin, Sergey N.
Rybak, Ilya A.
Molkov, Yaroslav I.
The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective
title The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective
title_full The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective
title_fullStr The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective
title_full_unstemmed The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective
title_short The Functional Role of Striatal Cholinergic Interneurons in Reinforcement Learning From Computational Perspective
title_sort functional role of striatal cholinergic interneurons in reinforcement learning from computational perspective
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6393383/
https://www.ncbi.nlm.nih.gov/pubmed/30846930
http://dx.doi.org/10.3389/fncir.2019.00010
work_keys_str_mv AT kimtaegyo thefunctionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT cappsroberta thefunctionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT hamadekhaldounc thefunctionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT barnettwilliamh thefunctionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT todorovdmitriii thefunctionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT latashelizavetam thefunctionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT markinsergeyn thefunctionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT rybakilyaa thefunctionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT molkovyaroslavi thefunctionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT kimtaegyo functionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT cappsroberta functionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT hamadekhaldounc functionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT barnettwilliamh functionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT todorovdmitriii functionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT latashelizavetam functionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT markinsergeyn functionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT rybakilyaa functionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective
AT molkovyaroslavi functionalroleofstriatalcholinergicinterneuronsinreinforcementlearningfromcomputationalperspective