Cargando…

Acetylcholine-modulated plasticity in reward-driven navigation: a computational study

Neuromodulation plays a fundamental role in the acquisition of new behaviours. In previous experimental work, we showed that acetylcholine biases hippocampal synaptic plasticity towards depression, and the subsequent application of dopamine can retroactively convert depression into potentiation. We...

Descripción completa

Detalles Bibliográficos
Autores principales: Zannone, Sara, Brzosko, Zuzanna, Paulsen, Ole, Clopath, Claudia
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6013476/
https://www.ncbi.nlm.nih.gov/pubmed/29930322
http://dx.doi.org/10.1038/s41598-018-27393-2
_version_ 1783334019735224320
author Zannone, Sara
Brzosko, Zuzanna
Paulsen, Ole
Clopath, Claudia
author_facet Zannone, Sara
Brzosko, Zuzanna
Paulsen, Ole
Clopath, Claudia
author_sort Zannone, Sara
collection PubMed
description Neuromodulation plays a fundamental role in the acquisition of new behaviours. In previous experimental work, we showed that acetylcholine biases hippocampal synaptic plasticity towards depression, and the subsequent application of dopamine can retroactively convert depression into potentiation. We also demonstrated that incorporating this sequentially neuromodulated Spike-Timing-Dependent Plasticity (STDP) rule in a network model of navigation yields effective learning of changing reward locations. Here, we employ computational modelling to further characterize the effects of cholinergic depression on behaviour. We find that acetylcholine, by allowing learning from negative outcomes, enhances exploration over the action space. We show that this results in a variety of effects, depending on the structure of the model, the environment and the task. Interestingly, sequentially neuromodulated STDP also yields flexible learning, surpassing the performance of other reward-modulated plasticity rules.
format Online
Article
Text
id pubmed-6013476
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-60134762018-06-27 Acetylcholine-modulated plasticity in reward-driven navigation: a computational study Zannone, Sara Brzosko, Zuzanna Paulsen, Ole Clopath, Claudia Sci Rep Article Neuromodulation plays a fundamental role in the acquisition of new behaviours. In previous experimental work, we showed that acetylcholine biases hippocampal synaptic plasticity towards depression, and the subsequent application of dopamine can retroactively convert depression into potentiation. We also demonstrated that incorporating this sequentially neuromodulated Spike-Timing-Dependent Plasticity (STDP) rule in a network model of navigation yields effective learning of changing reward locations. Here, we employ computational modelling to further characterize the effects of cholinergic depression on behaviour. We find that acetylcholine, by allowing learning from negative outcomes, enhances exploration over the action space. We show that this results in a variety of effects, depending on the structure of the model, the environment and the task. Interestingly, sequentially neuromodulated STDP also yields flexible learning, surpassing the performance of other reward-modulated plasticity rules. Nature Publishing Group UK 2018-06-21 /pmc/articles/PMC6013476/ /pubmed/29930322 http://dx.doi.org/10.1038/s41598-018-27393-2 Text en © The Author(s) 2018 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Zannone, Sara
Brzosko, Zuzanna
Paulsen, Ole
Clopath, Claudia
Acetylcholine-modulated plasticity in reward-driven navigation: a computational study
title Acetylcholine-modulated plasticity in reward-driven navigation: a computational study
title_full Acetylcholine-modulated plasticity in reward-driven navigation: a computational study
title_fullStr Acetylcholine-modulated plasticity in reward-driven navigation: a computational study
title_full_unstemmed Acetylcholine-modulated plasticity in reward-driven navigation: a computational study
title_short Acetylcholine-modulated plasticity in reward-driven navigation: a computational study
title_sort acetylcholine-modulated plasticity in reward-driven navigation: a computational study
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6013476/
https://www.ncbi.nlm.nih.gov/pubmed/29930322
http://dx.doi.org/10.1038/s41598-018-27393-2
work_keys_str_mv AT zannonesara acetylcholinemodulatedplasticityinrewarddrivennavigationacomputationalstudy
AT brzoskozuzanna acetylcholinemodulatedplasticityinrewarddrivennavigationacomputationalstudy
AT paulsenole acetylcholinemodulatedplasticityinrewarddrivennavigationacomputationalstudy
AT clopathclaudia acetylcholinemodulatedplasticityinrewarddrivennavigationacomputationalstudy