Cargando…
Acetylcholine-modulated plasticity in reward-driven navigation: a computational study
Neuromodulation plays a fundamental role in the acquisition of new behaviours. In previous experimental work, we showed that acetylcholine biases hippocampal synaptic plasticity towards depression, and the subsequent application of dopamine can retroactively convert depression into potentiation. We...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6013476/ https://www.ncbi.nlm.nih.gov/pubmed/29930322 http://dx.doi.org/10.1038/s41598-018-27393-2 |
_version_ | 1783334019735224320 |
---|---|
author | Zannone, Sara Brzosko, Zuzanna Paulsen, Ole Clopath, Claudia |
author_facet | Zannone, Sara Brzosko, Zuzanna Paulsen, Ole Clopath, Claudia |
author_sort | Zannone, Sara |
collection | PubMed |
description | Neuromodulation plays a fundamental role in the acquisition of new behaviours. In previous experimental work, we showed that acetylcholine biases hippocampal synaptic plasticity towards depression, and the subsequent application of dopamine can retroactively convert depression into potentiation. We also demonstrated that incorporating this sequentially neuromodulated Spike-Timing-Dependent Plasticity (STDP) rule in a network model of navigation yields effective learning of changing reward locations. Here, we employ computational modelling to further characterize the effects of cholinergic depression on behaviour. We find that acetylcholine, by allowing learning from negative outcomes, enhances exploration over the action space. We show that this results in a variety of effects, depending on the structure of the model, the environment and the task. Interestingly, sequentially neuromodulated STDP also yields flexible learning, surpassing the performance of other reward-modulated plasticity rules. |
format | Online Article Text |
id | pubmed-6013476 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-60134762018-06-27 Acetylcholine-modulated plasticity in reward-driven navigation: a computational study Zannone, Sara Brzosko, Zuzanna Paulsen, Ole Clopath, Claudia Sci Rep Article Neuromodulation plays a fundamental role in the acquisition of new behaviours. In previous experimental work, we showed that acetylcholine biases hippocampal synaptic plasticity towards depression, and the subsequent application of dopamine can retroactively convert depression into potentiation. We also demonstrated that incorporating this sequentially neuromodulated Spike-Timing-Dependent Plasticity (STDP) rule in a network model of navigation yields effective learning of changing reward locations. Here, we employ computational modelling to further characterize the effects of cholinergic depression on behaviour. We find that acetylcholine, by allowing learning from negative outcomes, enhances exploration over the action space. We show that this results in a variety of effects, depending on the structure of the model, the environment and the task. Interestingly, sequentially neuromodulated STDP also yields flexible learning, surpassing the performance of other reward-modulated plasticity rules. Nature Publishing Group UK 2018-06-21 /pmc/articles/PMC6013476/ /pubmed/29930322 http://dx.doi.org/10.1038/s41598-018-27393-2 Text en © The Author(s) 2018 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Zannone, Sara Brzosko, Zuzanna Paulsen, Ole Clopath, Claudia Acetylcholine-modulated plasticity in reward-driven navigation: a computational study |
title | Acetylcholine-modulated plasticity in reward-driven navigation: a computational study |
title_full | Acetylcholine-modulated plasticity in reward-driven navigation: a computational study |
title_fullStr | Acetylcholine-modulated plasticity in reward-driven navigation: a computational study |
title_full_unstemmed | Acetylcholine-modulated plasticity in reward-driven navigation: a computational study |
title_short | Acetylcholine-modulated plasticity in reward-driven navigation: a computational study |
title_sort | acetylcholine-modulated plasticity in reward-driven navigation: a computational study |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6013476/ https://www.ncbi.nlm.nih.gov/pubmed/29930322 http://dx.doi.org/10.1038/s41598-018-27393-2 |
work_keys_str_mv | AT zannonesara acetylcholinemodulatedplasticityinrewarddrivennavigationacomputationalstudy AT brzoskozuzanna acetylcholinemodulatedplasticityinrewarddrivennavigationacomputationalstudy AT paulsenole acetylcholinemodulatedplasticityinrewarddrivennavigationacomputationalstudy AT clopathclaudia acetylcholinemodulatedplasticityinrewarddrivennavigationacomputationalstudy |