Cargando…

Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system

Recent experiments have shown that animals and humans have a remarkable ability to adapt their learning rate according to the volatility of the environment. Yet the neural mechanism responsible for such adaptive learning has remained unclear. To fill this gap, we investigated a biophysically inspire...

Descripción completa

Detalles Bibliográficos
Autor principal: Iigaya, Kiyohito
Formato: Online Artículo Texto
Lenguaje:English
Publicado: eLife Sciences Publications, Ltd 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5008908/
https://www.ncbi.nlm.nih.gov/pubmed/27504806
http://dx.doi.org/10.7554/eLife.18073
_version_ 1782451463035813888
author Iigaya, Kiyohito
author_facet Iigaya, Kiyohito
author_sort Iigaya, Kiyohito
collection PubMed
description Recent experiments have shown that animals and humans have a remarkable ability to adapt their learning rate according to the volatility of the environment. Yet the neural mechanism responsible for such adaptive learning has remained unclear. To fill this gap, we investigated a biophysically inspired, metaplastic synaptic model within the context of a well-studied decision-making network, in which synapses can change their rate of plasticity in addition to their efficacy according to a reward-based learning rule. We found that our model, which assumes that synaptic plasticity is guided by a novel surprise detection system, captures a wide range of key experimental findings and performs as well as a Bayes optimal model, with remarkably little parameter tuning. Our results further demonstrate the computational power of synaptic plasticity, and provide insights into the circuit-level computation which underlies adaptive decision-making. DOI: http://dx.doi.org/10.7554/eLife.18073.001
format Online
Article
Text
id pubmed-5008908
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher eLife Sciences Publications, Ltd
record_format MEDLINE/PubMed
spelling pubmed-50089082016-09-06 Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system Iigaya, Kiyohito eLife Neuroscience Recent experiments have shown that animals and humans have a remarkable ability to adapt their learning rate according to the volatility of the environment. Yet the neural mechanism responsible for such adaptive learning has remained unclear. To fill this gap, we investigated a biophysically inspired, metaplastic synaptic model within the context of a well-studied decision-making network, in which synapses can change their rate of plasticity in addition to their efficacy according to a reward-based learning rule. We found that our model, which assumes that synaptic plasticity is guided by a novel surprise detection system, captures a wide range of key experimental findings and performs as well as a Bayes optimal model, with remarkably little parameter tuning. Our results further demonstrate the computational power of synaptic plasticity, and provide insights into the circuit-level computation which underlies adaptive decision-making. DOI: http://dx.doi.org/10.7554/eLife.18073.001 eLife Sciences Publications, Ltd 2016-08-09 /pmc/articles/PMC5008908/ /pubmed/27504806 http://dx.doi.org/10.7554/eLife.18073 Text en © 2016, Iigaya et al https://creativecommons.org/licenses/by/4.0/This article is distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use and redistribution provided that the original author and source are credited.
spellingShingle Neuroscience
Iigaya, Kiyohito
Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system
title Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system
title_full Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system
title_fullStr Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system
title_full_unstemmed Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system
title_short Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system
title_sort adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5008908/
https://www.ncbi.nlm.nih.gov/pubmed/27504806
http://dx.doi.org/10.7554/eLife.18073
work_keys_str_mv AT iigayakiyohito adaptivelearninganddecisionmakingunderuncertaintybymetaplasticsynapsesguidedbyasurprisedetectionsystem