Cargando…

Learning the Synaptic and Intrinsic Membrane Dynamics Underlying Working Memory in Spiking Neural Network Models

Recurrent neural network (RNN) models trained to perform cognitive tasks are a useful computational tool for understanding how cortical circuits execute complex computations. However, these models are often composed of units that interact with one another using continuous signals and overlook parame...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Yinghao, Kim, Robert, Sejnowski, Terrence J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MIT Press 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8662709/
https://www.ncbi.nlm.nih.gov/pubmed/34710902
http://dx.doi.org/10.1162/neco_a_01409
_version_ 1784613495937957888
author Li, Yinghao
Kim, Robert
Sejnowski, Terrence J.
author_facet Li, Yinghao
Kim, Robert
Sejnowski, Terrence J.
author_sort Li, Yinghao
collection PubMed
description Recurrent neural network (RNN) models trained to perform cognitive tasks are a useful computational tool for understanding how cortical circuits execute complex computations. However, these models are often composed of units that interact with one another using continuous signals and overlook parameters intrinsic to spiking neurons. Here, we developed a method to directly train not only synaptic-related variables but also membrane-related parameters of a spiking RNN model. Training our model on a wide range of cognitive tasks resulted in diverse yet task-specific synaptic and membrane parameters. We also show that fast membrane time constants and slow synaptic decay dynamics naturally emerge from our model when it is trained on tasks associated with working memory (WM). Further dissecting the optimized parameters revealed that fast membrane properties are important for encoding stimuli, and slow synaptic dynamics are needed for WM maintenance. This approach offers a unique window into how connectivity patterns and intrinsic neuronal properties contribute to complex dynamics in neural populations.
format Online
Article
Text
id pubmed-8662709
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MIT Press
record_format MEDLINE/PubMed
spelling pubmed-86627092022-02-12 Learning the Synaptic and Intrinsic Membrane Dynamics Underlying Working Memory in Spiking Neural Network Models Li, Yinghao Kim, Robert Sejnowski, Terrence J. Neural Comput Research Article Recurrent neural network (RNN) models trained to perform cognitive tasks are a useful computational tool for understanding how cortical circuits execute complex computations. However, these models are often composed of units that interact with one another using continuous signals and overlook parameters intrinsic to spiking neurons. Here, we developed a method to directly train not only synaptic-related variables but also membrane-related parameters of a spiking RNN model. Training our model on a wide range of cognitive tasks resulted in diverse yet task-specific synaptic and membrane parameters. We also show that fast membrane time constants and slow synaptic decay dynamics naturally emerge from our model when it is trained on tasks associated with working memory (WM). Further dissecting the optimized parameters revealed that fast membrane properties are important for encoding stimuli, and slow synaptic dynamics are needed for WM maintenance. This approach offers a unique window into how connectivity patterns and intrinsic neuronal properties contribute to complex dynamics in neural populations. MIT Press 2021-11-12 /pmc/articles/PMC8662709/ /pubmed/34710902 http://dx.doi.org/10.1162/neco_a_01409 Text en © 2021 Massachusetts Institute of Technology https://creativecommons.org/licenses/by-nc/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) license, which permits copying and redistributing the material in any medium or format for noncommercial purposes only. For a full description of the license, please visit https://creativecommons.org/licenses/by-nc/4.0 (https://creativecommons.org/licenses/by-nc/4.0/) .
spellingShingle Research Article
Li, Yinghao
Kim, Robert
Sejnowski, Terrence J.
Learning the Synaptic and Intrinsic Membrane Dynamics Underlying Working Memory in Spiking Neural Network Models
title Learning the Synaptic and Intrinsic Membrane Dynamics Underlying Working Memory in Spiking Neural Network Models
title_full Learning the Synaptic and Intrinsic Membrane Dynamics Underlying Working Memory in Spiking Neural Network Models
title_fullStr Learning the Synaptic and Intrinsic Membrane Dynamics Underlying Working Memory in Spiking Neural Network Models
title_full_unstemmed Learning the Synaptic and Intrinsic Membrane Dynamics Underlying Working Memory in Spiking Neural Network Models
title_short Learning the Synaptic and Intrinsic Membrane Dynamics Underlying Working Memory in Spiking Neural Network Models
title_sort learning the synaptic and intrinsic membrane dynamics underlying working memory in spiking neural network models
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8662709/
https://www.ncbi.nlm.nih.gov/pubmed/34710902
http://dx.doi.org/10.1162/neco_a_01409
work_keys_str_mv AT liyinghao learningthesynapticandintrinsicmembranedynamicsunderlyingworkingmemoryinspikingneuralnetworkmodels
AT kimrobert learningthesynapticandintrinsicmembranedynamicsunderlyingworkingmemoryinspikingneuralnetworkmodels
AT sejnowskiterrencej learningthesynapticandintrinsicmembranedynamicsunderlyingworkingmemoryinspikingneuralnetworkmodels