Cargando…

Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics

Reservoir computing provides a time and cost-efficient alternative to traditional learning methods. Critical regimes, known as the “edge of chaos,” have been found to optimize computational performance in binary neural networks. However, little attention has been devoted to studying reservoir-to-res...

Descripción completa

Detalles Bibliográficos
Autores principales: Calvet, Emmanuel, Rouat, Jean, Reulet, Bertrand
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10445160/
https://www.ncbi.nlm.nih.gov/pubmed/37621962
http://dx.doi.org/10.3389/fncom.2023.1223258
_version_ 1785094117768822784
author Calvet, Emmanuel
Rouat, Jean
Reulet, Bertrand
author_facet Calvet, Emmanuel
Rouat, Jean
Reulet, Bertrand
author_sort Calvet, Emmanuel
collection PubMed
description Reservoir computing provides a time and cost-efficient alternative to traditional learning methods. Critical regimes, known as the “edge of chaos,” have been found to optimize computational performance in binary neural networks. However, little attention has been devoted to studying reservoir-to-reservoir variability when investigating the link between connectivity, dynamics, and performance. As physical reservoir computers become more prevalent, developing a systematic approach to network design is crucial. In this article, we examine Random Boolean Networks (RBNs) and demonstrate that specific distribution parameters can lead to diverse dynamics near critical points. We identify distinct dynamical attractors and quantify their statistics, revealing that most reservoirs possess a dominant attractor. We then evaluate performance in two challenging tasks, memorization and prediction, and find that a positive excitatory balance produces a critical point with higher memory performance. In comparison, a negative inhibitory balance delivers another critical point with better prediction performance. Interestingly, we show that the intrinsic attractor dynamics have little influence on performance in either case.
format Online
Article
Text
id pubmed-10445160
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-104451602023-08-24 Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics Calvet, Emmanuel Rouat, Jean Reulet, Bertrand Front Comput Neurosci Neuroscience Reservoir computing provides a time and cost-efficient alternative to traditional learning methods. Critical regimes, known as the “edge of chaos,” have been found to optimize computational performance in binary neural networks. However, little attention has been devoted to studying reservoir-to-reservoir variability when investigating the link between connectivity, dynamics, and performance. As physical reservoir computers become more prevalent, developing a systematic approach to network design is crucial. In this article, we examine Random Boolean Networks (RBNs) and demonstrate that specific distribution parameters can lead to diverse dynamics near critical points. We identify distinct dynamical attractors and quantify their statistics, revealing that most reservoirs possess a dominant attractor. We then evaluate performance in two challenging tasks, memorization and prediction, and find that a positive excitatory balance produces a critical point with higher memory performance. In comparison, a negative inhibitory balance delivers another critical point with better prediction performance. Interestingly, we show that the intrinsic attractor dynamics have little influence on performance in either case. Frontiers Media S.A. 2023-08-09 /pmc/articles/PMC10445160/ /pubmed/37621962 http://dx.doi.org/10.3389/fncom.2023.1223258 Text en Copyright © 2023 Calvet, Rouat and Reulet. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Calvet, Emmanuel
Rouat, Jean
Reulet, Bertrand
Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics
title Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics
title_full Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics
title_fullStr Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics
title_full_unstemmed Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics
title_short Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics
title_sort excitatory/inhibitory balance emerges as a key factor for rbn performance, overriding attractor dynamics
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10445160/
https://www.ncbi.nlm.nih.gov/pubmed/37621962
http://dx.doi.org/10.3389/fncom.2023.1223258
work_keys_str_mv AT calvetemmanuel excitatoryinhibitorybalanceemergesasakeyfactorforrbnperformanceoverridingattractordynamics
AT rouatjean excitatoryinhibitorybalanceemergesasakeyfactorforrbnperformanceoverridingattractordynamics
AT reuletbertrand excitatoryinhibitorybalanceemergesasakeyfactorforrbnperformanceoverridingattractordynamics