Cargando…
Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics
Reservoir computing provides a time and cost-efficient alternative to traditional learning methods. Critical regimes, known as the “edge of chaos,” have been found to optimize computational performance in binary neural networks. However, little attention has been devoted to studying reservoir-to-res...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10445160/ https://www.ncbi.nlm.nih.gov/pubmed/37621962 http://dx.doi.org/10.3389/fncom.2023.1223258 |
_version_ | 1785094117768822784 |
---|---|
author | Calvet, Emmanuel Rouat, Jean Reulet, Bertrand |
author_facet | Calvet, Emmanuel Rouat, Jean Reulet, Bertrand |
author_sort | Calvet, Emmanuel |
collection | PubMed |
description | Reservoir computing provides a time and cost-efficient alternative to traditional learning methods. Critical regimes, known as the “edge of chaos,” have been found to optimize computational performance in binary neural networks. However, little attention has been devoted to studying reservoir-to-reservoir variability when investigating the link between connectivity, dynamics, and performance. As physical reservoir computers become more prevalent, developing a systematic approach to network design is crucial. In this article, we examine Random Boolean Networks (RBNs) and demonstrate that specific distribution parameters can lead to diverse dynamics near critical points. We identify distinct dynamical attractors and quantify their statistics, revealing that most reservoirs possess a dominant attractor. We then evaluate performance in two challenging tasks, memorization and prediction, and find that a positive excitatory balance produces a critical point with higher memory performance. In comparison, a negative inhibitory balance delivers another critical point with better prediction performance. Interestingly, we show that the intrinsic attractor dynamics have little influence on performance in either case. |
format | Online Article Text |
id | pubmed-10445160 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-104451602023-08-24 Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics Calvet, Emmanuel Rouat, Jean Reulet, Bertrand Front Comput Neurosci Neuroscience Reservoir computing provides a time and cost-efficient alternative to traditional learning methods. Critical regimes, known as the “edge of chaos,” have been found to optimize computational performance in binary neural networks. However, little attention has been devoted to studying reservoir-to-reservoir variability when investigating the link between connectivity, dynamics, and performance. As physical reservoir computers become more prevalent, developing a systematic approach to network design is crucial. In this article, we examine Random Boolean Networks (RBNs) and demonstrate that specific distribution parameters can lead to diverse dynamics near critical points. We identify distinct dynamical attractors and quantify their statistics, revealing that most reservoirs possess a dominant attractor. We then evaluate performance in two challenging tasks, memorization and prediction, and find that a positive excitatory balance produces a critical point with higher memory performance. In comparison, a negative inhibitory balance delivers another critical point with better prediction performance. Interestingly, we show that the intrinsic attractor dynamics have little influence on performance in either case. Frontiers Media S.A. 2023-08-09 /pmc/articles/PMC10445160/ /pubmed/37621962 http://dx.doi.org/10.3389/fncom.2023.1223258 Text en Copyright © 2023 Calvet, Rouat and Reulet. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Calvet, Emmanuel Rouat, Jean Reulet, Bertrand Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics |
title | Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics |
title_full | Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics |
title_fullStr | Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics |
title_full_unstemmed | Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics |
title_short | Excitatory/inhibitory balance emerges as a key factor for RBN performance, overriding attractor dynamics |
title_sort | excitatory/inhibitory balance emerges as a key factor for rbn performance, overriding attractor dynamics |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10445160/ https://www.ncbi.nlm.nih.gov/pubmed/37621962 http://dx.doi.org/10.3389/fncom.2023.1223258 |
work_keys_str_mv | AT calvetemmanuel excitatoryinhibitorybalanceemergesasakeyfactorforrbnperformanceoverridingattractordynamics AT rouatjean excitatoryinhibitorybalanceemergesasakeyfactorforrbnperformanceoverridingattractordynamics AT reuletbertrand excitatoryinhibitorybalanceemergesasakeyfactorforrbnperformanceoverridingattractordynamics |