Cargando…
Dynamical complexity and computation in recurrent neural networks beyond their fixed point
Spontaneous activity found in neural networks usually results in a reduction of computational performance. As a consequence, artificial neural networks are often operated at the edge of chaos, where the network is stable yet highly susceptible to input information. Surprisingly, regular spontaneous...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5820323/ https://www.ncbi.nlm.nih.gov/pubmed/29463810 http://dx.doi.org/10.1038/s41598-018-21624-2 |
_version_ | 1783301341521641472 |
---|---|
author | Marquez, Bicky A. Larger, Laurent Jacquot, Maxime Chembo, Yanne K. Brunner, Daniel |
author_facet | Marquez, Bicky A. Larger, Laurent Jacquot, Maxime Chembo, Yanne K. Brunner, Daniel |
author_sort | Marquez, Bicky A. |
collection | PubMed |
description | Spontaneous activity found in neural networks usually results in a reduction of computational performance. As a consequence, artificial neural networks are often operated at the edge of chaos, where the network is stable yet highly susceptible to input information. Surprisingly, regular spontaneous dynamics in Neural Networks beyond their resting state possess a high degree of spatio-temporal synchronization, a situation that can also be found in biological neural networks. Characterizing information preservation via complexity indices, we show how spatial synchronization allows rRNNs to reduce the negative impact of regular spontaneous dynamics on their computational performance. |
format | Online Article Text |
id | pubmed-5820323 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-58203232018-02-26 Dynamical complexity and computation in recurrent neural networks beyond their fixed point Marquez, Bicky A. Larger, Laurent Jacquot, Maxime Chembo, Yanne K. Brunner, Daniel Sci Rep Article Spontaneous activity found in neural networks usually results in a reduction of computational performance. As a consequence, artificial neural networks are often operated at the edge of chaos, where the network is stable yet highly susceptible to input information. Surprisingly, regular spontaneous dynamics in Neural Networks beyond their resting state possess a high degree of spatio-temporal synchronization, a situation that can also be found in biological neural networks. Characterizing information preservation via complexity indices, we show how spatial synchronization allows rRNNs to reduce the negative impact of regular spontaneous dynamics on their computational performance. Nature Publishing Group UK 2018-02-20 /pmc/articles/PMC5820323/ /pubmed/29463810 http://dx.doi.org/10.1038/s41598-018-21624-2 Text en © The Author(s) 2018 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Marquez, Bicky A. Larger, Laurent Jacquot, Maxime Chembo, Yanne K. Brunner, Daniel Dynamical complexity and computation in recurrent neural networks beyond their fixed point |
title | Dynamical complexity and computation in recurrent neural networks beyond their fixed point |
title_full | Dynamical complexity and computation in recurrent neural networks beyond their fixed point |
title_fullStr | Dynamical complexity and computation in recurrent neural networks beyond their fixed point |
title_full_unstemmed | Dynamical complexity and computation in recurrent neural networks beyond their fixed point |
title_short | Dynamical complexity and computation in recurrent neural networks beyond their fixed point |
title_sort | dynamical complexity and computation in recurrent neural networks beyond their fixed point |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5820323/ https://www.ncbi.nlm.nih.gov/pubmed/29463810 http://dx.doi.org/10.1038/s41598-018-21624-2 |
work_keys_str_mv | AT marquezbickya dynamicalcomplexityandcomputationinrecurrentneuralnetworksbeyondtheirfixedpoint AT largerlaurent dynamicalcomplexityandcomputationinrecurrentneuralnetworksbeyondtheirfixedpoint AT jacquotmaxime dynamicalcomplexityandcomputationinrecurrentneuralnetworksbeyondtheirfixedpoint AT chemboyannek dynamicalcomplexityandcomputationinrecurrentneuralnetworksbeyondtheirfixedpoint AT brunnerdaniel dynamicalcomplexityandcomputationinrecurrentneuralnetworksbeyondtheirfixedpoint |