Cargando…
Learning Universal Computations with Spikes
Providing the neurobiological basis of information processing in higher animals, spiking neural networks must be able to learn a variety of complicated computations, including the generation of appropriate, possibly delayed reactions to inputs and the self-sustained generation of complex activity pa...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2016
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4911146/ https://www.ncbi.nlm.nih.gov/pubmed/27309381 http://dx.doi.org/10.1371/journal.pcbi.1004895 |
_version_ | 1782438094308376576 |
---|---|
author | Thalmeier, Dominik Uhlmann, Marvin Kappen, Hilbert J. Memmesheimer, Raoul-Martin |
author_facet | Thalmeier, Dominik Uhlmann, Marvin Kappen, Hilbert J. Memmesheimer, Raoul-Martin |
author_sort | Thalmeier, Dominik |
collection | PubMed |
description | Providing the neurobiological basis of information processing in higher animals, spiking neural networks must be able to learn a variety of complicated computations, including the generation of appropriate, possibly delayed reactions to inputs and the self-sustained generation of complex activity patterns, e.g. for locomotion. Many such computations require previous building of intrinsic world models. Here we show how spiking neural networks may solve these different tasks. Firstly, we derive constraints under which classes of spiking neural networks lend themselves to substrates of powerful general purpose computing. The networks contain dendritic or synaptic nonlinearities and have a constrained connectivity. We then combine such networks with learning rules for outputs or recurrent connections. We show that this allows to learn even difficult benchmark tasks such as the self-sustained generation of desired low-dimensional chaotic dynamics or memory-dependent computations. Furthermore, we show how spiking networks can build models of external world systems and use the acquired knowledge to control them. |
format | Online Article Text |
id | pubmed-4911146 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2016 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-49111462016-07-06 Learning Universal Computations with Spikes Thalmeier, Dominik Uhlmann, Marvin Kappen, Hilbert J. Memmesheimer, Raoul-Martin PLoS Comput Biol Research Article Providing the neurobiological basis of information processing in higher animals, spiking neural networks must be able to learn a variety of complicated computations, including the generation of appropriate, possibly delayed reactions to inputs and the self-sustained generation of complex activity patterns, e.g. for locomotion. Many such computations require previous building of intrinsic world models. Here we show how spiking neural networks may solve these different tasks. Firstly, we derive constraints under which classes of spiking neural networks lend themselves to substrates of powerful general purpose computing. The networks contain dendritic or synaptic nonlinearities and have a constrained connectivity. We then combine such networks with learning rules for outputs or recurrent connections. We show that this allows to learn even difficult benchmark tasks such as the self-sustained generation of desired low-dimensional chaotic dynamics or memory-dependent computations. Furthermore, we show how spiking networks can build models of external world systems and use the acquired knowledge to control them. Public Library of Science 2016-06-16 /pmc/articles/PMC4911146/ /pubmed/27309381 http://dx.doi.org/10.1371/journal.pcbi.1004895 Text en © 2016 Thalmeier et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Thalmeier, Dominik Uhlmann, Marvin Kappen, Hilbert J. Memmesheimer, Raoul-Martin Learning Universal Computations with Spikes |
title | Learning Universal Computations with Spikes |
title_full | Learning Universal Computations with Spikes |
title_fullStr | Learning Universal Computations with Spikes |
title_full_unstemmed | Learning Universal Computations with Spikes |
title_short | Learning Universal Computations with Spikes |
title_sort | learning universal computations with spikes |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4911146/ https://www.ncbi.nlm.nih.gov/pubmed/27309381 http://dx.doi.org/10.1371/journal.pcbi.1004895 |
work_keys_str_mv | AT thalmeierdominik learninguniversalcomputationswithspikes AT uhlmannmarvin learninguniversalcomputationswithspikes AT kappenhilbertj learninguniversalcomputationswithspikes AT memmesheimerraoulmartin learninguniversalcomputationswithspikes |