Cargando…

Neurons with dendrites can perform linearly separable computations with low resolution synaptic weights

In theory, neurons modelled as single layer perceptrons can implement all linearly separable computations. In practice, however, these computations may require arbitrarily precise synaptic weights. This is a strong constraint since both biological neurons and their artificial counterparts have to co...

Descripción completa

Detalles Bibliográficos
Autores principales: Cazé, Romain D., Stimberg, Marcel
Formato: Online Artículo Texto
Lenguaje:English
Publicado: F1000 Research Limited 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7848858/
https://www.ncbi.nlm.nih.gov/pubmed/33564396
http://dx.doi.org/10.12688/f1000research.26486.3
_version_ 1783645215722045440
author Cazé, Romain D.
Stimberg, Marcel
author_facet Cazé, Romain D.
Stimberg, Marcel
author_sort Cazé, Romain D.
collection PubMed
description In theory, neurons modelled as single layer perceptrons can implement all linearly separable computations. In practice, however, these computations may require arbitrarily precise synaptic weights. This is a strong constraint since both biological neurons and their artificial counterparts have to cope with limited precision. Here, we explore how non-linear processing in dendrites helps overcome this constraint. We start by finding a class of computations which requires increasing precision with the number of inputs in a perceptron and show that it can be implemented without this constraint in a neuron with sub-linear dendritic subunits. Then, we complement this analytical study by a simulation of a biophysical neuron model with two passive dendrites and a soma, and show that it can implement this computation. This work demonstrates a new role of dendrites in neural computation: by distributing the computation across independent subunits, the same computation can be performed more efficiently with less precise tuning of the synaptic weights. This work not only offers new insight into the importance of dendrites for biological neurons, but also paves the way for new, more efficient architectures of artificial neuromorphic chips.
format Online
Article
Text
id pubmed-7848858
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher F1000 Research Limited
record_format MEDLINE/PubMed
spelling pubmed-78488582021-02-08 Neurons with dendrites can perform linearly separable computations with low resolution synaptic weights Cazé, Romain D. Stimberg, Marcel F1000Res Research Article In theory, neurons modelled as single layer perceptrons can implement all linearly separable computations. In practice, however, these computations may require arbitrarily precise synaptic weights. This is a strong constraint since both biological neurons and their artificial counterparts have to cope with limited precision. Here, we explore how non-linear processing in dendrites helps overcome this constraint. We start by finding a class of computations which requires increasing precision with the number of inputs in a perceptron and show that it can be implemented without this constraint in a neuron with sub-linear dendritic subunits. Then, we complement this analytical study by a simulation of a biophysical neuron model with two passive dendrites and a soma, and show that it can implement this computation. This work demonstrates a new role of dendrites in neural computation: by distributing the computation across independent subunits, the same computation can be performed more efficiently with less precise tuning of the synaptic weights. This work not only offers new insight into the importance of dendrites for biological neurons, but also paves the way for new, more efficient architectures of artificial neuromorphic chips. F1000 Research Limited 2021-04-18 /pmc/articles/PMC7848858/ /pubmed/33564396 http://dx.doi.org/10.12688/f1000research.26486.3 Text en Copyright: © 2021 Cazé RD and Stimberg M https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Cazé, Romain D.
Stimberg, Marcel
Neurons with dendrites can perform linearly separable computations with low resolution synaptic weights
title Neurons with dendrites can perform linearly separable computations with low resolution synaptic weights
title_full Neurons with dendrites can perform linearly separable computations with low resolution synaptic weights
title_fullStr Neurons with dendrites can perform linearly separable computations with low resolution synaptic weights
title_full_unstemmed Neurons with dendrites can perform linearly separable computations with low resolution synaptic weights
title_short Neurons with dendrites can perform linearly separable computations with low resolution synaptic weights
title_sort neurons with dendrites can perform linearly separable computations with low resolution synaptic weights
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7848858/
https://www.ncbi.nlm.nih.gov/pubmed/33564396
http://dx.doi.org/10.12688/f1000research.26486.3
work_keys_str_mv AT cazeromaind neuronswithdendritescanperformlinearlyseparablecomputationswithlowresolutionsynapticweights
AT stimbergmarcel neuronswithdendritescanperformlinearlyseparablecomputationswithlowresolutionsynapticweights