Cargando…

Biological learning curves outperform existing ones in artificial intelligence algorithms

Recently, deep learning algorithms have outperformed human experts in various tasks across several domains; however, their characteristics are distant from current knowledge of neuroscience. The simulation results of biological learning algorithms presented herein outperform state-of-the-art optimal...

Descripción completa

Detalles Bibliográficos
Autores principales: Uzan, Herut, Sardi, Shira, Goldental, Amir, Vardi, Roni, Kanter, Ido
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6688986/
https://www.ncbi.nlm.nih.gov/pubmed/31399614
http://dx.doi.org/10.1038/s41598-019-48016-4
_version_ 1783442962154258432
author Uzan, Herut
Sardi, Shira
Goldental, Amir
Vardi, Roni
Kanter, Ido
author_facet Uzan, Herut
Sardi, Shira
Goldental, Amir
Vardi, Roni
Kanter, Ido
author_sort Uzan, Herut
collection PubMed
description Recently, deep learning algorithms have outperformed human experts in various tasks across several domains; however, their characteristics are distant from current knowledge of neuroscience. The simulation results of biological learning algorithms presented herein outperform state-of-the-art optimal learning curves in supervised learning of feedforward networks. The biological learning algorithms comprise asynchronous input signals with decaying input summation, weights adaptation, and multiple outputs for an input signal. In particular, the generalization error for such biological perceptrons decreases rapidly with increasing number of examples, and it is independent of the size of the input. This is achieved using either synaptic learning, or solely through dendritic adaptation with a mechanism of swinging between reflecting boundaries, without learning steps. The proposed biological learning algorithms outperform the optimal scaling of the learning curve in a traditional perceptron. It also results in a considerable robustness to disparity between weights of two networks with very similar outputs in biological supervised learning scenarios. The simulation results indicate the potency of neurobiological mechanisms and open opportunities for developing a superior class of deep learning algorithms.
format Online
Article
Text
id pubmed-6688986
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-66889862019-08-13 Biological learning curves outperform existing ones in artificial intelligence algorithms Uzan, Herut Sardi, Shira Goldental, Amir Vardi, Roni Kanter, Ido Sci Rep Article Recently, deep learning algorithms have outperformed human experts in various tasks across several domains; however, their characteristics are distant from current knowledge of neuroscience. The simulation results of biological learning algorithms presented herein outperform state-of-the-art optimal learning curves in supervised learning of feedforward networks. The biological learning algorithms comprise asynchronous input signals with decaying input summation, weights adaptation, and multiple outputs for an input signal. In particular, the generalization error for such biological perceptrons decreases rapidly with increasing number of examples, and it is independent of the size of the input. This is achieved using either synaptic learning, or solely through dendritic adaptation with a mechanism of swinging between reflecting boundaries, without learning steps. The proposed biological learning algorithms outperform the optimal scaling of the learning curve in a traditional perceptron. It also results in a considerable robustness to disparity between weights of two networks with very similar outputs in biological supervised learning scenarios. The simulation results indicate the potency of neurobiological mechanisms and open opportunities for developing a superior class of deep learning algorithms. Nature Publishing Group UK 2019-08-09 /pmc/articles/PMC6688986/ /pubmed/31399614 http://dx.doi.org/10.1038/s41598-019-48016-4 Text en © The Author(s) 2019 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Uzan, Herut
Sardi, Shira
Goldental, Amir
Vardi, Roni
Kanter, Ido
Biological learning curves outperform existing ones in artificial intelligence algorithms
title Biological learning curves outperform existing ones in artificial intelligence algorithms
title_full Biological learning curves outperform existing ones in artificial intelligence algorithms
title_fullStr Biological learning curves outperform existing ones in artificial intelligence algorithms
title_full_unstemmed Biological learning curves outperform existing ones in artificial intelligence algorithms
title_short Biological learning curves outperform existing ones in artificial intelligence algorithms
title_sort biological learning curves outperform existing ones in artificial intelligence algorithms
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6688986/
https://www.ncbi.nlm.nih.gov/pubmed/31399614
http://dx.doi.org/10.1038/s41598-019-48016-4
work_keys_str_mv AT uzanherut biologicallearningcurvesoutperformexistingonesinartificialintelligencealgorithms
AT sardishira biologicallearningcurvesoutperformexistingonesinartificialintelligencealgorithms
AT goldentalamir biologicallearningcurvesoutperformexistingonesinartificialintelligencealgorithms
AT vardironi biologicallearningcurvesoutperformexistingonesinartificialintelligencealgorithms
AT kanterido biologicallearningcurvesoutperformexistingonesinartificialintelligencealgorithms