Cargando…
Biological learning curves outperform existing ones in artificial intelligence algorithms
Recently, deep learning algorithms have outperformed human experts in various tasks across several domains; however, their characteristics are distant from current knowledge of neuroscience. The simulation results of biological learning algorithms presented herein outperform state-of-the-art optimal...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6688986/ https://www.ncbi.nlm.nih.gov/pubmed/31399614 http://dx.doi.org/10.1038/s41598-019-48016-4 |
_version_ | 1783442962154258432 |
---|---|
author | Uzan, Herut Sardi, Shira Goldental, Amir Vardi, Roni Kanter, Ido |
author_facet | Uzan, Herut Sardi, Shira Goldental, Amir Vardi, Roni Kanter, Ido |
author_sort | Uzan, Herut |
collection | PubMed |
description | Recently, deep learning algorithms have outperformed human experts in various tasks across several domains; however, their characteristics are distant from current knowledge of neuroscience. The simulation results of biological learning algorithms presented herein outperform state-of-the-art optimal learning curves in supervised learning of feedforward networks. The biological learning algorithms comprise asynchronous input signals with decaying input summation, weights adaptation, and multiple outputs for an input signal. In particular, the generalization error for such biological perceptrons decreases rapidly with increasing number of examples, and it is independent of the size of the input. This is achieved using either synaptic learning, or solely through dendritic adaptation with a mechanism of swinging between reflecting boundaries, without learning steps. The proposed biological learning algorithms outperform the optimal scaling of the learning curve in a traditional perceptron. It also results in a considerable robustness to disparity between weights of two networks with very similar outputs in biological supervised learning scenarios. The simulation results indicate the potency of neurobiological mechanisms and open opportunities for developing a superior class of deep learning algorithms. |
format | Online Article Text |
id | pubmed-6688986 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-66889862019-08-13 Biological learning curves outperform existing ones in artificial intelligence algorithms Uzan, Herut Sardi, Shira Goldental, Amir Vardi, Roni Kanter, Ido Sci Rep Article Recently, deep learning algorithms have outperformed human experts in various tasks across several domains; however, their characteristics are distant from current knowledge of neuroscience. The simulation results of biological learning algorithms presented herein outperform state-of-the-art optimal learning curves in supervised learning of feedforward networks. The biological learning algorithms comprise asynchronous input signals with decaying input summation, weights adaptation, and multiple outputs for an input signal. In particular, the generalization error for such biological perceptrons decreases rapidly with increasing number of examples, and it is independent of the size of the input. This is achieved using either synaptic learning, or solely through dendritic adaptation with a mechanism of swinging between reflecting boundaries, without learning steps. The proposed biological learning algorithms outperform the optimal scaling of the learning curve in a traditional perceptron. It also results in a considerable robustness to disparity between weights of two networks with very similar outputs in biological supervised learning scenarios. The simulation results indicate the potency of neurobiological mechanisms and open opportunities for developing a superior class of deep learning algorithms. Nature Publishing Group UK 2019-08-09 /pmc/articles/PMC6688986/ /pubmed/31399614 http://dx.doi.org/10.1038/s41598-019-48016-4 Text en © The Author(s) 2019 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/. |
spellingShingle | Article Uzan, Herut Sardi, Shira Goldental, Amir Vardi, Roni Kanter, Ido Biological learning curves outperform existing ones in artificial intelligence algorithms |
title | Biological learning curves outperform existing ones in artificial intelligence algorithms |
title_full | Biological learning curves outperform existing ones in artificial intelligence algorithms |
title_fullStr | Biological learning curves outperform existing ones in artificial intelligence algorithms |
title_full_unstemmed | Biological learning curves outperform existing ones in artificial intelligence algorithms |
title_short | Biological learning curves outperform existing ones in artificial intelligence algorithms |
title_sort | biological learning curves outperform existing ones in artificial intelligence algorithms |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6688986/ https://www.ncbi.nlm.nih.gov/pubmed/31399614 http://dx.doi.org/10.1038/s41598-019-48016-4 |
work_keys_str_mv | AT uzanherut biologicallearningcurvesoutperformexistingonesinartificialintelligencealgorithms AT sardishira biologicallearningcurvesoutperformexistingonesinartificialintelligencealgorithms AT goldentalamir biologicallearningcurvesoutperformexistingonesinartificialintelligencealgorithms AT vardironi biologicallearningcurvesoutperformexistingonesinartificialintelligencealgorithms AT kanterido biologicallearningcurvesoutperformexistingonesinartificialintelligencealgorithms |