Cargando…
Brain-inspired global-local learning incorporated with neuromorphic computing
There are two principle approaches for learning in artificial intelligence: error-driven global learning and neuroscience-oriented local learning. Integrating them into one network may provide complementary learning capabilities for versatile learning scenarios. At the same time, neuromorphic comput...
Autores principales: | , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8748814/ https://www.ncbi.nlm.nih.gov/pubmed/35013198 http://dx.doi.org/10.1038/s41467-021-27653-2 |
_version_ | 1784631089687429120 |
---|---|
author | Wu, Yujie Zhao, Rong Zhu, Jun Chen, Feng Xu, Mingkun Li, Guoqi Song, Sen Deng, Lei Wang, Guanrui Zheng, Hao Ma, Songchen Pei, Jing Zhang, Youhui Zhao, Mingguo Shi, Luping |
author_facet | Wu, Yujie Zhao, Rong Zhu, Jun Chen, Feng Xu, Mingkun Li, Guoqi Song, Sen Deng, Lei Wang, Guanrui Zheng, Hao Ma, Songchen Pei, Jing Zhang, Youhui Zhao, Mingguo Shi, Luping |
author_sort | Wu, Yujie |
collection | PubMed |
description | There are two principle approaches for learning in artificial intelligence: error-driven global learning and neuroscience-oriented local learning. Integrating them into one network may provide complementary learning capabilities for versatile learning scenarios. At the same time, neuromorphic computing holds great promise, but still needs plenty of useful algorithms and algorithm-hardware co-designs to fully exploit its advantages. Here, we present a neuromorphic global-local synergic learning model by introducing a brain-inspired meta-learning paradigm and a differentiable spiking model incorporating neuronal dynamics and synaptic plasticity. It can meta-learn local plasticity and receive top-down supervision information for multiscale learning. We demonstrate the advantages of this model in multiple different tasks, including few-shot learning, continual learning, and fault-tolerance learning in neuromorphic vision sensors. It achieves significantly higher performance than single-learning methods. We further implement the model in the Tianjic neuromorphic platform by exploiting algorithm-hardware co-designs and prove that the model can fully utilize neuromorphic many-core architecture to develop hybrid computation paradigm. |
format | Online Article Text |
id | pubmed-8748814 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-87488142022-01-20 Brain-inspired global-local learning incorporated with neuromorphic computing Wu, Yujie Zhao, Rong Zhu, Jun Chen, Feng Xu, Mingkun Li, Guoqi Song, Sen Deng, Lei Wang, Guanrui Zheng, Hao Ma, Songchen Pei, Jing Zhang, Youhui Zhao, Mingguo Shi, Luping Nat Commun Article There are two principle approaches for learning in artificial intelligence: error-driven global learning and neuroscience-oriented local learning. Integrating them into one network may provide complementary learning capabilities for versatile learning scenarios. At the same time, neuromorphic computing holds great promise, but still needs plenty of useful algorithms and algorithm-hardware co-designs to fully exploit its advantages. Here, we present a neuromorphic global-local synergic learning model by introducing a brain-inspired meta-learning paradigm and a differentiable spiking model incorporating neuronal dynamics and synaptic plasticity. It can meta-learn local plasticity and receive top-down supervision information for multiscale learning. We demonstrate the advantages of this model in multiple different tasks, including few-shot learning, continual learning, and fault-tolerance learning in neuromorphic vision sensors. It achieves significantly higher performance than single-learning methods. We further implement the model in the Tianjic neuromorphic platform by exploiting algorithm-hardware co-designs and prove that the model can fully utilize neuromorphic many-core architecture to develop hybrid computation paradigm. Nature Publishing Group UK 2022-01-10 /pmc/articles/PMC8748814/ /pubmed/35013198 http://dx.doi.org/10.1038/s41467-021-27653-2 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Wu, Yujie Zhao, Rong Zhu, Jun Chen, Feng Xu, Mingkun Li, Guoqi Song, Sen Deng, Lei Wang, Guanrui Zheng, Hao Ma, Songchen Pei, Jing Zhang, Youhui Zhao, Mingguo Shi, Luping Brain-inspired global-local learning incorporated with neuromorphic computing |
title | Brain-inspired global-local learning incorporated with neuromorphic computing |
title_full | Brain-inspired global-local learning incorporated with neuromorphic computing |
title_fullStr | Brain-inspired global-local learning incorporated with neuromorphic computing |
title_full_unstemmed | Brain-inspired global-local learning incorporated with neuromorphic computing |
title_short | Brain-inspired global-local learning incorporated with neuromorphic computing |
title_sort | brain-inspired global-local learning incorporated with neuromorphic computing |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8748814/ https://www.ncbi.nlm.nih.gov/pubmed/35013198 http://dx.doi.org/10.1038/s41467-021-27653-2 |
work_keys_str_mv | AT wuyujie braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT zhaorong braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT zhujun braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT chenfeng braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT xumingkun braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT liguoqi braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT songsen braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT denglei braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT wangguanrui braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT zhenghao braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT masongchen braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT peijing braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT zhangyouhui braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT zhaomingguo braininspiredgloballocallearningincorporatedwithneuromorphiccomputing AT shiluping braininspiredgloballocallearningincorporatedwithneuromorphiccomputing |