Cargando…

Brain-inspired global-local learning incorporated with neuromorphic computing

There are two principle approaches for learning in artificial intelligence: error-driven global learning and neuroscience-oriented local learning. Integrating them into one network may provide complementary learning capabilities for versatile learning scenarios. At the same time, neuromorphic comput...

Descripción completa

Detalles Bibliográficos
Autores principales: Wu, Yujie, Zhao, Rong, Zhu, Jun, Chen, Feng, Xu, Mingkun, Li, Guoqi, Song, Sen, Deng, Lei, Wang, Guanrui, Zheng, Hao, Ma, Songchen, Pei, Jing, Zhang, Youhui, Zhao, Mingguo, Shi, Luping
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8748814/
https://www.ncbi.nlm.nih.gov/pubmed/35013198
http://dx.doi.org/10.1038/s41467-021-27653-2
_version_ 1784631089687429120
author Wu, Yujie
Zhao, Rong
Zhu, Jun
Chen, Feng
Xu, Mingkun
Li, Guoqi
Song, Sen
Deng, Lei
Wang, Guanrui
Zheng, Hao
Ma, Songchen
Pei, Jing
Zhang, Youhui
Zhao, Mingguo
Shi, Luping
author_facet Wu, Yujie
Zhao, Rong
Zhu, Jun
Chen, Feng
Xu, Mingkun
Li, Guoqi
Song, Sen
Deng, Lei
Wang, Guanrui
Zheng, Hao
Ma, Songchen
Pei, Jing
Zhang, Youhui
Zhao, Mingguo
Shi, Luping
author_sort Wu, Yujie
collection PubMed
description There are two principle approaches for learning in artificial intelligence: error-driven global learning and neuroscience-oriented local learning. Integrating them into one network may provide complementary learning capabilities for versatile learning scenarios. At the same time, neuromorphic computing holds great promise, but still needs plenty of useful algorithms and algorithm-hardware co-designs to fully exploit its advantages. Here, we present a neuromorphic global-local synergic learning model by introducing a brain-inspired meta-learning paradigm and a differentiable spiking model incorporating neuronal dynamics and synaptic plasticity. It can meta-learn local plasticity and receive top-down supervision information for multiscale learning. We demonstrate the advantages of this model in multiple different tasks, including few-shot learning, continual learning, and fault-tolerance learning in neuromorphic vision sensors. It achieves significantly higher performance than single-learning methods. We further implement the model in the Tianjic neuromorphic platform by exploiting algorithm-hardware co-designs and prove that the model can fully utilize neuromorphic many-core architecture to develop hybrid computation paradigm.
format Online
Article
Text
id pubmed-8748814
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-87488142022-01-20 Brain-inspired global-local learning incorporated with neuromorphic computing Wu, Yujie Zhao, Rong Zhu, Jun Chen, Feng Xu, Mingkun Li, Guoqi Song, Sen Deng, Lei Wang, Guanrui Zheng, Hao Ma, Songchen Pei, Jing Zhang, Youhui Zhao, Mingguo Shi, Luping Nat Commun Article There are two principle approaches for learning in artificial intelligence: error-driven global learning and neuroscience-oriented local learning. Integrating them into one network may provide complementary learning capabilities for versatile learning scenarios. At the same time, neuromorphic computing holds great promise, but still needs plenty of useful algorithms and algorithm-hardware co-designs to fully exploit its advantages. Here, we present a neuromorphic global-local synergic learning model by introducing a brain-inspired meta-learning paradigm and a differentiable spiking model incorporating neuronal dynamics and synaptic plasticity. It can meta-learn local plasticity and receive top-down supervision information for multiscale learning. We demonstrate the advantages of this model in multiple different tasks, including few-shot learning, continual learning, and fault-tolerance learning in neuromorphic vision sensors. It achieves significantly higher performance than single-learning methods. We further implement the model in the Tianjic neuromorphic platform by exploiting algorithm-hardware co-designs and prove that the model can fully utilize neuromorphic many-core architecture to develop hybrid computation paradigm. Nature Publishing Group UK 2022-01-10 /pmc/articles/PMC8748814/ /pubmed/35013198 http://dx.doi.org/10.1038/s41467-021-27653-2 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Wu, Yujie
Zhao, Rong
Zhu, Jun
Chen, Feng
Xu, Mingkun
Li, Guoqi
Song, Sen
Deng, Lei
Wang, Guanrui
Zheng, Hao
Ma, Songchen
Pei, Jing
Zhang, Youhui
Zhao, Mingguo
Shi, Luping
Brain-inspired global-local learning incorporated with neuromorphic computing
title Brain-inspired global-local learning incorporated with neuromorphic computing
title_full Brain-inspired global-local learning incorporated with neuromorphic computing
title_fullStr Brain-inspired global-local learning incorporated with neuromorphic computing
title_full_unstemmed Brain-inspired global-local learning incorporated with neuromorphic computing
title_short Brain-inspired global-local learning incorporated with neuromorphic computing
title_sort brain-inspired global-local learning incorporated with neuromorphic computing
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8748814/
https://www.ncbi.nlm.nih.gov/pubmed/35013198
http://dx.doi.org/10.1038/s41467-021-27653-2
work_keys_str_mv AT wuyujie braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT zhaorong braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT zhujun braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT chenfeng braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT xumingkun braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT liguoqi braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT songsen braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT denglei braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT wangguanrui braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT zhenghao braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT masongchen braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT peijing braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT zhangyouhui braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT zhaomingguo braininspiredgloballocallearningincorporatedwithneuromorphiccomputing
AT shiluping braininspiredgloballocallearningincorporatedwithneuromorphiccomputing