Cargando…

Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning

In-sensor multi-task learning is not only the key merit of biological visions but also a primary goal of artificial-general-intelligence. However, traditional silicon-vision-chips suffer from large time/energy overheads. Further, training conventional deep-learning models is neither scalable nor aff...

Descripción completa

Detalles Bibliográficos
Autores principales: Wu, Xiaosong, Wang, Shaocong, Huang, Wei, Dong, Yu, Wang, Zhongrui, Huang, Weiguo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9884246/
https://www.ncbi.nlm.nih.gov/pubmed/36709349
http://dx.doi.org/10.1038/s41467-023-36205-9
_version_ 1784879676894740480
author Wu, Xiaosong
Wang, Shaocong
Huang, Wei
Dong, Yu
Wang, Zhongrui
Huang, Weiguo
author_facet Wu, Xiaosong
Wang, Shaocong
Huang, Wei
Dong, Yu
Wang, Zhongrui
Huang, Weiguo
author_sort Wu, Xiaosong
collection PubMed
description In-sensor multi-task learning is not only the key merit of biological visions but also a primary goal of artificial-general-intelligence. However, traditional silicon-vision-chips suffer from large time/energy overheads. Further, training conventional deep-learning models is neither scalable nor affordable on edge-devices. Here, a material-algorithm co-design is proposed to emulate human retina and the affordable learning paradigm. Relying on a bottle-brush-shaped semiconducting p-NDI with efficient exciton-dissociations and through-space charge-transport characteristics, a wearable transistor-based dynamic in-sensor Reservoir-Computing system manifesting excellent separability, fading memory, and echo state property on different tasks is developed. Paired with a ‘readout function’ on memristive organic diodes, the RC recognizes handwritten letters and numbers, and classifies diverse costumes with accuracies of 98.04%, 88.18%, and 91.76%, respectively (higher than all reported organic semiconductors). In addition to 2D images, the spatiotemporal dynamics of RC naturally extract features of event-based videos, classifying 3 types of hand gestures at an accuracy of 98.62%. Further, the computing cost is significantly lower than that of the conventional artificial-neural-networks. This work provides a promising material-algorithm co-design for affordable and highly efficient photonic neuromorphic systems.
format Online
Article
Text
id pubmed-9884246
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-98842462023-01-30 Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning Wu, Xiaosong Wang, Shaocong Huang, Wei Dong, Yu Wang, Zhongrui Huang, Weiguo Nat Commun Article In-sensor multi-task learning is not only the key merit of biological visions but also a primary goal of artificial-general-intelligence. However, traditional silicon-vision-chips suffer from large time/energy overheads. Further, training conventional deep-learning models is neither scalable nor affordable on edge-devices. Here, a material-algorithm co-design is proposed to emulate human retina and the affordable learning paradigm. Relying on a bottle-brush-shaped semiconducting p-NDI with efficient exciton-dissociations and through-space charge-transport characteristics, a wearable transistor-based dynamic in-sensor Reservoir-Computing system manifesting excellent separability, fading memory, and echo state property on different tasks is developed. Paired with a ‘readout function’ on memristive organic diodes, the RC recognizes handwritten letters and numbers, and classifies diverse costumes with accuracies of 98.04%, 88.18%, and 91.76%, respectively (higher than all reported organic semiconductors). In addition to 2D images, the spatiotemporal dynamics of RC naturally extract features of event-based videos, classifying 3 types of hand gestures at an accuracy of 98.62%. Further, the computing cost is significantly lower than that of the conventional artificial-neural-networks. This work provides a promising material-algorithm co-design for affordable and highly efficient photonic neuromorphic systems. Nature Publishing Group UK 2023-01-28 /pmc/articles/PMC9884246/ /pubmed/36709349 http://dx.doi.org/10.1038/s41467-023-36205-9 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Wu, Xiaosong
Wang, Shaocong
Huang, Wei
Dong, Yu
Wang, Zhongrui
Huang, Weiguo
Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning
title Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning
title_full Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning
title_fullStr Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning
title_full_unstemmed Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning
title_short Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning
title_sort wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9884246/
https://www.ncbi.nlm.nih.gov/pubmed/36709349
http://dx.doi.org/10.1038/s41467-023-36205-9
work_keys_str_mv AT wuxiaosong wearableinsensorreservoircomputingusingoptoelectronicpolymerswiththroughspacechargetransportcharacteristicsformultitasklearning
AT wangshaocong wearableinsensorreservoircomputingusingoptoelectronicpolymerswiththroughspacechargetransportcharacteristicsformultitasklearning
AT huangwei wearableinsensorreservoircomputingusingoptoelectronicpolymerswiththroughspacechargetransportcharacteristicsformultitasklearning
AT dongyu wearableinsensorreservoircomputingusingoptoelectronicpolymerswiththroughspacechargetransportcharacteristicsformultitasklearning
AT wangzhongrui wearableinsensorreservoircomputingusingoptoelectronicpolymerswiththroughspacechargetransportcharacteristicsformultitasklearning
AT huangweiguo wearableinsensorreservoircomputingusingoptoelectronicpolymerswiththroughspacechargetransportcharacteristicsformultitasklearning