Cargando…
Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning
In-sensor multi-task learning is not only the key merit of biological visions but also a primary goal of artificial-general-intelligence. However, traditional silicon-vision-chips suffer from large time/energy overheads. Further, training conventional deep-learning models is neither scalable nor aff...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9884246/ https://www.ncbi.nlm.nih.gov/pubmed/36709349 http://dx.doi.org/10.1038/s41467-023-36205-9 |
_version_ | 1784879676894740480 |
---|---|
author | Wu, Xiaosong Wang, Shaocong Huang, Wei Dong, Yu Wang, Zhongrui Huang, Weiguo |
author_facet | Wu, Xiaosong Wang, Shaocong Huang, Wei Dong, Yu Wang, Zhongrui Huang, Weiguo |
author_sort | Wu, Xiaosong |
collection | PubMed |
description | In-sensor multi-task learning is not only the key merit of biological visions but also a primary goal of artificial-general-intelligence. However, traditional silicon-vision-chips suffer from large time/energy overheads. Further, training conventional deep-learning models is neither scalable nor affordable on edge-devices. Here, a material-algorithm co-design is proposed to emulate human retina and the affordable learning paradigm. Relying on a bottle-brush-shaped semiconducting p-NDI with efficient exciton-dissociations and through-space charge-transport characteristics, a wearable transistor-based dynamic in-sensor Reservoir-Computing system manifesting excellent separability, fading memory, and echo state property on different tasks is developed. Paired with a ‘readout function’ on memristive organic diodes, the RC recognizes handwritten letters and numbers, and classifies diverse costumes with accuracies of 98.04%, 88.18%, and 91.76%, respectively (higher than all reported organic semiconductors). In addition to 2D images, the spatiotemporal dynamics of RC naturally extract features of event-based videos, classifying 3 types of hand gestures at an accuracy of 98.62%. Further, the computing cost is significantly lower than that of the conventional artificial-neural-networks. This work provides a promising material-algorithm co-design for affordable and highly efficient photonic neuromorphic systems. |
format | Online Article Text |
id | pubmed-9884246 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-98842462023-01-30 Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning Wu, Xiaosong Wang, Shaocong Huang, Wei Dong, Yu Wang, Zhongrui Huang, Weiguo Nat Commun Article In-sensor multi-task learning is not only the key merit of biological visions but also a primary goal of artificial-general-intelligence. However, traditional silicon-vision-chips suffer from large time/energy overheads. Further, training conventional deep-learning models is neither scalable nor affordable on edge-devices. Here, a material-algorithm co-design is proposed to emulate human retina and the affordable learning paradigm. Relying on a bottle-brush-shaped semiconducting p-NDI with efficient exciton-dissociations and through-space charge-transport characteristics, a wearable transistor-based dynamic in-sensor Reservoir-Computing system manifesting excellent separability, fading memory, and echo state property on different tasks is developed. Paired with a ‘readout function’ on memristive organic diodes, the RC recognizes handwritten letters and numbers, and classifies diverse costumes with accuracies of 98.04%, 88.18%, and 91.76%, respectively (higher than all reported organic semiconductors). In addition to 2D images, the spatiotemporal dynamics of RC naturally extract features of event-based videos, classifying 3 types of hand gestures at an accuracy of 98.62%. Further, the computing cost is significantly lower than that of the conventional artificial-neural-networks. This work provides a promising material-algorithm co-design for affordable and highly efficient photonic neuromorphic systems. Nature Publishing Group UK 2023-01-28 /pmc/articles/PMC9884246/ /pubmed/36709349 http://dx.doi.org/10.1038/s41467-023-36205-9 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Wu, Xiaosong Wang, Shaocong Huang, Wei Dong, Yu Wang, Zhongrui Huang, Weiguo Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning |
title | Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning |
title_full | Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning |
title_fullStr | Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning |
title_full_unstemmed | Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning |
title_short | Wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning |
title_sort | wearable in-sensor reservoir computing using optoelectronic polymers with through-space charge-transport characteristics for multi-task learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9884246/ https://www.ncbi.nlm.nih.gov/pubmed/36709349 http://dx.doi.org/10.1038/s41467-023-36205-9 |
work_keys_str_mv | AT wuxiaosong wearableinsensorreservoircomputingusingoptoelectronicpolymerswiththroughspacechargetransportcharacteristicsformultitasklearning AT wangshaocong wearableinsensorreservoircomputingusingoptoelectronicpolymerswiththroughspacechargetransportcharacteristicsformultitasklearning AT huangwei wearableinsensorreservoircomputingusingoptoelectronicpolymerswiththroughspacechargetransportcharacteristicsformultitasklearning AT dongyu wearableinsensorreservoircomputingusingoptoelectronicpolymerswiththroughspacechargetransportcharacteristicsformultitasklearning AT wangzhongrui wearableinsensorreservoircomputingusingoptoelectronicpolymerswiththroughspacechargetransportcharacteristicsformultitasklearning AT huangweiguo wearableinsensorreservoircomputingusingoptoelectronicpolymerswiththroughspacechargetransportcharacteristicsformultitasklearning |