Cargando…

Ultralow‐Power Machine Vision with Self‐Powered Sensor Reservoir

A neuromorphic visual system integrating optoelectronic synapses to perform the in‐sensor computing is triggering a revolution due to the reduction of latency and energy consumption. Here it is demonstrated that the dwell time of photon‐generated carriers in the space‐charge region can be effectivel...

Descripción completa

Detalles Bibliográficos
Autores principales: Lao, Jie, Yan, Mengge, Tian, Bobo, Jiang, Chunli, Luo, Chunhua, Xie, Zhuozhuang, Zhu, Qiuxiang, Bao, Zhiqiang, Zhong, Ni, Tang, Xiaodong, Sun, Linfeng, Wu, Guangjian, Wang, Jianlu, Peng, Hui, Chu, Junhao, Duan, Chungang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9130913/
https://www.ncbi.nlm.nih.gov/pubmed/35285175
http://dx.doi.org/10.1002/advs.202106092
_version_ 1784713076411465728
author Lao, Jie
Yan, Mengge
Tian, Bobo
Jiang, Chunli
Luo, Chunhua
Xie, Zhuozhuang
Zhu, Qiuxiang
Bao, Zhiqiang
Zhong, Ni
Tang, Xiaodong
Sun, Linfeng
Wu, Guangjian
Wang, Jianlu
Peng, Hui
Chu, Junhao
Duan, Chungang
author_facet Lao, Jie
Yan, Mengge
Tian, Bobo
Jiang, Chunli
Luo, Chunhua
Xie, Zhuozhuang
Zhu, Qiuxiang
Bao, Zhiqiang
Zhong, Ni
Tang, Xiaodong
Sun, Linfeng
Wu, Guangjian
Wang, Jianlu
Peng, Hui
Chu, Junhao
Duan, Chungang
author_sort Lao, Jie
collection PubMed
description A neuromorphic visual system integrating optoelectronic synapses to perform the in‐sensor computing is triggering a revolution due to the reduction of latency and energy consumption. Here it is demonstrated that the dwell time of photon‐generated carriers in the space‐charge region can be effectively extended by embedding a potential well on the shoulder of Schottky energy barrier. It permits the nonlinear interaction of photocurrents stimulated by spatiotemporal optical signals, which is necessary for in‐sensor reservoir computing (RC). The machine vision with the sensor reservoir constituted by designed self‐powered Au/P(VDF‐TrFE)/Cs(2)AgBiBr(6)/ITO devices is competent for both static and dynamic vision tasks. It shows an accuracy of 99.97% for face classification and 100% for dynamic vehicle flow recognition. The in‐sensor RC system takes advantage of near‐zero energy consumption in the reservoir, resulting in decades‐time lower training costs than a conventional neural network. This work paves the way for ultralow‐power machine vision using photonic devices.
format Online
Article
Text
id pubmed-9130913
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-91309132022-05-26 Ultralow‐Power Machine Vision with Self‐Powered Sensor Reservoir Lao, Jie Yan, Mengge Tian, Bobo Jiang, Chunli Luo, Chunhua Xie, Zhuozhuang Zhu, Qiuxiang Bao, Zhiqiang Zhong, Ni Tang, Xiaodong Sun, Linfeng Wu, Guangjian Wang, Jianlu Peng, Hui Chu, Junhao Duan, Chungang Adv Sci (Weinh) Research Articles A neuromorphic visual system integrating optoelectronic synapses to perform the in‐sensor computing is triggering a revolution due to the reduction of latency and energy consumption. Here it is demonstrated that the dwell time of photon‐generated carriers in the space‐charge region can be effectively extended by embedding a potential well on the shoulder of Schottky energy barrier. It permits the nonlinear interaction of photocurrents stimulated by spatiotemporal optical signals, which is necessary for in‐sensor reservoir computing (RC). The machine vision with the sensor reservoir constituted by designed self‐powered Au/P(VDF‐TrFE)/Cs(2)AgBiBr(6)/ITO devices is competent for both static and dynamic vision tasks. It shows an accuracy of 99.97% for face classification and 100% for dynamic vehicle flow recognition. The in‐sensor RC system takes advantage of near‐zero energy consumption in the reservoir, resulting in decades‐time lower training costs than a conventional neural network. This work paves the way for ultralow‐power machine vision using photonic devices. John Wiley and Sons Inc. 2022-03-13 /pmc/articles/PMC9130913/ /pubmed/35285175 http://dx.doi.org/10.1002/advs.202106092 Text en © 2022 The Authors. Advanced Science published by Wiley‐VCH GmbH https://creativecommons.org/licenses/by/4.0/This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Articles
Lao, Jie
Yan, Mengge
Tian, Bobo
Jiang, Chunli
Luo, Chunhua
Xie, Zhuozhuang
Zhu, Qiuxiang
Bao, Zhiqiang
Zhong, Ni
Tang, Xiaodong
Sun, Linfeng
Wu, Guangjian
Wang, Jianlu
Peng, Hui
Chu, Junhao
Duan, Chungang
Ultralow‐Power Machine Vision with Self‐Powered Sensor Reservoir
title Ultralow‐Power Machine Vision with Self‐Powered Sensor Reservoir
title_full Ultralow‐Power Machine Vision with Self‐Powered Sensor Reservoir
title_fullStr Ultralow‐Power Machine Vision with Self‐Powered Sensor Reservoir
title_full_unstemmed Ultralow‐Power Machine Vision with Self‐Powered Sensor Reservoir
title_short Ultralow‐Power Machine Vision with Self‐Powered Sensor Reservoir
title_sort ultralow‐power machine vision with self‐powered sensor reservoir
topic Research Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9130913/
https://www.ncbi.nlm.nih.gov/pubmed/35285175
http://dx.doi.org/10.1002/advs.202106092
work_keys_str_mv AT laojie ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT yanmengge ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT tianbobo ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT jiangchunli ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT luochunhua ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT xiezhuozhuang ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT zhuqiuxiang ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT baozhiqiang ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT zhongni ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT tangxiaodong ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT sunlinfeng ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT wuguangjian ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT wangjianlu ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT penghui ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT chujunhao ultralowpowermachinevisionwithselfpoweredsensorreservoir
AT duanchungang ultralowpowermachinevisionwithselfpoweredsensorreservoir