Cargando…

Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction

Neuro-inspired vision systems hold great promise to address the growing demands of mass data processing for edge computing, a distributed framework that brings computation and data storage closer to the sources of data. In addition to the capability of static image sensing and processing, the hardwa...

Descripción completa

Detalles Bibliográficos
Autores principales: Huang, Pei-Yu, Jiang, Bi-Yi, Chen, Hong-Ji, Xu, Jia-Yi, Wang, Kang, Zhu, Cheng-Yi, Hu, Xin-Yan, Li, Dong, Zhen, Liang, Zhou, Fei-Chi, Qin, Jing-Kai, Xu, Cheng-Yan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10593955/
https://www.ncbi.nlm.nih.gov/pubmed/37872169
http://dx.doi.org/10.1038/s41467-023-42488-9
_version_ 1785124543515328512
author Huang, Pei-Yu
Jiang, Bi-Yi
Chen, Hong-Ji
Xu, Jia-Yi
Wang, Kang
Zhu, Cheng-Yi
Hu, Xin-Yan
Li, Dong
Zhen, Liang
Zhou, Fei-Chi
Qin, Jing-Kai
Xu, Cheng-Yan
author_facet Huang, Pei-Yu
Jiang, Bi-Yi
Chen, Hong-Ji
Xu, Jia-Yi
Wang, Kang
Zhu, Cheng-Yi
Hu, Xin-Yan
Li, Dong
Zhen, Liang
Zhou, Fei-Chi
Qin, Jing-Kai
Xu, Cheng-Yan
author_sort Huang, Pei-Yu
collection PubMed
description Neuro-inspired vision systems hold great promise to address the growing demands of mass data processing for edge computing, a distributed framework that brings computation and data storage closer to the sources of data. In addition to the capability of static image sensing and processing, the hardware implementation of a neuro-inspired vision system also requires the fulfilment of detecting and recognizing moving targets. Here, we demonstrated a neuro-inspired optical sensor based on two-dimensional NbS(2)/MoS(2) hybrid films, which featured remarkable photo-induced conductance plasticity and low electrical energy consumption. A neuro-inspired optical sensor array with 10 × 10 NbS(2)/MoS(2) phototransistors enabled highly integrated functions of sensing, memory, and contrast enhancement capabilities for static images, which benefits convolutional neural network (CNN) with a high image recognition accuracy. More importantly, in-sensor trajectory registration of moving light spots was experimentally implemented such that the post-processing could yield a high restoration accuracy. Our neuro-inspired optical sensor array could provide a fascinating platform for the implementation of high-performance artificial vision systems.
format Online
Article
Text
id pubmed-10593955
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-105939552023-10-25 Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction Huang, Pei-Yu Jiang, Bi-Yi Chen, Hong-Ji Xu, Jia-Yi Wang, Kang Zhu, Cheng-Yi Hu, Xin-Yan Li, Dong Zhen, Liang Zhou, Fei-Chi Qin, Jing-Kai Xu, Cheng-Yan Nat Commun Article Neuro-inspired vision systems hold great promise to address the growing demands of mass data processing for edge computing, a distributed framework that brings computation and data storage closer to the sources of data. In addition to the capability of static image sensing and processing, the hardware implementation of a neuro-inspired vision system also requires the fulfilment of detecting and recognizing moving targets. Here, we demonstrated a neuro-inspired optical sensor based on two-dimensional NbS(2)/MoS(2) hybrid films, which featured remarkable photo-induced conductance plasticity and low electrical energy consumption. A neuro-inspired optical sensor array with 10 × 10 NbS(2)/MoS(2) phototransistors enabled highly integrated functions of sensing, memory, and contrast enhancement capabilities for static images, which benefits convolutional neural network (CNN) with a high image recognition accuracy. More importantly, in-sensor trajectory registration of moving light spots was experimentally implemented such that the post-processing could yield a high restoration accuracy. Our neuro-inspired optical sensor array could provide a fascinating platform for the implementation of high-performance artificial vision systems. Nature Publishing Group UK 2023-10-23 /pmc/articles/PMC10593955/ /pubmed/37872169 http://dx.doi.org/10.1038/s41467-023-42488-9 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Huang, Pei-Yu
Jiang, Bi-Yi
Chen, Hong-Ji
Xu, Jia-Yi
Wang, Kang
Zhu, Cheng-Yi
Hu, Xin-Yan
Li, Dong
Zhen, Liang
Zhou, Fei-Chi
Qin, Jing-Kai
Xu, Cheng-Yan
Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction
title Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction
title_full Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction
title_fullStr Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction
title_full_unstemmed Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction
title_short Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction
title_sort neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10593955/
https://www.ncbi.nlm.nih.gov/pubmed/37872169
http://dx.doi.org/10.1038/s41467-023-42488-9
work_keys_str_mv AT huangpeiyu neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction
AT jiangbiyi neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction
AT chenhongji neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction
AT xujiayi neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction
AT wangkang neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction
AT zhuchengyi neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction
AT huxinyan neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction
AT lidong neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction
AT zhenliang neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction
AT zhoufeichi neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction
AT qinjingkai neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction
AT xuchengyan neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction