Cargando…
Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction
Neuro-inspired vision systems hold great promise to address the growing demands of mass data processing for edge computing, a distributed framework that brings computation and data storage closer to the sources of data. In addition to the capability of static image sensing and processing, the hardwa...
Autores principales: | , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10593955/ https://www.ncbi.nlm.nih.gov/pubmed/37872169 http://dx.doi.org/10.1038/s41467-023-42488-9 |
_version_ | 1785124543515328512 |
---|---|
author | Huang, Pei-Yu Jiang, Bi-Yi Chen, Hong-Ji Xu, Jia-Yi Wang, Kang Zhu, Cheng-Yi Hu, Xin-Yan Li, Dong Zhen, Liang Zhou, Fei-Chi Qin, Jing-Kai Xu, Cheng-Yan |
author_facet | Huang, Pei-Yu Jiang, Bi-Yi Chen, Hong-Ji Xu, Jia-Yi Wang, Kang Zhu, Cheng-Yi Hu, Xin-Yan Li, Dong Zhen, Liang Zhou, Fei-Chi Qin, Jing-Kai Xu, Cheng-Yan |
author_sort | Huang, Pei-Yu |
collection | PubMed |
description | Neuro-inspired vision systems hold great promise to address the growing demands of mass data processing for edge computing, a distributed framework that brings computation and data storage closer to the sources of data. In addition to the capability of static image sensing and processing, the hardware implementation of a neuro-inspired vision system also requires the fulfilment of detecting and recognizing moving targets. Here, we demonstrated a neuro-inspired optical sensor based on two-dimensional NbS(2)/MoS(2) hybrid films, which featured remarkable photo-induced conductance plasticity and low electrical energy consumption. A neuro-inspired optical sensor array with 10 × 10 NbS(2)/MoS(2) phototransistors enabled highly integrated functions of sensing, memory, and contrast enhancement capabilities for static images, which benefits convolutional neural network (CNN) with a high image recognition accuracy. More importantly, in-sensor trajectory registration of moving light spots was experimentally implemented such that the post-processing could yield a high restoration accuracy. Our neuro-inspired optical sensor array could provide a fascinating platform for the implementation of high-performance artificial vision systems. |
format | Online Article Text |
id | pubmed-10593955 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-105939552023-10-25 Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction Huang, Pei-Yu Jiang, Bi-Yi Chen, Hong-Ji Xu, Jia-Yi Wang, Kang Zhu, Cheng-Yi Hu, Xin-Yan Li, Dong Zhen, Liang Zhou, Fei-Chi Qin, Jing-Kai Xu, Cheng-Yan Nat Commun Article Neuro-inspired vision systems hold great promise to address the growing demands of mass data processing for edge computing, a distributed framework that brings computation and data storage closer to the sources of data. In addition to the capability of static image sensing and processing, the hardware implementation of a neuro-inspired vision system also requires the fulfilment of detecting and recognizing moving targets. Here, we demonstrated a neuro-inspired optical sensor based on two-dimensional NbS(2)/MoS(2) hybrid films, which featured remarkable photo-induced conductance plasticity and low electrical energy consumption. A neuro-inspired optical sensor array with 10 × 10 NbS(2)/MoS(2) phototransistors enabled highly integrated functions of sensing, memory, and contrast enhancement capabilities for static images, which benefits convolutional neural network (CNN) with a high image recognition accuracy. More importantly, in-sensor trajectory registration of moving light spots was experimentally implemented such that the post-processing could yield a high restoration accuracy. Our neuro-inspired optical sensor array could provide a fascinating platform for the implementation of high-performance artificial vision systems. Nature Publishing Group UK 2023-10-23 /pmc/articles/PMC10593955/ /pubmed/37872169 http://dx.doi.org/10.1038/s41467-023-42488-9 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Huang, Pei-Yu Jiang, Bi-Yi Chen, Hong-Ji Xu, Jia-Yi Wang, Kang Zhu, Cheng-Yi Hu, Xin-Yan Li, Dong Zhen, Liang Zhou, Fei-Chi Qin, Jing-Kai Xu, Cheng-Yan Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction |
title | Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction |
title_full | Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction |
title_fullStr | Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction |
title_full_unstemmed | Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction |
title_short | Neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction |
title_sort | neuro-inspired optical sensor array for high-accuracy static image recognition and dynamic trace extraction |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10593955/ https://www.ncbi.nlm.nih.gov/pubmed/37872169 http://dx.doi.org/10.1038/s41467-023-42488-9 |
work_keys_str_mv | AT huangpeiyu neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction AT jiangbiyi neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction AT chenhongji neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction AT xujiayi neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction AT wangkang neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction AT zhuchengyi neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction AT huxinyan neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction AT lidong neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction AT zhenliang neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction AT zhoufeichi neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction AT qinjingkai neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction AT xuchengyan neuroinspiredopticalsensorarrayforhighaccuracystaticimagerecognitionanddynamictraceextraction |