Cargando…

Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception

Compared to human vision, conventional machine vision composed of an image sensor and processor suffers from high latency and large power consumption due to physically separated image sensing and processing. A neuromorphic vision system with brain-inspired visual perception provides a promising solu...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Shuang, Wang, Chen-Yu, Wang, Pengfei, Wang, Cong, Li, Zhu-An, Pan, Chen, Dai, Yitong, Gao, Anyuan, Liu, Chuan, Liu, Jian, Yang, Huafeng, Liu, Xiaowei, Cheng, Bin, Chen, Kunji, Wang, Zhenlin, Watanabe, Kenji, Taniguchi, Takashi, Liang, Shi-Jun, Miao, Feng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Oxford University Press 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8288371/
https://www.ncbi.nlm.nih.gov/pubmed/34691573
http://dx.doi.org/10.1093/nsr/nwaa172
_version_ 1783724074902487040
author Wang, Shuang
Wang, Chen-Yu
Wang, Pengfei
Wang, Cong
Li, Zhu-An
Pan, Chen
Dai, Yitong
Gao, Anyuan
Liu, Chuan
Liu, Jian
Yang, Huafeng
Liu, Xiaowei
Cheng, Bin
Chen, Kunji
Wang, Zhenlin
Watanabe, Kenji
Taniguchi, Takashi
Liang, Shi-Jun
Miao, Feng
author_facet Wang, Shuang
Wang, Chen-Yu
Wang, Pengfei
Wang, Cong
Li, Zhu-An
Pan, Chen
Dai, Yitong
Gao, Anyuan
Liu, Chuan
Liu, Jian
Yang, Huafeng
Liu, Xiaowei
Cheng, Bin
Chen, Kunji
Wang, Zhenlin
Watanabe, Kenji
Taniguchi, Takashi
Liang, Shi-Jun
Miao, Feng
author_sort Wang, Shuang
collection PubMed
description Compared to human vision, conventional machine vision composed of an image sensor and processor suffers from high latency and large power consumption due to physically separated image sensing and processing. A neuromorphic vision system with brain-inspired visual perception provides a promising solution to the problem. Here we propose and demonstrate a prototype neuromorphic vision system by networking a retinomorphic sensor with a memristive crossbar. We fabricate the retinomorphic sensor by using WSe(2)/h-BN/Al(2)O(3) van der Waals heterostructures with gate-tunable photoresponses, to closely mimic the human retinal capabilities in simultaneously sensing and processing images. We then network the sensor with a large-scale Pt/Ta/HfO(2)/Ta one-transistor-one-resistor (1T1R) memristive crossbar, which plays a similar role to the visual cortex in the human brain. The realized neuromorphic vision system allows for fast letter recognition and object tracking, indicating the capabilities of image sensing, processing and recognition in the full analog regime. Our work suggests that such a neuromorphic vision system may open up unprecedented opportunities in future visual perception applications.
format Online
Article
Text
id pubmed-8288371
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Oxford University Press
record_format MEDLINE/PubMed
spelling pubmed-82883712021-10-21 Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception Wang, Shuang Wang, Chen-Yu Wang, Pengfei Wang, Cong Li, Zhu-An Pan, Chen Dai, Yitong Gao, Anyuan Liu, Chuan Liu, Jian Yang, Huafeng Liu, Xiaowei Cheng, Bin Chen, Kunji Wang, Zhenlin Watanabe, Kenji Taniguchi, Takashi Liang, Shi-Jun Miao, Feng Natl Sci Rev Information Science Compared to human vision, conventional machine vision composed of an image sensor and processor suffers from high latency and large power consumption due to physically separated image sensing and processing. A neuromorphic vision system with brain-inspired visual perception provides a promising solution to the problem. Here we propose and demonstrate a prototype neuromorphic vision system by networking a retinomorphic sensor with a memristive crossbar. We fabricate the retinomorphic sensor by using WSe(2)/h-BN/Al(2)O(3) van der Waals heterostructures with gate-tunable photoresponses, to closely mimic the human retinal capabilities in simultaneously sensing and processing images. We then network the sensor with a large-scale Pt/Ta/HfO(2)/Ta one-transistor-one-resistor (1T1R) memristive crossbar, which plays a similar role to the visual cortex in the human brain. The realized neuromorphic vision system allows for fast letter recognition and object tracking, indicating the capabilities of image sensing, processing and recognition in the full analog regime. Our work suggests that such a neuromorphic vision system may open up unprecedented opportunities in future visual perception applications. Oxford University Press 2020-07-25 /pmc/articles/PMC8288371/ /pubmed/34691573 http://dx.doi.org/10.1093/nsr/nwaa172 Text en © The Author(s) 2020. Published by Oxford University Press on behalf of China Science Publishing & Media Ltd. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Information Science
Wang, Shuang
Wang, Chen-Yu
Wang, Pengfei
Wang, Cong
Li, Zhu-An
Pan, Chen
Dai, Yitong
Gao, Anyuan
Liu, Chuan
Liu, Jian
Yang, Huafeng
Liu, Xiaowei
Cheng, Bin
Chen, Kunji
Wang, Zhenlin
Watanabe, Kenji
Taniguchi, Takashi
Liang, Shi-Jun
Miao, Feng
Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception
title Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception
title_full Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception
title_fullStr Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception
title_full_unstemmed Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception
title_short Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception
title_sort networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception
topic Information Science
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8288371/
https://www.ncbi.nlm.nih.gov/pubmed/34691573
http://dx.doi.org/10.1093/nsr/nwaa172
work_keys_str_mv AT wangshuang networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT wangchenyu networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT wangpengfei networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT wangcong networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT lizhuan networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT panchen networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT daiyitong networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT gaoanyuan networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT liuchuan networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT liujian networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT yanghuafeng networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT liuxiaowei networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT chengbin networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT chenkunji networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT wangzhenlin networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT watanabekenji networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT taniguchitakashi networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT liangshijun networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception
AT miaofeng networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception