Cargando…
Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception
Compared to human vision, conventional machine vision composed of an image sensor and processor suffers from high latency and large power consumption due to physically separated image sensing and processing. A neuromorphic vision system with brain-inspired visual perception provides a promising solu...
Autores principales: | , , , , , , , , , , , , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Oxford University Press
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8288371/ https://www.ncbi.nlm.nih.gov/pubmed/34691573 http://dx.doi.org/10.1093/nsr/nwaa172 |
_version_ | 1783724074902487040 |
---|---|
author | Wang, Shuang Wang, Chen-Yu Wang, Pengfei Wang, Cong Li, Zhu-An Pan, Chen Dai, Yitong Gao, Anyuan Liu, Chuan Liu, Jian Yang, Huafeng Liu, Xiaowei Cheng, Bin Chen, Kunji Wang, Zhenlin Watanabe, Kenji Taniguchi, Takashi Liang, Shi-Jun Miao, Feng |
author_facet | Wang, Shuang Wang, Chen-Yu Wang, Pengfei Wang, Cong Li, Zhu-An Pan, Chen Dai, Yitong Gao, Anyuan Liu, Chuan Liu, Jian Yang, Huafeng Liu, Xiaowei Cheng, Bin Chen, Kunji Wang, Zhenlin Watanabe, Kenji Taniguchi, Takashi Liang, Shi-Jun Miao, Feng |
author_sort | Wang, Shuang |
collection | PubMed |
description | Compared to human vision, conventional machine vision composed of an image sensor and processor suffers from high latency and large power consumption due to physically separated image sensing and processing. A neuromorphic vision system with brain-inspired visual perception provides a promising solution to the problem. Here we propose and demonstrate a prototype neuromorphic vision system by networking a retinomorphic sensor with a memristive crossbar. We fabricate the retinomorphic sensor by using WSe(2)/h-BN/Al(2)O(3) van der Waals heterostructures with gate-tunable photoresponses, to closely mimic the human retinal capabilities in simultaneously sensing and processing images. We then network the sensor with a large-scale Pt/Ta/HfO(2)/Ta one-transistor-one-resistor (1T1R) memristive crossbar, which plays a similar role to the visual cortex in the human brain. The realized neuromorphic vision system allows for fast letter recognition and object tracking, indicating the capabilities of image sensing, processing and recognition in the full analog regime. Our work suggests that such a neuromorphic vision system may open up unprecedented opportunities in future visual perception applications. |
format | Online Article Text |
id | pubmed-8288371 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Oxford University Press |
record_format | MEDLINE/PubMed |
spelling | pubmed-82883712021-10-21 Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception Wang, Shuang Wang, Chen-Yu Wang, Pengfei Wang, Cong Li, Zhu-An Pan, Chen Dai, Yitong Gao, Anyuan Liu, Chuan Liu, Jian Yang, Huafeng Liu, Xiaowei Cheng, Bin Chen, Kunji Wang, Zhenlin Watanabe, Kenji Taniguchi, Takashi Liang, Shi-Jun Miao, Feng Natl Sci Rev Information Science Compared to human vision, conventional machine vision composed of an image sensor and processor suffers from high latency and large power consumption due to physically separated image sensing and processing. A neuromorphic vision system with brain-inspired visual perception provides a promising solution to the problem. Here we propose and demonstrate a prototype neuromorphic vision system by networking a retinomorphic sensor with a memristive crossbar. We fabricate the retinomorphic sensor by using WSe(2)/h-BN/Al(2)O(3) van der Waals heterostructures with gate-tunable photoresponses, to closely mimic the human retinal capabilities in simultaneously sensing and processing images. We then network the sensor with a large-scale Pt/Ta/HfO(2)/Ta one-transistor-one-resistor (1T1R) memristive crossbar, which plays a similar role to the visual cortex in the human brain. The realized neuromorphic vision system allows for fast letter recognition and object tracking, indicating the capabilities of image sensing, processing and recognition in the full analog regime. Our work suggests that such a neuromorphic vision system may open up unprecedented opportunities in future visual perception applications. Oxford University Press 2020-07-25 /pmc/articles/PMC8288371/ /pubmed/34691573 http://dx.doi.org/10.1093/nsr/nwaa172 Text en © The Author(s) 2020. Published by Oxford University Press on behalf of China Science Publishing & Media Ltd. https://creativecommons.org/licenses/by/4.0/This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ), which permits unrestricted reuse, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Information Science Wang, Shuang Wang, Chen-Yu Wang, Pengfei Wang, Cong Li, Zhu-An Pan, Chen Dai, Yitong Gao, Anyuan Liu, Chuan Liu, Jian Yang, Huafeng Liu, Xiaowei Cheng, Bin Chen, Kunji Wang, Zhenlin Watanabe, Kenji Taniguchi, Takashi Liang, Shi-Jun Miao, Feng Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception |
title | Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception |
title_full | Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception |
title_fullStr | Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception |
title_full_unstemmed | Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception |
title_short | Networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception |
title_sort | networking retinomorphic sensor with memristive crossbar for brain-inspired visual perception |
topic | Information Science |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8288371/ https://www.ncbi.nlm.nih.gov/pubmed/34691573 http://dx.doi.org/10.1093/nsr/nwaa172 |
work_keys_str_mv | AT wangshuang networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT wangchenyu networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT wangpengfei networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT wangcong networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT lizhuan networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT panchen networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT daiyitong networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT gaoanyuan networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT liuchuan networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT liujian networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT yanghuafeng networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT liuxiaowei networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT chengbin networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT chenkunji networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT wangzhenlin networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT watanabekenji networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT taniguchitakashi networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT liangshijun networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception AT miaofeng networkingretinomorphicsensorwithmemristivecrossbarforbraininspiredvisualperception |