Cargando…

A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition

Realizing multi-modal information recognition tasks which can process external information efficiently and comprehensively is an urgent requirement in the field of artificial intelligence. However, it remains a challenge to achieve simple structure and high-performance multi-modal recognition demons...

Descripción completa

Detalles Bibliográficos
Autores principales: Shan, Liuting, Chen, Qizhen, Yu, Rengjian, Gao, Changsong, Liu, Lujian, Guo, Tailiang, Chen, Huipeng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10167252/
https://www.ncbi.nlm.nih.gov/pubmed/37156788
http://dx.doi.org/10.1038/s41467-023-38396-7
_version_ 1785038622184964096
author Shan, Liuting
Chen, Qizhen
Yu, Rengjian
Gao, Changsong
Liu, Lujian
Guo, Tailiang
Chen, Huipeng
author_facet Shan, Liuting
Chen, Qizhen
Yu, Rengjian
Gao, Changsong
Liu, Lujian
Guo, Tailiang
Chen, Huipeng
author_sort Shan, Liuting
collection PubMed
description Realizing multi-modal information recognition tasks which can process external information efficiently and comprehensively is an urgent requirement in the field of artificial intelligence. However, it remains a challenge to achieve simple structure and high-performance multi-modal recognition demonstrations owing to the complex execution module and separation of memory processing based on the traditional complementary metal oxide semiconductor (CMOS) architecture. Here, we propose an efficient sensory memory processing system (SMPS), which can process sensory information and generate synapse-like and multi-wavelength light-emitting output, realizing diversified utilization of light in information processing and multi-modal information recognition. The SMPS exhibits strong robustness in information encoding/transmission and the capability of visible information display through the multi-level color responses, which can implement the multi-level pain warning process of organisms intuitively. Furthermore, different from the conventional multi-modal information processing system that requires independent and complex circuit modules, the proposed SMPS with unique optical multi-information parallel output can realize efficient multi-modal information recognition of dynamic step frequency and spatial positioning simultaneously with the accuracy of 99.5% and 98.2%, respectively. Therefore, the SMPS proposed in this work with simple component, flexible operation, strong robustness, and highly efficiency is promising for future sensory-neuromorphic photonic systems and interactive artificial intelligence.
format Online
Article
Text
id pubmed-10167252
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-101672522023-05-10 A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition Shan, Liuting Chen, Qizhen Yu, Rengjian Gao, Changsong Liu, Lujian Guo, Tailiang Chen, Huipeng Nat Commun Article Realizing multi-modal information recognition tasks which can process external information efficiently and comprehensively is an urgent requirement in the field of artificial intelligence. However, it remains a challenge to achieve simple structure and high-performance multi-modal recognition demonstrations owing to the complex execution module and separation of memory processing based on the traditional complementary metal oxide semiconductor (CMOS) architecture. Here, we propose an efficient sensory memory processing system (SMPS), which can process sensory information and generate synapse-like and multi-wavelength light-emitting output, realizing diversified utilization of light in information processing and multi-modal information recognition. The SMPS exhibits strong robustness in information encoding/transmission and the capability of visible information display through the multi-level color responses, which can implement the multi-level pain warning process of organisms intuitively. Furthermore, different from the conventional multi-modal information processing system that requires independent and complex circuit modules, the proposed SMPS with unique optical multi-information parallel output can realize efficient multi-modal information recognition of dynamic step frequency and spatial positioning simultaneously with the accuracy of 99.5% and 98.2%, respectively. Therefore, the SMPS proposed in this work with simple component, flexible operation, strong robustness, and highly efficiency is promising for future sensory-neuromorphic photonic systems and interactive artificial intelligence. Nature Publishing Group UK 2023-05-08 /pmc/articles/PMC10167252/ /pubmed/37156788 http://dx.doi.org/10.1038/s41467-023-38396-7 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Shan, Liuting
Chen, Qizhen
Yu, Rengjian
Gao, Changsong
Liu, Lujian
Guo, Tailiang
Chen, Huipeng
A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition
title A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition
title_full A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition
title_fullStr A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition
title_full_unstemmed A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition
title_short A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition
title_sort sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10167252/
https://www.ncbi.nlm.nih.gov/pubmed/37156788
http://dx.doi.org/10.1038/s41467-023-38396-7
work_keys_str_mv AT shanliuting asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition
AT chenqizhen asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition
AT yurengjian asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition
AT gaochangsong asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition
AT liulujian asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition
AT guotailiang asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition
AT chenhuipeng asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition
AT shanliuting sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition
AT chenqizhen sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition
AT yurengjian sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition
AT gaochangsong sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition
AT liulujian sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition
AT guotailiang sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition
AT chenhuipeng sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition