Cargando…
A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition
Realizing multi-modal information recognition tasks which can process external information efficiently and comprehensively is an urgent requirement in the field of artificial intelligence. However, it remains a challenge to achieve simple structure and high-performance multi-modal recognition demons...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10167252/ https://www.ncbi.nlm.nih.gov/pubmed/37156788 http://dx.doi.org/10.1038/s41467-023-38396-7 |
_version_ | 1785038622184964096 |
---|---|
author | Shan, Liuting Chen, Qizhen Yu, Rengjian Gao, Changsong Liu, Lujian Guo, Tailiang Chen, Huipeng |
author_facet | Shan, Liuting Chen, Qizhen Yu, Rengjian Gao, Changsong Liu, Lujian Guo, Tailiang Chen, Huipeng |
author_sort | Shan, Liuting |
collection | PubMed |
description | Realizing multi-modal information recognition tasks which can process external information efficiently and comprehensively is an urgent requirement in the field of artificial intelligence. However, it remains a challenge to achieve simple structure and high-performance multi-modal recognition demonstrations owing to the complex execution module and separation of memory processing based on the traditional complementary metal oxide semiconductor (CMOS) architecture. Here, we propose an efficient sensory memory processing system (SMPS), which can process sensory information and generate synapse-like and multi-wavelength light-emitting output, realizing diversified utilization of light in information processing and multi-modal information recognition. The SMPS exhibits strong robustness in information encoding/transmission and the capability of visible information display through the multi-level color responses, which can implement the multi-level pain warning process of organisms intuitively. Furthermore, different from the conventional multi-modal information processing system that requires independent and complex circuit modules, the proposed SMPS with unique optical multi-information parallel output can realize efficient multi-modal information recognition of dynamic step frequency and spatial positioning simultaneously with the accuracy of 99.5% and 98.2%, respectively. Therefore, the SMPS proposed in this work with simple component, flexible operation, strong robustness, and highly efficiency is promising for future sensory-neuromorphic photonic systems and interactive artificial intelligence. |
format | Online Article Text |
id | pubmed-10167252 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-101672522023-05-10 A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition Shan, Liuting Chen, Qizhen Yu, Rengjian Gao, Changsong Liu, Lujian Guo, Tailiang Chen, Huipeng Nat Commun Article Realizing multi-modal information recognition tasks which can process external information efficiently and comprehensively is an urgent requirement in the field of artificial intelligence. However, it remains a challenge to achieve simple structure and high-performance multi-modal recognition demonstrations owing to the complex execution module and separation of memory processing based on the traditional complementary metal oxide semiconductor (CMOS) architecture. Here, we propose an efficient sensory memory processing system (SMPS), which can process sensory information and generate synapse-like and multi-wavelength light-emitting output, realizing diversified utilization of light in information processing and multi-modal information recognition. The SMPS exhibits strong robustness in information encoding/transmission and the capability of visible information display through the multi-level color responses, which can implement the multi-level pain warning process of organisms intuitively. Furthermore, different from the conventional multi-modal information processing system that requires independent and complex circuit modules, the proposed SMPS with unique optical multi-information parallel output can realize efficient multi-modal information recognition of dynamic step frequency and spatial positioning simultaneously with the accuracy of 99.5% and 98.2%, respectively. Therefore, the SMPS proposed in this work with simple component, flexible operation, strong robustness, and highly efficiency is promising for future sensory-neuromorphic photonic systems and interactive artificial intelligence. Nature Publishing Group UK 2023-05-08 /pmc/articles/PMC10167252/ /pubmed/37156788 http://dx.doi.org/10.1038/s41467-023-38396-7 Text en © The Author(s) 2023 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Shan, Liuting Chen, Qizhen Yu, Rengjian Gao, Changsong Liu, Lujian Guo, Tailiang Chen, Huipeng A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition |
title | A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition |
title_full | A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition |
title_fullStr | A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition |
title_full_unstemmed | A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition |
title_short | A sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition |
title_sort | sensory memory processing system with multi-wavelength synaptic-polychromatic light emission for multi-modal information recognition |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10167252/ https://www.ncbi.nlm.nih.gov/pubmed/37156788 http://dx.doi.org/10.1038/s41467-023-38396-7 |
work_keys_str_mv | AT shanliuting asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition AT chenqizhen asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition AT yurengjian asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition AT gaochangsong asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition AT liulujian asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition AT guotailiang asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition AT chenhuipeng asensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition AT shanliuting sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition AT chenqizhen sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition AT yurengjian sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition AT gaochangsong sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition AT liulujian sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition AT guotailiang sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition AT chenhuipeng sensorymemoryprocessingsystemwithmultiwavelengthsynapticpolychromaticlightemissionformultimodalinformationrecognition |