Cargando…

Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing

Reservoir computing is a highly efficient network for processing temporal signals due to its low training cost compared to standard recurrent neural networks, and generating rich reservoir states is critical in the hardware implementation. In this work, we report a parallel dynamic memristor-based r...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhong, Yanan, Tang, Jianshi, Li, Xinyi, Gao, Bin, Qian, He, Wu, Huaqiang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7814066/
https://www.ncbi.nlm.nih.gov/pubmed/33462233
http://dx.doi.org/10.1038/s41467-020-20692-1
_version_ 1783637982516871168
author Zhong, Yanan
Tang, Jianshi
Li, Xinyi
Gao, Bin
Qian, He
Wu, Huaqiang
author_facet Zhong, Yanan
Tang, Jianshi
Li, Xinyi
Gao, Bin
Qian, He
Wu, Huaqiang
author_sort Zhong, Yanan
collection PubMed
description Reservoir computing is a highly efficient network for processing temporal signals due to its low training cost compared to standard recurrent neural networks, and generating rich reservoir states is critical in the hardware implementation. In this work, we report a parallel dynamic memristor-based reservoir computing system by applying a controllable mask process, in which the critical parameters, including state richness, feedback strength and input scaling, can be tuned by changing the mask length and the range of input signal. Our system achieves a low word error rate of 0.4% in the spoken-digit recognition and low normalized root mean square error of 0.046 in the time-series prediction of the Hénon map, which outperforms most existing hardware-based reservoir computing systems and also software-based one in the Hénon map prediction task. Our work could pave the road towards high-efficiency memristor-based reservoir computing systems to handle more complex temporal tasks in the future.
format Online
Article
Text
id pubmed-7814066
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-78140662021-01-25 Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing Zhong, Yanan Tang, Jianshi Li, Xinyi Gao, Bin Qian, He Wu, Huaqiang Nat Commun Article Reservoir computing is a highly efficient network for processing temporal signals due to its low training cost compared to standard recurrent neural networks, and generating rich reservoir states is critical in the hardware implementation. In this work, we report a parallel dynamic memristor-based reservoir computing system by applying a controllable mask process, in which the critical parameters, including state richness, feedback strength and input scaling, can be tuned by changing the mask length and the range of input signal. Our system achieves a low word error rate of 0.4% in the spoken-digit recognition and low normalized root mean square error of 0.046 in the time-series prediction of the Hénon map, which outperforms most existing hardware-based reservoir computing systems and also software-based one in the Hénon map prediction task. Our work could pave the road towards high-efficiency memristor-based reservoir computing systems to handle more complex temporal tasks in the future. Nature Publishing Group UK 2021-01-18 /pmc/articles/PMC7814066/ /pubmed/33462233 http://dx.doi.org/10.1038/s41467-020-20692-1 Text en © The Author(s) 2021 Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
spellingShingle Article
Zhong, Yanan
Tang, Jianshi
Li, Xinyi
Gao, Bin
Qian, He
Wu, Huaqiang
Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing
title Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing
title_full Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing
title_fullStr Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing
title_full_unstemmed Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing
title_short Dynamic memristor-based reservoir computing for high-efficiency temporal signal processing
title_sort dynamic memristor-based reservoir computing for high-efficiency temporal signal processing
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7814066/
https://www.ncbi.nlm.nih.gov/pubmed/33462233
http://dx.doi.org/10.1038/s41467-020-20692-1
work_keys_str_mv AT zhongyanan dynamicmemristorbasedreservoircomputingforhighefficiencytemporalsignalprocessing
AT tangjianshi dynamicmemristorbasedreservoircomputingforhighefficiencytemporalsignalprocessing
AT lixinyi dynamicmemristorbasedreservoircomputingforhighefficiencytemporalsignalprocessing
AT gaobin dynamicmemristorbasedreservoircomputingforhighefficiencytemporalsignalprocessing
AT qianhe dynamicmemristorbasedreservoircomputingforhighefficiencytemporalsignalprocessing
AT wuhuaqiang dynamicmemristorbasedreservoircomputingforhighefficiencytemporalsignalprocessing