Cargando…

LST-EMG-Net: Long short-term transformer feature fusion network for sEMG gesture recognition

With the development of signal analysis technology and artificial intelligence, surface electromyography (sEMG) signal gesture recognition is widely used in rehabilitation therapy, human-computer interaction, and other fields. Deep learning has gradually become the mainstream technology for gesture...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhang, Wenli, Zhao, Tingsong, Zhang, Jianyi, Wang, Yufei
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10011454/
https://www.ncbi.nlm.nih.gov/pubmed/36925629
http://dx.doi.org/10.3389/fnbot.2023.1127338
_version_ 1784906396840493056
author Zhang, Wenli
Zhao, Tingsong
Zhang, Jianyi
Wang, Yufei
author_facet Zhang, Wenli
Zhao, Tingsong
Zhang, Jianyi
Wang, Yufei
author_sort Zhang, Wenli
collection PubMed
description With the development of signal analysis technology and artificial intelligence, surface electromyography (sEMG) signal gesture recognition is widely used in rehabilitation therapy, human-computer interaction, and other fields. Deep learning has gradually become the mainstream technology for gesture recognition. It is necessary to consider the characteristics of the surface EMG signal when constructing the deep learning model. The surface electromyography signal is an information carrier that can reflect neuromuscular activity. Under the same circumstances, a longer signal segment contains more information about muscle activity, and a shorter segment contains less information about muscle activity. Thus, signals with longer segments are suitable for recognizing gestures that mobilize complex muscle activity, and signals with shorter segments are suitable for recognizing gestures that mobilize simple muscle activity. However, current deep learning models usually extract features from single-length signal segments. This can easily cause a mismatch between the amount of information in the features and the information needed to recognize gestures, which is not conducive to improving the accuracy and stability of recognition. Therefore, in this article, we develop a long short-term transformer feature fusion network (referred to as LST-EMG-Net) that considers the differences in the timing lengths of EMG segments required for the recognition of different gestures. LST-EMG-Net imports multichannel sEMG datasets into a long short-term encoder. The encoder extracts the sEMG signals’ long short-term features. Finally, we successfully fuse the features using a feature cross-attention module and output the gesture category. We evaluated LST-EMG-Net on multiple datasets based on sparse channels and high density. It reached 81.47, 88.24, and 98.95% accuracy on Ninapro DB2E2, DB5E3 partial gesture, and CapgMyo DB-c, respectively. Following the experiment, we demonstrated that LST-EMG-Net could increase the accuracy and stability of various gesture identification and recognition tasks better than existing networks.
format Online
Article
Text
id pubmed-10011454
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-100114542023-03-15 LST-EMG-Net: Long short-term transformer feature fusion network for sEMG gesture recognition Zhang, Wenli Zhao, Tingsong Zhang, Jianyi Wang, Yufei Front Neurorobot Neuroscience With the development of signal analysis technology and artificial intelligence, surface electromyography (sEMG) signal gesture recognition is widely used in rehabilitation therapy, human-computer interaction, and other fields. Deep learning has gradually become the mainstream technology for gesture recognition. It is necessary to consider the characteristics of the surface EMG signal when constructing the deep learning model. The surface electromyography signal is an information carrier that can reflect neuromuscular activity. Under the same circumstances, a longer signal segment contains more information about muscle activity, and a shorter segment contains less information about muscle activity. Thus, signals with longer segments are suitable for recognizing gestures that mobilize complex muscle activity, and signals with shorter segments are suitable for recognizing gestures that mobilize simple muscle activity. However, current deep learning models usually extract features from single-length signal segments. This can easily cause a mismatch between the amount of information in the features and the information needed to recognize gestures, which is not conducive to improving the accuracy and stability of recognition. Therefore, in this article, we develop a long short-term transformer feature fusion network (referred to as LST-EMG-Net) that considers the differences in the timing lengths of EMG segments required for the recognition of different gestures. LST-EMG-Net imports multichannel sEMG datasets into a long short-term encoder. The encoder extracts the sEMG signals’ long short-term features. Finally, we successfully fuse the features using a feature cross-attention module and output the gesture category. We evaluated LST-EMG-Net on multiple datasets based on sparse channels and high density. It reached 81.47, 88.24, and 98.95% accuracy on Ninapro DB2E2, DB5E3 partial gesture, and CapgMyo DB-c, respectively. Following the experiment, we demonstrated that LST-EMG-Net could increase the accuracy and stability of various gesture identification and recognition tasks better than existing networks. Frontiers Media S.A. 2023-02-28 /pmc/articles/PMC10011454/ /pubmed/36925629 http://dx.doi.org/10.3389/fnbot.2023.1127338 Text en Copyright © 2023 Zhang, Zhao, Zhang and Wang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Zhang, Wenli
Zhao, Tingsong
Zhang, Jianyi
Wang, Yufei
LST-EMG-Net: Long short-term transformer feature fusion network for sEMG gesture recognition
title LST-EMG-Net: Long short-term transformer feature fusion network for sEMG gesture recognition
title_full LST-EMG-Net: Long short-term transformer feature fusion network for sEMG gesture recognition
title_fullStr LST-EMG-Net: Long short-term transformer feature fusion network for sEMG gesture recognition
title_full_unstemmed LST-EMG-Net: Long short-term transformer feature fusion network for sEMG gesture recognition
title_short LST-EMG-Net: Long short-term transformer feature fusion network for sEMG gesture recognition
title_sort lst-emg-net: long short-term transformer feature fusion network for semg gesture recognition
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10011454/
https://www.ncbi.nlm.nih.gov/pubmed/36925629
http://dx.doi.org/10.3389/fnbot.2023.1127338
work_keys_str_mv AT zhangwenli lstemgnetlongshorttermtransformerfeaturefusionnetworkforsemggesturerecognition
AT zhaotingsong lstemgnetlongshorttermtransformerfeaturefusionnetworkforsemggesturerecognition
AT zhangjianyi lstemgnetlongshorttermtransformerfeaturefusionnetworkforsemggesturerecognition
AT wangyufei lstemgnetlongshorttermtransformerfeaturefusionnetworkforsemggesturerecognition