Cargando…

A Transformer-Based Neural Network for Gait Prediction in Lower Limb Exoskeleton Robots Using Plantar Force

Lower limb exoskeleton robots have shown significant research value due to their capabilities of providing assistance to wearers and improving physical motion functions. As a type of robotic technology, wearable robots are directly in contact with the wearer’s limbs during operation, necessitating a...

Descripción completa

Detalles Bibliográficos
Autores principales: Ren, Jiale, Wang, Aihui, Li, Hengyi, Yue, Xuebin, Meng, Lin
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10384092/
https://www.ncbi.nlm.nih.gov/pubmed/37514841
http://dx.doi.org/10.3390/s23146547
_version_ 1785081072351969280
author Ren, Jiale
Wang, Aihui
Li, Hengyi
Yue, Xuebin
Meng, Lin
author_facet Ren, Jiale
Wang, Aihui
Li, Hengyi
Yue, Xuebin
Meng, Lin
author_sort Ren, Jiale
collection PubMed
description Lower limb exoskeleton robots have shown significant research value due to their capabilities of providing assistance to wearers and improving physical motion functions. As a type of robotic technology, wearable robots are directly in contact with the wearer’s limbs during operation, necessitating a high level of human–robot collaboration to ensure safety and efficacy. Furthermore, gait prediction for the wearer, which helps to compensate for sensor delays and provide references for controller design, is crucial for improving the the human–robot collaboration capability. For gait prediction, the plantar force intrinsically reflects crucial gait patterns regardless of individual differences. To be exact, the plantar force encompasses a doubled three-axis force, which varies over time concerning the two feet, which also reflects the gait patterns indistinctly. In this paper, we developed a transformer-based neural network (TFSformer) comprising convolution and variational mode decomposition (VMD) to predict bilateral hip and knee joint angles utilizing the plantar pressure. Given the distinct information contained in the temporal and the force-space dimensions of plantar pressure, the encoder uses 1D convolution to obtain the integrated features in the two dimensions. As for the decoder, it utilizes a multi-channel attention mechanism to simultaneously focus on both dimensions and a deep multi-channel attention structure to reduce the computational and memory consumption. Furthermore, VMD is applied to networks to better distinguish the trends and changes in data. The model is trained and tested on a self-constructed dataset that consists of data from 35 volunteers. The experimental results show that FTSformer reduces the mean absolute error (MAE) up to [Formula: see text] , [Formula: see text] and [Formula: see text] and the mean squared error (MSE) by [Formula: see text] , [Formula: see text] and [Formula: see text] compared to the CNN model, the transformer model and the CNN transformer model, respectively.
format Online
Article
Text
id pubmed-10384092
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-103840922023-07-30 A Transformer-Based Neural Network for Gait Prediction in Lower Limb Exoskeleton Robots Using Plantar Force Ren, Jiale Wang, Aihui Li, Hengyi Yue, Xuebin Meng, Lin Sensors (Basel) Article Lower limb exoskeleton robots have shown significant research value due to their capabilities of providing assistance to wearers and improving physical motion functions. As a type of robotic technology, wearable robots are directly in contact with the wearer’s limbs during operation, necessitating a high level of human–robot collaboration to ensure safety and efficacy. Furthermore, gait prediction for the wearer, which helps to compensate for sensor delays and provide references for controller design, is crucial for improving the the human–robot collaboration capability. For gait prediction, the plantar force intrinsically reflects crucial gait patterns regardless of individual differences. To be exact, the plantar force encompasses a doubled three-axis force, which varies over time concerning the two feet, which also reflects the gait patterns indistinctly. In this paper, we developed a transformer-based neural network (TFSformer) comprising convolution and variational mode decomposition (VMD) to predict bilateral hip and knee joint angles utilizing the plantar pressure. Given the distinct information contained in the temporal and the force-space dimensions of plantar pressure, the encoder uses 1D convolution to obtain the integrated features in the two dimensions. As for the decoder, it utilizes a multi-channel attention mechanism to simultaneously focus on both dimensions and a deep multi-channel attention structure to reduce the computational and memory consumption. Furthermore, VMD is applied to networks to better distinguish the trends and changes in data. The model is trained and tested on a self-constructed dataset that consists of data from 35 volunteers. The experimental results show that FTSformer reduces the mean absolute error (MAE) up to [Formula: see text] , [Formula: see text] and [Formula: see text] and the mean squared error (MSE) by [Formula: see text] , [Formula: see text] and [Formula: see text] compared to the CNN model, the transformer model and the CNN transformer model, respectively. MDPI 2023-07-20 /pmc/articles/PMC10384092/ /pubmed/37514841 http://dx.doi.org/10.3390/s23146547 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Ren, Jiale
Wang, Aihui
Li, Hengyi
Yue, Xuebin
Meng, Lin
A Transformer-Based Neural Network for Gait Prediction in Lower Limb Exoskeleton Robots Using Plantar Force
title A Transformer-Based Neural Network for Gait Prediction in Lower Limb Exoskeleton Robots Using Plantar Force
title_full A Transformer-Based Neural Network for Gait Prediction in Lower Limb Exoskeleton Robots Using Plantar Force
title_fullStr A Transformer-Based Neural Network for Gait Prediction in Lower Limb Exoskeleton Robots Using Plantar Force
title_full_unstemmed A Transformer-Based Neural Network for Gait Prediction in Lower Limb Exoskeleton Robots Using Plantar Force
title_short A Transformer-Based Neural Network for Gait Prediction in Lower Limb Exoskeleton Robots Using Plantar Force
title_sort transformer-based neural network for gait prediction in lower limb exoskeleton robots using plantar force
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10384092/
https://www.ncbi.nlm.nih.gov/pubmed/37514841
http://dx.doi.org/10.3390/s23146547
work_keys_str_mv AT renjiale atransformerbasedneuralnetworkforgaitpredictioninlowerlimbexoskeletonrobotsusingplantarforce
AT wangaihui atransformerbasedneuralnetworkforgaitpredictioninlowerlimbexoskeletonrobotsusingplantarforce
AT lihengyi atransformerbasedneuralnetworkforgaitpredictioninlowerlimbexoskeletonrobotsusingplantarforce
AT yuexuebin atransformerbasedneuralnetworkforgaitpredictioninlowerlimbexoskeletonrobotsusingplantarforce
AT menglin atransformerbasedneuralnetworkforgaitpredictioninlowerlimbexoskeletonrobotsusingplantarforce
AT renjiale transformerbasedneuralnetworkforgaitpredictioninlowerlimbexoskeletonrobotsusingplantarforce
AT wangaihui transformerbasedneuralnetworkforgaitpredictioninlowerlimbexoskeletonrobotsusingplantarforce
AT lihengyi transformerbasedneuralnetworkforgaitpredictioninlowerlimbexoskeletonrobotsusingplantarforce
AT yuexuebin transformerbasedneuralnetworkforgaitpredictioninlowerlimbexoskeletonrobotsusingplantarforce
AT menglin transformerbasedneuralnetworkforgaitpredictioninlowerlimbexoskeletonrobotsusingplantarforce