Cargando…

Deep Learning-Based Approaches for Decoding Motor Intent From Peripheral Nerve Signals

Previous literature shows that deep learning is an effective tool to decode the motor intent from neural signals obtained from different parts of the nervous system. However, deep neural networks are often computationally complex and not feasible to work in real-time. Here we investigate different a...

Descripción completa

Detalles Bibliográficos
Autores principales: Luu, Diu K., Nguyen, Anh T., Jiang, Ming, Xu, Jian, Drealan, Markus W., Cheng, Jonathan, Keefer, Edward W., Zhao, Qi, Yang, Zhi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8260935/
https://www.ncbi.nlm.nih.gov/pubmed/34248481
http://dx.doi.org/10.3389/fnins.2021.667907
_version_ 1783718906379108352
author Luu, Diu K.
Nguyen, Anh T.
Jiang, Ming
Xu, Jian
Drealan, Markus W.
Cheng, Jonathan
Keefer, Edward W.
Zhao, Qi
Yang, Zhi
author_facet Luu, Diu K.
Nguyen, Anh T.
Jiang, Ming
Xu, Jian
Drealan, Markus W.
Cheng, Jonathan
Keefer, Edward W.
Zhao, Qi
Yang, Zhi
author_sort Luu, Diu K.
collection PubMed
description Previous literature shows that deep learning is an effective tool to decode the motor intent from neural signals obtained from different parts of the nervous system. However, deep neural networks are often computationally complex and not feasible to work in real-time. Here we investigate different approaches' advantages and disadvantages to enhance the deep learning-based motor decoding paradigm's efficiency and inform its future implementation in real-time. Our data are recorded from the amputee's residual peripheral nerves. While the primary analysis is offline, the nerve data is cut using a sliding window to create a “pseudo-online” dataset that resembles the conditions in a real-time paradigm. First, a comprehensive collection of feature extraction techniques is applied to reduce the input data dimensionality, which later helps substantially lower the motor decoder's complexity, making it feasible for translation to a real-time paradigm. Next, we investigate two different strategies for deploying deep learning models: a one-step (1S) approach when big input data are available and a two-step (2S) when input data are limited. This research predicts five individual finger movements and four combinations of the fingers. The 1S approach using a recurrent neural network (RNN) to concurrently predict all fingers' trajectories generally gives better prediction results than all the machine learning algorithms that do the same task. This result reaffirms that deep learning is more advantageous than classic machine learning methods for handling a large dataset. However, when training on a smaller input data set in the 2S approach, which includes a classification stage to identify active fingers before predicting their trajectories, machine learning techniques offer a simpler implementation while ensuring comparably good decoding outcomes to the deep learning ones. In the classification step, either machine learning or deep learning models achieve the accuracy and F1 score of 0.99. Thanks to the classification step, in the regression step, both types of models result in a comparable mean squared error (MSE) and variance accounted for (VAF) scores as those of the 1S approach. Our study outlines the trade-offs to inform the future implementation of real-time, low-latency, and high accuracy deep learning-based motor decoder for clinical applications.
format Online
Article
Text
id pubmed-8260935
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-82609352021-07-08 Deep Learning-Based Approaches for Decoding Motor Intent From Peripheral Nerve Signals Luu, Diu K. Nguyen, Anh T. Jiang, Ming Xu, Jian Drealan, Markus W. Cheng, Jonathan Keefer, Edward W. Zhao, Qi Yang, Zhi Front Neurosci Neuroscience Previous literature shows that deep learning is an effective tool to decode the motor intent from neural signals obtained from different parts of the nervous system. However, deep neural networks are often computationally complex and not feasible to work in real-time. Here we investigate different approaches' advantages and disadvantages to enhance the deep learning-based motor decoding paradigm's efficiency and inform its future implementation in real-time. Our data are recorded from the amputee's residual peripheral nerves. While the primary analysis is offline, the nerve data is cut using a sliding window to create a “pseudo-online” dataset that resembles the conditions in a real-time paradigm. First, a comprehensive collection of feature extraction techniques is applied to reduce the input data dimensionality, which later helps substantially lower the motor decoder's complexity, making it feasible for translation to a real-time paradigm. Next, we investigate two different strategies for deploying deep learning models: a one-step (1S) approach when big input data are available and a two-step (2S) when input data are limited. This research predicts five individual finger movements and four combinations of the fingers. The 1S approach using a recurrent neural network (RNN) to concurrently predict all fingers' trajectories generally gives better prediction results than all the machine learning algorithms that do the same task. This result reaffirms that deep learning is more advantageous than classic machine learning methods for handling a large dataset. However, when training on a smaller input data set in the 2S approach, which includes a classification stage to identify active fingers before predicting their trajectories, machine learning techniques offer a simpler implementation while ensuring comparably good decoding outcomes to the deep learning ones. In the classification step, either machine learning or deep learning models achieve the accuracy and F1 score of 0.99. Thanks to the classification step, in the regression step, both types of models result in a comparable mean squared error (MSE) and variance accounted for (VAF) scores as those of the 1S approach. Our study outlines the trade-offs to inform the future implementation of real-time, low-latency, and high accuracy deep learning-based motor decoder for clinical applications. Frontiers Media S.A. 2021-06-23 /pmc/articles/PMC8260935/ /pubmed/34248481 http://dx.doi.org/10.3389/fnins.2021.667907 Text en Copyright © 2021 Luu, Nguyen, Jiang, Xu, Drealan, Cheng, Keefer, Zhao and Yang. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Luu, Diu K.
Nguyen, Anh T.
Jiang, Ming
Xu, Jian
Drealan, Markus W.
Cheng, Jonathan
Keefer, Edward W.
Zhao, Qi
Yang, Zhi
Deep Learning-Based Approaches for Decoding Motor Intent From Peripheral Nerve Signals
title Deep Learning-Based Approaches for Decoding Motor Intent From Peripheral Nerve Signals
title_full Deep Learning-Based Approaches for Decoding Motor Intent From Peripheral Nerve Signals
title_fullStr Deep Learning-Based Approaches for Decoding Motor Intent From Peripheral Nerve Signals
title_full_unstemmed Deep Learning-Based Approaches for Decoding Motor Intent From Peripheral Nerve Signals
title_short Deep Learning-Based Approaches for Decoding Motor Intent From Peripheral Nerve Signals
title_sort deep learning-based approaches for decoding motor intent from peripheral nerve signals
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8260935/
https://www.ncbi.nlm.nih.gov/pubmed/34248481
http://dx.doi.org/10.3389/fnins.2021.667907
work_keys_str_mv AT luudiuk deeplearningbasedapproachesfordecodingmotorintentfromperipheralnervesignals
AT nguyenanht deeplearningbasedapproachesfordecodingmotorintentfromperipheralnervesignals
AT jiangming deeplearningbasedapproachesfordecodingmotorintentfromperipheralnervesignals
AT xujian deeplearningbasedapproachesfordecodingmotorintentfromperipheralnervesignals
AT drealanmarkusw deeplearningbasedapproachesfordecodingmotorintentfromperipheralnervesignals
AT chengjonathan deeplearningbasedapproachesfordecodingmotorintentfromperipheralnervesignals
AT keeferedwardw deeplearningbasedapproachesfordecodingmotorintentfromperipheralnervesignals
AT zhaoqi deeplearningbasedapproachesfordecodingmotorintentfromperipheralnervesignals
AT yangzhi deeplearningbasedapproachesfordecodingmotorintentfromperipheralnervesignals