Cargando…
Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking
INTRODUCTION: Brain-machine interfaces (BMIs) attempt to establish communication between the user and the device to be controlled. BMIs have great challenges to face in order to design a robust control in the real field of application. The artifacts, high volume of training data, and non-stationarit...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10043233/ https://www.ncbi.nlm.nih.gov/pubmed/36998726 http://dx.doi.org/10.3389/fnins.2023.1154480 |
_version_ | 1784913099686412288 |
---|---|
author | Quiles, Vicente Ferrero, Laura Iáñez, Eduardo Ortiz, Mario Gil-Agudo, Ángel Azorín, José M. |
author_facet | Quiles, Vicente Ferrero, Laura Iáñez, Eduardo Ortiz, Mario Gil-Agudo, Ángel Azorín, José M. |
author_sort | Quiles, Vicente |
collection | PubMed |
description | INTRODUCTION: Brain-machine interfaces (BMIs) attempt to establish communication between the user and the device to be controlled. BMIs have great challenges to face in order to design a robust control in the real field of application. The artifacts, high volume of training data, and non-stationarity of the signal of EEG-based interfaces are challenges that classical processing techniques do not solve, showing certain shortcomings in the real-time domain. Recent advances in deep-learning techniques open a window of opportunity to solve some of these problems. In this work, an interface able to detect the evoked potential that occurs when a person intends to stop due to the appearance of an unexpected obstacle has been developed. MATERIAL AND METHODS: First, the interface was tested on a treadmill with five subjects, in which the user stopped when an obstacle appeared (simulated by a laser). The analysis is based on two consecutive convolutional networks: the first one to discern the intention to stop against normal walking and the second one to correct false detections of the previous one. RESULTS AND DISCUSSION: The results were superior when using the methodology of the two consecutive networks vs. only the first one in a cross-validation pseudo-online analysis. The false positives per min (FP/min) decreased from 31.8 to 3.9 FP/min and the number of repetitions in which there were no false positives and true positives (TP) improved from 34.9% to 60.3% NOFP/TP. This methodology was tested in a closed-loop experiment with an exoskeleton, in which the brain-machine interface (BMI) detected an obstacle and sent the command to the exoskeleton to stop. This methodology was tested with three healthy subjects, and the online results were 3.8 FP/min and 49.3% NOFP/TP. To make this model feasible for non-able bodied patients with a reduced and manageable time frame, transfer-learning techniques were applied and validated in the previous tests, and were then applied to patients. The results for two incomplete Spinal Cord Injury (iSCI) patients were 37.9% NOFP/TP and 7.7 FP/min. |
format | Online Article Text |
id | pubmed-10043233 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-100432332023-03-29 Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking Quiles, Vicente Ferrero, Laura Iáñez, Eduardo Ortiz, Mario Gil-Agudo, Ángel Azorín, José M. Front Neurosci Neuroscience INTRODUCTION: Brain-machine interfaces (BMIs) attempt to establish communication between the user and the device to be controlled. BMIs have great challenges to face in order to design a robust control in the real field of application. The artifacts, high volume of training data, and non-stationarity of the signal of EEG-based interfaces are challenges that classical processing techniques do not solve, showing certain shortcomings in the real-time domain. Recent advances in deep-learning techniques open a window of opportunity to solve some of these problems. In this work, an interface able to detect the evoked potential that occurs when a person intends to stop due to the appearance of an unexpected obstacle has been developed. MATERIAL AND METHODS: First, the interface was tested on a treadmill with five subjects, in which the user stopped when an obstacle appeared (simulated by a laser). The analysis is based on two consecutive convolutional networks: the first one to discern the intention to stop against normal walking and the second one to correct false detections of the previous one. RESULTS AND DISCUSSION: The results were superior when using the methodology of the two consecutive networks vs. only the first one in a cross-validation pseudo-online analysis. The false positives per min (FP/min) decreased from 31.8 to 3.9 FP/min and the number of repetitions in which there were no false positives and true positives (TP) improved from 34.9% to 60.3% NOFP/TP. This methodology was tested in a closed-loop experiment with an exoskeleton, in which the brain-machine interface (BMI) detected an obstacle and sent the command to the exoskeleton to stop. This methodology was tested with three healthy subjects, and the online results were 3.8 FP/min and 49.3% NOFP/TP. To make this model feasible for non-able bodied patients with a reduced and manageable time frame, transfer-learning techniques were applied and validated in the previous tests, and were then applied to patients. The results for two incomplete Spinal Cord Injury (iSCI) patients were 37.9% NOFP/TP and 7.7 FP/min. Frontiers Media S.A. 2023-03-14 /pmc/articles/PMC10043233/ /pubmed/36998726 http://dx.doi.org/10.3389/fnins.2023.1154480 Text en Copyright © 2023 Quiles, Ferrero, Iáñez, Ortiz, Gil-Agudo and Azorín. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Quiles, Vicente Ferrero, Laura Iáñez, Eduardo Ortiz, Mario Gil-Agudo, Ángel Azorín, José M. Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking |
title | Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking |
title_full | Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking |
title_fullStr | Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking |
title_full_unstemmed | Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking |
title_short | Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking |
title_sort | brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10043233/ https://www.ncbi.nlm.nih.gov/pubmed/36998726 http://dx.doi.org/10.3389/fnins.2023.1154480 |
work_keys_str_mv | AT quilesvicente brainmachineinterfacebasedontransferlearningfordetectingtheappearanceofobstaclesduringexoskeletonassistedwalking AT ferrerolaura brainmachineinterfacebasedontransferlearningfordetectingtheappearanceofobstaclesduringexoskeletonassistedwalking AT ianezeduardo brainmachineinterfacebasedontransferlearningfordetectingtheappearanceofobstaclesduringexoskeletonassistedwalking AT ortizmario brainmachineinterfacebasedontransferlearningfordetectingtheappearanceofobstaclesduringexoskeletonassistedwalking AT gilagudoangel brainmachineinterfacebasedontransferlearningfordetectingtheappearanceofobstaclesduringexoskeletonassistedwalking AT azorinjosem brainmachineinterfacebasedontransferlearningfordetectingtheappearanceofobstaclesduringexoskeletonassistedwalking |