Cargando…

Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking

INTRODUCTION: Brain-machine interfaces (BMIs) attempt to establish communication between the user and the device to be controlled. BMIs have great challenges to face in order to design a robust control in the real field of application. The artifacts, high volume of training data, and non-stationarit...

Descripción completa

Detalles Bibliográficos
Autores principales: Quiles, Vicente, Ferrero, Laura, Iáñez, Eduardo, Ortiz, Mario, Gil-Agudo, Ángel, Azorín, José M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10043233/
https://www.ncbi.nlm.nih.gov/pubmed/36998726
http://dx.doi.org/10.3389/fnins.2023.1154480
_version_ 1784913099686412288
author Quiles, Vicente
Ferrero, Laura
Iáñez, Eduardo
Ortiz, Mario
Gil-Agudo, Ángel
Azorín, José M.
author_facet Quiles, Vicente
Ferrero, Laura
Iáñez, Eduardo
Ortiz, Mario
Gil-Agudo, Ángel
Azorín, José M.
author_sort Quiles, Vicente
collection PubMed
description INTRODUCTION: Brain-machine interfaces (BMIs) attempt to establish communication between the user and the device to be controlled. BMIs have great challenges to face in order to design a robust control in the real field of application. The artifacts, high volume of training data, and non-stationarity of the signal of EEG-based interfaces are challenges that classical processing techniques do not solve, showing certain shortcomings in the real-time domain. Recent advances in deep-learning techniques open a window of opportunity to solve some of these problems. In this work, an interface able to detect the evoked potential that occurs when a person intends to stop due to the appearance of an unexpected obstacle has been developed. MATERIAL AND METHODS: First, the interface was tested on a treadmill with five subjects, in which the user stopped when an obstacle appeared (simulated by a laser). The analysis is based on two consecutive convolutional networks: the first one to discern the intention to stop against normal walking and the second one to correct false detections of the previous one. RESULTS AND DISCUSSION: The results were superior when using the methodology of the two consecutive networks vs. only the first one in a cross-validation pseudo-online analysis. The false positives per min (FP/min) decreased from 31.8 to 3.9 FP/min and the number of repetitions in which there were no false positives and true positives (TP) improved from 34.9% to 60.3% NOFP/TP. This methodology was tested in a closed-loop experiment with an exoskeleton, in which the brain-machine interface (BMI) detected an obstacle and sent the command to the exoskeleton to stop. This methodology was tested with three healthy subjects, and the online results were 3.8 FP/min and 49.3% NOFP/TP. To make this model feasible for non-able bodied patients with a reduced and manageable time frame, transfer-learning techniques were applied and validated in the previous tests, and were then applied to patients. The results for two incomplete Spinal Cord Injury (iSCI) patients were 37.9% NOFP/TP and 7.7 FP/min.
format Online
Article
Text
id pubmed-10043233
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-100432332023-03-29 Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking Quiles, Vicente Ferrero, Laura Iáñez, Eduardo Ortiz, Mario Gil-Agudo, Ángel Azorín, José M. Front Neurosci Neuroscience INTRODUCTION: Brain-machine interfaces (BMIs) attempt to establish communication between the user and the device to be controlled. BMIs have great challenges to face in order to design a robust control in the real field of application. The artifacts, high volume of training data, and non-stationarity of the signal of EEG-based interfaces are challenges that classical processing techniques do not solve, showing certain shortcomings in the real-time domain. Recent advances in deep-learning techniques open a window of opportunity to solve some of these problems. In this work, an interface able to detect the evoked potential that occurs when a person intends to stop due to the appearance of an unexpected obstacle has been developed. MATERIAL AND METHODS: First, the interface was tested on a treadmill with five subjects, in which the user stopped when an obstacle appeared (simulated by a laser). The analysis is based on two consecutive convolutional networks: the first one to discern the intention to stop against normal walking and the second one to correct false detections of the previous one. RESULTS AND DISCUSSION: The results were superior when using the methodology of the two consecutive networks vs. only the first one in a cross-validation pseudo-online analysis. The false positives per min (FP/min) decreased from 31.8 to 3.9 FP/min and the number of repetitions in which there were no false positives and true positives (TP) improved from 34.9% to 60.3% NOFP/TP. This methodology was tested in a closed-loop experiment with an exoskeleton, in which the brain-machine interface (BMI) detected an obstacle and sent the command to the exoskeleton to stop. This methodology was tested with three healthy subjects, and the online results were 3.8 FP/min and 49.3% NOFP/TP. To make this model feasible for non-able bodied patients with a reduced and manageable time frame, transfer-learning techniques were applied and validated in the previous tests, and were then applied to patients. The results for two incomplete Spinal Cord Injury (iSCI) patients were 37.9% NOFP/TP and 7.7 FP/min. Frontiers Media S.A. 2023-03-14 /pmc/articles/PMC10043233/ /pubmed/36998726 http://dx.doi.org/10.3389/fnins.2023.1154480 Text en Copyright © 2023 Quiles, Ferrero, Iáñez, Ortiz, Gil-Agudo and Azorín. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Quiles, Vicente
Ferrero, Laura
Iáñez, Eduardo
Ortiz, Mario
Gil-Agudo, Ángel
Azorín, José M.
Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking
title Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking
title_full Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking
title_fullStr Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking
title_full_unstemmed Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking
title_short Brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking
title_sort brain-machine interface based on transfer-learning for detecting the appearance of obstacles during exoskeleton-assisted walking
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10043233/
https://www.ncbi.nlm.nih.gov/pubmed/36998726
http://dx.doi.org/10.3389/fnins.2023.1154480
work_keys_str_mv AT quilesvicente brainmachineinterfacebasedontransferlearningfordetectingtheappearanceofobstaclesduringexoskeletonassistedwalking
AT ferrerolaura brainmachineinterfacebasedontransferlearningfordetectingtheappearanceofobstaclesduringexoskeletonassistedwalking
AT ianezeduardo brainmachineinterfacebasedontransferlearningfordetectingtheappearanceofobstaclesduringexoskeletonassistedwalking
AT ortizmario brainmachineinterfacebasedontransferlearningfordetectingtheappearanceofobstaclesduringexoskeletonassistedwalking
AT gilagudoangel brainmachineinterfacebasedontransferlearningfordetectingtheappearanceofobstaclesduringexoskeletonassistedwalking
AT azorinjosem brainmachineinterfacebasedontransferlearningfordetectingtheappearanceofobstaclesduringexoskeletonassistedwalking