Cargando…

Increasing Robustness of Brain–Computer Interfaces Through Automatic Detection and Removal of Corrupted Input Signals

For brain–computer interfaces (BCIs) to be viable for long-term daily usage, they must be able to quickly identify and adapt to signal disruptions. Furthermore, the detection and mitigation steps need to occur automatically and without the need for user intervention while also being computationally...

Descripción completa

Detalles Bibliográficos
Autores principales: Vasko, Jordan L., Aume, Laura, Tamrakar, Sanjay, Colachis, Samuel C. IV, Dunlap, Collin F., Rich, Adam, Meyers, Eric C., Gabrieli, David, Friedenberg, David A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9096265/
https://www.ncbi.nlm.nih.gov/pubmed/35573306
http://dx.doi.org/10.3389/fnins.2022.858377
_version_ 1784705936800088064
author Vasko, Jordan L.
Aume, Laura
Tamrakar, Sanjay
Colachis, Samuel C. IV
Dunlap, Collin F.
Rich, Adam
Meyers, Eric C.
Gabrieli, David
Friedenberg, David A.
author_facet Vasko, Jordan L.
Aume, Laura
Tamrakar, Sanjay
Colachis, Samuel C. IV
Dunlap, Collin F.
Rich, Adam
Meyers, Eric C.
Gabrieli, David
Friedenberg, David A.
author_sort Vasko, Jordan L.
collection PubMed
description For brain–computer interfaces (BCIs) to be viable for long-term daily usage, they must be able to quickly identify and adapt to signal disruptions. Furthermore, the detection and mitigation steps need to occur automatically and without the need for user intervention while also being computationally tractable for the low-power hardware that will be used in a deployed BCI system. Here, we focus on disruptions that are likely to occur during chronic use that cause some recording channels to fail but leave the remaining channels unaffected. In these cases, the algorithm that translates recorded neural activity into actions, the neural decoder, should seamlessly identify and adjust to the altered neural signals with minimal inconvenience to the user. First, we introduce an adapted statistical process control (SPC) method that automatically identifies disrupted channels so that both decoding algorithms can be adjusted, and technicians can be alerted. Next, after identifying corrupted channels, we demonstrate the automated and rapid removal of channels from a neural network decoder using a masking approach that does not change the decoding architecture, making it amenable for transfer learning. Finally, using transfer and unsupervised learning techniques, we update the model weights to adjust for the corrupted channels without requiring the user to collect additional calibration data. We demonstrate with both real and simulated neural data that our approach can maintain high-performance while simultaneously minimizing computation time and data storage requirements. This framework is invisible to the user but can dramatically increase BCI robustness and usability.
format Online
Article
Text
id pubmed-9096265
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-90962652022-05-13 Increasing Robustness of Brain–Computer Interfaces Through Automatic Detection and Removal of Corrupted Input Signals Vasko, Jordan L. Aume, Laura Tamrakar, Sanjay Colachis, Samuel C. IV Dunlap, Collin F. Rich, Adam Meyers, Eric C. Gabrieli, David Friedenberg, David A. Front Neurosci Neuroscience For brain–computer interfaces (BCIs) to be viable for long-term daily usage, they must be able to quickly identify and adapt to signal disruptions. Furthermore, the detection and mitigation steps need to occur automatically and without the need for user intervention while also being computationally tractable for the low-power hardware that will be used in a deployed BCI system. Here, we focus on disruptions that are likely to occur during chronic use that cause some recording channels to fail but leave the remaining channels unaffected. In these cases, the algorithm that translates recorded neural activity into actions, the neural decoder, should seamlessly identify and adjust to the altered neural signals with minimal inconvenience to the user. First, we introduce an adapted statistical process control (SPC) method that automatically identifies disrupted channels so that both decoding algorithms can be adjusted, and technicians can be alerted. Next, after identifying corrupted channels, we demonstrate the automated and rapid removal of channels from a neural network decoder using a masking approach that does not change the decoding architecture, making it amenable for transfer learning. Finally, using transfer and unsupervised learning techniques, we update the model weights to adjust for the corrupted channels without requiring the user to collect additional calibration data. We demonstrate with both real and simulated neural data that our approach can maintain high-performance while simultaneously minimizing computation time and data storage requirements. This framework is invisible to the user but can dramatically increase BCI robustness and usability. Frontiers Media S.A. 2022-04-28 /pmc/articles/PMC9096265/ /pubmed/35573306 http://dx.doi.org/10.3389/fnins.2022.858377 Text en Copyright © 2022 Vasko, Aume, Tamrakar, Colachis, Dunlap, Rich, Meyers, Gabrieli and Friedenberg. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Vasko, Jordan L.
Aume, Laura
Tamrakar, Sanjay
Colachis, Samuel C. IV
Dunlap, Collin F.
Rich, Adam
Meyers, Eric C.
Gabrieli, David
Friedenberg, David A.
Increasing Robustness of Brain–Computer Interfaces Through Automatic Detection and Removal of Corrupted Input Signals
title Increasing Robustness of Brain–Computer Interfaces Through Automatic Detection and Removal of Corrupted Input Signals
title_full Increasing Robustness of Brain–Computer Interfaces Through Automatic Detection and Removal of Corrupted Input Signals
title_fullStr Increasing Robustness of Brain–Computer Interfaces Through Automatic Detection and Removal of Corrupted Input Signals
title_full_unstemmed Increasing Robustness of Brain–Computer Interfaces Through Automatic Detection and Removal of Corrupted Input Signals
title_short Increasing Robustness of Brain–Computer Interfaces Through Automatic Detection and Removal of Corrupted Input Signals
title_sort increasing robustness of brain–computer interfaces through automatic detection and removal of corrupted input signals
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9096265/
https://www.ncbi.nlm.nih.gov/pubmed/35573306
http://dx.doi.org/10.3389/fnins.2022.858377
work_keys_str_mv AT vaskojordanl increasingrobustnessofbraincomputerinterfacesthroughautomaticdetectionandremovalofcorruptedinputsignals
AT aumelaura increasingrobustnessofbraincomputerinterfacesthroughautomaticdetectionandremovalofcorruptedinputsignals
AT tamrakarsanjay increasingrobustnessofbraincomputerinterfacesthroughautomaticdetectionandremovalofcorruptedinputsignals
AT colachissamuelciv increasingrobustnessofbraincomputerinterfacesthroughautomaticdetectionandremovalofcorruptedinputsignals
AT dunlapcollinf increasingrobustnessofbraincomputerinterfacesthroughautomaticdetectionandremovalofcorruptedinputsignals
AT richadam increasingrobustnessofbraincomputerinterfacesthroughautomaticdetectionandremovalofcorruptedinputsignals
AT meyersericc increasingrobustnessofbraincomputerinterfacesthroughautomaticdetectionandremovalofcorruptedinputsignals
AT gabrielidavid increasingrobustnessofbraincomputerinterfacesthroughautomaticdetectionandremovalofcorruptedinputsignals
AT friedenbergdavida increasingrobustnessofbraincomputerinterfacesthroughautomaticdetectionandremovalofcorruptedinputsignals