Cargando…

Error detection and correction in intracortical brain–machine interfaces controlling two finger groups

Objective. While brain–machine interfaces (BMIs) are promising technologies that could provide direct pathways for controlling the external world and thus regaining motor capabilities, their effectiveness is hampered by decoding errors. Previous research has demonstrated the detection and correction...

Descripción completa

Detalles Bibliográficos
Autores principales: Wallace, Dylan M, Benyamini, Miri, Nason-Tomaszewski, Samuel R, Costello, Joseph T, Cubillos, Luis H, Mender, Matthew J, Temmar, Hisham, Willsey, Matthew S, Patil, Parag G, Chestek, Cynthia A, Zacksenhouse, Miriam
Formato: Online Artículo Texto
Lenguaje:English
Publicado: IOP Publishing 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10594236/
https://www.ncbi.nlm.nih.gov/pubmed/37567222
http://dx.doi.org/10.1088/1741-2552/acef95
_version_ 1785124603270529024
author Wallace, Dylan M
Benyamini, Miri
Nason-Tomaszewski, Samuel R
Costello, Joseph T
Cubillos, Luis H
Mender, Matthew J
Temmar, Hisham
Willsey, Matthew S
Patil, Parag G
Chestek, Cynthia A
Zacksenhouse, Miriam
author_facet Wallace, Dylan M
Benyamini, Miri
Nason-Tomaszewski, Samuel R
Costello, Joseph T
Cubillos, Luis H
Mender, Matthew J
Temmar, Hisham
Willsey, Matthew S
Patil, Parag G
Chestek, Cynthia A
Zacksenhouse, Miriam
author_sort Wallace, Dylan M
collection PubMed
description Objective. While brain–machine interfaces (BMIs) are promising technologies that could provide direct pathways for controlling the external world and thus regaining motor capabilities, their effectiveness is hampered by decoding errors. Previous research has demonstrated the detection and correction of BMI outcome errors, which occur at the end of trials. Here we focus on continuous detection and correction of BMI execution errors, which occur during real-time movements. Approach. Two adult male rhesus macaques were implanted with Utah arrays in the motor cortex. The monkeys performed single or two-finger group BMI tasks where a Kalman filter decoded binned spiking-band power into intended finger kinematics. Neural activity was analyzed to determine how it depends not only on the kinematics of the fingers, but also on the distance of each finger-group to its target. We developed a method to detect erroneous movements, i.e. consistent movements away from the target, from the same neural activity used by the Kalman filter. Detected errors were corrected by a simple stopping strategy, and the effect on performance was evaluated. Main results. First we show that including distance to target explains significantly more variance of the recorded neural activity. Then, for the first time, we demonstrate that neural activity in motor cortex can be used to detect execution errors during BMI controlled movements. Keeping false positive rate below [Formula: see text] , it was possible to achieve mean true positive rate of [Formula: see text] online. Despite requiring 200 ms to detect and react to suspected errors, we were able to achieve a significant improvement in task performance via reduced orbiting time of one finger group. Significance. Neural activity recorded in motor cortex for BMI control can be used to detect and correct BMI errors and thus to improve performance. Further improvements may be obtained by enhancing classification and correction strategies.
format Online
Article
Text
id pubmed-10594236
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher IOP Publishing
record_format MEDLINE/PubMed
spelling pubmed-105942362023-10-25 Error detection and correction in intracortical brain–machine interfaces controlling two finger groups Wallace, Dylan M Benyamini, Miri Nason-Tomaszewski, Samuel R Costello, Joseph T Cubillos, Luis H Mender, Matthew J Temmar, Hisham Willsey, Matthew S Patil, Parag G Chestek, Cynthia A Zacksenhouse, Miriam J Neural Eng Paper Objective. While brain–machine interfaces (BMIs) are promising technologies that could provide direct pathways for controlling the external world and thus regaining motor capabilities, their effectiveness is hampered by decoding errors. Previous research has demonstrated the detection and correction of BMI outcome errors, which occur at the end of trials. Here we focus on continuous detection and correction of BMI execution errors, which occur during real-time movements. Approach. Two adult male rhesus macaques were implanted with Utah arrays in the motor cortex. The monkeys performed single or two-finger group BMI tasks where a Kalman filter decoded binned spiking-band power into intended finger kinematics. Neural activity was analyzed to determine how it depends not only on the kinematics of the fingers, but also on the distance of each finger-group to its target. We developed a method to detect erroneous movements, i.e. consistent movements away from the target, from the same neural activity used by the Kalman filter. Detected errors were corrected by a simple stopping strategy, and the effect on performance was evaluated. Main results. First we show that including distance to target explains significantly more variance of the recorded neural activity. Then, for the first time, we demonstrate that neural activity in motor cortex can be used to detect execution errors during BMI controlled movements. Keeping false positive rate below [Formula: see text] , it was possible to achieve mean true positive rate of [Formula: see text] online. Despite requiring 200 ms to detect and react to suspected errors, we were able to achieve a significant improvement in task performance via reduced orbiting time of one finger group. Significance. Neural activity recorded in motor cortex for BMI control can be used to detect and correct BMI errors and thus to improve performance. Further improvements may be obtained by enhancing classification and correction strategies. IOP Publishing 2023-08-01 2023-08-25 /pmc/articles/PMC10594236/ /pubmed/37567222 http://dx.doi.org/10.1088/1741-2552/acef95 Text en © 2023 The Author(s). Published by IOP Publishing Ltd https://creativecommons.org/licenses/by/4.0/ Original content from this work may be used under the terms of the Creative Commons Attribution 4.0 license (https://creativecommons.org/licenses/by/4.0/) . Any further distribution of this work must maintain attribution to the author(s) and the title of the work, journal citation and DOI.
spellingShingle Paper
Wallace, Dylan M
Benyamini, Miri
Nason-Tomaszewski, Samuel R
Costello, Joseph T
Cubillos, Luis H
Mender, Matthew J
Temmar, Hisham
Willsey, Matthew S
Patil, Parag G
Chestek, Cynthia A
Zacksenhouse, Miriam
Error detection and correction in intracortical brain–machine interfaces controlling two finger groups
title Error detection and correction in intracortical brain–machine interfaces controlling two finger groups
title_full Error detection and correction in intracortical brain–machine interfaces controlling two finger groups
title_fullStr Error detection and correction in intracortical brain–machine interfaces controlling two finger groups
title_full_unstemmed Error detection and correction in intracortical brain–machine interfaces controlling two finger groups
title_short Error detection and correction in intracortical brain–machine interfaces controlling two finger groups
title_sort error detection and correction in intracortical brain–machine interfaces controlling two finger groups
topic Paper
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10594236/
https://www.ncbi.nlm.nih.gov/pubmed/37567222
http://dx.doi.org/10.1088/1741-2552/acef95
work_keys_str_mv AT wallacedylanm errordetectionandcorrectioninintracorticalbrainmachineinterfacescontrollingtwofingergroups
AT benyaminimiri errordetectionandcorrectioninintracorticalbrainmachineinterfacescontrollingtwofingergroups
AT nasontomaszewskisamuelr errordetectionandcorrectioninintracorticalbrainmachineinterfacescontrollingtwofingergroups
AT costellojosepht errordetectionandcorrectioninintracorticalbrainmachineinterfacescontrollingtwofingergroups
AT cubillosluish errordetectionandcorrectioninintracorticalbrainmachineinterfacescontrollingtwofingergroups
AT mendermatthewj errordetectionandcorrectioninintracorticalbrainmachineinterfacescontrollingtwofingergroups
AT temmarhisham errordetectionandcorrectioninintracorticalbrainmachineinterfacescontrollingtwofingergroups
AT willseymatthews errordetectionandcorrectioninintracorticalbrainmachineinterfacescontrollingtwofingergroups
AT patilparagg errordetectionandcorrectioninintracorticalbrainmachineinterfacescontrollingtwofingergroups
AT chestekcynthiaa errordetectionandcorrectioninintracorticalbrainmachineinterfacescontrollingtwofingergroups
AT zacksenhousemiriam errordetectionandcorrectioninintracorticalbrainmachineinterfacescontrollingtwofingergroups