Cargando…

Training in Use of Brain–Machine Interface-Controlled Robotic Hand Improves Accuracy Decoding Two Types of Hand Movements

Objective: Brain-machine interfaces (BMIs) are useful for inducing plastic changes in cortical representation. A BMI first decodes hand movements using cortical signals and then converts the decoded information into movements of a robotic hand. By using the BMI robotic hand, the cortical representat...

Descripción completa

Detalles Bibliográficos
Autores principales: Fukuma, Ryohei, Yanagisawa, Takufumi, Yokoi, Hiroshi, Hirata, Masayuki, Yoshimine, Toshiki, Saitoh, Youichi, Kamitani, Yukiyasu, Kishima, Haruhiko
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6050372/
https://www.ncbi.nlm.nih.gov/pubmed/30050405
http://dx.doi.org/10.3389/fnins.2018.00478
_version_ 1783340321859436544
author Fukuma, Ryohei
Yanagisawa, Takufumi
Yokoi, Hiroshi
Hirata, Masayuki
Yoshimine, Toshiki
Saitoh, Youichi
Kamitani, Yukiyasu
Kishima, Haruhiko
author_facet Fukuma, Ryohei
Yanagisawa, Takufumi
Yokoi, Hiroshi
Hirata, Masayuki
Yoshimine, Toshiki
Saitoh, Youichi
Kamitani, Yukiyasu
Kishima, Haruhiko
author_sort Fukuma, Ryohei
collection PubMed
description Objective: Brain-machine interfaces (BMIs) are useful for inducing plastic changes in cortical representation. A BMI first decodes hand movements using cortical signals and then converts the decoded information into movements of a robotic hand. By using the BMI robotic hand, the cortical representation decoded by the BMI is modulated to improve decoding accuracy. We developed a BMI based on real-time magnetoencephalography (MEG) signals to control a robotic hand using decoded hand movements. Subjects were trained to use the BMI robotic hand freely for 10 min to evaluate plastic changes in the cortical representation due to the training. Method: We trained nine young healthy subjects with normal motor function. In open-loop conditions, they were instructed to grasp or open their right hands during MEG recording. Time-averaged MEG signals were then used to train a real decoder to control the robotic arm in real time. Then, subjects were instructed to control the BMI-controlled robotic hand by moving their right hands for 10 min while watching the robot's movement. During this closed-loop session, subjects tried to improve their ability to control the robot. Finally, subjects performed the same offline task to compare cortical activities related to the hand movements. As a control, we used a random decoder trained by the MEG signals with shuffled movement labels. We performed the same experiments with the random decoder as a crossover trial. To evaluate the cortical representation, cortical currents were estimated using a source localization technique. Hand movements were also decoded by a support vector machine using the MEG signals during the offline task. The classification accuracy of the movements was compared among offline tasks. Results: During the BMI training with the real decoder, the subjects succeeded in improving their accuracy in controlling the BMI robotic hand with correct rates of 0.28 ± 0.13 to 0.50 ± 0.11 (p = 0.017, n = 8, paired Student's t-test). Moreover, the classification accuracy of hand movements during the offline task was significantly increased after BMI training with the real decoder from 62.7 ± 6.5 to 70.0 ± 11.1% (p = 0.022, n = 8, t((7)) = 2.93, paired Student's t-test), whereas accuracy did not significantly change after BMI training with the random decoder from 63.0 ± 8.8 to 66.4 ± 9.0% (p = 0.225, n = 8, t((7)) = 1.33). Conclusion: BMI training is a useful tool to train the cortical activity necessary for BMI control and to induce some plastic changes in the activity.
format Online
Article
Text
id pubmed-6050372
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-60503722018-07-26 Training in Use of Brain–Machine Interface-Controlled Robotic Hand Improves Accuracy Decoding Two Types of Hand Movements Fukuma, Ryohei Yanagisawa, Takufumi Yokoi, Hiroshi Hirata, Masayuki Yoshimine, Toshiki Saitoh, Youichi Kamitani, Yukiyasu Kishima, Haruhiko Front Neurosci Neuroscience Objective: Brain-machine interfaces (BMIs) are useful for inducing plastic changes in cortical representation. A BMI first decodes hand movements using cortical signals and then converts the decoded information into movements of a robotic hand. By using the BMI robotic hand, the cortical representation decoded by the BMI is modulated to improve decoding accuracy. We developed a BMI based on real-time magnetoencephalography (MEG) signals to control a robotic hand using decoded hand movements. Subjects were trained to use the BMI robotic hand freely for 10 min to evaluate plastic changes in the cortical representation due to the training. Method: We trained nine young healthy subjects with normal motor function. In open-loop conditions, they were instructed to grasp or open their right hands during MEG recording. Time-averaged MEG signals were then used to train a real decoder to control the robotic arm in real time. Then, subjects were instructed to control the BMI-controlled robotic hand by moving their right hands for 10 min while watching the robot's movement. During this closed-loop session, subjects tried to improve their ability to control the robot. Finally, subjects performed the same offline task to compare cortical activities related to the hand movements. As a control, we used a random decoder trained by the MEG signals with shuffled movement labels. We performed the same experiments with the random decoder as a crossover trial. To evaluate the cortical representation, cortical currents were estimated using a source localization technique. Hand movements were also decoded by a support vector machine using the MEG signals during the offline task. The classification accuracy of the movements was compared among offline tasks. Results: During the BMI training with the real decoder, the subjects succeeded in improving their accuracy in controlling the BMI robotic hand with correct rates of 0.28 ± 0.13 to 0.50 ± 0.11 (p = 0.017, n = 8, paired Student's t-test). Moreover, the classification accuracy of hand movements during the offline task was significantly increased after BMI training with the real decoder from 62.7 ± 6.5 to 70.0 ± 11.1% (p = 0.022, n = 8, t((7)) = 2.93, paired Student's t-test), whereas accuracy did not significantly change after BMI training with the random decoder from 63.0 ± 8.8 to 66.4 ± 9.0% (p = 0.225, n = 8, t((7)) = 1.33). Conclusion: BMI training is a useful tool to train the cortical activity necessary for BMI control and to induce some plastic changes in the activity. Frontiers Media S.A. 2018-07-11 /pmc/articles/PMC6050372/ /pubmed/30050405 http://dx.doi.org/10.3389/fnins.2018.00478 Text en Copyright © 2018 Fukuma, Yanagisawa, Yokoi, Hirata, Yoshimine, Saitoh, Kamitani and Kishima. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Fukuma, Ryohei
Yanagisawa, Takufumi
Yokoi, Hiroshi
Hirata, Masayuki
Yoshimine, Toshiki
Saitoh, Youichi
Kamitani, Yukiyasu
Kishima, Haruhiko
Training in Use of Brain–Machine Interface-Controlled Robotic Hand Improves Accuracy Decoding Two Types of Hand Movements
title Training in Use of Brain–Machine Interface-Controlled Robotic Hand Improves Accuracy Decoding Two Types of Hand Movements
title_full Training in Use of Brain–Machine Interface-Controlled Robotic Hand Improves Accuracy Decoding Two Types of Hand Movements
title_fullStr Training in Use of Brain–Machine Interface-Controlled Robotic Hand Improves Accuracy Decoding Two Types of Hand Movements
title_full_unstemmed Training in Use of Brain–Machine Interface-Controlled Robotic Hand Improves Accuracy Decoding Two Types of Hand Movements
title_short Training in Use of Brain–Machine Interface-Controlled Robotic Hand Improves Accuracy Decoding Two Types of Hand Movements
title_sort training in use of brain–machine interface-controlled robotic hand improves accuracy decoding two types of hand movements
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6050372/
https://www.ncbi.nlm.nih.gov/pubmed/30050405
http://dx.doi.org/10.3389/fnins.2018.00478
work_keys_str_mv AT fukumaryohei traininginuseofbrainmachineinterfacecontrolledrobotichandimprovesaccuracydecodingtwotypesofhandmovements
AT yanagisawatakufumi traininginuseofbrainmachineinterfacecontrolledrobotichandimprovesaccuracydecodingtwotypesofhandmovements
AT yokoihiroshi traininginuseofbrainmachineinterfacecontrolledrobotichandimprovesaccuracydecodingtwotypesofhandmovements
AT hiratamasayuki traininginuseofbrainmachineinterfacecontrolledrobotichandimprovesaccuracydecodingtwotypesofhandmovements
AT yoshiminetoshiki traininginuseofbrainmachineinterfacecontrolledrobotichandimprovesaccuracydecodingtwotypesofhandmovements
AT saitohyouichi traininginuseofbrainmachineinterfacecontrolledrobotichandimprovesaccuracydecodingtwotypesofhandmovements
AT kamitaniyukiyasu traininginuseofbrainmachineinterfacecontrolledrobotichandimprovesaccuracydecodingtwotypesofhandmovements
AT kishimaharuhiko traininginuseofbrainmachineinterfacecontrolledrobotichandimprovesaccuracydecodingtwotypesofhandmovements