Cargando…
Long-Term Mutual Training for the CYBATHLON BCI Race With a Tetraplegic Pilot: A Case Study on Inter-Session Transfer and Intra-Session Adaptation
CYBATHLON is an international championship where people with severe physical disabilities compete with the aid of state-of-the-art assistive technology. In one of the disciplines, the BCI Race, tetraplegic pilots compete in a computer game race by controlling an avatar with a brain-computer interfac...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7952767/ https://www.ncbi.nlm.nih.gov/pubmed/33716698 http://dx.doi.org/10.3389/fnhum.2021.635777 |
_version_ | 1783663801867960320 |
---|---|
author | Hehenberger, Lea Kobler, Reinmar J. Lopes-Dias, Catarina Srisrisawang, Nitikorn Tumfart, Peter Uroko, John B. Torke, Paul R. Müller-Putz, Gernot R. |
author_facet | Hehenberger, Lea Kobler, Reinmar J. Lopes-Dias, Catarina Srisrisawang, Nitikorn Tumfart, Peter Uroko, John B. Torke, Paul R. Müller-Putz, Gernot R. |
author_sort | Hehenberger, Lea |
collection | PubMed |
description | CYBATHLON is an international championship where people with severe physical disabilities compete with the aid of state-of-the-art assistive technology. In one of the disciplines, the BCI Race, tetraplegic pilots compete in a computer game race by controlling an avatar with a brain-computer interface (BCI). This competition offers a perfect opportunity for BCI researchers to study long-term training effects in potential end-users, and to evaluate BCI performance in a realistic environment. In this work, we describe the BCI system designed by the team Mirage91 for participation in the CYBATHLON BCI Series 2019, as well as in the CYBATHLON 2020 Global Edition. Furthermore, we present the BCI’s interface with the game and the main methodological strategies, along with a detailed evaluation of its performance over the course of the training period, which lasted 14 months. The developed system was a 4-class BCI relying on task-specific modulations of brain rhythms. We implemented inter-session transfer learning to reduce calibration time, and to reinforce the stability of the brain patterns. Additionally, in order to compensate for potential intra-session shifts in the features’ distribution, normalization parameters were continuously adapted in an unsupervised fashion. Across the aforementioned 14 months, we recorded 26 game-based training sessions. Between the first eight sessions, and the final eight sessions leading up to the CYBATHLON 2020 Global Edition, the runtimes significantly improved from 255 ± 23 s (mean ± std) to 225 ± 22 s, respectively. Moreover, we observed a significant increase in the classifier’s accuracy from 46 to 53%, driven by more distinguishable brain patterns. Compared to conventional single session, non-adaptive BCIs, the inter-session transfer learning and unsupervised intra-session adaptation techniques significantly improved the performance. This long-term study demonstrates that regular training helped the pilot to significantly increase the distance between task-specific patterns, which resulted in an improvement of performance, both with respect to class separability in the calibration data, and with respect to the game. Furthermore, it shows that our methodological approaches were beneficial in transferring the performance across sessions, and most importantly to the CYBATHLON competitions. |
format | Online Article Text |
id | pubmed-7952767 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-79527672021-03-13 Long-Term Mutual Training for the CYBATHLON BCI Race With a Tetraplegic Pilot: A Case Study on Inter-Session Transfer and Intra-Session Adaptation Hehenberger, Lea Kobler, Reinmar J. Lopes-Dias, Catarina Srisrisawang, Nitikorn Tumfart, Peter Uroko, John B. Torke, Paul R. Müller-Putz, Gernot R. Front Hum Neurosci Neuroscience CYBATHLON is an international championship where people with severe physical disabilities compete with the aid of state-of-the-art assistive technology. In one of the disciplines, the BCI Race, tetraplegic pilots compete in a computer game race by controlling an avatar with a brain-computer interface (BCI). This competition offers a perfect opportunity for BCI researchers to study long-term training effects in potential end-users, and to evaluate BCI performance in a realistic environment. In this work, we describe the BCI system designed by the team Mirage91 for participation in the CYBATHLON BCI Series 2019, as well as in the CYBATHLON 2020 Global Edition. Furthermore, we present the BCI’s interface with the game and the main methodological strategies, along with a detailed evaluation of its performance over the course of the training period, which lasted 14 months. The developed system was a 4-class BCI relying on task-specific modulations of brain rhythms. We implemented inter-session transfer learning to reduce calibration time, and to reinforce the stability of the brain patterns. Additionally, in order to compensate for potential intra-session shifts in the features’ distribution, normalization parameters were continuously adapted in an unsupervised fashion. Across the aforementioned 14 months, we recorded 26 game-based training sessions. Between the first eight sessions, and the final eight sessions leading up to the CYBATHLON 2020 Global Edition, the runtimes significantly improved from 255 ± 23 s (mean ± std) to 225 ± 22 s, respectively. Moreover, we observed a significant increase in the classifier’s accuracy from 46 to 53%, driven by more distinguishable brain patterns. Compared to conventional single session, non-adaptive BCIs, the inter-session transfer learning and unsupervised intra-session adaptation techniques significantly improved the performance. This long-term study demonstrates that regular training helped the pilot to significantly increase the distance between task-specific patterns, which resulted in an improvement of performance, both with respect to class separability in the calibration data, and with respect to the game. Furthermore, it shows that our methodological approaches were beneficial in transferring the performance across sessions, and most importantly to the CYBATHLON competitions. Frontiers Media S.A. 2021-02-26 /pmc/articles/PMC7952767/ /pubmed/33716698 http://dx.doi.org/10.3389/fnhum.2021.635777 Text en Copyright © 2021 Hehenberger, Kobler, Lopes-Dias, Srisrisawang, Tumfart, Uroko, Torke and Müller-Putz. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Hehenberger, Lea Kobler, Reinmar J. Lopes-Dias, Catarina Srisrisawang, Nitikorn Tumfart, Peter Uroko, John B. Torke, Paul R. Müller-Putz, Gernot R. Long-Term Mutual Training for the CYBATHLON BCI Race With a Tetraplegic Pilot: A Case Study on Inter-Session Transfer and Intra-Session Adaptation |
title | Long-Term Mutual Training for the CYBATHLON BCI Race With a Tetraplegic Pilot: A Case Study on Inter-Session Transfer and Intra-Session Adaptation |
title_full | Long-Term Mutual Training for the CYBATHLON BCI Race With a Tetraplegic Pilot: A Case Study on Inter-Session Transfer and Intra-Session Adaptation |
title_fullStr | Long-Term Mutual Training for the CYBATHLON BCI Race With a Tetraplegic Pilot: A Case Study on Inter-Session Transfer and Intra-Session Adaptation |
title_full_unstemmed | Long-Term Mutual Training for the CYBATHLON BCI Race With a Tetraplegic Pilot: A Case Study on Inter-Session Transfer and Intra-Session Adaptation |
title_short | Long-Term Mutual Training for the CYBATHLON BCI Race With a Tetraplegic Pilot: A Case Study on Inter-Session Transfer and Intra-Session Adaptation |
title_sort | long-term mutual training for the cybathlon bci race with a tetraplegic pilot: a case study on inter-session transfer and intra-session adaptation |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7952767/ https://www.ncbi.nlm.nih.gov/pubmed/33716698 http://dx.doi.org/10.3389/fnhum.2021.635777 |
work_keys_str_mv | AT hehenbergerlea longtermmutualtrainingforthecybathlonbciracewithatetraplegicpilotacasestudyonintersessiontransferandintrasessionadaptation AT koblerreinmarj longtermmutualtrainingforthecybathlonbciracewithatetraplegicpilotacasestudyonintersessiontransferandintrasessionadaptation AT lopesdiascatarina longtermmutualtrainingforthecybathlonbciracewithatetraplegicpilotacasestudyonintersessiontransferandintrasessionadaptation AT srisrisawangnitikorn longtermmutualtrainingforthecybathlonbciracewithatetraplegicpilotacasestudyonintersessiontransferandintrasessionadaptation AT tumfartpeter longtermmutualtrainingforthecybathlonbciracewithatetraplegicpilotacasestudyonintersessiontransferandintrasessionadaptation AT urokojohnb longtermmutualtrainingforthecybathlonbciracewithatetraplegicpilotacasestudyonintersessiontransferandintrasessionadaptation AT torkepaulr longtermmutualtrainingforthecybathlonbciracewithatetraplegicpilotacasestudyonintersessiontransferandintrasessionadaptation AT mullerputzgernotr longtermmutualtrainingforthecybathlonbciracewithatetraplegicpilotacasestudyonintersessiontransferandintrasessionadaptation |