Cargando…

A reinforcement learning approach to gait training improves retention

Many gait training programs are based on supervised learning principles: an individual is guided towards a desired gait pattern with directional error feedback. While this results in rapid adaptation, improvements quickly disappear. This study tested the hypothesis that a reinforcement learning appr...

Descripción completa

Detalles Bibliográficos
Autores principales: Hasson, Christopher J., Manczurowsky, Julia, Yen, Sheng-Che
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2015
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4550775/
https://www.ncbi.nlm.nih.gov/pubmed/26379524
http://dx.doi.org/10.3389/fnhum.2015.00459
_version_ 1782387498293395456
author Hasson, Christopher J.
Manczurowsky, Julia
Yen, Sheng-Che
author_facet Hasson, Christopher J.
Manczurowsky, Julia
Yen, Sheng-Che
author_sort Hasson, Christopher J.
collection PubMed
description Many gait training programs are based on supervised learning principles: an individual is guided towards a desired gait pattern with directional error feedback. While this results in rapid adaptation, improvements quickly disappear. This study tested the hypothesis that a reinforcement learning approach improves retention and transfer of a new gait pattern. The results of a pilot study and larger experiment are presented. Healthy subjects were randomly assigned to either a supervised group, who received explicit instructions and directional error feedback while they learned a new gait pattern on a treadmill, or a reinforcement group, who was only shown whether they were close to or far from the desired gait. Subjects practiced for 10 min, followed by immediate and overnight retention and over-ground transfer tests. The pilot study showed that subjects could learn a new gait pattern under a reinforcement learning paradigm. The larger experiment, which had twice as many subjects (16 in each group) showed that the reinforcement group had better overnight retention than the supervised group (a 32% vs. 120% error increase, respectively), but there were no differences for over-ground transfer. These results suggest that encouraging participants to find rewarding actions through self-guided exploration is beneficial for retention.
format Online
Article
Text
id pubmed-4550775
institution National Center for Biotechnology Information
language English
publishDate 2015
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-45507752015-09-14 A reinforcement learning approach to gait training improves retention Hasson, Christopher J. Manczurowsky, Julia Yen, Sheng-Che Front Hum Neurosci Neuroscience Many gait training programs are based on supervised learning principles: an individual is guided towards a desired gait pattern with directional error feedback. While this results in rapid adaptation, improvements quickly disappear. This study tested the hypothesis that a reinforcement learning approach improves retention and transfer of a new gait pattern. The results of a pilot study and larger experiment are presented. Healthy subjects were randomly assigned to either a supervised group, who received explicit instructions and directional error feedback while they learned a new gait pattern on a treadmill, or a reinforcement group, who was only shown whether they were close to or far from the desired gait. Subjects practiced for 10 min, followed by immediate and overnight retention and over-ground transfer tests. The pilot study showed that subjects could learn a new gait pattern under a reinforcement learning paradigm. The larger experiment, which had twice as many subjects (16 in each group) showed that the reinforcement group had better overnight retention than the supervised group (a 32% vs. 120% error increase, respectively), but there were no differences for over-ground transfer. These results suggest that encouraging participants to find rewarding actions through self-guided exploration is beneficial for retention. Frontiers Media S.A. 2015-08-27 /pmc/articles/PMC4550775/ /pubmed/26379524 http://dx.doi.org/10.3389/fnhum.2015.00459 Text en Copyright © 2015 Hasson, Manczurowsky and Yen. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution and reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Hasson, Christopher J.
Manczurowsky, Julia
Yen, Sheng-Che
A reinforcement learning approach to gait training improves retention
title A reinforcement learning approach to gait training improves retention
title_full A reinforcement learning approach to gait training improves retention
title_fullStr A reinforcement learning approach to gait training improves retention
title_full_unstemmed A reinforcement learning approach to gait training improves retention
title_short A reinforcement learning approach to gait training improves retention
title_sort reinforcement learning approach to gait training improves retention
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4550775/
https://www.ncbi.nlm.nih.gov/pubmed/26379524
http://dx.doi.org/10.3389/fnhum.2015.00459
work_keys_str_mv AT hassonchristopherj areinforcementlearningapproachtogaittrainingimprovesretention
AT manczurowskyjulia areinforcementlearningapproachtogaittrainingimprovesretention
AT yenshengche areinforcementlearningapproachtogaittrainingimprovesretention
AT hassonchristopherj reinforcementlearningapproachtogaittrainingimprovesretention
AT manczurowskyjulia reinforcementlearningapproachtogaittrainingimprovesretention
AT yenshengche reinforcementlearningapproachtogaittrainingimprovesretention