Cargando…
Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning
Motor adaptation can be achieved through error-based learning, driven by sensory prediction errors, or reinforcement learning, driven by reward prediction errors. Recent work on visuomotor adaptation has shown that reinforcement learning leads to more persistent adaptation when visual feedback is re...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9159621/ https://www.ncbi.nlm.nih.gov/pubmed/35648778 http://dx.doi.org/10.1371/journal.pone.0269297 |
_version_ | 1784719094367387648 |
---|---|
author | Ikegami, Tsuyoshi Flanagan, J. Randall Wolpert, Daniel M. |
author_facet | Ikegami, Tsuyoshi Flanagan, J. Randall Wolpert, Daniel M. |
author_sort | Ikegami, Tsuyoshi |
collection | PubMed |
description | Motor adaptation can be achieved through error-based learning, driven by sensory prediction errors, or reinforcement learning, driven by reward prediction errors. Recent work on visuomotor adaptation has shown that reinforcement learning leads to more persistent adaptation when visual feedback is removed, compared to error-based learning in which continuous visual feedback of the movement is provided. However, there is evidence that error-based learning with terminal visual feedback of the movement (provided at the end of movement) may be driven by both sensory and reward prediction errors. Here we examined the influence of feedback on learning using a visuomotor adaptation task in which participants moved a cursor to a single target while the gain between hand and cursor movement displacement was gradually altered. Different groups received either continuous error feedback (EC), terminal error feedback (ET), or binary reinforcement feedback (success/fail) at the end of the movement (R). Following adaptation we tested generalization to targets located in different directions and found that generalization in the ET group was intermediate between the EC and R groups. We then examined the persistence of adaptation in the EC and ET groups when the cursor was extinguished and only binary reward feedback was provided. Whereas performance was maintained in the ET group, it quickly deteriorated in the EC group. These results suggest that terminal error feedback leads to a more robust form of learning than continuous error feedback. In addition our findings are consistent with the view that error-based learning with terminal feedback involves both error-based and reinforcement learning. |
format | Online Article Text |
id | pubmed-9159621 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-91596212022-06-02 Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning Ikegami, Tsuyoshi Flanagan, J. Randall Wolpert, Daniel M. PLoS One Research Article Motor adaptation can be achieved through error-based learning, driven by sensory prediction errors, or reinforcement learning, driven by reward prediction errors. Recent work on visuomotor adaptation has shown that reinforcement learning leads to more persistent adaptation when visual feedback is removed, compared to error-based learning in which continuous visual feedback of the movement is provided. However, there is evidence that error-based learning with terminal visual feedback of the movement (provided at the end of movement) may be driven by both sensory and reward prediction errors. Here we examined the influence of feedback on learning using a visuomotor adaptation task in which participants moved a cursor to a single target while the gain between hand and cursor movement displacement was gradually altered. Different groups received either continuous error feedback (EC), terminal error feedback (ET), or binary reinforcement feedback (success/fail) at the end of the movement (R). Following adaptation we tested generalization to targets located in different directions and found that generalization in the ET group was intermediate between the EC and R groups. We then examined the persistence of adaptation in the EC and ET groups when the cursor was extinguished and only binary reward feedback was provided. Whereas performance was maintained in the ET group, it quickly deteriorated in the EC group. These results suggest that terminal error feedback leads to a more robust form of learning than continuous error feedback. In addition our findings are consistent with the view that error-based learning with terminal feedback involves both error-based and reinforcement learning. Public Library of Science 2022-06-01 /pmc/articles/PMC9159621/ /pubmed/35648778 http://dx.doi.org/10.1371/journal.pone.0269297 Text en © 2022 Ikegami et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Ikegami, Tsuyoshi Flanagan, J. Randall Wolpert, Daniel M. Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning |
title | Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning |
title_full | Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning |
title_fullStr | Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning |
title_full_unstemmed | Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning |
title_short | Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning |
title_sort | reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9159621/ https://www.ncbi.nlm.nih.gov/pubmed/35648778 http://dx.doi.org/10.1371/journal.pone.0269297 |
work_keys_str_mv | AT ikegamitsuyoshi reachadaptiontoavisuomotorgainwithterminalerrorfeedbackinvolvesreinforcementlearning AT flanaganjrandall reachadaptiontoavisuomotorgainwithterminalerrorfeedbackinvolvesreinforcementlearning AT wolpertdanielm reachadaptiontoavisuomotorgainwithterminalerrorfeedbackinvolvesreinforcementlearning |