Cargando…

Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning

Motor adaptation can be achieved through error-based learning, driven by sensory prediction errors, or reinforcement learning, driven by reward prediction errors. Recent work on visuomotor adaptation has shown that reinforcement learning leads to more persistent adaptation when visual feedback is re...

Descripción completa

Detalles Bibliográficos
Autores principales: Ikegami, Tsuyoshi, Flanagan, J. Randall, Wolpert, Daniel M.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9159621/
https://www.ncbi.nlm.nih.gov/pubmed/35648778
http://dx.doi.org/10.1371/journal.pone.0269297
_version_ 1784719094367387648
author Ikegami, Tsuyoshi
Flanagan, J. Randall
Wolpert, Daniel M.
author_facet Ikegami, Tsuyoshi
Flanagan, J. Randall
Wolpert, Daniel M.
author_sort Ikegami, Tsuyoshi
collection PubMed
description Motor adaptation can be achieved through error-based learning, driven by sensory prediction errors, or reinforcement learning, driven by reward prediction errors. Recent work on visuomotor adaptation has shown that reinforcement learning leads to more persistent adaptation when visual feedback is removed, compared to error-based learning in which continuous visual feedback of the movement is provided. However, there is evidence that error-based learning with terminal visual feedback of the movement (provided at the end of movement) may be driven by both sensory and reward prediction errors. Here we examined the influence of feedback on learning using a visuomotor adaptation task in which participants moved a cursor to a single target while the gain between hand and cursor movement displacement was gradually altered. Different groups received either continuous error feedback (EC), terminal error feedback (ET), or binary reinforcement feedback (success/fail) at the end of the movement (R). Following adaptation we tested generalization to targets located in different directions and found that generalization in the ET group was intermediate between the EC and R groups. We then examined the persistence of adaptation in the EC and ET groups when the cursor was extinguished and only binary reward feedback was provided. Whereas performance was maintained in the ET group, it quickly deteriorated in the EC group. These results suggest that terminal error feedback leads to a more robust form of learning than continuous error feedback. In addition our findings are consistent with the view that error-based learning with terminal feedback involves both error-based and reinforcement learning.
format Online
Article
Text
id pubmed-9159621
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-91596212022-06-02 Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning Ikegami, Tsuyoshi Flanagan, J. Randall Wolpert, Daniel M. PLoS One Research Article Motor adaptation can be achieved through error-based learning, driven by sensory prediction errors, or reinforcement learning, driven by reward prediction errors. Recent work on visuomotor adaptation has shown that reinforcement learning leads to more persistent adaptation when visual feedback is removed, compared to error-based learning in which continuous visual feedback of the movement is provided. However, there is evidence that error-based learning with terminal visual feedback of the movement (provided at the end of movement) may be driven by both sensory and reward prediction errors. Here we examined the influence of feedback on learning using a visuomotor adaptation task in which participants moved a cursor to a single target while the gain between hand and cursor movement displacement was gradually altered. Different groups received either continuous error feedback (EC), terminal error feedback (ET), or binary reinforcement feedback (success/fail) at the end of the movement (R). Following adaptation we tested generalization to targets located in different directions and found that generalization in the ET group was intermediate between the EC and R groups. We then examined the persistence of adaptation in the EC and ET groups when the cursor was extinguished and only binary reward feedback was provided. Whereas performance was maintained in the ET group, it quickly deteriorated in the EC group. These results suggest that terminal error feedback leads to a more robust form of learning than continuous error feedback. In addition our findings are consistent with the view that error-based learning with terminal feedback involves both error-based and reinforcement learning. Public Library of Science 2022-06-01 /pmc/articles/PMC9159621/ /pubmed/35648778 http://dx.doi.org/10.1371/journal.pone.0269297 Text en © 2022 Ikegami et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Ikegami, Tsuyoshi
Flanagan, J. Randall
Wolpert, Daniel M.
Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning
title Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning
title_full Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning
title_fullStr Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning
title_full_unstemmed Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning
title_short Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning
title_sort reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9159621/
https://www.ncbi.nlm.nih.gov/pubmed/35648778
http://dx.doi.org/10.1371/journal.pone.0269297
work_keys_str_mv AT ikegamitsuyoshi reachadaptiontoavisuomotorgainwithterminalerrorfeedbackinvolvesreinforcementlearning
AT flanaganjrandall reachadaptiontoavisuomotorgainwithterminalerrorfeedbackinvolvesreinforcementlearning
AT wolpertdanielm reachadaptiontoavisuomotorgainwithterminalerrorfeedbackinvolvesreinforcementlearning