Cargando…

Learning from Sensory and Reward Prediction Errors during Motor Adaptation

Voluntary motor commands produce two kinds of consequences. Initially, a sensory consequence is observed in terms of activity in our primary sensory organs (e.g., vision, proprioception). Subsequently, the brain evaluates the sensory feedback and produces a subjective measure of utility or usefulnes...

Descripción completa

Detalles Bibliográficos
Autores principales: Izawa, Jun, Shadmehr, Reza
Formato: Texto
Lenguaje:English
Publicado: Public Library of Science 2011
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3053313/
https://www.ncbi.nlm.nih.gov/pubmed/21423711
http://dx.doi.org/10.1371/journal.pcbi.1002012
_version_ 1782199724739133440
author Izawa, Jun
Shadmehr, Reza
author_facet Izawa, Jun
Shadmehr, Reza
author_sort Izawa, Jun
collection PubMed
description Voluntary motor commands produce two kinds of consequences. Initially, a sensory consequence is observed in terms of activity in our primary sensory organs (e.g., vision, proprioception). Subsequently, the brain evaluates the sensory feedback and produces a subjective measure of utility or usefulness of the motor commands (e.g., reward). As a result, comparisons between predicted and observed consequences of motor commands produce two forms of prediction error. How do these errors contribute to changes in motor commands? Here, we considered a reach adaptation protocol and found that when high quality sensory feedback was available, adaptation of motor commands was driven almost exclusively by sensory prediction errors. This form of learning had a distinct signature: as motor commands adapted, the subjects altered their predictions regarding sensory consequences of motor commands, and generalized this learning broadly to neighboring motor commands. In contrast, as the quality of the sensory feedback degraded, adaptation of motor commands became more dependent on reward prediction errors. Reward prediction errors produced comparable changes in the motor commands, but produced no change in the predicted sensory consequences of motor commands, and generalized only locally. Because we found that there was a within subject correlation between generalization patterns and sensory remapping, it is plausible that during adaptation an individual's relative reliance on sensory vs. reward prediction errors could be inferred. We suggest that while motor commands change because of sensory and reward prediction errors, only sensory prediction errors produce a change in the neural system that predicts sensory consequences of motor commands.
format Text
id pubmed-3053313
institution National Center for Biotechnology Information
language English
publishDate 2011
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-30533132011-03-18 Learning from Sensory and Reward Prediction Errors during Motor Adaptation Izawa, Jun Shadmehr, Reza PLoS Comput Biol Research Article Voluntary motor commands produce two kinds of consequences. Initially, a sensory consequence is observed in terms of activity in our primary sensory organs (e.g., vision, proprioception). Subsequently, the brain evaluates the sensory feedback and produces a subjective measure of utility or usefulness of the motor commands (e.g., reward). As a result, comparisons between predicted and observed consequences of motor commands produce two forms of prediction error. How do these errors contribute to changes in motor commands? Here, we considered a reach adaptation protocol and found that when high quality sensory feedback was available, adaptation of motor commands was driven almost exclusively by sensory prediction errors. This form of learning had a distinct signature: as motor commands adapted, the subjects altered their predictions regarding sensory consequences of motor commands, and generalized this learning broadly to neighboring motor commands. In contrast, as the quality of the sensory feedback degraded, adaptation of motor commands became more dependent on reward prediction errors. Reward prediction errors produced comparable changes in the motor commands, but produced no change in the predicted sensory consequences of motor commands, and generalized only locally. Because we found that there was a within subject correlation between generalization patterns and sensory remapping, it is plausible that during adaptation an individual's relative reliance on sensory vs. reward prediction errors could be inferred. We suggest that while motor commands change because of sensory and reward prediction errors, only sensory prediction errors produce a change in the neural system that predicts sensory consequences of motor commands. Public Library of Science 2011-03-10 /pmc/articles/PMC3053313/ /pubmed/21423711 http://dx.doi.org/10.1371/journal.pcbi.1002012 Text en Izawa, Shadmehr. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
spellingShingle Research Article
Izawa, Jun
Shadmehr, Reza
Learning from Sensory and Reward Prediction Errors during Motor Adaptation
title Learning from Sensory and Reward Prediction Errors during Motor Adaptation
title_full Learning from Sensory and Reward Prediction Errors during Motor Adaptation
title_fullStr Learning from Sensory and Reward Prediction Errors during Motor Adaptation
title_full_unstemmed Learning from Sensory and Reward Prediction Errors during Motor Adaptation
title_short Learning from Sensory and Reward Prediction Errors during Motor Adaptation
title_sort learning from sensory and reward prediction errors during motor adaptation
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3053313/
https://www.ncbi.nlm.nih.gov/pubmed/21423711
http://dx.doi.org/10.1371/journal.pcbi.1002012
work_keys_str_mv AT izawajun learningfromsensoryandrewardpredictionerrorsduringmotoradaptation
AT shadmehrreza learningfromsensoryandrewardpredictionerrorsduringmotoradaptation