Cargando…
Learning from Sensory and Reward Prediction Errors during Motor Adaptation
Voluntary motor commands produce two kinds of consequences. Initially, a sensory consequence is observed in terms of activity in our primary sensory organs (e.g., vision, proprioception). Subsequently, the brain evaluates the sensory feedback and produces a subjective measure of utility or usefulnes...
Autores principales: | , |
---|---|
Formato: | Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2011
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3053313/ https://www.ncbi.nlm.nih.gov/pubmed/21423711 http://dx.doi.org/10.1371/journal.pcbi.1002012 |
_version_ | 1782199724739133440 |
---|---|
author | Izawa, Jun Shadmehr, Reza |
author_facet | Izawa, Jun Shadmehr, Reza |
author_sort | Izawa, Jun |
collection | PubMed |
description | Voluntary motor commands produce two kinds of consequences. Initially, a sensory consequence is observed in terms of activity in our primary sensory organs (e.g., vision, proprioception). Subsequently, the brain evaluates the sensory feedback and produces a subjective measure of utility or usefulness of the motor commands (e.g., reward). As a result, comparisons between predicted and observed consequences of motor commands produce two forms of prediction error. How do these errors contribute to changes in motor commands? Here, we considered a reach adaptation protocol and found that when high quality sensory feedback was available, adaptation of motor commands was driven almost exclusively by sensory prediction errors. This form of learning had a distinct signature: as motor commands adapted, the subjects altered their predictions regarding sensory consequences of motor commands, and generalized this learning broadly to neighboring motor commands. In contrast, as the quality of the sensory feedback degraded, adaptation of motor commands became more dependent on reward prediction errors. Reward prediction errors produced comparable changes in the motor commands, but produced no change in the predicted sensory consequences of motor commands, and generalized only locally. Because we found that there was a within subject correlation between generalization patterns and sensory remapping, it is plausible that during adaptation an individual's relative reliance on sensory vs. reward prediction errors could be inferred. We suggest that while motor commands change because of sensory and reward prediction errors, only sensory prediction errors produce a change in the neural system that predicts sensory consequences of motor commands. |
format | Text |
id | pubmed-3053313 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2011 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-30533132011-03-18 Learning from Sensory and Reward Prediction Errors during Motor Adaptation Izawa, Jun Shadmehr, Reza PLoS Comput Biol Research Article Voluntary motor commands produce two kinds of consequences. Initially, a sensory consequence is observed in terms of activity in our primary sensory organs (e.g., vision, proprioception). Subsequently, the brain evaluates the sensory feedback and produces a subjective measure of utility or usefulness of the motor commands (e.g., reward). As a result, comparisons between predicted and observed consequences of motor commands produce two forms of prediction error. How do these errors contribute to changes in motor commands? Here, we considered a reach adaptation protocol and found that when high quality sensory feedback was available, adaptation of motor commands was driven almost exclusively by sensory prediction errors. This form of learning had a distinct signature: as motor commands adapted, the subjects altered their predictions regarding sensory consequences of motor commands, and generalized this learning broadly to neighboring motor commands. In contrast, as the quality of the sensory feedback degraded, adaptation of motor commands became more dependent on reward prediction errors. Reward prediction errors produced comparable changes in the motor commands, but produced no change in the predicted sensory consequences of motor commands, and generalized only locally. Because we found that there was a within subject correlation between generalization patterns and sensory remapping, it is plausible that during adaptation an individual's relative reliance on sensory vs. reward prediction errors could be inferred. We suggest that while motor commands change because of sensory and reward prediction errors, only sensory prediction errors produce a change in the neural system that predicts sensory consequences of motor commands. Public Library of Science 2011-03-10 /pmc/articles/PMC3053313/ /pubmed/21423711 http://dx.doi.org/10.1371/journal.pcbi.1002012 Text en Izawa, Shadmehr. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited. |
spellingShingle | Research Article Izawa, Jun Shadmehr, Reza Learning from Sensory and Reward Prediction Errors during Motor Adaptation |
title | Learning from Sensory and Reward Prediction Errors during Motor Adaptation |
title_full | Learning from Sensory and Reward Prediction Errors during Motor Adaptation |
title_fullStr | Learning from Sensory and Reward Prediction Errors during Motor Adaptation |
title_full_unstemmed | Learning from Sensory and Reward Prediction Errors during Motor Adaptation |
title_short | Learning from Sensory and Reward Prediction Errors during Motor Adaptation |
title_sort | learning from sensory and reward prediction errors during motor adaptation |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3053313/ https://www.ncbi.nlm.nih.gov/pubmed/21423711 http://dx.doi.org/10.1371/journal.pcbi.1002012 |
work_keys_str_mv | AT izawajun learningfromsensoryandrewardpredictionerrorsduringmotoradaptation AT shadmehrreza learningfromsensoryandrewardpredictionerrorsduringmotoradaptation |