Cargando…

Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty

Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive op...

Descripción completa

Detalles Bibliográficos
Autores principales: Nagengast, Arne J., Braun, Daniel A., Wolpert, Daniel M.
Formato: Texto
Lenguaje:English
Publicado: Public Library of Science 2010
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2904762/
https://www.ncbi.nlm.nih.gov/pubmed/20657657
http://dx.doi.org/10.1371/journal.pcbi.1000857
_version_ 1782183906031697920
author Nagengast, Arne J.
Braun, Daniel A.
Wolpert, Daniel M.
author_facet Nagengast, Arne J.
Braun, Daniel A.
Wolpert, Daniel M.
author_sort Nagengast, Arne J.
collection PubMed
description Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive optimal controller that incorporates movement cost variance either as an added cost (risk-averse controller) or as an added value (risk-seeking controller) to model human motor behavior in the face of uncertainty. We use a sensorimotor task to test the hypothesis that subjects are risk-sensitive. Subjects controlled a virtual ball undergoing Brownian motion towards a target. Subjects were required to minimize an explicit cost, in points, that was a combination of the final positional error of the ball and the integrated control cost. By testing subjects on different levels of Brownian motion noise and relative weighting of the position and control cost, we could distinguish between risk-sensitive and risk-neutral control. We show that subjects change their movement strategy pessimistically in the face of increased uncertainty in accord with the predictions of a risk-averse optimal controller. Our results suggest that risk-sensitivity is a fundamental attribute that needs to be incorporated into optimal feedback control models.
format Text
id pubmed-2904762
institution National Center for Biotechnology Information
language English
publishDate 2010
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-29047622010-07-23 Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty Nagengast, Arne J. Braun, Daniel A. Wolpert, Daniel M. PLoS Comput Biol Research Article Many aspects of human motor behavior can be understood using optimality principles such as optimal feedback control. However, these proposed optimal control models are risk-neutral; that is, they are indifferent to the variability of the movement cost. Here, we propose the use of a risk-sensitive optimal controller that incorporates movement cost variance either as an added cost (risk-averse controller) or as an added value (risk-seeking controller) to model human motor behavior in the face of uncertainty. We use a sensorimotor task to test the hypothesis that subjects are risk-sensitive. Subjects controlled a virtual ball undergoing Brownian motion towards a target. Subjects were required to minimize an explicit cost, in points, that was a combination of the final positional error of the ball and the integrated control cost. By testing subjects on different levels of Brownian motion noise and relative weighting of the position and control cost, we could distinguish between risk-sensitive and risk-neutral control. We show that subjects change their movement strategy pessimistically in the face of increased uncertainty in accord with the predictions of a risk-averse optimal controller. Our results suggest that risk-sensitivity is a fundamental attribute that needs to be incorporated into optimal feedback control models. Public Library of Science 2010-07-15 /pmc/articles/PMC2904762/ /pubmed/20657657 http://dx.doi.org/10.1371/journal.pcbi.1000857 Text en Nagengast et al. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
spellingShingle Research Article
Nagengast, Arne J.
Braun, Daniel A.
Wolpert, Daniel M.
Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty
title Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty
title_full Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty
title_fullStr Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty
title_full_unstemmed Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty
title_short Risk-Sensitive Optimal Feedback Control Accounts for Sensorimotor Behavior under Uncertainty
title_sort risk-sensitive optimal feedback control accounts for sensorimotor behavior under uncertainty
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2904762/
https://www.ncbi.nlm.nih.gov/pubmed/20657657
http://dx.doi.org/10.1371/journal.pcbi.1000857
work_keys_str_mv AT nagengastarnej risksensitiveoptimalfeedbackcontrolaccountsforsensorimotorbehaviorunderuncertainty
AT braundaniela risksensitiveoptimalfeedbackcontrolaccountsforsensorimotorbehaviorunderuncertainty
AT wolpertdanielm risksensitiveoptimalfeedbackcontrolaccountsforsensorimotorbehaviorunderuncertainty