Cargando…

Can Monkeys Choose Optimally When Faced with Noisy Stimuli and Unequal Rewards?

We review the leaky competing accumulator model for two-alternative forced-choice decisions with cued responses, and propose extensions to account for the influence of unequal rewards. Assuming that stimulus information is integrated until the cue to respond arrives and that firing rates of stimulus...

Descripción completa

Detalles Bibliográficos
Autores principales: Feng, Samuel, Holmes, Philip, Rorie, Alan, Newsome, William T.
Formato: Texto
Lenguaje:English
Publicado: Public Library of Science 2009
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2631644/
https://www.ncbi.nlm.nih.gov/pubmed/19214201
http://dx.doi.org/10.1371/journal.pcbi.1000284
_version_ 1782163956169703424
author Feng, Samuel
Holmes, Philip
Rorie, Alan
Newsome, William T.
author_facet Feng, Samuel
Holmes, Philip
Rorie, Alan
Newsome, William T.
author_sort Feng, Samuel
collection PubMed
description We review the leaky competing accumulator model for two-alternative forced-choice decisions with cued responses, and propose extensions to account for the influence of unequal rewards. Assuming that stimulus information is integrated until the cue to respond arrives and that firing rates of stimulus-selective neurons remain well within physiological bounds, the model reduces to an Ornstein-Uhlenbeck (OU) process that yields explicit expressions for the psychometric function that describes accuracy. From these we compute strategies that optimize the rewards expected over blocks of trials administered with mixed difficulty and reward contingencies. The psychometric function is characterized by two parameters: its midpoint slope, which quantifies a subject's ability to extract signal from noise, and its shift, which measures the bias applied to account for unequal rewards. We fit these to data from two monkeys performing the moving dots task with mixed coherences and reward schedules. We find that their behaviors averaged over multiple sessions are close to optimal, with shifts erring in the direction of smaller penalties. We propose two methods for biasing the OU process to produce such shifts.
format Text
id pubmed-2631644
institution National Center for Biotechnology Information
language English
publishDate 2009
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-26316442009-02-13 Can Monkeys Choose Optimally When Faced with Noisy Stimuli and Unequal Rewards? Feng, Samuel Holmes, Philip Rorie, Alan Newsome, William T. PLoS Comput Biol Research Article We review the leaky competing accumulator model for two-alternative forced-choice decisions with cued responses, and propose extensions to account for the influence of unequal rewards. Assuming that stimulus information is integrated until the cue to respond arrives and that firing rates of stimulus-selective neurons remain well within physiological bounds, the model reduces to an Ornstein-Uhlenbeck (OU) process that yields explicit expressions for the psychometric function that describes accuracy. From these we compute strategies that optimize the rewards expected over blocks of trials administered with mixed difficulty and reward contingencies. The psychometric function is characterized by two parameters: its midpoint slope, which quantifies a subject's ability to extract signal from noise, and its shift, which measures the bias applied to account for unequal rewards. We fit these to data from two monkeys performing the moving dots task with mixed coherences and reward schedules. We find that their behaviors averaged over multiple sessions are close to optimal, with shifts erring in the direction of smaller penalties. We propose two methods for biasing the OU process to produce such shifts. Public Library of Science 2009-02-13 /pmc/articles/PMC2631644/ /pubmed/19214201 http://dx.doi.org/10.1371/journal.pcbi.1000284 Text en Feng et al. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are properly credited.
spellingShingle Research Article
Feng, Samuel
Holmes, Philip
Rorie, Alan
Newsome, William T.
Can Monkeys Choose Optimally When Faced with Noisy Stimuli and Unequal Rewards?
title Can Monkeys Choose Optimally When Faced with Noisy Stimuli and Unequal Rewards?
title_full Can Monkeys Choose Optimally When Faced with Noisy Stimuli and Unequal Rewards?
title_fullStr Can Monkeys Choose Optimally When Faced with Noisy Stimuli and Unequal Rewards?
title_full_unstemmed Can Monkeys Choose Optimally When Faced with Noisy Stimuli and Unequal Rewards?
title_short Can Monkeys Choose Optimally When Faced with Noisy Stimuli and Unequal Rewards?
title_sort can monkeys choose optimally when faced with noisy stimuli and unequal rewards?
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC2631644/
https://www.ncbi.nlm.nih.gov/pubmed/19214201
http://dx.doi.org/10.1371/journal.pcbi.1000284
work_keys_str_mv AT fengsamuel canmonkeyschooseoptimallywhenfacedwithnoisystimuliandunequalrewards
AT holmesphilip canmonkeyschooseoptimallywhenfacedwithnoisystimuliandunequalrewards
AT roriealan canmonkeyschooseoptimallywhenfacedwithnoisystimuliandunequalrewards
AT newsomewilliamt canmonkeyschooseoptimallywhenfacedwithnoisystimuliandunequalrewards