Cargando…
Action in auctions: neural and computational mechanisms of bidding behaviour
Competition for resources is a fundamental characteristic of evolution. Auctions have been widely used to model competition of individuals for resources, and bidding behaviour plays a major role in social competition. Yet, how humans learn to bid efficiently remains an open question. We used model‐b...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
John Wiley and Sons Inc.
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6899836/ https://www.ncbi.nlm.nih.gov/pubmed/31219633 http://dx.doi.org/10.1111/ejn.14492 |
_version_ | 1783477219673243648 |
---|---|
author | Martinez-Saito, Mario Konovalov, Rodion Piradov, Michael A. Shestakova, Anna Gutkin, Boris Klucharev, Vasily |
author_facet | Martinez-Saito, Mario Konovalov, Rodion Piradov, Michael A. Shestakova, Anna Gutkin, Boris Klucharev, Vasily |
author_sort | Martinez-Saito, Mario |
collection | PubMed |
description | Competition for resources is a fundamental characteristic of evolution. Auctions have been widely used to model competition of individuals for resources, and bidding behaviour plays a major role in social competition. Yet, how humans learn to bid efficiently remains an open question. We used model‐based neuroimaging to investigate the neural mechanisms of bidding behaviour under different types of competition. Twenty‐seven subjects (nine male) played a prototypical bidding game: a double action, with three “market” types, which differed in the number of competitors. We compared different computational learning models of bidding: directional learning models (DL), where the model bid is “nudged” depending on whether it was accepted or rejected, along with standard reinforcement learning models (RL). We found that DL fit the behaviour best and resulted in higher payoffs. We found the binary learning signal associated with DL to be represented by neural activity in the striatum distinctly posterior to a weaker reward prediction error signal. We posited that DL is an efficient heuristic for valuation when the action (bid) space is continuous. Indeed, we found that the posterior parietal cortex represents the continuous action space of the task, and the frontopolar prefrontal cortex distinguishes among conditions of social competition. Based on our findings, we proposed a conceptual model that accounts for a sequence of processes that are required to perform successful and flexible bidding under different types of competition. |
format | Online Article Text |
id | pubmed-6899836 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | John Wiley and Sons Inc. |
record_format | MEDLINE/PubMed |
spelling | pubmed-68998362019-12-19 Action in auctions: neural and computational mechanisms of bidding behaviour Martinez-Saito, Mario Konovalov, Rodion Piradov, Michael A. Shestakova, Anna Gutkin, Boris Klucharev, Vasily Eur J Neurosci Cognitive Neuroscience Competition for resources is a fundamental characteristic of evolution. Auctions have been widely used to model competition of individuals for resources, and bidding behaviour plays a major role in social competition. Yet, how humans learn to bid efficiently remains an open question. We used model‐based neuroimaging to investigate the neural mechanisms of bidding behaviour under different types of competition. Twenty‐seven subjects (nine male) played a prototypical bidding game: a double action, with three “market” types, which differed in the number of competitors. We compared different computational learning models of bidding: directional learning models (DL), where the model bid is “nudged” depending on whether it was accepted or rejected, along with standard reinforcement learning models (RL). We found that DL fit the behaviour best and resulted in higher payoffs. We found the binary learning signal associated with DL to be represented by neural activity in the striatum distinctly posterior to a weaker reward prediction error signal. We posited that DL is an efficient heuristic for valuation when the action (bid) space is continuous. Indeed, we found that the posterior parietal cortex represents the continuous action space of the task, and the frontopolar prefrontal cortex distinguishes among conditions of social competition. Based on our findings, we proposed a conceptual model that accounts for a sequence of processes that are required to perform successful and flexible bidding under different types of competition. John Wiley and Sons Inc. 2019-07-29 2019-10 /pmc/articles/PMC6899836/ /pubmed/31219633 http://dx.doi.org/10.1111/ejn.14492 Text en © 2019 The Authors. European Journal of Neuroscience published by Federation of European Neuroscience Societies and John Wiley & Sons Ltd. This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Cognitive Neuroscience Martinez-Saito, Mario Konovalov, Rodion Piradov, Michael A. Shestakova, Anna Gutkin, Boris Klucharev, Vasily Action in auctions: neural and computational mechanisms of bidding behaviour |
title | Action in auctions: neural and computational mechanisms of bidding behaviour |
title_full | Action in auctions: neural and computational mechanisms of bidding behaviour |
title_fullStr | Action in auctions: neural and computational mechanisms of bidding behaviour |
title_full_unstemmed | Action in auctions: neural and computational mechanisms of bidding behaviour |
title_short | Action in auctions: neural and computational mechanisms of bidding behaviour |
title_sort | action in auctions: neural and computational mechanisms of bidding behaviour |
topic | Cognitive Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6899836/ https://www.ncbi.nlm.nih.gov/pubmed/31219633 http://dx.doi.org/10.1111/ejn.14492 |
work_keys_str_mv | AT martinezsaitomario actioninauctionsneuralandcomputationalmechanismsofbiddingbehaviour AT konovalovrodion actioninauctionsneuralandcomputationalmechanismsofbiddingbehaviour AT piradovmichaela actioninauctionsneuralandcomputationalmechanismsofbiddingbehaviour AT shestakovaanna actioninauctionsneuralandcomputationalmechanismsofbiddingbehaviour AT gutkinboris actioninauctionsneuralandcomputationalmechanismsofbiddingbehaviour AT klucharevvasily actioninauctionsneuralandcomputationalmechanismsofbiddingbehaviour |