Cargando…

Action in auctions: neural and computational mechanisms of bidding behaviour

Competition for resources is a fundamental characteristic of evolution. Auctions have been widely used to model competition of individuals for resources, and bidding behaviour plays a major role in social competition. Yet, how humans learn to bid efficiently remains an open question. We used model‐b...

Descripción completa

Detalles Bibliográficos
Autores principales: Martinez-Saito, Mario, Konovalov, Rodion, Piradov, Michael A., Shestakova, Anna, Gutkin, Boris, Klucharev, Vasily
Formato: Online Artículo Texto
Lenguaje:English
Publicado: John Wiley and Sons Inc. 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6899836/
https://www.ncbi.nlm.nih.gov/pubmed/31219633
http://dx.doi.org/10.1111/ejn.14492
_version_ 1783477219673243648
author Martinez-Saito, Mario
Konovalov, Rodion
Piradov, Michael A.
Shestakova, Anna
Gutkin, Boris
Klucharev, Vasily
author_facet Martinez-Saito, Mario
Konovalov, Rodion
Piradov, Michael A.
Shestakova, Anna
Gutkin, Boris
Klucharev, Vasily
author_sort Martinez-Saito, Mario
collection PubMed
description Competition for resources is a fundamental characteristic of evolution. Auctions have been widely used to model competition of individuals for resources, and bidding behaviour plays a major role in social competition. Yet, how humans learn to bid efficiently remains an open question. We used model‐based neuroimaging to investigate the neural mechanisms of bidding behaviour under different types of competition. Twenty‐seven subjects (nine male) played a prototypical bidding game: a double action, with three “market” types, which differed in the number of competitors. We compared different computational learning models of bidding: directional learning models (DL), where the model bid is “nudged” depending on whether it was accepted or rejected, along with standard reinforcement learning models (RL). We found that DL fit the behaviour best and resulted in higher payoffs. We found the binary learning signal associated with DL to be represented by neural activity in the striatum distinctly posterior to a weaker reward prediction error signal. We posited that DL is an efficient heuristic for valuation when the action (bid) space is continuous. Indeed, we found that the posterior parietal cortex represents the continuous action space of the task, and the frontopolar prefrontal cortex distinguishes among conditions of social competition. Based on our findings, we proposed a conceptual model that accounts for a sequence of processes that are required to perform successful and flexible bidding under different types of competition.
format Online
Article
Text
id pubmed-6899836
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher John Wiley and Sons Inc.
record_format MEDLINE/PubMed
spelling pubmed-68998362019-12-19 Action in auctions: neural and computational mechanisms of bidding behaviour Martinez-Saito, Mario Konovalov, Rodion Piradov, Michael A. Shestakova, Anna Gutkin, Boris Klucharev, Vasily Eur J Neurosci Cognitive Neuroscience Competition for resources is a fundamental characteristic of evolution. Auctions have been widely used to model competition of individuals for resources, and bidding behaviour plays a major role in social competition. Yet, how humans learn to bid efficiently remains an open question. We used model‐based neuroimaging to investigate the neural mechanisms of bidding behaviour under different types of competition. Twenty‐seven subjects (nine male) played a prototypical bidding game: a double action, with three “market” types, which differed in the number of competitors. We compared different computational learning models of bidding: directional learning models (DL), where the model bid is “nudged” depending on whether it was accepted or rejected, along with standard reinforcement learning models (RL). We found that DL fit the behaviour best and resulted in higher payoffs. We found the binary learning signal associated with DL to be represented by neural activity in the striatum distinctly posterior to a weaker reward prediction error signal. We posited that DL is an efficient heuristic for valuation when the action (bid) space is continuous. Indeed, we found that the posterior parietal cortex represents the continuous action space of the task, and the frontopolar prefrontal cortex distinguishes among conditions of social competition. Based on our findings, we proposed a conceptual model that accounts for a sequence of processes that are required to perform successful and flexible bidding under different types of competition. John Wiley and Sons Inc. 2019-07-29 2019-10 /pmc/articles/PMC6899836/ /pubmed/31219633 http://dx.doi.org/10.1111/ejn.14492 Text en © 2019 The Authors. European Journal of Neuroscience published by Federation of European Neuroscience Societies and John Wiley & Sons Ltd. This is an open access article under the terms of the http://creativecommons.org/licenses/by/4.0/ License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.
spellingShingle Cognitive Neuroscience
Martinez-Saito, Mario
Konovalov, Rodion
Piradov, Michael A.
Shestakova, Anna
Gutkin, Boris
Klucharev, Vasily
Action in auctions: neural and computational mechanisms of bidding behaviour
title Action in auctions: neural and computational mechanisms of bidding behaviour
title_full Action in auctions: neural and computational mechanisms of bidding behaviour
title_fullStr Action in auctions: neural and computational mechanisms of bidding behaviour
title_full_unstemmed Action in auctions: neural and computational mechanisms of bidding behaviour
title_short Action in auctions: neural and computational mechanisms of bidding behaviour
title_sort action in auctions: neural and computational mechanisms of bidding behaviour
topic Cognitive Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6899836/
https://www.ncbi.nlm.nih.gov/pubmed/31219633
http://dx.doi.org/10.1111/ejn.14492
work_keys_str_mv AT martinezsaitomario actioninauctionsneuralandcomputationalmechanismsofbiddingbehaviour
AT konovalovrodion actioninauctionsneuralandcomputationalmechanismsofbiddingbehaviour
AT piradovmichaela actioninauctionsneuralandcomputationalmechanismsofbiddingbehaviour
AT shestakovaanna actioninauctionsneuralandcomputationalmechanismsofbiddingbehaviour
AT gutkinboris actioninauctionsneuralandcomputationalmechanismsofbiddingbehaviour
AT klucharevvasily actioninauctionsneuralandcomputationalmechanismsofbiddingbehaviour