Cargando…

Reinforcement learning accounts for moody conditional cooperation behavior: experimental results

In social dilemma games, human participants often show conditional cooperation (CC) behavior or its variant called moody conditional cooperation (MCC), with which they basically tend to cooperate when many other peers have previously cooperated. Recent computational studies showed that CC and MCC be...

Descripción completa

Detalles Bibliográficos
Autores principales: Horita, Yutaka, Takezawa, Masanori, Inukai, Keigo, Kita, Toshimasa, Masuda, Naoki
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group 2017
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5223288/
https://www.ncbi.nlm.nih.gov/pubmed/28071646
http://dx.doi.org/10.1038/srep39275
_version_ 1782493139475365888
author Horita, Yutaka
Takezawa, Masanori
Inukai, Keigo
Kita, Toshimasa
Masuda, Naoki
author_facet Horita, Yutaka
Takezawa, Masanori
Inukai, Keigo
Kita, Toshimasa
Masuda, Naoki
author_sort Horita, Yutaka
collection PubMed
description In social dilemma games, human participants often show conditional cooperation (CC) behavior or its variant called moody conditional cooperation (MCC), with which they basically tend to cooperate when many other peers have previously cooperated. Recent computational studies showed that CC and MCC behavioral patterns could be explained by reinforcement learning. In the present study, we use a repeated multiplayer prisoner’s dilemma game and the repeated public goods game played by human participants to examine whether MCC is observed across different types of game and the possibility that reinforcement learning explains observed behavior. We observed MCC behavior in both games, but the MCC that we observed was different from that observed in the past experiments. In the present study, whether or not a focal participant cooperated previously affected the overall level of cooperation, instead of changing the tendency of cooperation in response to cooperation of other participants in the previous time step. We found that, across different conditions, reinforcement learning models were approximately as accurate as a MCC model in describing the experimental results. Consistent with the previous computational studies, the present results suggest that reinforcement learning may be a major proximate mechanism governing MCC behavior.
format Online
Article
Text
id pubmed-5223288
institution National Center for Biotechnology Information
language English
publishDate 2017
publisher Nature Publishing Group
record_format MEDLINE/PubMed
spelling pubmed-52232882017-01-17 Reinforcement learning accounts for moody conditional cooperation behavior: experimental results Horita, Yutaka Takezawa, Masanori Inukai, Keigo Kita, Toshimasa Masuda, Naoki Sci Rep Article In social dilemma games, human participants often show conditional cooperation (CC) behavior or its variant called moody conditional cooperation (MCC), with which they basically tend to cooperate when many other peers have previously cooperated. Recent computational studies showed that CC and MCC behavioral patterns could be explained by reinforcement learning. In the present study, we use a repeated multiplayer prisoner’s dilemma game and the repeated public goods game played by human participants to examine whether MCC is observed across different types of game and the possibility that reinforcement learning explains observed behavior. We observed MCC behavior in both games, but the MCC that we observed was different from that observed in the past experiments. In the present study, whether or not a focal participant cooperated previously affected the overall level of cooperation, instead of changing the tendency of cooperation in response to cooperation of other participants in the previous time step. We found that, across different conditions, reinforcement learning models were approximately as accurate as a MCC model in describing the experimental results. Consistent with the previous computational studies, the present results suggest that reinforcement learning may be a major proximate mechanism governing MCC behavior. Nature Publishing Group 2017-01-10 /pmc/articles/PMC5223288/ /pubmed/28071646 http://dx.doi.org/10.1038/srep39275 Text en Copyright © 2017, The Author(s) http://creativecommons.org/licenses/by/4.0/ This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
spellingShingle Article
Horita, Yutaka
Takezawa, Masanori
Inukai, Keigo
Kita, Toshimasa
Masuda, Naoki
Reinforcement learning accounts for moody conditional cooperation behavior: experimental results
title Reinforcement learning accounts for moody conditional cooperation behavior: experimental results
title_full Reinforcement learning accounts for moody conditional cooperation behavior: experimental results
title_fullStr Reinforcement learning accounts for moody conditional cooperation behavior: experimental results
title_full_unstemmed Reinforcement learning accounts for moody conditional cooperation behavior: experimental results
title_short Reinforcement learning accounts for moody conditional cooperation behavior: experimental results
title_sort reinforcement learning accounts for moody conditional cooperation behavior: experimental results
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5223288/
https://www.ncbi.nlm.nih.gov/pubmed/28071646
http://dx.doi.org/10.1038/srep39275
work_keys_str_mv AT horitayutaka reinforcementlearningaccountsformoodyconditionalcooperationbehaviorexperimentalresults
AT takezawamasanori reinforcementlearningaccountsformoodyconditionalcooperationbehaviorexperimentalresults
AT inukaikeigo reinforcementlearningaccountsformoodyconditionalcooperationbehaviorexperimentalresults
AT kitatoshimasa reinforcementlearningaccountsformoodyconditionalcooperationbehaviorexperimentalresults
AT masudanaoki reinforcementlearningaccountsformoodyconditionalcooperationbehaviorexperimentalresults