Cargando…

Importance of prefrontal meta control in human-like reinforcement learning

Recent investigation on reinforcement learning (RL) has demonstrated considerable flexibility in dealing with various problems. However, such models often experience difficulty learning seemingly easy tasks for humans. To reconcile the discrepancy, our paper is focused on the computational benefits...

Descripción completa

Detalles Bibliográficos
Autores principales: Lee, Jee Hang, Leibo, Joel Z., An, Su Jin, Lee, Sang Wan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9811824/
https://www.ncbi.nlm.nih.gov/pubmed/36618272
http://dx.doi.org/10.3389/fncom.2022.1060101
_version_ 1784863607306059776
author Lee, Jee Hang
Leibo, Joel Z.
An, Su Jin
Lee, Sang Wan
author_facet Lee, Jee Hang
Leibo, Joel Z.
An, Su Jin
Lee, Sang Wan
author_sort Lee, Jee Hang
collection PubMed
description Recent investigation on reinforcement learning (RL) has demonstrated considerable flexibility in dealing with various problems. However, such models often experience difficulty learning seemingly easy tasks for humans. To reconcile the discrepancy, our paper is focused on the computational benefits of the brain's RL. We examine the brain's ability to combine complementary learning strategies to resolve the trade-off between prediction performance, computational costs, and time constraints. The complex need for task performance created by a volatile and/or multi-agent environment motivates the brain to continually explore an ideal combination of multiple strategies, called meta-control. Understanding these functions would allow us to build human-aligned RL models.
format Online
Article
Text
id pubmed-9811824
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-98118242023-01-05 Importance of prefrontal meta control in human-like reinforcement learning Lee, Jee Hang Leibo, Joel Z. An, Su Jin Lee, Sang Wan Front Comput Neurosci Neuroscience Recent investigation on reinforcement learning (RL) has demonstrated considerable flexibility in dealing with various problems. However, such models often experience difficulty learning seemingly easy tasks for humans. To reconcile the discrepancy, our paper is focused on the computational benefits of the brain's RL. We examine the brain's ability to combine complementary learning strategies to resolve the trade-off between prediction performance, computational costs, and time constraints. The complex need for task performance created by a volatile and/or multi-agent environment motivates the brain to continually explore an ideal combination of multiple strategies, called meta-control. Understanding these functions would allow us to build human-aligned RL models. Frontiers Media S.A. 2022-12-21 /pmc/articles/PMC9811824/ /pubmed/36618272 http://dx.doi.org/10.3389/fncom.2022.1060101 Text en Copyright © 2022 Lee, Leibo, An and Lee. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Lee, Jee Hang
Leibo, Joel Z.
An, Su Jin
Lee, Sang Wan
Importance of prefrontal meta control in human-like reinforcement learning
title Importance of prefrontal meta control in human-like reinforcement learning
title_full Importance of prefrontal meta control in human-like reinforcement learning
title_fullStr Importance of prefrontal meta control in human-like reinforcement learning
title_full_unstemmed Importance of prefrontal meta control in human-like reinforcement learning
title_short Importance of prefrontal meta control in human-like reinforcement learning
title_sort importance of prefrontal meta control in human-like reinforcement learning
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9811824/
https://www.ncbi.nlm.nih.gov/pubmed/36618272
http://dx.doi.org/10.3389/fncom.2022.1060101
work_keys_str_mv AT leejeehang importanceofprefrontalmetacontrolinhumanlikereinforcementlearning
AT leibojoelz importanceofprefrontalmetacontrolinhumanlikereinforcementlearning
AT ansujin importanceofprefrontalmetacontrolinhumanlikereinforcementlearning
AT leesangwan importanceofprefrontalmetacontrolinhumanlikereinforcementlearning