Cargando…
Importance of prefrontal meta control in human-like reinforcement learning
Recent investigation on reinforcement learning (RL) has demonstrated considerable flexibility in dealing with various problems. However, such models often experience difficulty learning seemingly easy tasks for humans. To reconcile the discrepancy, our paper is focused on the computational benefits...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9811824/ https://www.ncbi.nlm.nih.gov/pubmed/36618272 http://dx.doi.org/10.3389/fncom.2022.1060101 |
_version_ | 1784863607306059776 |
---|---|
author | Lee, Jee Hang Leibo, Joel Z. An, Su Jin Lee, Sang Wan |
author_facet | Lee, Jee Hang Leibo, Joel Z. An, Su Jin Lee, Sang Wan |
author_sort | Lee, Jee Hang |
collection | PubMed |
description | Recent investigation on reinforcement learning (RL) has demonstrated considerable flexibility in dealing with various problems. However, such models often experience difficulty learning seemingly easy tasks for humans. To reconcile the discrepancy, our paper is focused on the computational benefits of the brain's RL. We examine the brain's ability to combine complementary learning strategies to resolve the trade-off between prediction performance, computational costs, and time constraints. The complex need for task performance created by a volatile and/or multi-agent environment motivates the brain to continually explore an ideal combination of multiple strategies, called meta-control. Understanding these functions would allow us to build human-aligned RL models. |
format | Online Article Text |
id | pubmed-9811824 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-98118242023-01-05 Importance of prefrontal meta control in human-like reinforcement learning Lee, Jee Hang Leibo, Joel Z. An, Su Jin Lee, Sang Wan Front Comput Neurosci Neuroscience Recent investigation on reinforcement learning (RL) has demonstrated considerable flexibility in dealing with various problems. However, such models often experience difficulty learning seemingly easy tasks for humans. To reconcile the discrepancy, our paper is focused on the computational benefits of the brain's RL. We examine the brain's ability to combine complementary learning strategies to resolve the trade-off between prediction performance, computational costs, and time constraints. The complex need for task performance created by a volatile and/or multi-agent environment motivates the brain to continually explore an ideal combination of multiple strategies, called meta-control. Understanding these functions would allow us to build human-aligned RL models. Frontiers Media S.A. 2022-12-21 /pmc/articles/PMC9811824/ /pubmed/36618272 http://dx.doi.org/10.3389/fncom.2022.1060101 Text en Copyright © 2022 Lee, Leibo, An and Lee. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Lee, Jee Hang Leibo, Joel Z. An, Su Jin Lee, Sang Wan Importance of prefrontal meta control in human-like reinforcement learning |
title | Importance of prefrontal meta control in human-like reinforcement learning |
title_full | Importance of prefrontal meta control in human-like reinforcement learning |
title_fullStr | Importance of prefrontal meta control in human-like reinforcement learning |
title_full_unstemmed | Importance of prefrontal meta control in human-like reinforcement learning |
title_short | Importance of prefrontal meta control in human-like reinforcement learning |
title_sort | importance of prefrontal meta control in human-like reinforcement learning |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9811824/ https://www.ncbi.nlm.nih.gov/pubmed/36618272 http://dx.doi.org/10.3389/fncom.2022.1060101 |
work_keys_str_mv | AT leejeehang importanceofprefrontalmetacontrolinhumanlikereinforcementlearning AT leibojoelz importanceofprefrontalmetacontrolinhumanlikereinforcementlearning AT ansujin importanceofprefrontalmetacontrolinhumanlikereinforcementlearning AT leesangwan importanceofprefrontalmetacontrolinhumanlikereinforcementlearning |