Cargando…
The attention schema theory in a neural network agent: Controlling visuospatial attention using a descriptive model of attention
In the attention schema theory (AST), the brain constructs a model of attention, the attention schema, to aid in the endogenous control of attention. Growing behavioral evidence appears to support the presence of a model of attention. However, a central question remains: does a controller of attenti...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
National Academy of Sciences
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8379943/ https://www.ncbi.nlm.nih.gov/pubmed/34385306 http://dx.doi.org/10.1073/pnas.2102421118 |
_version_ | 1783741104251731968 |
---|---|
author | Wilterson, Andrew I. Graziano, Michael S. A. |
author_facet | Wilterson, Andrew I. Graziano, Michael S. A. |
author_sort | Wilterson, Andrew I. |
collection | PubMed |
description | In the attention schema theory (AST), the brain constructs a model of attention, the attention schema, to aid in the endogenous control of attention. Growing behavioral evidence appears to support the presence of a model of attention. However, a central question remains: does a controller of attention actually benefit by having access to an attention schema? We constructed an artificial deep Q-learning neural network agent that was trained to control a simple form of visuospatial attention, tracking a stimulus with an attention spotlight in order to solve a catch task. The agent was tested with and without access to an attention schema. In both conditions, the agent received sufficient information such that it should, theoretically, be able to learn the task. We found that with an attention schema present, the agent learned to control its attention spotlight and learned the catch task. Once the agent learned, if the attention schema was then disabled, the agent’s performance was greatly reduced. If the attention schema was removed before learning began, the agent was impaired at learning. The results show how the presence of even a simple attention schema can provide a profound benefit to a controller of attention. We interpret these results as supporting the central argument of AST: the brain contains an attention schema because of its practical benefit in the endogenous control of attention. |
format | Online Article Text |
id | pubmed-8379943 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | National Academy of Sciences |
record_format | MEDLINE/PubMed |
spelling | pubmed-83799432021-08-30 The attention schema theory in a neural network agent: Controlling visuospatial attention using a descriptive model of attention Wilterson, Andrew I. Graziano, Michael S. A. Proc Natl Acad Sci U S A Social Sciences In the attention schema theory (AST), the brain constructs a model of attention, the attention schema, to aid in the endogenous control of attention. Growing behavioral evidence appears to support the presence of a model of attention. However, a central question remains: does a controller of attention actually benefit by having access to an attention schema? We constructed an artificial deep Q-learning neural network agent that was trained to control a simple form of visuospatial attention, tracking a stimulus with an attention spotlight in order to solve a catch task. The agent was tested with and without access to an attention schema. In both conditions, the agent received sufficient information such that it should, theoretically, be able to learn the task. We found that with an attention schema present, the agent learned to control its attention spotlight and learned the catch task. Once the agent learned, if the attention schema was then disabled, the agent’s performance was greatly reduced. If the attention schema was removed before learning began, the agent was impaired at learning. The results show how the presence of even a simple attention schema can provide a profound benefit to a controller of attention. We interpret these results as supporting the central argument of AST: the brain contains an attention schema because of its practical benefit in the endogenous control of attention. National Academy of Sciences 2021-08-17 2021-08-12 /pmc/articles/PMC8379943/ /pubmed/34385306 http://dx.doi.org/10.1073/pnas.2102421118 Text en Copyright © 2021 the Author(s). Published by PNAS. https://creativecommons.org/licenses/by-nc-nd/4.0/This open access article is distributed under Creative Commons Attribution-NonCommercial-NoDerivatives License 4.0 (CC BY-NC-ND) (https://creativecommons.org/licenses/by-nc-nd/4.0/) . |
spellingShingle | Social Sciences Wilterson, Andrew I. Graziano, Michael S. A. The attention schema theory in a neural network agent: Controlling visuospatial attention using a descriptive model of attention |
title | The attention schema theory in a neural network agent: Controlling visuospatial attention using a descriptive model of attention |
title_full | The attention schema theory in a neural network agent: Controlling visuospatial attention using a descriptive model of attention |
title_fullStr | The attention schema theory in a neural network agent: Controlling visuospatial attention using a descriptive model of attention |
title_full_unstemmed | The attention schema theory in a neural network agent: Controlling visuospatial attention using a descriptive model of attention |
title_short | The attention schema theory in a neural network agent: Controlling visuospatial attention using a descriptive model of attention |
title_sort | attention schema theory in a neural network agent: controlling visuospatial attention using a descriptive model of attention |
topic | Social Sciences |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8379943/ https://www.ncbi.nlm.nih.gov/pubmed/34385306 http://dx.doi.org/10.1073/pnas.2102421118 |
work_keys_str_mv | AT wiltersonandrewi theattentionschematheoryinaneuralnetworkagentcontrollingvisuospatialattentionusingadescriptivemodelofattention AT grazianomichaelsa theattentionschematheoryinaneuralnetworkagentcontrollingvisuospatialattentionusingadescriptivemodelofattention AT wiltersonandrewi attentionschematheoryinaneuralnetworkagentcontrollingvisuospatialattentionusingadescriptivemodelofattention AT grazianomichaelsa attentionschematheoryinaneuralnetworkagentcontrollingvisuospatialattentionusingadescriptivemodelofattention |