Cargando…
Planning and navigation as active inference
This paper introduces an active inference formulation of planning and navigation. It illustrates how the exploitation–exploration dilemma is dissolved by acting to minimise uncertainty (i.e. expected surprise or free energy). We use simulations of a maze problem to illustrate how agents can solve qu...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer Berlin Heidelberg
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6060791/ https://www.ncbi.nlm.nih.gov/pubmed/29572721 http://dx.doi.org/10.1007/s00422-018-0753-2 |
_version_ | 1783342086904348672 |
---|---|
author | Kaplan, Raphael Friston, Karl J. |
author_facet | Kaplan, Raphael Friston, Karl J. |
author_sort | Kaplan, Raphael |
collection | PubMed |
description | This paper introduces an active inference formulation of planning and navigation. It illustrates how the exploitation–exploration dilemma is dissolved by acting to minimise uncertainty (i.e. expected surprise or free energy). We use simulations of a maze problem to illustrate how agents can solve quite complicated problems using context sensitive prior preferences to form subgoals. Our focus is on how epistemic behaviour—driven by novelty and the imperative to reduce uncertainty about the world—contextualises pragmatic or goal-directed behaviour. Using simulations, we illustrate the underlying process theory with synthetic behavioural and electrophysiological responses during exploration of a maze and subsequent navigation to a target location. An interesting phenomenon that emerged from the simulations was a putative distinction between ‘place cells’—that fire when a subgoal is reached—and ‘path cells’—that fire until a subgoal is reached. |
format | Online Article Text |
id | pubmed-6060791 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | Springer Berlin Heidelberg |
record_format | MEDLINE/PubMed |
spelling | pubmed-60607912018-08-09 Planning and navigation as active inference Kaplan, Raphael Friston, Karl J. Biol Cybern Original Article This paper introduces an active inference formulation of planning and navigation. It illustrates how the exploitation–exploration dilemma is dissolved by acting to minimise uncertainty (i.e. expected surprise or free energy). We use simulations of a maze problem to illustrate how agents can solve quite complicated problems using context sensitive prior preferences to form subgoals. Our focus is on how epistemic behaviour—driven by novelty and the imperative to reduce uncertainty about the world—contextualises pragmatic or goal-directed behaviour. Using simulations, we illustrate the underlying process theory with synthetic behavioural and electrophysiological responses during exploration of a maze and subsequent navigation to a target location. An interesting phenomenon that emerged from the simulations was a putative distinction between ‘place cells’—that fire when a subgoal is reached—and ‘path cells’—that fire until a subgoal is reached. Springer Berlin Heidelberg 2018-03-23 2018 /pmc/articles/PMC6060791/ /pubmed/29572721 http://dx.doi.org/10.1007/s00422-018-0753-2 Text en © The Author(s) 2018 Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. |
spellingShingle | Original Article Kaplan, Raphael Friston, Karl J. Planning and navigation as active inference |
title | Planning and navigation as active inference |
title_full | Planning and navigation as active inference |
title_fullStr | Planning and navigation as active inference |
title_full_unstemmed | Planning and navigation as active inference |
title_short | Planning and navigation as active inference |
title_sort | planning and navigation as active inference |
topic | Original Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6060791/ https://www.ncbi.nlm.nih.gov/pubmed/29572721 http://dx.doi.org/10.1007/s00422-018-0753-2 |
work_keys_str_mv | AT kaplanraphael planningandnavigationasactiveinference AT fristonkarlj planningandnavigationasactiveinference |