Cargando…

Planning and navigation as active inference

This paper introduces an active inference formulation of planning and navigation. It illustrates how the exploitation–exploration dilemma is dissolved by acting to minimise uncertainty (i.e. expected surprise or free energy). We use simulations of a maze problem to illustrate how agents can solve qu...

Descripción completa

Detalles Bibliográficos
Autores principales: Kaplan, Raphael, Friston, Karl J.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer Berlin Heidelberg 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6060791/
https://www.ncbi.nlm.nih.gov/pubmed/29572721
http://dx.doi.org/10.1007/s00422-018-0753-2
_version_ 1783342086904348672
author Kaplan, Raphael
Friston, Karl J.
author_facet Kaplan, Raphael
Friston, Karl J.
author_sort Kaplan, Raphael
collection PubMed
description This paper introduces an active inference formulation of planning and navigation. It illustrates how the exploitation–exploration dilemma is dissolved by acting to minimise uncertainty (i.e. expected surprise or free energy). We use simulations of a maze problem to illustrate how agents can solve quite complicated problems using context sensitive prior preferences to form subgoals. Our focus is on how epistemic behaviour—driven by novelty and the imperative to reduce uncertainty about the world—contextualises pragmatic or goal-directed behaviour. Using simulations, we illustrate the underlying process theory with synthetic behavioural and electrophysiological responses during exploration of a maze and subsequent navigation to a target location. An interesting phenomenon that emerged from the simulations was a putative distinction between ‘place cells’—that fire when a subgoal is reached—and ‘path cells’—that fire until a subgoal is reached.
format Online
Article
Text
id pubmed-6060791
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Springer Berlin Heidelberg
record_format MEDLINE/PubMed
spelling pubmed-60607912018-08-09 Planning and navigation as active inference Kaplan, Raphael Friston, Karl J. Biol Cybern Original Article This paper introduces an active inference formulation of planning and navigation. It illustrates how the exploitation–exploration dilemma is dissolved by acting to minimise uncertainty (i.e. expected surprise or free energy). We use simulations of a maze problem to illustrate how agents can solve quite complicated problems using context sensitive prior preferences to form subgoals. Our focus is on how epistemic behaviour—driven by novelty and the imperative to reduce uncertainty about the world—contextualises pragmatic or goal-directed behaviour. Using simulations, we illustrate the underlying process theory with synthetic behavioural and electrophysiological responses during exploration of a maze and subsequent navigation to a target location. An interesting phenomenon that emerged from the simulations was a putative distinction between ‘place cells’—that fire when a subgoal is reached—and ‘path cells’—that fire until a subgoal is reached. Springer Berlin Heidelberg 2018-03-23 2018 /pmc/articles/PMC6060791/ /pubmed/29572721 http://dx.doi.org/10.1007/s00422-018-0753-2 Text en © The Author(s) 2018 Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
spellingShingle Original Article
Kaplan, Raphael
Friston, Karl J.
Planning and navigation as active inference
title Planning and navigation as active inference
title_full Planning and navigation as active inference
title_fullStr Planning and navigation as active inference
title_full_unstemmed Planning and navigation as active inference
title_short Planning and navigation as active inference
title_sort planning and navigation as active inference
topic Original Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6060791/
https://www.ncbi.nlm.nih.gov/pubmed/29572721
http://dx.doi.org/10.1007/s00422-018-0753-2
work_keys_str_mv AT kaplanraphael planningandnavigationasactiveinference
AT fristonkarlj planningandnavigationasactiveinference