Cargando…

A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination

As a new type of artificial neural network model, HTM has become the focus of current research and application. The sparse distributed representation is the basis of the HTM model, but the existing spatial pool learning algorithms have high training time overhead and may cause the spatial pool to be...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Lei, Zou, Tingting, Cai, Tao, Niu, Dejiao, Zhu, Yuquan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7994094/
https://www.ncbi.nlm.nih.gov/pubmed/33790959
http://dx.doi.org/10.1155/2021/6680833
_version_ 1783669691910193152
author Li, Lei
Zou, Tingting
Cai, Tao
Niu, Dejiao
Zhu, Yuquan
author_facet Li, Lei
Zou, Tingting
Cai, Tao
Niu, Dejiao
Zhu, Yuquan
author_sort Li, Lei
collection PubMed
description As a new type of artificial neural network model, HTM has become the focus of current research and application. The sparse distributed representation is the basis of the HTM model, but the existing spatial pool learning algorithms have high training time overhead and may cause the spatial pool to become unstable. To overcome these disadvantages, we propose a fast spatial pool learning algorithm of HTM based on minicolumn's nomination, where the minicolumns are selected according to the load-carrying capacity and the synapses are adjusted using compressed encoding. We have implemented the prototype of the algorithm and carried out experiments on three datasets. It is verified that the training time overhead of the proposed algorithm is almost unaffected by the encoding length, and the spatial pool becomes stable after fewer iterations of training. Moreover, the training of the new input does not affect the already trained results.
format Online
Article
Text
id pubmed-7994094
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-79940942021-03-30 A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination Li, Lei Zou, Tingting Cai, Tao Niu, Dejiao Zhu, Yuquan Comput Intell Neurosci Research Article As a new type of artificial neural network model, HTM has become the focus of current research and application. The sparse distributed representation is the basis of the HTM model, but the existing spatial pool learning algorithms have high training time overhead and may cause the spatial pool to become unstable. To overcome these disadvantages, we propose a fast spatial pool learning algorithm of HTM based on minicolumn's nomination, where the minicolumns are selected according to the load-carrying capacity and the synapses are adjusted using compressed encoding. We have implemented the prototype of the algorithm and carried out experiments on three datasets. It is verified that the training time overhead of the proposed algorithm is almost unaffected by the encoding length, and the spatial pool becomes stable after fewer iterations of training. Moreover, the training of the new input does not affect the already trained results. Hindawi 2021-03-17 /pmc/articles/PMC7994094/ /pubmed/33790959 http://dx.doi.org/10.1155/2021/6680833 Text en Copyright © 2021 Lei Li et al. https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Li, Lei
Zou, Tingting
Cai, Tao
Niu, Dejiao
Zhu, Yuquan
A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination
title A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination
title_full A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination
title_fullStr A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination
title_full_unstemmed A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination
title_short A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination
title_sort fast spatial pool learning algorithm of hierarchical temporal memory based on minicolumn's self-nomination
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7994094/
https://www.ncbi.nlm.nih.gov/pubmed/33790959
http://dx.doi.org/10.1155/2021/6680833
work_keys_str_mv AT lilei afastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination
AT zoutingting afastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination
AT caitao afastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination
AT niudejiao afastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination
AT zhuyuquan afastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination
AT lilei fastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination
AT zoutingting fastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination
AT caitao fastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination
AT niudejiao fastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination
AT zhuyuquan fastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination