Cargando…
A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination
As a new type of artificial neural network model, HTM has become the focus of current research and application. The sparse distributed representation is the basis of the HTM model, but the existing spatial pool learning algorithms have high training time overhead and may cause the spatial pool to be...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Hindawi
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7994094/ https://www.ncbi.nlm.nih.gov/pubmed/33790959 http://dx.doi.org/10.1155/2021/6680833 |
_version_ | 1783669691910193152 |
---|---|
author | Li, Lei Zou, Tingting Cai, Tao Niu, Dejiao Zhu, Yuquan |
author_facet | Li, Lei Zou, Tingting Cai, Tao Niu, Dejiao Zhu, Yuquan |
author_sort | Li, Lei |
collection | PubMed |
description | As a new type of artificial neural network model, HTM has become the focus of current research and application. The sparse distributed representation is the basis of the HTM model, but the existing spatial pool learning algorithms have high training time overhead and may cause the spatial pool to become unstable. To overcome these disadvantages, we propose a fast spatial pool learning algorithm of HTM based on minicolumn's nomination, where the minicolumns are selected according to the load-carrying capacity and the synapses are adjusted using compressed encoding. We have implemented the prototype of the algorithm and carried out experiments on three datasets. It is verified that the training time overhead of the proposed algorithm is almost unaffected by the encoding length, and the spatial pool becomes stable after fewer iterations of training. Moreover, the training of the new input does not affect the already trained results. |
format | Online Article Text |
id | pubmed-7994094 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Hindawi |
record_format | MEDLINE/PubMed |
spelling | pubmed-79940942021-03-30 A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination Li, Lei Zou, Tingting Cai, Tao Niu, Dejiao Zhu, Yuquan Comput Intell Neurosci Research Article As a new type of artificial neural network model, HTM has become the focus of current research and application. The sparse distributed representation is the basis of the HTM model, but the existing spatial pool learning algorithms have high training time overhead and may cause the spatial pool to become unstable. To overcome these disadvantages, we propose a fast spatial pool learning algorithm of HTM based on minicolumn's nomination, where the minicolumns are selected according to the load-carrying capacity and the synapses are adjusted using compressed encoding. We have implemented the prototype of the algorithm and carried out experiments on three datasets. It is verified that the training time overhead of the proposed algorithm is almost unaffected by the encoding length, and the spatial pool becomes stable after fewer iterations of training. Moreover, the training of the new input does not affect the already trained results. Hindawi 2021-03-17 /pmc/articles/PMC7994094/ /pubmed/33790959 http://dx.doi.org/10.1155/2021/6680833 Text en Copyright © 2021 Lei Li et al. https://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research Article Li, Lei Zou, Tingting Cai, Tao Niu, Dejiao Zhu, Yuquan A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination |
title | A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination |
title_full | A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination |
title_fullStr | A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination |
title_full_unstemmed | A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination |
title_short | A Fast Spatial Pool Learning Algorithm of Hierarchical Temporal Memory Based on Minicolumn's Self-Nomination |
title_sort | fast spatial pool learning algorithm of hierarchical temporal memory based on minicolumn's self-nomination |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7994094/ https://www.ncbi.nlm.nih.gov/pubmed/33790959 http://dx.doi.org/10.1155/2021/6680833 |
work_keys_str_mv | AT lilei afastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination AT zoutingting afastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination AT caitao afastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination AT niudejiao afastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination AT zhuyuquan afastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination AT lilei fastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination AT zoutingting fastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination AT caitao fastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination AT niudejiao fastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination AT zhuyuquan fastspatialpoollearningalgorithmofhierarchicaltemporalmemorybasedonminicolumnsselfnomination |