Cargando…

Capacity, Fidelity, and Noise Tolerance of Associative Spatial-Temporal Memories Based on Memristive Neuromorphic Networks

We have calculated key characteristics of associative (content-addressable) spatial-temporal memories based on neuromorphic networks with restricted connectivity—“CrossNets.” Such networks may be naturally implemented in nanoelectronic hardware using hybrid memristive circuits, which may feature ext...

Descripción completa

Detalles Bibliográficos
Autores principales: Gavrilov, Dmitri, Strukov, Dmitri, Likharev, Konstantin K.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5883079/
https://www.ncbi.nlm.nih.gov/pubmed/29643761
http://dx.doi.org/10.3389/fnins.2018.00195
_version_ 1783311584882327552
author Gavrilov, Dmitri
Strukov, Dmitri
Likharev, Konstantin K.
author_facet Gavrilov, Dmitri
Strukov, Dmitri
Likharev, Konstantin K.
author_sort Gavrilov, Dmitri
collection PubMed
description We have calculated key characteristics of associative (content-addressable) spatial-temporal memories based on neuromorphic networks with restricted connectivity—“CrossNets.” Such networks may be naturally implemented in nanoelectronic hardware using hybrid memristive circuits, which may feature extremely high energy efficiency, approaching that of biological cortical circuits, at much higher operation speed. Our numerical simulations, in some cases confirmed by analytical calculations, show that the characteristics depend substantially on the method of information recording into the memory. Of the four methods we have explored, two methods look especially promising—one based on the quadratic programming, and the other one being a specific discrete version of the gradient descent. The latter method provides a slightly lower memory capacity (at the same fidelity) then the former one, but it allows local recording, which may be more readily implemented in nanoelectronic hardware. Most importantly, at the synchronous retrieval, both methods provide a capacity higher than that of the well-known Ternary Content-Addressable Memories with the same number of nonvolatile memory cells (e.g., memristors), though the input noise immunity of the CrossNet memories is lower.
format Online
Article
Text
id pubmed-5883079
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-58830792018-04-11 Capacity, Fidelity, and Noise Tolerance of Associative Spatial-Temporal Memories Based on Memristive Neuromorphic Networks Gavrilov, Dmitri Strukov, Dmitri Likharev, Konstantin K. Front Neurosci Neuroscience We have calculated key characteristics of associative (content-addressable) spatial-temporal memories based on neuromorphic networks with restricted connectivity—“CrossNets.” Such networks may be naturally implemented in nanoelectronic hardware using hybrid memristive circuits, which may feature extremely high energy efficiency, approaching that of biological cortical circuits, at much higher operation speed. Our numerical simulations, in some cases confirmed by analytical calculations, show that the characteristics depend substantially on the method of information recording into the memory. Of the four methods we have explored, two methods look especially promising—one based on the quadratic programming, and the other one being a specific discrete version of the gradient descent. The latter method provides a slightly lower memory capacity (at the same fidelity) then the former one, but it allows local recording, which may be more readily implemented in nanoelectronic hardware. Most importantly, at the synchronous retrieval, both methods provide a capacity higher than that of the well-known Ternary Content-Addressable Memories with the same number of nonvolatile memory cells (e.g., memristors), though the input noise immunity of the CrossNet memories is lower. Frontiers Media S.A. 2018-03-28 /pmc/articles/PMC5883079/ /pubmed/29643761 http://dx.doi.org/10.3389/fnins.2018.00195 Text en Copyright © 2018 Gavrilov, Strukov and Likharev. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Gavrilov, Dmitri
Strukov, Dmitri
Likharev, Konstantin K.
Capacity, Fidelity, and Noise Tolerance of Associative Spatial-Temporal Memories Based on Memristive Neuromorphic Networks
title Capacity, Fidelity, and Noise Tolerance of Associative Spatial-Temporal Memories Based on Memristive Neuromorphic Networks
title_full Capacity, Fidelity, and Noise Tolerance of Associative Spatial-Temporal Memories Based on Memristive Neuromorphic Networks
title_fullStr Capacity, Fidelity, and Noise Tolerance of Associative Spatial-Temporal Memories Based on Memristive Neuromorphic Networks
title_full_unstemmed Capacity, Fidelity, and Noise Tolerance of Associative Spatial-Temporal Memories Based on Memristive Neuromorphic Networks
title_short Capacity, Fidelity, and Noise Tolerance of Associative Spatial-Temporal Memories Based on Memristive Neuromorphic Networks
title_sort capacity, fidelity, and noise tolerance of associative spatial-temporal memories based on memristive neuromorphic networks
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5883079/
https://www.ncbi.nlm.nih.gov/pubmed/29643761
http://dx.doi.org/10.3389/fnins.2018.00195
work_keys_str_mv AT gavrilovdmitri capacityfidelityandnoisetoleranceofassociativespatialtemporalmemoriesbasedonmemristiveneuromorphicnetworks
AT strukovdmitri capacityfidelityandnoisetoleranceofassociativespatialtemporalmemoriesbasedonmemristiveneuromorphicnetworks
AT likharevkonstantink capacityfidelityandnoisetoleranceofassociativespatialtemporalmemoriesbasedonmemristiveneuromorphicnetworks