Cargando…

A 22-pJ/spike 73-Mspikes/s 130k-compartment neural array transceiver with conductance-based synaptic and membrane dynamics

Neuromorphic cognitive computing offers a bio-inspired means to approach the natural intelligence of biological neural systems in silicon integrated circuits. Typically, such circuits either reproduce biophysical neuronal dynamics in great detail as tools for computational neuroscience, or abstract...

Descripción completa

Detalles Bibliográficos
Autores principales: Park, Jongkil, Ha, Sohmyung, Yu, Theodore, Neftci, Emre, Cauwenberghs, Gert
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10493285/
https://www.ncbi.nlm.nih.gov/pubmed/37700751
http://dx.doi.org/10.3389/fnins.2023.1198306
_version_ 1785104441842597888
author Park, Jongkil
Ha, Sohmyung
Yu, Theodore
Neftci, Emre
Cauwenberghs, Gert
author_facet Park, Jongkil
Ha, Sohmyung
Yu, Theodore
Neftci, Emre
Cauwenberghs, Gert
author_sort Park, Jongkil
collection PubMed
description Neuromorphic cognitive computing offers a bio-inspired means to approach the natural intelligence of biological neural systems in silicon integrated circuits. Typically, such circuits either reproduce biophysical neuronal dynamics in great detail as tools for computational neuroscience, or abstract away the biology by simplifying the functional forms of neural computation in large-scale systems for machine intelligence with high integration density and energy efficiency. Here we report a hybrid which offers biophysical realism in the emulation of multi-compartmental neuronal network dynamics at very large scale with high implementation efficiency, and yet with high flexibility in configuring the functional form and the network topology. The integrate-and-fire array transceiver (IFAT) chip emulates the continuous-time analog membrane dynamics of 65 k two-compartment neurons with conductance-based synapses. Fired action potentials are registered as address-event encoded output spikes, while the four types of synapses coupling to each neuron are activated by address-event decoded input spikes for fully reconfigurable synaptic connectivity, facilitating virtual wiring as implemented by routing address-event spikes externally through synaptic routing table. Peak conductance strength of synapse activation specified by the address-event input spans three decades of dynamic range, digitally controlled by pulse width and amplitude modulation (PWAM) of the drive voltage activating the log-domain linear synapse circuit. Two nested levels of micro-pipelining in the IFAT architecture improve both throughput and efficiency of synaptic input. This two-tier micro-pipelining results in a measured sustained peak throughput of 73 Mspikes/s and overall chip-level energy efficiency of 22 pJ/spike. Non-uniformity in digitally encoded synapse strength due to analog mismatch is mitigated through single-point digital offset calibration. Combined with the flexibly layered and recurrent synaptic connectivity provided by hierarchical address-event routing of registered spike events through external memory, the IFAT lends itself to efficient large-scale emulation of general biophysical spiking neural networks, as well as rate-based mapping of rectified linear unit (ReLU) neural activations.
format Online
Article
Text
id pubmed-10493285
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-104932852023-09-12 A 22-pJ/spike 73-Mspikes/s 130k-compartment neural array transceiver with conductance-based synaptic and membrane dynamics Park, Jongkil Ha, Sohmyung Yu, Theodore Neftci, Emre Cauwenberghs, Gert Front Neurosci Neuroscience Neuromorphic cognitive computing offers a bio-inspired means to approach the natural intelligence of biological neural systems in silicon integrated circuits. Typically, such circuits either reproduce biophysical neuronal dynamics in great detail as tools for computational neuroscience, or abstract away the biology by simplifying the functional forms of neural computation in large-scale systems for machine intelligence with high integration density and energy efficiency. Here we report a hybrid which offers biophysical realism in the emulation of multi-compartmental neuronal network dynamics at very large scale with high implementation efficiency, and yet with high flexibility in configuring the functional form and the network topology. The integrate-and-fire array transceiver (IFAT) chip emulates the continuous-time analog membrane dynamics of 65 k two-compartment neurons with conductance-based synapses. Fired action potentials are registered as address-event encoded output spikes, while the four types of synapses coupling to each neuron are activated by address-event decoded input spikes for fully reconfigurable synaptic connectivity, facilitating virtual wiring as implemented by routing address-event spikes externally through synaptic routing table. Peak conductance strength of synapse activation specified by the address-event input spans three decades of dynamic range, digitally controlled by pulse width and amplitude modulation (PWAM) of the drive voltage activating the log-domain linear synapse circuit. Two nested levels of micro-pipelining in the IFAT architecture improve both throughput and efficiency of synaptic input. This two-tier micro-pipelining results in a measured sustained peak throughput of 73 Mspikes/s and overall chip-level energy efficiency of 22 pJ/spike. Non-uniformity in digitally encoded synapse strength due to analog mismatch is mitigated through single-point digital offset calibration. Combined with the flexibly layered and recurrent synaptic connectivity provided by hierarchical address-event routing of registered spike events through external memory, the IFAT lends itself to efficient large-scale emulation of general biophysical spiking neural networks, as well as rate-based mapping of rectified linear unit (ReLU) neural activations. Frontiers Media S.A. 2023-08-28 /pmc/articles/PMC10493285/ /pubmed/37700751 http://dx.doi.org/10.3389/fnins.2023.1198306 Text en Copyright © 2023 Park, Ha, Yu, Neftci and Cauwenberghs. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Park, Jongkil
Ha, Sohmyung
Yu, Theodore
Neftci, Emre
Cauwenberghs, Gert
A 22-pJ/spike 73-Mspikes/s 130k-compartment neural array transceiver with conductance-based synaptic and membrane dynamics
title A 22-pJ/spike 73-Mspikes/s 130k-compartment neural array transceiver with conductance-based synaptic and membrane dynamics
title_full A 22-pJ/spike 73-Mspikes/s 130k-compartment neural array transceiver with conductance-based synaptic and membrane dynamics
title_fullStr A 22-pJ/spike 73-Mspikes/s 130k-compartment neural array transceiver with conductance-based synaptic and membrane dynamics
title_full_unstemmed A 22-pJ/spike 73-Mspikes/s 130k-compartment neural array transceiver with conductance-based synaptic and membrane dynamics
title_short A 22-pJ/spike 73-Mspikes/s 130k-compartment neural array transceiver with conductance-based synaptic and membrane dynamics
title_sort 22-pj/spike 73-mspikes/s 130k-compartment neural array transceiver with conductance-based synaptic and membrane dynamics
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10493285/
https://www.ncbi.nlm.nih.gov/pubmed/37700751
http://dx.doi.org/10.3389/fnins.2023.1198306
work_keys_str_mv AT parkjongkil a22pjspike73mspikess130kcompartmentneuralarraytransceiverwithconductancebasedsynapticandmembranedynamics
AT hasohmyung a22pjspike73mspikess130kcompartmentneuralarraytransceiverwithconductancebasedsynapticandmembranedynamics
AT yutheodore a22pjspike73mspikess130kcompartmentneuralarraytransceiverwithconductancebasedsynapticandmembranedynamics
AT neftciemre a22pjspike73mspikess130kcompartmentneuralarraytransceiverwithconductancebasedsynapticandmembranedynamics
AT cauwenberghsgert a22pjspike73mspikess130kcompartmentneuralarraytransceiverwithconductancebasedsynapticandmembranedynamics
AT parkjongkil 22pjspike73mspikess130kcompartmentneuralarraytransceiverwithconductancebasedsynapticandmembranedynamics
AT hasohmyung 22pjspike73mspikess130kcompartmentneuralarraytransceiverwithconductancebasedsynapticandmembranedynamics
AT yutheodore 22pjspike73mspikess130kcompartmentneuralarraytransceiverwithconductancebasedsynapticandmembranedynamics
AT neftciemre 22pjspike73mspikess130kcompartmentneuralarraytransceiverwithconductancebasedsynapticandmembranedynamics
AT cauwenberghsgert 22pjspike73mspikess130kcompartmentneuralarraytransceiverwithconductancebasedsynapticandmembranedynamics