Cargando…

A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks

As computational models inspired by the biological neural system, spiking neural networks (SNN) continue to demonstrate great potential in the landscape of artificial intelligence, particularly in tasks such as recognition, inference, and learning. While SNN focuses on achieving high-level intellige...

Descripción completa

Detalles Bibliográficos
Autores principales: Fang, Yan, Wang, Zheng, Gomez, Jorge, Datta, Suman, Khan, Asif I., Raychowdhury, Arijit
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6700359/
https://www.ncbi.nlm.nih.gov/pubmed/31456659
http://dx.doi.org/10.3389/fnins.2019.00855
_version_ 1783444855877271552
author Fang, Yan
Wang, Zheng
Gomez, Jorge
Datta, Suman
Khan, Asif I.
Raychowdhury, Arijit
author_facet Fang, Yan
Wang, Zheng
Gomez, Jorge
Datta, Suman
Khan, Asif I.
Raychowdhury, Arijit
author_sort Fang, Yan
collection PubMed
description As computational models inspired by the biological neural system, spiking neural networks (SNN) continue to demonstrate great potential in the landscape of artificial intelligence, particularly in tasks such as recognition, inference, and learning. While SNN focuses on achieving high-level intelligence of individual creatures, Swarm Intelligence (SI) is another type of bio-inspired models that mimic the collective intelligence of biological swarms, i.e., bird flocks, fish school and ant colonies. SI algorithms provide efficient and practical solutions to many difficult optimization problems through multi-agent metaheuristic search. Bridging these two distinct subfields of artificial intelligence has the potential to harness collective behavior and learning ability of biological systems. In this work, we explore the feasibility of connecting these two models by implementing a generalized SI model on SNN. In the proposed computing paradigm, we use SNNs to represent agents in the swarm and encode problem solutions with the spike firing rate and with spike timing. The coupled neurons communicate and modulate each other's action potentials through event-driven spikes and synchronize their dynamics around the states of optimal solutions. We demonstrate that such an SI-SNN model is capable of efficiently solving optimization problems, such as parameter optimization of continuous functions and a ubiquitous combinatorial optimization problem, namely, the traveling salesman problem with near-optimal solutions. Furthermore, we demonstrate an efficient implementation of such neural dynamics on an emerging hardware platform, namely ferroelectric field-effect transistor (FeFET) based spiking neurons. Such an emerging in-silico neuron is composed of a compact 1T-1FeFET structure with both excitatory and inhibitory inputs. We show that the designed neuromorphic system can serve as an optimization solver with high-performance and high energy-efficiency.
format Online
Article
Text
id pubmed-6700359
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-67003592019-08-27 A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks Fang, Yan Wang, Zheng Gomez, Jorge Datta, Suman Khan, Asif I. Raychowdhury, Arijit Front Neurosci Neuroscience As computational models inspired by the biological neural system, spiking neural networks (SNN) continue to demonstrate great potential in the landscape of artificial intelligence, particularly in tasks such as recognition, inference, and learning. While SNN focuses on achieving high-level intelligence of individual creatures, Swarm Intelligence (SI) is another type of bio-inspired models that mimic the collective intelligence of biological swarms, i.e., bird flocks, fish school and ant colonies. SI algorithms provide efficient and practical solutions to many difficult optimization problems through multi-agent metaheuristic search. Bridging these two distinct subfields of artificial intelligence has the potential to harness collective behavior and learning ability of biological systems. In this work, we explore the feasibility of connecting these two models by implementing a generalized SI model on SNN. In the proposed computing paradigm, we use SNNs to represent agents in the swarm and encode problem solutions with the spike firing rate and with spike timing. The coupled neurons communicate and modulate each other's action potentials through event-driven spikes and synchronize their dynamics around the states of optimal solutions. We demonstrate that such an SI-SNN model is capable of efficiently solving optimization problems, such as parameter optimization of continuous functions and a ubiquitous combinatorial optimization problem, namely, the traveling salesman problem with near-optimal solutions. Furthermore, we demonstrate an efficient implementation of such neural dynamics on an emerging hardware platform, namely ferroelectric field-effect transistor (FeFET) based spiking neurons. Such an emerging in-silico neuron is composed of a compact 1T-1FeFET structure with both excitatory and inhibitory inputs. We show that the designed neuromorphic system can serve as an optimization solver with high-performance and high energy-efficiency. Frontiers Media S.A. 2019-08-13 /pmc/articles/PMC6700359/ /pubmed/31456659 http://dx.doi.org/10.3389/fnins.2019.00855 Text en Copyright © 2019 Fang, Wang, Gomez, Datta, Khan and Raychowdhury. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Fang, Yan
Wang, Zheng
Gomez, Jorge
Datta, Suman
Khan, Asif I.
Raychowdhury, Arijit
A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks
title A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks
title_full A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks
title_fullStr A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks
title_full_unstemmed A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks
title_short A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks
title_sort swarm optimization solver based on ferroelectric spiking neural networks
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6700359/
https://www.ncbi.nlm.nih.gov/pubmed/31456659
http://dx.doi.org/10.3389/fnins.2019.00855
work_keys_str_mv AT fangyan aswarmoptimizationsolverbasedonferroelectricspikingneuralnetworks
AT wangzheng aswarmoptimizationsolverbasedonferroelectricspikingneuralnetworks
AT gomezjorge aswarmoptimizationsolverbasedonferroelectricspikingneuralnetworks
AT dattasuman aswarmoptimizationsolverbasedonferroelectricspikingneuralnetworks
AT khanasifi aswarmoptimizationsolverbasedonferroelectricspikingneuralnetworks
AT raychowdhuryarijit aswarmoptimizationsolverbasedonferroelectricspikingneuralnetworks
AT fangyan swarmoptimizationsolverbasedonferroelectricspikingneuralnetworks
AT wangzheng swarmoptimizationsolverbasedonferroelectricspikingneuralnetworks
AT gomezjorge swarmoptimizationsolverbasedonferroelectricspikingneuralnetworks
AT dattasuman swarmoptimizationsolverbasedonferroelectricspikingneuralnetworks
AT khanasifi swarmoptimizationsolverbasedonferroelectricspikingneuralnetworks
AT raychowdhuryarijit swarmoptimizationsolverbasedonferroelectricspikingneuralnetworks