Cargando…
A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks
As computational models inspired by the biological neural system, spiking neural networks (SNN) continue to demonstrate great potential in the landscape of artificial intelligence, particularly in tasks such as recognition, inference, and learning. While SNN focuses on achieving high-level intellige...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2019
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6700359/ https://www.ncbi.nlm.nih.gov/pubmed/31456659 http://dx.doi.org/10.3389/fnins.2019.00855 |
_version_ | 1783444855877271552 |
---|---|
author | Fang, Yan Wang, Zheng Gomez, Jorge Datta, Suman Khan, Asif I. Raychowdhury, Arijit |
author_facet | Fang, Yan Wang, Zheng Gomez, Jorge Datta, Suman Khan, Asif I. Raychowdhury, Arijit |
author_sort | Fang, Yan |
collection | PubMed |
description | As computational models inspired by the biological neural system, spiking neural networks (SNN) continue to demonstrate great potential in the landscape of artificial intelligence, particularly in tasks such as recognition, inference, and learning. While SNN focuses on achieving high-level intelligence of individual creatures, Swarm Intelligence (SI) is another type of bio-inspired models that mimic the collective intelligence of biological swarms, i.e., bird flocks, fish school and ant colonies. SI algorithms provide efficient and practical solutions to many difficult optimization problems through multi-agent metaheuristic search. Bridging these two distinct subfields of artificial intelligence has the potential to harness collective behavior and learning ability of biological systems. In this work, we explore the feasibility of connecting these two models by implementing a generalized SI model on SNN. In the proposed computing paradigm, we use SNNs to represent agents in the swarm and encode problem solutions with the spike firing rate and with spike timing. The coupled neurons communicate and modulate each other's action potentials through event-driven spikes and synchronize their dynamics around the states of optimal solutions. We demonstrate that such an SI-SNN model is capable of efficiently solving optimization problems, such as parameter optimization of continuous functions and a ubiquitous combinatorial optimization problem, namely, the traveling salesman problem with near-optimal solutions. Furthermore, we demonstrate an efficient implementation of such neural dynamics on an emerging hardware platform, namely ferroelectric field-effect transistor (FeFET) based spiking neurons. Such an emerging in-silico neuron is composed of a compact 1T-1FeFET structure with both excitatory and inhibitory inputs. We show that the designed neuromorphic system can serve as an optimization solver with high-performance and high energy-efficiency. |
format | Online Article Text |
id | pubmed-6700359 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2019 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-67003592019-08-27 A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks Fang, Yan Wang, Zheng Gomez, Jorge Datta, Suman Khan, Asif I. Raychowdhury, Arijit Front Neurosci Neuroscience As computational models inspired by the biological neural system, spiking neural networks (SNN) continue to demonstrate great potential in the landscape of artificial intelligence, particularly in tasks such as recognition, inference, and learning. While SNN focuses on achieving high-level intelligence of individual creatures, Swarm Intelligence (SI) is another type of bio-inspired models that mimic the collective intelligence of biological swarms, i.e., bird flocks, fish school and ant colonies. SI algorithms provide efficient and practical solutions to many difficult optimization problems through multi-agent metaheuristic search. Bridging these two distinct subfields of artificial intelligence has the potential to harness collective behavior and learning ability of biological systems. In this work, we explore the feasibility of connecting these two models by implementing a generalized SI model on SNN. In the proposed computing paradigm, we use SNNs to represent agents in the swarm and encode problem solutions with the spike firing rate and with spike timing. The coupled neurons communicate and modulate each other's action potentials through event-driven spikes and synchronize their dynamics around the states of optimal solutions. We demonstrate that such an SI-SNN model is capable of efficiently solving optimization problems, such as parameter optimization of continuous functions and a ubiquitous combinatorial optimization problem, namely, the traveling salesman problem with near-optimal solutions. Furthermore, we demonstrate an efficient implementation of such neural dynamics on an emerging hardware platform, namely ferroelectric field-effect transistor (FeFET) based spiking neurons. Such an emerging in-silico neuron is composed of a compact 1T-1FeFET structure with both excitatory and inhibitory inputs. We show that the designed neuromorphic system can serve as an optimization solver with high-performance and high energy-efficiency. Frontiers Media S.A. 2019-08-13 /pmc/articles/PMC6700359/ /pubmed/31456659 http://dx.doi.org/10.3389/fnins.2019.00855 Text en Copyright © 2019 Fang, Wang, Gomez, Datta, Khan and Raychowdhury. http://creativecommons.org/licenses/by/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Fang, Yan Wang, Zheng Gomez, Jorge Datta, Suman Khan, Asif I. Raychowdhury, Arijit A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks |
title | A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks |
title_full | A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks |
title_fullStr | A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks |
title_full_unstemmed | A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks |
title_short | A Swarm Optimization Solver Based on Ferroelectric Spiking Neural Networks |
title_sort | swarm optimization solver based on ferroelectric spiking neural networks |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6700359/ https://www.ncbi.nlm.nih.gov/pubmed/31456659 http://dx.doi.org/10.3389/fnins.2019.00855 |
work_keys_str_mv | AT fangyan aswarmoptimizationsolverbasedonferroelectricspikingneuralnetworks AT wangzheng aswarmoptimizationsolverbasedonferroelectricspikingneuralnetworks AT gomezjorge aswarmoptimizationsolverbasedonferroelectricspikingneuralnetworks AT dattasuman aswarmoptimizationsolverbasedonferroelectricspikingneuralnetworks AT khanasifi aswarmoptimizationsolverbasedonferroelectricspikingneuralnetworks AT raychowdhuryarijit aswarmoptimizationsolverbasedonferroelectricspikingneuralnetworks AT fangyan swarmoptimizationsolverbasedonferroelectricspikingneuralnetworks AT wangzheng swarmoptimizationsolverbasedonferroelectricspikingneuralnetworks AT gomezjorge swarmoptimizationsolverbasedonferroelectricspikingneuralnetworks AT dattasuman swarmoptimizationsolverbasedonferroelectricspikingneuralnetworks AT khanasifi swarmoptimizationsolverbasedonferroelectricspikingneuralnetworks AT raychowdhuryarijit swarmoptimizationsolverbasedonferroelectricspikingneuralnetworks |