Cargando…

Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks

Artificial neural networks have demonstrated superiority over traditional computing architectures in tasks such as pattern classification and learning. However, they do not measure uncertainty in predictions, and hence they can make wrong predictions with high confidence, which can be detrimental fo...

Descripción completa

Detalles Bibliográficos
Autores principales: Sebastian, Amritanand, Pendurthi, Rahul, Kozhakhmetov, Azimkhan, Trainor, Nicholas, Robinson, Joshua A., Redwing, Joan M., Das, Saptarshi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group UK 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9576759/
https://www.ncbi.nlm.nih.gov/pubmed/36253370
http://dx.doi.org/10.1038/s41467-022-33699-7
_version_ 1784811604072726528
author Sebastian, Amritanand
Pendurthi, Rahul
Kozhakhmetov, Azimkhan
Trainor, Nicholas
Robinson, Joshua A.
Redwing, Joan M.
Das, Saptarshi
author_facet Sebastian, Amritanand
Pendurthi, Rahul
Kozhakhmetov, Azimkhan
Trainor, Nicholas
Robinson, Joshua A.
Redwing, Joan M.
Das, Saptarshi
author_sort Sebastian, Amritanand
collection PubMed
description Artificial neural networks have demonstrated superiority over traditional computing architectures in tasks such as pattern classification and learning. However, they do not measure uncertainty in predictions, and hence they can make wrong predictions with high confidence, which can be detrimental for many mission-critical applications. In contrast, Bayesian neural networks (BNNs) naturally include such uncertainty in their model, as the weights are represented by probability distributions (e.g. Gaussian distribution). Here we introduce three-terminal memtransistors based on two-dimensional (2D) materials, which can emulate both probabilistic synapses as well as reconfigurable neurons. The cycle-to-cycle variation in the programming of the 2D memtransistor is exploited to achieve Gaussian random number generator-based synapses, whereas 2D memtransistor based integrated circuits are used to obtain neurons with hyperbolic tangent and sigmoid activation functions. Finally, memtransistor-based synapses and neurons are combined in a crossbar array architecture to realize a BNN accelerator for a data classification task.
format Online
Article
Text
id pubmed-9576759
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Nature Publishing Group UK
record_format MEDLINE/PubMed
spelling pubmed-95767592022-10-19 Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks Sebastian, Amritanand Pendurthi, Rahul Kozhakhmetov, Azimkhan Trainor, Nicholas Robinson, Joshua A. Redwing, Joan M. Das, Saptarshi Nat Commun Article Artificial neural networks have demonstrated superiority over traditional computing architectures in tasks such as pattern classification and learning. However, they do not measure uncertainty in predictions, and hence they can make wrong predictions with high confidence, which can be detrimental for many mission-critical applications. In contrast, Bayesian neural networks (BNNs) naturally include such uncertainty in their model, as the weights are represented by probability distributions (e.g. Gaussian distribution). Here we introduce three-terminal memtransistors based on two-dimensional (2D) materials, which can emulate both probabilistic synapses as well as reconfigurable neurons. The cycle-to-cycle variation in the programming of the 2D memtransistor is exploited to achieve Gaussian random number generator-based synapses, whereas 2D memtransistor based integrated circuits are used to obtain neurons with hyperbolic tangent and sigmoid activation functions. Finally, memtransistor-based synapses and neurons are combined in a crossbar array architecture to realize a BNN accelerator for a data classification task. Nature Publishing Group UK 2022-10-17 /pmc/articles/PMC9576759/ /pubmed/36253370 http://dx.doi.org/10.1038/s41467-022-33699-7 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Sebastian, Amritanand
Pendurthi, Rahul
Kozhakhmetov, Azimkhan
Trainor, Nicholas
Robinson, Joshua A.
Redwing, Joan M.
Das, Saptarshi
Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks
title Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks
title_full Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks
title_fullStr Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks
title_full_unstemmed Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks
title_short Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks
title_sort two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using bayesian neural networks
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9576759/
https://www.ncbi.nlm.nih.gov/pubmed/36253370
http://dx.doi.org/10.1038/s41467-022-33699-7
work_keys_str_mv AT sebastianamritanand twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks
AT pendurthirahul twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks
AT kozhakhmetovazimkhan twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks
AT trainornicholas twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks
AT robinsonjoshuaa twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks
AT redwingjoanm twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks
AT dassaptarshi twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks