Cargando…
Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks
Artificial neural networks have demonstrated superiority over traditional computing architectures in tasks such as pattern classification and learning. However, they do not measure uncertainty in predictions, and hence they can make wrong predictions with high confidence, which can be detrimental fo...
Autores principales: | , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group UK
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9576759/ https://www.ncbi.nlm.nih.gov/pubmed/36253370 http://dx.doi.org/10.1038/s41467-022-33699-7 |
_version_ | 1784811604072726528 |
---|---|
author | Sebastian, Amritanand Pendurthi, Rahul Kozhakhmetov, Azimkhan Trainor, Nicholas Robinson, Joshua A. Redwing, Joan M. Das, Saptarshi |
author_facet | Sebastian, Amritanand Pendurthi, Rahul Kozhakhmetov, Azimkhan Trainor, Nicholas Robinson, Joshua A. Redwing, Joan M. Das, Saptarshi |
author_sort | Sebastian, Amritanand |
collection | PubMed |
description | Artificial neural networks have demonstrated superiority over traditional computing architectures in tasks such as pattern classification and learning. However, they do not measure uncertainty in predictions, and hence they can make wrong predictions with high confidence, which can be detrimental for many mission-critical applications. In contrast, Bayesian neural networks (BNNs) naturally include such uncertainty in their model, as the weights are represented by probability distributions (e.g. Gaussian distribution). Here we introduce three-terminal memtransistors based on two-dimensional (2D) materials, which can emulate both probabilistic synapses as well as reconfigurable neurons. The cycle-to-cycle variation in the programming of the 2D memtransistor is exploited to achieve Gaussian random number generator-based synapses, whereas 2D memtransistor based integrated circuits are used to obtain neurons with hyperbolic tangent and sigmoid activation functions. Finally, memtransistor-based synapses and neurons are combined in a crossbar array architecture to realize a BNN accelerator for a data classification task. |
format | Online Article Text |
id | pubmed-9576759 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Nature Publishing Group UK |
record_format | MEDLINE/PubMed |
spelling | pubmed-95767592022-10-19 Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks Sebastian, Amritanand Pendurthi, Rahul Kozhakhmetov, Azimkhan Trainor, Nicholas Robinson, Joshua A. Redwing, Joan M. Das, Saptarshi Nat Commun Article Artificial neural networks have demonstrated superiority over traditional computing architectures in tasks such as pattern classification and learning. However, they do not measure uncertainty in predictions, and hence they can make wrong predictions with high confidence, which can be detrimental for many mission-critical applications. In contrast, Bayesian neural networks (BNNs) naturally include such uncertainty in their model, as the weights are represented by probability distributions (e.g. Gaussian distribution). Here we introduce three-terminal memtransistors based on two-dimensional (2D) materials, which can emulate both probabilistic synapses as well as reconfigurable neurons. The cycle-to-cycle variation in the programming of the 2D memtransistor is exploited to achieve Gaussian random number generator-based synapses, whereas 2D memtransistor based integrated circuits are used to obtain neurons with hyperbolic tangent and sigmoid activation functions. Finally, memtransistor-based synapses and neurons are combined in a crossbar array architecture to realize a BNN accelerator for a data classification task. Nature Publishing Group UK 2022-10-17 /pmc/articles/PMC9576759/ /pubmed/36253370 http://dx.doi.org/10.1038/s41467-022-33699-7 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) . |
spellingShingle | Article Sebastian, Amritanand Pendurthi, Rahul Kozhakhmetov, Azimkhan Trainor, Nicholas Robinson, Joshua A. Redwing, Joan M. Das, Saptarshi Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks |
title | Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks |
title_full | Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks |
title_fullStr | Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks |
title_full_unstemmed | Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks |
title_short | Two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using Bayesian neural networks |
title_sort | two-dimensional materials-based probabilistic synapses and reconfigurable neurons for measuring inference uncertainty using bayesian neural networks |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9576759/ https://www.ncbi.nlm.nih.gov/pubmed/36253370 http://dx.doi.org/10.1038/s41467-022-33699-7 |
work_keys_str_mv | AT sebastianamritanand twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks AT pendurthirahul twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks AT kozhakhmetovazimkhan twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks AT trainornicholas twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks AT robinsonjoshuaa twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks AT redwingjoanm twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks AT dassaptarshi twodimensionalmaterialsbasedprobabilisticsynapsesandreconfigurableneuronsformeasuringinferenceuncertaintyusingbayesianneuralnetworks |