Cargando…
Maximum-Entropy Inference with a Programmable Annealer
Optimisation problems typically involve finding the ground state (i.e. the minimum energy configuration) of a cost function with respect to many variables. If the variables are corrupted by noise then this maximises the likelihood that the solution is correct. The maximum entropy solution on the oth...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Nature Publishing Group
2016
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4776239/ https://www.ncbi.nlm.nih.gov/pubmed/26936311 http://dx.doi.org/10.1038/srep22318 |
_version_ | 1782419120991502336 |
---|---|
author | Chancellor, Nicholas Szoke, Szilard Vinci, Walter Aeppli, Gabriel Warburton, Paul A. |
author_facet | Chancellor, Nicholas Szoke, Szilard Vinci, Walter Aeppli, Gabriel Warburton, Paul A. |
author_sort | Chancellor, Nicholas |
collection | PubMed |
description | Optimisation problems typically involve finding the ground state (i.e. the minimum energy configuration) of a cost function with respect to many variables. If the variables are corrupted by noise then this maximises the likelihood that the solution is correct. The maximum entropy solution on the other hand takes the form of a Boltzmann distribution over the ground and excited states of the cost function to correct for noise. Here we use a programmable annealer for the information decoding problem which we simulate as a random Ising model in a field. We show experimentally that finite temperature maximum entropy decoding can give slightly better bit-error-rates than the maximum likelihood approach, confirming that useful information can be extracted from the excited states of the annealer. Furthermore we introduce a bit-by-bit analytical method which is agnostic to the specific application and use it to show that the annealer samples from a highly Boltzmann-like distribution. Machines of this kind are therefore candidates for use in a variety of machine learning applications which exploit maximum entropy inference, including language processing and image recognition. |
format | Online Article Text |
id | pubmed-4776239 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2016 |
publisher | Nature Publishing Group |
record_format | MEDLINE/PubMed |
spelling | pubmed-47762392016-03-09 Maximum-Entropy Inference with a Programmable Annealer Chancellor, Nicholas Szoke, Szilard Vinci, Walter Aeppli, Gabriel Warburton, Paul A. Sci Rep Article Optimisation problems typically involve finding the ground state (i.e. the minimum energy configuration) of a cost function with respect to many variables. If the variables are corrupted by noise then this maximises the likelihood that the solution is correct. The maximum entropy solution on the other hand takes the form of a Boltzmann distribution over the ground and excited states of the cost function to correct for noise. Here we use a programmable annealer for the information decoding problem which we simulate as a random Ising model in a field. We show experimentally that finite temperature maximum entropy decoding can give slightly better bit-error-rates than the maximum likelihood approach, confirming that useful information can be extracted from the excited states of the annealer. Furthermore we introduce a bit-by-bit analytical method which is agnostic to the specific application and use it to show that the annealer samples from a highly Boltzmann-like distribution. Machines of this kind are therefore candidates for use in a variety of machine learning applications which exploit maximum entropy inference, including language processing and image recognition. Nature Publishing Group 2016-03-03 /pmc/articles/PMC4776239/ /pubmed/26936311 http://dx.doi.org/10.1038/srep22318 Text en Copyright © 2016, Macmillan Publishers Limited http://creativecommons.org/licenses/by/4.0/ This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/ |
spellingShingle | Article Chancellor, Nicholas Szoke, Szilard Vinci, Walter Aeppli, Gabriel Warburton, Paul A. Maximum-Entropy Inference with a Programmable Annealer |
title | Maximum-Entropy Inference with a Programmable Annealer |
title_full | Maximum-Entropy Inference with a Programmable Annealer |
title_fullStr | Maximum-Entropy Inference with a Programmable Annealer |
title_full_unstemmed | Maximum-Entropy Inference with a Programmable Annealer |
title_short | Maximum-Entropy Inference with a Programmable Annealer |
title_sort | maximum-entropy inference with a programmable annealer |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4776239/ https://www.ncbi.nlm.nih.gov/pubmed/26936311 http://dx.doi.org/10.1038/srep22318 |
work_keys_str_mv | AT chancellornicholas maximumentropyinferencewithaprogrammableannealer AT szokeszilard maximumentropyinferencewithaprogrammableannealer AT vinciwalter maximumentropyinferencewithaprogrammableannealer AT aeppligabriel maximumentropyinferencewithaprogrammableannealer AT warburtonpaula maximumentropyinferencewithaprogrammableannealer |