Cargando…

Maximum-Entropy Inference with a Programmable Annealer

Optimisation problems typically involve finding the ground state (i.e. the minimum energy configuration) of a cost function with respect to many variables. If the variables are corrupted by noise then this maximises the likelihood that the solution is correct. The maximum entropy solution on the oth...

Descripción completa

Detalles Bibliográficos
Autores principales: Chancellor, Nicholas, Szoke, Szilard, Vinci, Walter, Aeppli, Gabriel, Warburton, Paul A.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Nature Publishing Group 2016
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4776239/
https://www.ncbi.nlm.nih.gov/pubmed/26936311
http://dx.doi.org/10.1038/srep22318
_version_ 1782419120991502336
author Chancellor, Nicholas
Szoke, Szilard
Vinci, Walter
Aeppli, Gabriel
Warburton, Paul A.
author_facet Chancellor, Nicholas
Szoke, Szilard
Vinci, Walter
Aeppli, Gabriel
Warburton, Paul A.
author_sort Chancellor, Nicholas
collection PubMed
description Optimisation problems typically involve finding the ground state (i.e. the minimum energy configuration) of a cost function with respect to many variables. If the variables are corrupted by noise then this maximises the likelihood that the solution is correct. The maximum entropy solution on the other hand takes the form of a Boltzmann distribution over the ground and excited states of the cost function to correct for noise. Here we use a programmable annealer for the information decoding problem which we simulate as a random Ising model in a field. We show experimentally that finite temperature maximum entropy decoding can give slightly better bit-error-rates than the maximum likelihood approach, confirming that useful information can be extracted from the excited states of the annealer. Furthermore we introduce a bit-by-bit analytical method which is agnostic to the specific application and use it to show that the annealer samples from a highly Boltzmann-like distribution. Machines of this kind are therefore candidates for use in a variety of machine learning applications which exploit maximum entropy inference, including language processing and image recognition.
format Online
Article
Text
id pubmed-4776239
institution National Center for Biotechnology Information
language English
publishDate 2016
publisher Nature Publishing Group
record_format MEDLINE/PubMed
spelling pubmed-47762392016-03-09 Maximum-Entropy Inference with a Programmable Annealer Chancellor, Nicholas Szoke, Szilard Vinci, Walter Aeppli, Gabriel Warburton, Paul A. Sci Rep Article Optimisation problems typically involve finding the ground state (i.e. the minimum energy configuration) of a cost function with respect to many variables. If the variables are corrupted by noise then this maximises the likelihood that the solution is correct. The maximum entropy solution on the other hand takes the form of a Boltzmann distribution over the ground and excited states of the cost function to correct for noise. Here we use a programmable annealer for the information decoding problem which we simulate as a random Ising model in a field. We show experimentally that finite temperature maximum entropy decoding can give slightly better bit-error-rates than the maximum likelihood approach, confirming that useful information can be extracted from the excited states of the annealer. Furthermore we introduce a bit-by-bit analytical method which is agnostic to the specific application and use it to show that the annealer samples from a highly Boltzmann-like distribution. Machines of this kind are therefore candidates for use in a variety of machine learning applications which exploit maximum entropy inference, including language processing and image recognition. Nature Publishing Group 2016-03-03 /pmc/articles/PMC4776239/ /pubmed/26936311 http://dx.doi.org/10.1038/srep22318 Text en Copyright © 2016, Macmillan Publishers Limited http://creativecommons.org/licenses/by/4.0/ This work is licensed under a Creative Commons Attribution 4.0 International License. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in the credit line; if the material is not included under the Creative Commons license, users will need to obtain permission from the license holder to reproduce the material. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/
spellingShingle Article
Chancellor, Nicholas
Szoke, Szilard
Vinci, Walter
Aeppli, Gabriel
Warburton, Paul A.
Maximum-Entropy Inference with a Programmable Annealer
title Maximum-Entropy Inference with a Programmable Annealer
title_full Maximum-Entropy Inference with a Programmable Annealer
title_fullStr Maximum-Entropy Inference with a Programmable Annealer
title_full_unstemmed Maximum-Entropy Inference with a Programmable Annealer
title_short Maximum-Entropy Inference with a Programmable Annealer
title_sort maximum-entropy inference with a programmable annealer
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4776239/
https://www.ncbi.nlm.nih.gov/pubmed/26936311
http://dx.doi.org/10.1038/srep22318
work_keys_str_mv AT chancellornicholas maximumentropyinferencewithaprogrammableannealer
AT szokeszilard maximumentropyinferencewithaprogrammableannealer
AT vinciwalter maximumentropyinferencewithaprogrammableannealer
AT aeppligabriel maximumentropyinferencewithaprogrammableannealer
AT warburtonpaula maximumentropyinferencewithaprogrammableannealer