Cargando…

Optimal structure and parameter learning of Ising models

Reconstruction of the structure and parameters of an Ising model from binary samples is a problem of practical importance in a variety of disciplines, ranging from statistical physics and computational biology to image processing and machine learning. The focus of the research community shifted towa...

Descripción completa

Detalles Bibliográficos
Autores principales: Lokhov, Andrey Y., Vuffray, Marc, Misra, Sidhant, Chertkov, Michael
Formato: Online Artículo Texto
Lenguaje:English
Publicado: American Association for the Advancement of Science 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5856491/
https://www.ncbi.nlm.nih.gov/pubmed/29556527
http://dx.doi.org/10.1126/sciadv.1700791
_version_ 1783307315862044672
author Lokhov, Andrey Y.
Vuffray, Marc
Misra, Sidhant
Chertkov, Michael
author_facet Lokhov, Andrey Y.
Vuffray, Marc
Misra, Sidhant
Chertkov, Michael
author_sort Lokhov, Andrey Y.
collection PubMed
description Reconstruction of the structure and parameters of an Ising model from binary samples is a problem of practical importance in a variety of disciplines, ranging from statistical physics and computational biology to image processing and machine learning. The focus of the research community shifted toward developing universal reconstruction algorithms that are both computationally efficient and require the minimal amount of expensive data. We introduce a new method, interaction screening, which accurately estimates model parameters using local optimization problems. The algorithm provably achieves perfect graph structure recovery with an information-theoretically optimal number of samples, notably in the low-temperature regime, which is known to be the hardest for learning. The efficacy of interaction screening is assessed through extensive numerical tests on synthetic Ising models of various topologies with different types of interactions, as well as on real data produced by a D-Wave quantum computer. This study shows that the interaction screening method is an exact, tractable, and optimal technique that universally solves the inverse Ising problem.
format Online
Article
Text
id pubmed-5856491
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher American Association for the Advancement of Science
record_format MEDLINE/PubMed
spelling pubmed-58564912018-03-19 Optimal structure and parameter learning of Ising models Lokhov, Andrey Y. Vuffray, Marc Misra, Sidhant Chertkov, Michael Sci Adv Research Articles Reconstruction of the structure and parameters of an Ising model from binary samples is a problem of practical importance in a variety of disciplines, ranging from statistical physics and computational biology to image processing and machine learning. The focus of the research community shifted toward developing universal reconstruction algorithms that are both computationally efficient and require the minimal amount of expensive data. We introduce a new method, interaction screening, which accurately estimates model parameters using local optimization problems. The algorithm provably achieves perfect graph structure recovery with an information-theoretically optimal number of samples, notably in the low-temperature regime, which is known to be the hardest for learning. The efficacy of interaction screening is assessed through extensive numerical tests on synthetic Ising models of various topologies with different types of interactions, as well as on real data produced by a D-Wave quantum computer. This study shows that the interaction screening method is an exact, tractable, and optimal technique that universally solves the inverse Ising problem. American Association for the Advancement of Science 2018-03-16 /pmc/articles/PMC5856491/ /pubmed/29556527 http://dx.doi.org/10.1126/sciadv.1700791 Text en Copyright © 2018 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution NonCommercial License 4.0 (CC BY-NC). http://creativecommons.org/licenses/by-nc/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial license (http://creativecommons.org/licenses/by-nc/4.0/) , which permits use, distribution, and reproduction in any medium, so long as the resultant use is not for commercial advantage and provided the original work is properly cited.
spellingShingle Research Articles
Lokhov, Andrey Y.
Vuffray, Marc
Misra, Sidhant
Chertkov, Michael
Optimal structure and parameter learning of Ising models
title Optimal structure and parameter learning of Ising models
title_full Optimal structure and parameter learning of Ising models
title_fullStr Optimal structure and parameter learning of Ising models
title_full_unstemmed Optimal structure and parameter learning of Ising models
title_short Optimal structure and parameter learning of Ising models
title_sort optimal structure and parameter learning of ising models
topic Research Articles
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5856491/
https://www.ncbi.nlm.nih.gov/pubmed/29556527
http://dx.doi.org/10.1126/sciadv.1700791
work_keys_str_mv AT lokhovandreyy optimalstructureandparameterlearningofisingmodels
AT vuffraymarc optimalstructureandparameterlearningofisingmodels
AT misrasidhant optimalstructureandparameterlearningofisingmodels
AT chertkovmichael optimalstructureandparameterlearningofisingmodels