Cargando…
Optimal structure and parameter learning of Ising models
Reconstruction of the structure and parameters of an Ising model from binary samples is a problem of practical importance in a variety of disciplines, ranging from statistical physics and computational biology to image processing and machine learning. The focus of the research community shifted towa...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
American Association for the Advancement of Science
2018
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5856491/ https://www.ncbi.nlm.nih.gov/pubmed/29556527 http://dx.doi.org/10.1126/sciadv.1700791 |
_version_ | 1783307315862044672 |
---|---|
author | Lokhov, Andrey Y. Vuffray, Marc Misra, Sidhant Chertkov, Michael |
author_facet | Lokhov, Andrey Y. Vuffray, Marc Misra, Sidhant Chertkov, Michael |
author_sort | Lokhov, Andrey Y. |
collection | PubMed |
description | Reconstruction of the structure and parameters of an Ising model from binary samples is a problem of practical importance in a variety of disciplines, ranging from statistical physics and computational biology to image processing and machine learning. The focus of the research community shifted toward developing universal reconstruction algorithms that are both computationally efficient and require the minimal amount of expensive data. We introduce a new method, interaction screening, which accurately estimates model parameters using local optimization problems. The algorithm provably achieves perfect graph structure recovery with an information-theoretically optimal number of samples, notably in the low-temperature regime, which is known to be the hardest for learning. The efficacy of interaction screening is assessed through extensive numerical tests on synthetic Ising models of various topologies with different types of interactions, as well as on real data produced by a D-Wave quantum computer. This study shows that the interaction screening method is an exact, tractable, and optimal technique that universally solves the inverse Ising problem. |
format | Online Article Text |
id | pubmed-5856491 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2018 |
publisher | American Association for the Advancement of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-58564912018-03-19 Optimal structure and parameter learning of Ising models Lokhov, Andrey Y. Vuffray, Marc Misra, Sidhant Chertkov, Michael Sci Adv Research Articles Reconstruction of the structure and parameters of an Ising model from binary samples is a problem of practical importance in a variety of disciplines, ranging from statistical physics and computational biology to image processing and machine learning. The focus of the research community shifted toward developing universal reconstruction algorithms that are both computationally efficient and require the minimal amount of expensive data. We introduce a new method, interaction screening, which accurately estimates model parameters using local optimization problems. The algorithm provably achieves perfect graph structure recovery with an information-theoretically optimal number of samples, notably in the low-temperature regime, which is known to be the hardest for learning. The efficacy of interaction screening is assessed through extensive numerical tests on synthetic Ising models of various topologies with different types of interactions, as well as on real data produced by a D-Wave quantum computer. This study shows that the interaction screening method is an exact, tractable, and optimal technique that universally solves the inverse Ising problem. American Association for the Advancement of Science 2018-03-16 /pmc/articles/PMC5856491/ /pubmed/29556527 http://dx.doi.org/10.1126/sciadv.1700791 Text en Copyright © 2018 The Authors, some rights reserved; exclusive licensee American Association for the Advancement of Science. No claim to original U.S. Government Works. Distributed under a Creative Commons Attribution NonCommercial License 4.0 (CC BY-NC). http://creativecommons.org/licenses/by-nc/4.0/ This is an open-access article distributed under the terms of the Creative Commons Attribution-NonCommercial license (http://creativecommons.org/licenses/by-nc/4.0/) , which permits use, distribution, and reproduction in any medium, so long as the resultant use is not for commercial advantage and provided the original work is properly cited. |
spellingShingle | Research Articles Lokhov, Andrey Y. Vuffray, Marc Misra, Sidhant Chertkov, Michael Optimal structure and parameter learning of Ising models |
title | Optimal structure and parameter learning of Ising models |
title_full | Optimal structure and parameter learning of Ising models |
title_fullStr | Optimal structure and parameter learning of Ising models |
title_full_unstemmed | Optimal structure and parameter learning of Ising models |
title_short | Optimal structure and parameter learning of Ising models |
title_sort | optimal structure and parameter learning of ising models |
topic | Research Articles |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5856491/ https://www.ncbi.nlm.nih.gov/pubmed/29556527 http://dx.doi.org/10.1126/sciadv.1700791 |
work_keys_str_mv | AT lokhovandreyy optimalstructureandparameterlearningofisingmodels AT vuffraymarc optimalstructureandparameterlearningofisingmodels AT misrasidhant optimalstructureandparameterlearningofisingmodels AT chertkovmichael optimalstructureandparameterlearningofisingmodels |