Cargando…
Quantum-Inspired Magnetic Hamiltonian Monte Carlo
Hamiltonian Monte Carlo (HMC) is a Markov Chain Monte Carlo algorithm that is able to generate distant proposals via the use of Hamiltonian dynamics, which are able to incorporate first-order gradient information about the target posterior. This has driven its rise in popularity in the machine learn...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8491946/ https://www.ncbi.nlm.nih.gov/pubmed/34610053 http://dx.doi.org/10.1371/journal.pone.0258277 |
_version_ | 1784578834414174208 |
---|---|
author | Mongwe, Wilson Tsakane Mbuvha, Rendani Marwala, Tshilidzi |
author_facet | Mongwe, Wilson Tsakane Mbuvha, Rendani Marwala, Tshilidzi |
author_sort | Mongwe, Wilson Tsakane |
collection | PubMed |
description | Hamiltonian Monte Carlo (HMC) is a Markov Chain Monte Carlo algorithm that is able to generate distant proposals via the use of Hamiltonian dynamics, which are able to incorporate first-order gradient information about the target posterior. This has driven its rise in popularity in the machine learning community in recent times. It has been shown that making use of the energy-time uncertainty relation from quantum mechanics, one can devise an extension to HMC by allowing the mass matrix to be random with a probability distribution instead of a fixed mass. Furthermore, Magnetic Hamiltonian Monte Carlo (MHMC) has been recently proposed as an extension to HMC and adds a magnetic field to HMC which results in non-canonical dynamics associated with the movement of a particle under a magnetic field. In this work, we utilise the non-canonical dynamics of MHMC while allowing the mass matrix to be random to create the Quantum-Inspired Magnetic Hamiltonian Monte Carlo (QIMHMC) algorithm, which is shown to converge to the correct steady state distribution. Empirical results on a broad class of target posterior distributions show that the proposed method produces better sampling performance than HMC, MHMC and HMC with a random mass matrix. |
format | Online Article Text |
id | pubmed-8491946 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-84919462021-10-06 Quantum-Inspired Magnetic Hamiltonian Monte Carlo Mongwe, Wilson Tsakane Mbuvha, Rendani Marwala, Tshilidzi PLoS One Research Article Hamiltonian Monte Carlo (HMC) is a Markov Chain Monte Carlo algorithm that is able to generate distant proposals via the use of Hamiltonian dynamics, which are able to incorporate first-order gradient information about the target posterior. This has driven its rise in popularity in the machine learning community in recent times. It has been shown that making use of the energy-time uncertainty relation from quantum mechanics, one can devise an extension to HMC by allowing the mass matrix to be random with a probability distribution instead of a fixed mass. Furthermore, Magnetic Hamiltonian Monte Carlo (MHMC) has been recently proposed as an extension to HMC and adds a magnetic field to HMC which results in non-canonical dynamics associated with the movement of a particle under a magnetic field. In this work, we utilise the non-canonical dynamics of MHMC while allowing the mass matrix to be random to create the Quantum-Inspired Magnetic Hamiltonian Monte Carlo (QIMHMC) algorithm, which is shown to converge to the correct steady state distribution. Empirical results on a broad class of target posterior distributions show that the proposed method produces better sampling performance than HMC, MHMC and HMC with a random mass matrix. Public Library of Science 2021-10-05 /pmc/articles/PMC8491946/ /pubmed/34610053 http://dx.doi.org/10.1371/journal.pone.0258277 Text en © 2021 Mongwe et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Mongwe, Wilson Tsakane Mbuvha, Rendani Marwala, Tshilidzi Quantum-Inspired Magnetic Hamiltonian Monte Carlo |
title | Quantum-Inspired Magnetic Hamiltonian Monte Carlo |
title_full | Quantum-Inspired Magnetic Hamiltonian Monte Carlo |
title_fullStr | Quantum-Inspired Magnetic Hamiltonian Monte Carlo |
title_full_unstemmed | Quantum-Inspired Magnetic Hamiltonian Monte Carlo |
title_short | Quantum-Inspired Magnetic Hamiltonian Monte Carlo |
title_sort | quantum-inspired magnetic hamiltonian monte carlo |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8491946/ https://www.ncbi.nlm.nih.gov/pubmed/34610053 http://dx.doi.org/10.1371/journal.pone.0258277 |
work_keys_str_mv | AT mongwewilsontsakane quantuminspiredmagnetichamiltonianmontecarlo AT mbuvharendani quantuminspiredmagnetichamiltonianmontecarlo AT marwalatshilidzi quantuminspiredmagnetichamiltonianmontecarlo |