Cargando…

Quantum-Inspired Magnetic Hamiltonian Monte Carlo

Hamiltonian Monte Carlo (HMC) is a Markov Chain Monte Carlo algorithm that is able to generate distant proposals via the use of Hamiltonian dynamics, which are able to incorporate first-order gradient information about the target posterior. This has driven its rise in popularity in the machine learn...

Descripción completa

Detalles Bibliográficos
Autores principales: Mongwe, Wilson Tsakane, Mbuvha, Rendani, Marwala, Tshilidzi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8491946/
https://www.ncbi.nlm.nih.gov/pubmed/34610053
http://dx.doi.org/10.1371/journal.pone.0258277
_version_ 1784578834414174208
author Mongwe, Wilson Tsakane
Mbuvha, Rendani
Marwala, Tshilidzi
author_facet Mongwe, Wilson Tsakane
Mbuvha, Rendani
Marwala, Tshilidzi
author_sort Mongwe, Wilson Tsakane
collection PubMed
description Hamiltonian Monte Carlo (HMC) is a Markov Chain Monte Carlo algorithm that is able to generate distant proposals via the use of Hamiltonian dynamics, which are able to incorporate first-order gradient information about the target posterior. This has driven its rise in popularity in the machine learning community in recent times. It has been shown that making use of the energy-time uncertainty relation from quantum mechanics, one can devise an extension to HMC by allowing the mass matrix to be random with a probability distribution instead of a fixed mass. Furthermore, Magnetic Hamiltonian Monte Carlo (MHMC) has been recently proposed as an extension to HMC and adds a magnetic field to HMC which results in non-canonical dynamics associated with the movement of a particle under a magnetic field. In this work, we utilise the non-canonical dynamics of MHMC while allowing the mass matrix to be random to create the Quantum-Inspired Magnetic Hamiltonian Monte Carlo (QIMHMC) algorithm, which is shown to converge to the correct steady state distribution. Empirical results on a broad class of target posterior distributions show that the proposed method produces better sampling performance than HMC, MHMC and HMC with a random mass matrix.
format Online
Article
Text
id pubmed-8491946
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-84919462021-10-06 Quantum-Inspired Magnetic Hamiltonian Monte Carlo Mongwe, Wilson Tsakane Mbuvha, Rendani Marwala, Tshilidzi PLoS One Research Article Hamiltonian Monte Carlo (HMC) is a Markov Chain Monte Carlo algorithm that is able to generate distant proposals via the use of Hamiltonian dynamics, which are able to incorporate first-order gradient information about the target posterior. This has driven its rise in popularity in the machine learning community in recent times. It has been shown that making use of the energy-time uncertainty relation from quantum mechanics, one can devise an extension to HMC by allowing the mass matrix to be random with a probability distribution instead of a fixed mass. Furthermore, Magnetic Hamiltonian Monte Carlo (MHMC) has been recently proposed as an extension to HMC and adds a magnetic field to HMC which results in non-canonical dynamics associated with the movement of a particle under a magnetic field. In this work, we utilise the non-canonical dynamics of MHMC while allowing the mass matrix to be random to create the Quantum-Inspired Magnetic Hamiltonian Monte Carlo (QIMHMC) algorithm, which is shown to converge to the correct steady state distribution. Empirical results on a broad class of target posterior distributions show that the proposed method produces better sampling performance than HMC, MHMC and HMC with a random mass matrix. Public Library of Science 2021-10-05 /pmc/articles/PMC8491946/ /pubmed/34610053 http://dx.doi.org/10.1371/journal.pone.0258277 Text en © 2021 Mongwe et al https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Mongwe, Wilson Tsakane
Mbuvha, Rendani
Marwala, Tshilidzi
Quantum-Inspired Magnetic Hamiltonian Monte Carlo
title Quantum-Inspired Magnetic Hamiltonian Monte Carlo
title_full Quantum-Inspired Magnetic Hamiltonian Monte Carlo
title_fullStr Quantum-Inspired Magnetic Hamiltonian Monte Carlo
title_full_unstemmed Quantum-Inspired Magnetic Hamiltonian Monte Carlo
title_short Quantum-Inspired Magnetic Hamiltonian Monte Carlo
title_sort quantum-inspired magnetic hamiltonian monte carlo
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8491946/
https://www.ncbi.nlm.nih.gov/pubmed/34610053
http://dx.doi.org/10.1371/journal.pone.0258277
work_keys_str_mv AT mongwewilsontsakane quantuminspiredmagnetichamiltonianmontecarlo
AT mbuvharendani quantuminspiredmagnetichamiltonianmontecarlo
AT marwalatshilidzi quantuminspiredmagnetichamiltonianmontecarlo