Cargando…
Convergence Rates for the Constrained Sampling via Langevin Monte Carlo
Sampling from constrained distributions has posed significant challenges in terms of algorithmic design and non-asymptotic analysis, which are frequently encountered in statistical and machine-learning models. In this study, we propose three sampling algorithms based on Langevin Monte Carlo with the...
Autor principal: | |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10453724/ https://www.ncbi.nlm.nih.gov/pubmed/37628264 http://dx.doi.org/10.3390/e25081234 |
_version_ | 1785096007249297408 |
---|---|
author | Zhu, Yuanzheng |
author_facet | Zhu, Yuanzheng |
author_sort | Zhu, Yuanzheng |
collection | PubMed |
description | Sampling from constrained distributions has posed significant challenges in terms of algorithmic design and non-asymptotic analysis, which are frequently encountered in statistical and machine-learning models. In this study, we propose three sampling algorithms based on Langevin Monte Carlo with the Metropolis–Hastings steps to handle the distribution constrained within some convex body. We present a rigorous analysis of the corresponding Markov chains and derive non-asymptotic upper bounds on the convergence rates of these algorithms in total variation distance. Our results demonstrate that the sampling algorithm, enhanced with the Metropolis–Hastings steps, offers an effective solution for tackling some constrained sampling problems. The numerical experiments are conducted to compare our methods with several competing algorithms without the Metropolis–Hastings steps, and the results further support our theoretical findings. |
format | Online Article Text |
id | pubmed-10453724 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-104537242023-08-26 Convergence Rates for the Constrained Sampling via Langevin Monte Carlo Zhu, Yuanzheng Entropy (Basel) Article Sampling from constrained distributions has posed significant challenges in terms of algorithmic design and non-asymptotic analysis, which are frequently encountered in statistical and machine-learning models. In this study, we propose three sampling algorithms based on Langevin Monte Carlo with the Metropolis–Hastings steps to handle the distribution constrained within some convex body. We present a rigorous analysis of the corresponding Markov chains and derive non-asymptotic upper bounds on the convergence rates of these algorithms in total variation distance. Our results demonstrate that the sampling algorithm, enhanced with the Metropolis–Hastings steps, offers an effective solution for tackling some constrained sampling problems. The numerical experiments are conducted to compare our methods with several competing algorithms without the Metropolis–Hastings steps, and the results further support our theoretical findings. MDPI 2023-08-18 /pmc/articles/PMC10453724/ /pubmed/37628264 http://dx.doi.org/10.3390/e25081234 Text en © 2023 by the author. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Zhu, Yuanzheng Convergence Rates for the Constrained Sampling via Langevin Monte Carlo |
title | Convergence Rates for the Constrained Sampling via Langevin Monte Carlo |
title_full | Convergence Rates for the Constrained Sampling via Langevin Monte Carlo |
title_fullStr | Convergence Rates for the Constrained Sampling via Langevin Monte Carlo |
title_full_unstemmed | Convergence Rates for the Constrained Sampling via Langevin Monte Carlo |
title_short | Convergence Rates for the Constrained Sampling via Langevin Monte Carlo |
title_sort | convergence rates for the constrained sampling via langevin monte carlo |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10453724/ https://www.ncbi.nlm.nih.gov/pubmed/37628264 http://dx.doi.org/10.3390/e25081234 |
work_keys_str_mv | AT zhuyuanzheng convergenceratesfortheconstrainedsamplingvialangevinmontecarlo |