Cargando…

Convergence Rates for the Constrained Sampling via Langevin Monte Carlo

Sampling from constrained distributions has posed significant challenges in terms of algorithmic design and non-asymptotic analysis, which are frequently encountered in statistical and machine-learning models. In this study, we propose three sampling algorithms based on Langevin Monte Carlo with the...

Descripción completa

Detalles Bibliográficos
Autor principal: Zhu, Yuanzheng
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10453724/
https://www.ncbi.nlm.nih.gov/pubmed/37628264
http://dx.doi.org/10.3390/e25081234
_version_ 1785096007249297408
author Zhu, Yuanzheng
author_facet Zhu, Yuanzheng
author_sort Zhu, Yuanzheng
collection PubMed
description Sampling from constrained distributions has posed significant challenges in terms of algorithmic design and non-asymptotic analysis, which are frequently encountered in statistical and machine-learning models. In this study, we propose three sampling algorithms based on Langevin Monte Carlo with the Metropolis–Hastings steps to handle the distribution constrained within some convex body. We present a rigorous analysis of the corresponding Markov chains and derive non-asymptotic upper bounds on the convergence rates of these algorithms in total variation distance. Our results demonstrate that the sampling algorithm, enhanced with the Metropolis–Hastings steps, offers an effective solution for tackling some constrained sampling problems. The numerical experiments are conducted to compare our methods with several competing algorithms without the Metropolis–Hastings steps, and the results further support our theoretical findings.
format Online
Article
Text
id pubmed-10453724
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104537242023-08-26 Convergence Rates for the Constrained Sampling via Langevin Monte Carlo Zhu, Yuanzheng Entropy (Basel) Article Sampling from constrained distributions has posed significant challenges in terms of algorithmic design and non-asymptotic analysis, which are frequently encountered in statistical and machine-learning models. In this study, we propose three sampling algorithms based on Langevin Monte Carlo with the Metropolis–Hastings steps to handle the distribution constrained within some convex body. We present a rigorous analysis of the corresponding Markov chains and derive non-asymptotic upper bounds on the convergence rates of these algorithms in total variation distance. Our results demonstrate that the sampling algorithm, enhanced with the Metropolis–Hastings steps, offers an effective solution for tackling some constrained sampling problems. The numerical experiments are conducted to compare our methods with several competing algorithms without the Metropolis–Hastings steps, and the results further support our theoretical findings. MDPI 2023-08-18 /pmc/articles/PMC10453724/ /pubmed/37628264 http://dx.doi.org/10.3390/e25081234 Text en © 2023 by the author. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Zhu, Yuanzheng
Convergence Rates for the Constrained Sampling via Langevin Monte Carlo
title Convergence Rates for the Constrained Sampling via Langevin Monte Carlo
title_full Convergence Rates for the Constrained Sampling via Langevin Monte Carlo
title_fullStr Convergence Rates for the Constrained Sampling via Langevin Monte Carlo
title_full_unstemmed Convergence Rates for the Constrained Sampling via Langevin Monte Carlo
title_short Convergence Rates for the Constrained Sampling via Langevin Monte Carlo
title_sort convergence rates for the constrained sampling via langevin monte carlo
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10453724/
https://www.ncbi.nlm.nih.gov/pubmed/37628264
http://dx.doi.org/10.3390/e25081234
work_keys_str_mv AT zhuyuanzheng convergenceratesfortheconstrainedsamplingvialangevinmontecarlo