Cargando…

Optimal scaling of random walk Metropolis algorithms using Bayesian large-sample asymptotics

High-dimensional limit theorems have been shown useful to derive tuning rules for finding the optimal scaling in random walk Metropolis algorithms. The assumptions under which weak convergence results are proved are, however, restrictive: the target density is typically assumed to be of a product fo...

Descripción completa

Detalles Bibliográficos
Autores principales: Schmon, Sebastian M., Gagnon, Philippe
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8924149/
https://www.ncbi.nlm.nih.gov/pubmed/35310543
http://dx.doi.org/10.1007/s11222-022-10080-8
_version_ 1784669786039386112
author Schmon, Sebastian M.
Gagnon, Philippe
author_facet Schmon, Sebastian M.
Gagnon, Philippe
author_sort Schmon, Sebastian M.
collection PubMed
description High-dimensional limit theorems have been shown useful to derive tuning rules for finding the optimal scaling in random walk Metropolis algorithms. The assumptions under which weak convergence results are proved are, however, restrictive: the target density is typically assumed to be of a product form. Users may thus doubt the validity of such tuning rules in practical applications. In this paper, we shed some light on optimal scaling problems from a different perspective, namely a large-sample one. This allows to prove weak convergence results under realistic assumptions and to propose novel parameter-dimension-dependent tuning guidelines. The proposed guidelines are consistent with the previous ones when the target density is close to having a product form, and the results highlight that the correlation structure has to be accounted for to avoid performance deterioration if that is not the case, while justifying the use of a natural (asymptotically exact) approximation to the correlation matrix that can be employed for the very first algorithm run.
format Online
Article
Text
id pubmed-8924149
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-89241492022-03-17 Optimal scaling of random walk Metropolis algorithms using Bayesian large-sample asymptotics Schmon, Sebastian M. Gagnon, Philippe Stat Comput Article High-dimensional limit theorems have been shown useful to derive tuning rules for finding the optimal scaling in random walk Metropolis algorithms. The assumptions under which weak convergence results are proved are, however, restrictive: the target density is typically assumed to be of a product form. Users may thus doubt the validity of such tuning rules in practical applications. In this paper, we shed some light on optimal scaling problems from a different perspective, namely a large-sample one. This allows to prove weak convergence results under realistic assumptions and to propose novel parameter-dimension-dependent tuning guidelines. The proposed guidelines are consistent with the previous ones when the target density is close to having a product form, and the results highlight that the correlation structure has to be accounted for to avoid performance deterioration if that is not the case, while justifying the use of a natural (asymptotically exact) approximation to the correlation matrix that can be employed for the very first algorithm run. Springer US 2022-02-18 2022 /pmc/articles/PMC8924149/ /pubmed/35310543 http://dx.doi.org/10.1007/s11222-022-10080-8 Text en © The Author(s) 2022 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Schmon, Sebastian M.
Gagnon, Philippe
Optimal scaling of random walk Metropolis algorithms using Bayesian large-sample asymptotics
title Optimal scaling of random walk Metropolis algorithms using Bayesian large-sample asymptotics
title_full Optimal scaling of random walk Metropolis algorithms using Bayesian large-sample asymptotics
title_fullStr Optimal scaling of random walk Metropolis algorithms using Bayesian large-sample asymptotics
title_full_unstemmed Optimal scaling of random walk Metropolis algorithms using Bayesian large-sample asymptotics
title_short Optimal scaling of random walk Metropolis algorithms using Bayesian large-sample asymptotics
title_sort optimal scaling of random walk metropolis algorithms using bayesian large-sample asymptotics
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8924149/
https://www.ncbi.nlm.nih.gov/pubmed/35310543
http://dx.doi.org/10.1007/s11222-022-10080-8
work_keys_str_mv AT schmonsebastianm optimalscalingofrandomwalkmetropolisalgorithmsusingbayesianlargesampleasymptotics
AT gagnonphilippe optimalscalingofrandomwalkmetropolisalgorithmsusingbayesianlargesampleasymptotics