Cargando…

Forward-reflected-backward method with variance reduction

We propose a variance reduced algorithm for solving monotone variational inequalities. Without assuming strong monotonicity, cocoercivity, or boundedness of the domain, we prove almost sure convergence of the iterates generated by the algorithm to a solution. In the monotone case, the ergodic averag...

Descripción completa

Detalles Bibliográficos
Autores principales: Alacaoglu, Ahmet, Malitsky, Yura, Cevher, Volkan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8550342/
https://www.ncbi.nlm.nih.gov/pubmed/34720428
http://dx.doi.org/10.1007/s10589-021-00305-3
_version_ 1784590938507575296
author Alacaoglu, Ahmet
Malitsky, Yura
Cevher, Volkan
author_facet Alacaoglu, Ahmet
Malitsky, Yura
Cevher, Volkan
author_sort Alacaoglu, Ahmet
collection PubMed
description We propose a variance reduced algorithm for solving monotone variational inequalities. Without assuming strong monotonicity, cocoercivity, or boundedness of the domain, we prove almost sure convergence of the iterates generated by the algorithm to a solution. In the monotone case, the ergodic average converges with the optimal O(1/k) rate of convergence. When strong monotonicity is assumed, the algorithm converges linearly, without requiring the knowledge of strong monotonicity constant. We finalize with extensions and applications of our results to monotone inclusions, a class of non-monotone variational inequalities and Bregman projections.
format Online
Article
Text
id pubmed-8550342
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-85503422021-10-29 Forward-reflected-backward method with variance reduction Alacaoglu, Ahmet Malitsky, Yura Cevher, Volkan Comput Optim Appl Article We propose a variance reduced algorithm for solving monotone variational inequalities. Without assuming strong monotonicity, cocoercivity, or boundedness of the domain, we prove almost sure convergence of the iterates generated by the algorithm to a solution. In the monotone case, the ergodic average converges with the optimal O(1/k) rate of convergence. When strong monotonicity is assumed, the algorithm converges linearly, without requiring the knowledge of strong monotonicity constant. We finalize with extensions and applications of our results to monotone inclusions, a class of non-monotone variational inequalities and Bregman projections. Springer US 2021-08-19 2021 /pmc/articles/PMC8550342/ /pubmed/34720428 http://dx.doi.org/10.1007/s10589-021-00305-3 Text en © The Author(s) 2021 https://creativecommons.org/licenses/by/4.0/Open AccessThis article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) .
spellingShingle Article
Alacaoglu, Ahmet
Malitsky, Yura
Cevher, Volkan
Forward-reflected-backward method with variance reduction
title Forward-reflected-backward method with variance reduction
title_full Forward-reflected-backward method with variance reduction
title_fullStr Forward-reflected-backward method with variance reduction
title_full_unstemmed Forward-reflected-backward method with variance reduction
title_short Forward-reflected-backward method with variance reduction
title_sort forward-reflected-backward method with variance reduction
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8550342/
https://www.ncbi.nlm.nih.gov/pubmed/34720428
http://dx.doi.org/10.1007/s10589-021-00305-3
work_keys_str_mv AT alacaogluahmet forwardreflectedbackwardmethodwithvariancereduction
AT malitskyyura forwardreflectedbackwardmethodwithvariancereduction
AT cevhervolkan forwardreflectedbackwardmethodwithvariancereduction