Cargando…

Modified hybrid decomposition of the augmented Lagrangian method with larger step size for three-block separable convex programming

The Jacobian decomposition and the Gauss–Seidel decomposition of augmented Lagrangian method (ALM) are two popular methods for separable convex programming. However, their convergence is not guaranteed for three-block separable convex programming. In this paper, we present a modified hybrid decompos...

Descripción completa

Detalles Bibliográficos
Autores principales: Sun, Min, Wang, Yiju
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer International Publishing 2018
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6182414/
https://www.ncbi.nlm.nih.gov/pubmed/30363783
http://dx.doi.org/10.1186/s13660-018-1863-z
_version_ 1783362558032347136
author Sun, Min
Wang, Yiju
author_facet Sun, Min
Wang, Yiju
author_sort Sun, Min
collection PubMed
description The Jacobian decomposition and the Gauss–Seidel decomposition of augmented Lagrangian method (ALM) are two popular methods for separable convex programming. However, their convergence is not guaranteed for three-block separable convex programming. In this paper, we present a modified hybrid decomposition of ALM (MHD-ALM) for three-block separable convex programming, which first updates all variables by a hybrid decomposition of ALM, and then corrects the output by a correction step with constant step size [Formula: see text] which is much less restricted than the step sizes in similar methods. Furthermore, we show that [Formula: see text] is the optimal upper bound of the constant step size α. The rationality of MHD-ALM is testified by theoretical analysis, including global convergence, ergodic convergence rate, nonergodic convergence rate, and refined ergodic convergence rate. MHD-ALM is applied to solve video background extraction problem, and numerical results indicate that it is numerically reliable and requires less computation.
format Online
Article
Text
id pubmed-6182414
institution National Center for Biotechnology Information
language English
publishDate 2018
publisher Springer International Publishing
record_format MEDLINE/PubMed
spelling pubmed-61824142018-10-22 Modified hybrid decomposition of the augmented Lagrangian method with larger step size for three-block separable convex programming Sun, Min Wang, Yiju J Inequal Appl Research The Jacobian decomposition and the Gauss–Seidel decomposition of augmented Lagrangian method (ALM) are two popular methods for separable convex programming. However, their convergence is not guaranteed for three-block separable convex programming. In this paper, we present a modified hybrid decomposition of ALM (MHD-ALM) for three-block separable convex programming, which first updates all variables by a hybrid decomposition of ALM, and then corrects the output by a correction step with constant step size [Formula: see text] which is much less restricted than the step sizes in similar methods. Furthermore, we show that [Formula: see text] is the optimal upper bound of the constant step size α. The rationality of MHD-ALM is testified by theoretical analysis, including global convergence, ergodic convergence rate, nonergodic convergence rate, and refined ergodic convergence rate. MHD-ALM is applied to solve video background extraction problem, and numerical results indicate that it is numerically reliable and requires less computation. Springer International Publishing 2018-10-04 2018 /pmc/articles/PMC6182414/ /pubmed/30363783 http://dx.doi.org/10.1186/s13660-018-1863-z Text en © The Author(s) 2018 Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
spellingShingle Research
Sun, Min
Wang, Yiju
Modified hybrid decomposition of the augmented Lagrangian method with larger step size for three-block separable convex programming
title Modified hybrid decomposition of the augmented Lagrangian method with larger step size for three-block separable convex programming
title_full Modified hybrid decomposition of the augmented Lagrangian method with larger step size for three-block separable convex programming
title_fullStr Modified hybrid decomposition of the augmented Lagrangian method with larger step size for three-block separable convex programming
title_full_unstemmed Modified hybrid decomposition of the augmented Lagrangian method with larger step size for three-block separable convex programming
title_short Modified hybrid decomposition of the augmented Lagrangian method with larger step size for three-block separable convex programming
title_sort modified hybrid decomposition of the augmented lagrangian method with larger step size for three-block separable convex programming
topic Research
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6182414/
https://www.ncbi.nlm.nih.gov/pubmed/30363783
http://dx.doi.org/10.1186/s13660-018-1863-z
work_keys_str_mv AT sunmin modifiedhybriddecompositionoftheaugmentedlagrangianmethodwithlargerstepsizeforthreeblockseparableconvexprogramming
AT wangyiju modifiedhybriddecompositionoftheaugmentedlagrangianmethodwithlargerstepsizeforthreeblockseparableconvexprogramming