Cargando…

A multiresolution mixture generative adversarial network for video super-resolution

Generative adversarial networks (GANs) have been used to obtain super-resolution (SR) videos that have improved visual perception quality and more coherent details. However, the latest methods perform poorly in areas with dense textures. To better recover the areas with dense textures in video frame...

Descripción completa

Detalles Bibliográficos
Autores principales: Tian, Zhiqiang, Wang, Yudiao, Du, Shaoyi, Lan, Xuguang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7351143/
https://www.ncbi.nlm.nih.gov/pubmed/32649694
http://dx.doi.org/10.1371/journal.pone.0235352
_version_ 1783557392554786816
author Tian, Zhiqiang
Wang, Yudiao
Du, Shaoyi
Lan, Xuguang
author_facet Tian, Zhiqiang
Wang, Yudiao
Du, Shaoyi
Lan, Xuguang
author_sort Tian, Zhiqiang
collection PubMed
description Generative adversarial networks (GANs) have been used to obtain super-resolution (SR) videos that have improved visual perception quality and more coherent details. However, the latest methods perform poorly in areas with dense textures. To better recover the areas with dense textures in video frames and improve the visual perception quality and coherence in videos, this paper proposes a multiresolution mixture generative adversarial network for video super-resolution (MRMVSR). We propose a multiresolution mixture network (MRMNet) as the generative network that can simultaneously generate multiresolution feature maps. In MRMNet, the high-resolution (HR) feature maps can continuously extract information from low-resolution (LR) feature maps to supplement information. In addition, we propose a residual fluctuation loss function for video super-resolution. The residual fluctuation loss function is used to reduce the overall residual fluctuation on SR and HR video frames to avoid a scenario where local differences are too large. Experimental results on the public benchmark dataset show that our method outperforms the state-of-the-art methods for the majority of the test sets.
format Online
Article
Text
id pubmed-7351143
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-73511432020-07-20 A multiresolution mixture generative adversarial network for video super-resolution Tian, Zhiqiang Wang, Yudiao Du, Shaoyi Lan, Xuguang PLoS One Research Article Generative adversarial networks (GANs) have been used to obtain super-resolution (SR) videos that have improved visual perception quality and more coherent details. However, the latest methods perform poorly in areas with dense textures. To better recover the areas with dense textures in video frames and improve the visual perception quality and coherence in videos, this paper proposes a multiresolution mixture generative adversarial network for video super-resolution (MRMVSR). We propose a multiresolution mixture network (MRMNet) as the generative network that can simultaneously generate multiresolution feature maps. In MRMNet, the high-resolution (HR) feature maps can continuously extract information from low-resolution (LR) feature maps to supplement information. In addition, we propose a residual fluctuation loss function for video super-resolution. The residual fluctuation loss function is used to reduce the overall residual fluctuation on SR and HR video frames to avoid a scenario where local differences are too large. Experimental results on the public benchmark dataset show that our method outperforms the state-of-the-art methods for the majority of the test sets. Public Library of Science 2020-07-10 /pmc/articles/PMC7351143/ /pubmed/32649694 http://dx.doi.org/10.1371/journal.pone.0235352 Text en © 2020 Tian et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Tian, Zhiqiang
Wang, Yudiao
Du, Shaoyi
Lan, Xuguang
A multiresolution mixture generative adversarial network for video super-resolution
title A multiresolution mixture generative adversarial network for video super-resolution
title_full A multiresolution mixture generative adversarial network for video super-resolution
title_fullStr A multiresolution mixture generative adversarial network for video super-resolution
title_full_unstemmed A multiresolution mixture generative adversarial network for video super-resolution
title_short A multiresolution mixture generative adversarial network for video super-resolution
title_sort multiresolution mixture generative adversarial network for video super-resolution
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7351143/
https://www.ncbi.nlm.nih.gov/pubmed/32649694
http://dx.doi.org/10.1371/journal.pone.0235352
work_keys_str_mv AT tianzhiqiang amultiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution
AT wangyudiao amultiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution
AT dushaoyi amultiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution
AT lanxuguang amultiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution
AT tianzhiqiang multiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution
AT wangyudiao multiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution
AT dushaoyi multiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution
AT lanxuguang multiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution