Cargando…
A multiresolution mixture generative adversarial network for video super-resolution
Generative adversarial networks (GANs) have been used to obtain super-resolution (SR) videos that have improved visual perception quality and more coherent details. However, the latest methods perform poorly in areas with dense textures. To better recover the areas with dense textures in video frame...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Public Library of Science
2020
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7351143/ https://www.ncbi.nlm.nih.gov/pubmed/32649694 http://dx.doi.org/10.1371/journal.pone.0235352 |
_version_ | 1783557392554786816 |
---|---|
author | Tian, Zhiqiang Wang, Yudiao Du, Shaoyi Lan, Xuguang |
author_facet | Tian, Zhiqiang Wang, Yudiao Du, Shaoyi Lan, Xuguang |
author_sort | Tian, Zhiqiang |
collection | PubMed |
description | Generative adversarial networks (GANs) have been used to obtain super-resolution (SR) videos that have improved visual perception quality and more coherent details. However, the latest methods perform poorly in areas with dense textures. To better recover the areas with dense textures in video frames and improve the visual perception quality and coherence in videos, this paper proposes a multiresolution mixture generative adversarial network for video super-resolution (MRMVSR). We propose a multiresolution mixture network (MRMNet) as the generative network that can simultaneously generate multiresolution feature maps. In MRMNet, the high-resolution (HR) feature maps can continuously extract information from low-resolution (LR) feature maps to supplement information. In addition, we propose a residual fluctuation loss function for video super-resolution. The residual fluctuation loss function is used to reduce the overall residual fluctuation on SR and HR video frames to avoid a scenario where local differences are too large. Experimental results on the public benchmark dataset show that our method outperforms the state-of-the-art methods for the majority of the test sets. |
format | Online Article Text |
id | pubmed-7351143 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2020 |
publisher | Public Library of Science |
record_format | MEDLINE/PubMed |
spelling | pubmed-73511432020-07-20 A multiresolution mixture generative adversarial network for video super-resolution Tian, Zhiqiang Wang, Yudiao Du, Shaoyi Lan, Xuguang PLoS One Research Article Generative adversarial networks (GANs) have been used to obtain super-resolution (SR) videos that have improved visual perception quality and more coherent details. However, the latest methods perform poorly in areas with dense textures. To better recover the areas with dense textures in video frames and improve the visual perception quality and coherence in videos, this paper proposes a multiresolution mixture generative adversarial network for video super-resolution (MRMVSR). We propose a multiresolution mixture network (MRMNet) as the generative network that can simultaneously generate multiresolution feature maps. In MRMNet, the high-resolution (HR) feature maps can continuously extract information from low-resolution (LR) feature maps to supplement information. In addition, we propose a residual fluctuation loss function for video super-resolution. The residual fluctuation loss function is used to reduce the overall residual fluctuation on SR and HR video frames to avoid a scenario where local differences are too large. Experimental results on the public benchmark dataset show that our method outperforms the state-of-the-art methods for the majority of the test sets. Public Library of Science 2020-07-10 /pmc/articles/PMC7351143/ /pubmed/32649694 http://dx.doi.org/10.1371/journal.pone.0235352 Text en © 2020 Tian et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. |
spellingShingle | Research Article Tian, Zhiqiang Wang, Yudiao Du, Shaoyi Lan, Xuguang A multiresolution mixture generative adversarial network for video super-resolution |
title | A multiresolution mixture generative adversarial network for video super-resolution |
title_full | A multiresolution mixture generative adversarial network for video super-resolution |
title_fullStr | A multiresolution mixture generative adversarial network for video super-resolution |
title_full_unstemmed | A multiresolution mixture generative adversarial network for video super-resolution |
title_short | A multiresolution mixture generative adversarial network for video super-resolution |
title_sort | multiresolution mixture generative adversarial network for video super-resolution |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7351143/ https://www.ncbi.nlm.nih.gov/pubmed/32649694 http://dx.doi.org/10.1371/journal.pone.0235352 |
work_keys_str_mv | AT tianzhiqiang amultiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution AT wangyudiao amultiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution AT dushaoyi amultiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution AT lanxuguang amultiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution AT tianzhiqiang multiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution AT wangyudiao multiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution AT dushaoyi multiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution AT lanxuguang multiresolutionmixturegenerativeadversarialnetworkforvideosuperresolution |