Cargando…

Robust Nonparametric Distribution Transfer with Exposure Correction for Image Neural Style Transfer

Image neural style transfer is a process of utilizing convolutional neural networks to render a content image based on a style image. The algorithm can compute a stylized image with original content from the given content image but a new style from the given style image. Style transfer has become a...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Shuai, Hong, Caixia, He, Jing, Tian, Zhiqiang
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7571219/
https://www.ncbi.nlm.nih.gov/pubmed/32937788
http://dx.doi.org/10.3390/s20185232
_version_ 1783597127024246784
author Liu, Shuai
Hong, Caixia
He, Jing
Tian, Zhiqiang
author_facet Liu, Shuai
Hong, Caixia
He, Jing
Tian, Zhiqiang
author_sort Liu, Shuai
collection PubMed
description Image neural style transfer is a process of utilizing convolutional neural networks to render a content image based on a style image. The algorithm can compute a stylized image with original content from the given content image but a new style from the given style image. Style transfer has become a hot topic both in academic literature and industrial applications. The stylized results of current existing models are not ideal because of the color difference between two input images and the inconspicuous details of content image. To solve the problems, we propose two style transfer models based on robust nonparametric distribution transfer. The first model converts the color probability density function of the content image into that of the style image before style transfer. When the color dynamic range of the content image is smaller than that of style image, this model renders more reasonable spatial structure than the existing models. Then, an adaptive detail-enhanced exposure correction algorithm is proposed for underexposed images. Based this, the second model is proposed for the style transfer of underexposed content images. It can further improve the stylized results of underexposed images. Compared with popular methods, the proposed methods achieve the satisfactory qualitative and quantitative results.
format Online
Article
Text
id pubmed-7571219
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-75712192020-10-28 Robust Nonparametric Distribution Transfer with Exposure Correction for Image Neural Style Transfer Liu, Shuai Hong, Caixia He, Jing Tian, Zhiqiang Sensors (Basel) Article Image neural style transfer is a process of utilizing convolutional neural networks to render a content image based on a style image. The algorithm can compute a stylized image with original content from the given content image but a new style from the given style image. Style transfer has become a hot topic both in academic literature and industrial applications. The stylized results of current existing models are not ideal because of the color difference between two input images and the inconspicuous details of content image. To solve the problems, we propose two style transfer models based on robust nonparametric distribution transfer. The first model converts the color probability density function of the content image into that of the style image before style transfer. When the color dynamic range of the content image is smaller than that of style image, this model renders more reasonable spatial structure than the existing models. Then, an adaptive detail-enhanced exposure correction algorithm is proposed for underexposed images. Based this, the second model is proposed for the style transfer of underexposed content images. It can further improve the stylized results of underexposed images. Compared with popular methods, the proposed methods achieve the satisfactory qualitative and quantitative results. MDPI 2020-09-14 /pmc/articles/PMC7571219/ /pubmed/32937788 http://dx.doi.org/10.3390/s20185232 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Liu, Shuai
Hong, Caixia
He, Jing
Tian, Zhiqiang
Robust Nonparametric Distribution Transfer with Exposure Correction for Image Neural Style Transfer
title Robust Nonparametric Distribution Transfer with Exposure Correction for Image Neural Style Transfer
title_full Robust Nonparametric Distribution Transfer with Exposure Correction for Image Neural Style Transfer
title_fullStr Robust Nonparametric Distribution Transfer with Exposure Correction for Image Neural Style Transfer
title_full_unstemmed Robust Nonparametric Distribution Transfer with Exposure Correction for Image Neural Style Transfer
title_short Robust Nonparametric Distribution Transfer with Exposure Correction for Image Neural Style Transfer
title_sort robust nonparametric distribution transfer with exposure correction for image neural style transfer
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7571219/
https://www.ncbi.nlm.nih.gov/pubmed/32937788
http://dx.doi.org/10.3390/s20185232
work_keys_str_mv AT liushuai robustnonparametricdistributiontransferwithexposurecorrectionforimageneuralstyletransfer
AT hongcaixia robustnonparametricdistributiontransferwithexposurecorrectionforimageneuralstyletransfer
AT hejing robustnonparametricdistributiontransferwithexposurecorrectionforimageneuralstyletransfer
AT tianzhiqiang robustnonparametricdistributiontransferwithexposurecorrectionforimageneuralstyletransfer