Cargando…

Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network

A color transfer algorithm between images based on two-stage convolutional neural network (CNN) is proposed. The first stage network is based on VGG19 architecture as the backbone. The reference image-based color transfer (RICT) model was used to extract the features of the reference image and the t...

Descripción completa

Detalles Bibliográficos
Autores principales: Xu, Min, Ding, Youdong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9610276/
https://www.ncbi.nlm.nih.gov/pubmed/36298129
http://dx.doi.org/10.3390/s22207779
_version_ 1784819229651894272
author Xu, Min
Ding, Youdong
author_facet Xu, Min
Ding, Youdong
author_sort Xu, Min
collection PubMed
description A color transfer algorithm between images based on two-stage convolutional neural network (CNN) is proposed. The first stage network is based on VGG19 architecture as the backbone. The reference image-based color transfer (RICT) model was used to extract the features of the reference image and the target image, so as to realize the color transfer between them. The second stage is based on progressive convolutional neural network (PCNN) as its backbone. The palette-based emotional color enhancement (PECE) model is adopted to enhance the emotional coloring of the resulting image by comparing the palette, emotional value and the proportion of each color of the reference image. Through five sets of experiments, it is proved that the visual effect processed by our model is obviously better than several main colorization methods in both subjective evaluation and objective data. It can be applied to various complex scenes, and in the near future, it can also be better applied to the fields of digital restoration of old image archives, medical image coloring, art restoration, remote sensing image enhancement, infrared image enhancement and other fields.
format Online
Article
Text
id pubmed-9610276
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-96102762022-10-28 Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network Xu, Min Ding, Youdong Sensors (Basel) Article A color transfer algorithm between images based on two-stage convolutional neural network (CNN) is proposed. The first stage network is based on VGG19 architecture as the backbone. The reference image-based color transfer (RICT) model was used to extract the features of the reference image and the target image, so as to realize the color transfer between them. The second stage is based on progressive convolutional neural network (PCNN) as its backbone. The palette-based emotional color enhancement (PECE) model is adopted to enhance the emotional coloring of the resulting image by comparing the palette, emotional value and the proportion of each color of the reference image. Through five sets of experiments, it is proved that the visual effect processed by our model is obviously better than several main colorization methods in both subjective evaluation and objective data. It can be applied to various complex scenes, and in the near future, it can also be better applied to the fields of digital restoration of old image archives, medical image coloring, art restoration, remote sensing image enhancement, infrared image enhancement and other fields. MDPI 2022-10-13 /pmc/articles/PMC9610276/ /pubmed/36298129 http://dx.doi.org/10.3390/s22207779 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Xu, Min
Ding, Youdong
Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network
title Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network
title_full Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network
title_fullStr Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network
title_full_unstemmed Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network
title_short Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network
title_sort color transfer algorithm between images based on a two-stage convolutional neural network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9610276/
https://www.ncbi.nlm.nih.gov/pubmed/36298129
http://dx.doi.org/10.3390/s22207779
work_keys_str_mv AT xumin colortransferalgorithmbetweenimagesbasedonatwostageconvolutionalneuralnetwork
AT dingyoudong colortransferalgorithmbetweenimagesbasedonatwostageconvolutionalneuralnetwork