Cargando…
Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network
A color transfer algorithm between images based on two-stage convolutional neural network (CNN) is proposed. The first stage network is based on VGG19 architecture as the backbone. The reference image-based color transfer (RICT) model was used to extract the features of the reference image and the t...
Autores principales: | , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9610276/ https://www.ncbi.nlm.nih.gov/pubmed/36298129 http://dx.doi.org/10.3390/s22207779 |
_version_ | 1784819229651894272 |
---|---|
author | Xu, Min Ding, Youdong |
author_facet | Xu, Min Ding, Youdong |
author_sort | Xu, Min |
collection | PubMed |
description | A color transfer algorithm between images based on two-stage convolutional neural network (CNN) is proposed. The first stage network is based on VGG19 architecture as the backbone. The reference image-based color transfer (RICT) model was used to extract the features of the reference image and the target image, so as to realize the color transfer between them. The second stage is based on progressive convolutional neural network (PCNN) as its backbone. The palette-based emotional color enhancement (PECE) model is adopted to enhance the emotional coloring of the resulting image by comparing the palette, emotional value and the proportion of each color of the reference image. Through five sets of experiments, it is proved that the visual effect processed by our model is obviously better than several main colorization methods in both subjective evaluation and objective data. It can be applied to various complex scenes, and in the near future, it can also be better applied to the fields of digital restoration of old image archives, medical image coloring, art restoration, remote sensing image enhancement, infrared image enhancement and other fields. |
format | Online Article Text |
id | pubmed-9610276 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-96102762022-10-28 Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network Xu, Min Ding, Youdong Sensors (Basel) Article A color transfer algorithm between images based on two-stage convolutional neural network (CNN) is proposed. The first stage network is based on VGG19 architecture as the backbone. The reference image-based color transfer (RICT) model was used to extract the features of the reference image and the target image, so as to realize the color transfer between them. The second stage is based on progressive convolutional neural network (PCNN) as its backbone. The palette-based emotional color enhancement (PECE) model is adopted to enhance the emotional coloring of the resulting image by comparing the palette, emotional value and the proportion of each color of the reference image. Through five sets of experiments, it is proved that the visual effect processed by our model is obviously better than several main colorization methods in both subjective evaluation and objective data. It can be applied to various complex scenes, and in the near future, it can also be better applied to the fields of digital restoration of old image archives, medical image coloring, art restoration, remote sensing image enhancement, infrared image enhancement and other fields. MDPI 2022-10-13 /pmc/articles/PMC9610276/ /pubmed/36298129 http://dx.doi.org/10.3390/s22207779 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Xu, Min Ding, Youdong Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network |
title | Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network |
title_full | Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network |
title_fullStr | Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network |
title_full_unstemmed | Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network |
title_short | Color Transfer Algorithm between Images Based on a Two-Stage Convolutional Neural Network |
title_sort | color transfer algorithm between images based on a two-stage convolutional neural network |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9610276/ https://www.ncbi.nlm.nih.gov/pubmed/36298129 http://dx.doi.org/10.3390/s22207779 |
work_keys_str_mv | AT xumin colortransferalgorithmbetweenimagesbasedonatwostageconvolutionalneuralnetwork AT dingyoudong colortransferalgorithmbetweenimagesbasedonatwostageconvolutionalneuralnetwork |