Cargando…

Unsupervised Image-to-Image Translation: A Review

Supervised image-to-image translation has been proven to generate realistic images with sharp details and to have good quantitative performance. Such methods are trained on a paired dataset, where an image from the source domain already has a corresponding translated image in the target domain. Howe...

Descripción completa

Detalles Bibliográficos
Autores principales: Hoyez, Henri, Schockaert, Cédric, Rambach, Jason, Mirbach, Bruno, Stricker, Didier
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9654990/
https://www.ncbi.nlm.nih.gov/pubmed/36366238
http://dx.doi.org/10.3390/s22218540
_version_ 1784829074765512704
author Hoyez, Henri
Schockaert, Cédric
Rambach, Jason
Mirbach, Bruno
Stricker, Didier
author_facet Hoyez, Henri
Schockaert, Cédric
Rambach, Jason
Mirbach, Bruno
Stricker, Didier
author_sort Hoyez, Henri
collection PubMed
description Supervised image-to-image translation has been proven to generate realistic images with sharp details and to have good quantitative performance. Such methods are trained on a paired dataset, where an image from the source domain already has a corresponding translated image in the target domain. However, this paired dataset requirement imposes a huge practical constraint, requires domain knowledge or is even impossible to obtain in certain cases. Due to these problems, unsupervised image-to-image translation has been proposed, which does not require domain expertise and can take advantage of a large unlabeled dataset. Although such models perform well, they are hard to train due to the major constraints induced in their loss functions, which make training unstable. Since CycleGAN has been released, numerous methods have been proposed which try to address various problems from different perspectives. In this review, we firstly describe the general image-to-image translation framework and discuss the datasets and metrics involved in the topic. Furthermore, we revise the current state-of-the-art with a classification of existing works. This part is followed by a small quantitative evaluation, for which results were taken from papers.
format Online
Article
Text
id pubmed-9654990
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-96549902022-11-15 Unsupervised Image-to-Image Translation: A Review Hoyez, Henri Schockaert, Cédric Rambach, Jason Mirbach, Bruno Stricker, Didier Sensors (Basel) Review Supervised image-to-image translation has been proven to generate realistic images with sharp details and to have good quantitative performance. Such methods are trained on a paired dataset, where an image from the source domain already has a corresponding translated image in the target domain. However, this paired dataset requirement imposes a huge practical constraint, requires domain knowledge or is even impossible to obtain in certain cases. Due to these problems, unsupervised image-to-image translation has been proposed, which does not require domain expertise and can take advantage of a large unlabeled dataset. Although such models perform well, they are hard to train due to the major constraints induced in their loss functions, which make training unstable. Since CycleGAN has been released, numerous methods have been proposed which try to address various problems from different perspectives. In this review, we firstly describe the general image-to-image translation framework and discuss the datasets and metrics involved in the topic. Furthermore, we revise the current state-of-the-art with a classification of existing works. This part is followed by a small quantitative evaluation, for which results were taken from papers. MDPI 2022-11-06 /pmc/articles/PMC9654990/ /pubmed/36366238 http://dx.doi.org/10.3390/s22218540 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Review
Hoyez, Henri
Schockaert, Cédric
Rambach, Jason
Mirbach, Bruno
Stricker, Didier
Unsupervised Image-to-Image Translation: A Review
title Unsupervised Image-to-Image Translation: A Review
title_full Unsupervised Image-to-Image Translation: A Review
title_fullStr Unsupervised Image-to-Image Translation: A Review
title_full_unstemmed Unsupervised Image-to-Image Translation: A Review
title_short Unsupervised Image-to-Image Translation: A Review
title_sort unsupervised image-to-image translation: a review
topic Review
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9654990/
https://www.ncbi.nlm.nih.gov/pubmed/36366238
http://dx.doi.org/10.3390/s22218540
work_keys_str_mv AT hoyezhenri unsupervisedimagetoimagetranslationareview
AT schockaertcedric unsupervisedimagetoimagetranslationareview
AT rambachjason unsupervisedimagetoimagetranslationareview
AT mirbachbruno unsupervisedimagetoimagetranslationareview
AT strickerdidier unsupervisedimagetoimagetranslationareview