Cargando…

Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation

Unsupervised image-to-image translation has received considerable attention due to the recent remarkable advancements in generative adversarial networks (GANs). In image-to-image translation, state-of-the-art methods use unpaired image data to learn mappings between the source and target domains. Ho...

Descripción completa

Detalles Bibliográficos
Autores principales: Lee, Hong-Yu, Li, Yung-Hui, Lee, Ting-Hsuan, Aslam, Muhammad Saqlain
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422294/
https://www.ncbi.nlm.nih.gov/pubmed/37571641
http://dx.doi.org/10.3390/s23156858
_version_ 1785089173408972800
author Lee, Hong-Yu
Li, Yung-Hui
Lee, Ting-Hsuan
Aslam, Muhammad Saqlain
author_facet Lee, Hong-Yu
Li, Yung-Hui
Lee, Ting-Hsuan
Aslam, Muhammad Saqlain
author_sort Lee, Hong-Yu
collection PubMed
description Unsupervised image-to-image translation has received considerable attention due to the recent remarkable advancements in generative adversarial networks (GANs). In image-to-image translation, state-of-the-art methods use unpaired image data to learn mappings between the source and target domains. However, despite their promising results, existing approaches often fail in challenging conditions, particularly when images have various target instances and a translation task involves significant transitions in shape and visual artifacts when translating low-level information rather than high-level semantics. To tackle the problem, we propose a novel framework called Progressive Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization (PRO-U-GAT-IT) for the unsupervised image-to-image translation task. In contrast to existing attention-based models that fail to handle geometric transitions between the source and target domains, our model can translate images requiring extensive and holistic changes in shape. Experimental results show the superiority of the proposed approach compared to the existing state-of-the-art models on different datasets.
format Online
Article
Text
id pubmed-10422294
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-104222942023-08-13 Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation Lee, Hong-Yu Li, Yung-Hui Lee, Ting-Hsuan Aslam, Muhammad Saqlain Sensors (Basel) Article Unsupervised image-to-image translation has received considerable attention due to the recent remarkable advancements in generative adversarial networks (GANs). In image-to-image translation, state-of-the-art methods use unpaired image data to learn mappings between the source and target domains. However, despite their promising results, existing approaches often fail in challenging conditions, particularly when images have various target instances and a translation task involves significant transitions in shape and visual artifacts when translating low-level information rather than high-level semantics. To tackle the problem, we propose a novel framework called Progressive Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization (PRO-U-GAT-IT) for the unsupervised image-to-image translation task. In contrast to existing attention-based models that fail to handle geometric transitions between the source and target domains, our model can translate images requiring extensive and holistic changes in shape. Experimental results show the superiority of the proposed approach compared to the existing state-of-the-art models on different datasets. MDPI 2023-08-01 /pmc/articles/PMC10422294/ /pubmed/37571641 http://dx.doi.org/10.3390/s23156858 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Lee, Hong-Yu
Li, Yung-Hui
Lee, Ting-Hsuan
Aslam, Muhammad Saqlain
Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation
title Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation
title_full Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation
title_fullStr Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation
title_full_unstemmed Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation
title_short Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation
title_sort progressively unsupervised generative attentional networks with adaptive layer-instance normalization for image-to-image translation
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422294/
https://www.ncbi.nlm.nih.gov/pubmed/37571641
http://dx.doi.org/10.3390/s23156858
work_keys_str_mv AT leehongyu progressivelyunsupervisedgenerativeattentionalnetworkswithadaptivelayerinstancenormalizationforimagetoimagetranslation
AT liyunghui progressivelyunsupervisedgenerativeattentionalnetworkswithadaptivelayerinstancenormalizationforimagetoimagetranslation
AT leetinghsuan progressivelyunsupervisedgenerativeattentionalnetworkswithadaptivelayerinstancenormalizationforimagetoimagetranslation
AT aslammuhammadsaqlain progressivelyunsupervisedgenerativeattentionalnetworkswithadaptivelayerinstancenormalizationforimagetoimagetranslation