Cargando…
Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation
Unsupervised image-to-image translation has received considerable attention due to the recent remarkable advancements in generative adversarial networks (GANs). In image-to-image translation, state-of-the-art methods use unpaired image data to learn mappings between the source and target domains. Ho...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422294/ https://www.ncbi.nlm.nih.gov/pubmed/37571641 http://dx.doi.org/10.3390/s23156858 |
_version_ | 1785089173408972800 |
---|---|
author | Lee, Hong-Yu Li, Yung-Hui Lee, Ting-Hsuan Aslam, Muhammad Saqlain |
author_facet | Lee, Hong-Yu Li, Yung-Hui Lee, Ting-Hsuan Aslam, Muhammad Saqlain |
author_sort | Lee, Hong-Yu |
collection | PubMed |
description | Unsupervised image-to-image translation has received considerable attention due to the recent remarkable advancements in generative adversarial networks (GANs). In image-to-image translation, state-of-the-art methods use unpaired image data to learn mappings between the source and target domains. However, despite their promising results, existing approaches often fail in challenging conditions, particularly when images have various target instances and a translation task involves significant transitions in shape and visual artifacts when translating low-level information rather than high-level semantics. To tackle the problem, we propose a novel framework called Progressive Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization (PRO-U-GAT-IT) for the unsupervised image-to-image translation task. In contrast to existing attention-based models that fail to handle geometric transitions between the source and target domains, our model can translate images requiring extensive and holistic changes in shape. Experimental results show the superiority of the proposed approach compared to the existing state-of-the-art models on different datasets. |
format | Online Article Text |
id | pubmed-10422294 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-104222942023-08-13 Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation Lee, Hong-Yu Li, Yung-Hui Lee, Ting-Hsuan Aslam, Muhammad Saqlain Sensors (Basel) Article Unsupervised image-to-image translation has received considerable attention due to the recent remarkable advancements in generative adversarial networks (GANs). In image-to-image translation, state-of-the-art methods use unpaired image data to learn mappings between the source and target domains. However, despite their promising results, existing approaches often fail in challenging conditions, particularly when images have various target instances and a translation task involves significant transitions in shape and visual artifacts when translating low-level information rather than high-level semantics. To tackle the problem, we propose a novel framework called Progressive Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization (PRO-U-GAT-IT) for the unsupervised image-to-image translation task. In contrast to existing attention-based models that fail to handle geometric transitions between the source and target domains, our model can translate images requiring extensive and holistic changes in shape. Experimental results show the superiority of the proposed approach compared to the existing state-of-the-art models on different datasets. MDPI 2023-08-01 /pmc/articles/PMC10422294/ /pubmed/37571641 http://dx.doi.org/10.3390/s23156858 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Lee, Hong-Yu Li, Yung-Hui Lee, Ting-Hsuan Aslam, Muhammad Saqlain Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation |
title | Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation |
title_full | Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation |
title_fullStr | Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation |
title_full_unstemmed | Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation |
title_short | Progressively Unsupervised Generative Attentional Networks with Adaptive Layer-Instance Normalization for Image-to-Image Translation |
title_sort | progressively unsupervised generative attentional networks with adaptive layer-instance normalization for image-to-image translation |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10422294/ https://www.ncbi.nlm.nih.gov/pubmed/37571641 http://dx.doi.org/10.3390/s23156858 |
work_keys_str_mv | AT leehongyu progressivelyunsupervisedgenerativeattentionalnetworkswithadaptivelayerinstancenormalizationforimagetoimagetranslation AT liyunghui progressivelyunsupervisedgenerativeattentionalnetworkswithadaptivelayerinstancenormalizationforimagetoimagetranslation AT leetinghsuan progressivelyunsupervisedgenerativeattentionalnetworkswithadaptivelayerinstancenormalizationforimagetoimagetranslation AT aslammuhammadsaqlain progressivelyunsupervisedgenerativeattentionalnetworkswithadaptivelayerinstancenormalizationforimagetoimagetranslation |