Cargando…

Would Your Clothes Look Good on Me? Towards Transferring Clothing Styles with Adaptive Instance Normalization

Several applications of deep learning, such as image classification and retrieval, recommendation systems, and especially image synthesis, are of great interest to the fashion industry. Recently, image generation of clothes gained lot of popularity as it is a very challenging task that is far from b...

Descripción completa

Detalles Bibliográficos
Autores principales: Fontanini, Tomaso, Ferrari, Claudio
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9269762/
https://www.ncbi.nlm.nih.gov/pubmed/35808497
http://dx.doi.org/10.3390/s22135002
_version_ 1784744300595118080
author Fontanini, Tomaso
Ferrari, Claudio
author_facet Fontanini, Tomaso
Ferrari, Claudio
author_sort Fontanini, Tomaso
collection PubMed
description Several applications of deep learning, such as image classification and retrieval, recommendation systems, and especially image synthesis, are of great interest to the fashion industry. Recently, image generation of clothes gained lot of popularity as it is a very challenging task that is far from being solved. Additionally, it would open lots of possibilities for designers and stylists enhancing their creativity. For this reason, in this paper we propose to tackle the problem of style transfer between two different people wearing different clothes. We draw inspiration from the recent StarGANv2 architecture that reached impressive results in transferring a target domain to a source image and we adapted it to work with fashion images and to transfer clothes styles. In more detail, we modified the architecture to work without the need of a clear separation between multiple domains, added a perceptual loss between the target and the source clothes, and edited the style encoder to better represent the style information of target clothes. We performed both qualitative and quantitative experiments with the recent DeepFashion2 dataset and proved the efficacy and novelty of our method.
format Online
Article
Text
id pubmed-9269762
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-92697622022-07-09 Would Your Clothes Look Good on Me? Towards Transferring Clothing Styles with Adaptive Instance Normalization Fontanini, Tomaso Ferrari, Claudio Sensors (Basel) Article Several applications of deep learning, such as image classification and retrieval, recommendation systems, and especially image synthesis, are of great interest to the fashion industry. Recently, image generation of clothes gained lot of popularity as it is a very challenging task that is far from being solved. Additionally, it would open lots of possibilities for designers and stylists enhancing their creativity. For this reason, in this paper we propose to tackle the problem of style transfer between two different people wearing different clothes. We draw inspiration from the recent StarGANv2 architecture that reached impressive results in transferring a target domain to a source image and we adapted it to work with fashion images and to transfer clothes styles. In more detail, we modified the architecture to work without the need of a clear separation between multiple domains, added a perceptual loss between the target and the source clothes, and edited the style encoder to better represent the style information of target clothes. We performed both qualitative and quantitative experiments with the recent DeepFashion2 dataset and proved the efficacy and novelty of our method. MDPI 2022-07-02 /pmc/articles/PMC9269762/ /pubmed/35808497 http://dx.doi.org/10.3390/s22135002 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Fontanini, Tomaso
Ferrari, Claudio
Would Your Clothes Look Good on Me? Towards Transferring Clothing Styles with Adaptive Instance Normalization
title Would Your Clothes Look Good on Me? Towards Transferring Clothing Styles with Adaptive Instance Normalization
title_full Would Your Clothes Look Good on Me? Towards Transferring Clothing Styles with Adaptive Instance Normalization
title_fullStr Would Your Clothes Look Good on Me? Towards Transferring Clothing Styles with Adaptive Instance Normalization
title_full_unstemmed Would Your Clothes Look Good on Me? Towards Transferring Clothing Styles with Adaptive Instance Normalization
title_short Would Your Clothes Look Good on Me? Towards Transferring Clothing Styles with Adaptive Instance Normalization
title_sort would your clothes look good on me? towards transferring clothing styles with adaptive instance normalization
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9269762/
https://www.ncbi.nlm.nih.gov/pubmed/35808497
http://dx.doi.org/10.3390/s22135002
work_keys_str_mv AT fontaninitomaso wouldyourclotheslookgoodonmetowardstransferringclothingstyleswithadaptiveinstancenormalization
AT ferrariclaudio wouldyourclotheslookgoodonmetowardstransferringclothingstyleswithadaptiveinstancenormalization