Cargando…

Improving Deep Interactive Evolution with a Style-Based Generator for Artistic Expression and Creative Exploration

Deep interactive evolution (DeepIE) combines the capacity of interactive evolutionary computation (IEC) to capture a user’s preference with the domain-specific robustness of a trained generative adversarial network (GAN) generator, allowing the user to control the GAN output through evolutionary exp...

Descripción completa

Detalles Bibliográficos
Autores principales: Tejeda-Ocampo, Carlos, López-Cuevas, Armando, Terashima-Marin, Hugo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2020
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7823808/
https://www.ncbi.nlm.nih.gov/pubmed/33374104
http://dx.doi.org/10.3390/e23010011
_version_ 1783639924417757184
author Tejeda-Ocampo, Carlos
López-Cuevas, Armando
Terashima-Marin, Hugo
author_facet Tejeda-Ocampo, Carlos
López-Cuevas, Armando
Terashima-Marin, Hugo
author_sort Tejeda-Ocampo, Carlos
collection PubMed
description Deep interactive evolution (DeepIE) combines the capacity of interactive evolutionary computation (IEC) to capture a user’s preference with the domain-specific robustness of a trained generative adversarial network (GAN) generator, allowing the user to control the GAN output through evolutionary exploration of the latent space. However, the traditional GAN latent space presents feature entanglement, which limits the practicability of possible applications of DeepIE. In this paper, we implement DeepIE within a style-based generator from a StyleGAN model trained on the WikiArt dataset and propose StyleIE, a variation of DeepIE that takes advantage of the secondary disentangled latent space in the style-based generator. We performed two AB/BA crossover user tests that compared the performance of DeepIE against StyleIE for art generation. Self-rated evaluations of the performance were collected through a questionnaire. Findings from the tests suggest that StyleIE and DeepIE perform equally in tasks with open-ended goals with relaxed constraints, but StyleIE performs better in close-ended and more constrained tasks.
format Online
Article
Text
id pubmed-7823808
institution National Center for Biotechnology Information
language English
publishDate 2020
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-78238082021-02-24 Improving Deep Interactive Evolution with a Style-Based Generator for Artistic Expression and Creative Exploration Tejeda-Ocampo, Carlos López-Cuevas, Armando Terashima-Marin, Hugo Entropy (Basel) Article Deep interactive evolution (DeepIE) combines the capacity of interactive evolutionary computation (IEC) to capture a user’s preference with the domain-specific robustness of a trained generative adversarial network (GAN) generator, allowing the user to control the GAN output through evolutionary exploration of the latent space. However, the traditional GAN latent space presents feature entanglement, which limits the practicability of possible applications of DeepIE. In this paper, we implement DeepIE within a style-based generator from a StyleGAN model trained on the WikiArt dataset and propose StyleIE, a variation of DeepIE that takes advantage of the secondary disentangled latent space in the style-based generator. We performed two AB/BA crossover user tests that compared the performance of DeepIE against StyleIE for art generation. Self-rated evaluations of the performance were collected through a questionnaire. Findings from the tests suggest that StyleIE and DeepIE perform equally in tasks with open-ended goals with relaxed constraints, but StyleIE performs better in close-ended and more constrained tasks. MDPI 2020-12-24 /pmc/articles/PMC7823808/ /pubmed/33374104 http://dx.doi.org/10.3390/e23010011 Text en © 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Tejeda-Ocampo, Carlos
López-Cuevas, Armando
Terashima-Marin, Hugo
Improving Deep Interactive Evolution with a Style-Based Generator for Artistic Expression and Creative Exploration
title Improving Deep Interactive Evolution with a Style-Based Generator for Artistic Expression and Creative Exploration
title_full Improving Deep Interactive Evolution with a Style-Based Generator for Artistic Expression and Creative Exploration
title_fullStr Improving Deep Interactive Evolution with a Style-Based Generator for Artistic Expression and Creative Exploration
title_full_unstemmed Improving Deep Interactive Evolution with a Style-Based Generator for Artistic Expression and Creative Exploration
title_short Improving Deep Interactive Evolution with a Style-Based Generator for Artistic Expression and Creative Exploration
title_sort improving deep interactive evolution with a style-based generator for artistic expression and creative exploration
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7823808/
https://www.ncbi.nlm.nih.gov/pubmed/33374104
http://dx.doi.org/10.3390/e23010011
work_keys_str_mv AT tejedaocampocarlos improvingdeepinteractiveevolutionwithastylebasedgeneratorforartisticexpressionandcreativeexploration
AT lopezcuevasarmando improvingdeepinteractiveevolutionwithastylebasedgeneratorforartisticexpressionandcreativeexploration
AT terashimamarinhugo improvingdeepinteractiveevolutionwithastylebasedgeneratorforartisticexpressionandcreativeexploration