Cargando…

Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer

Artificial intelligence has emerged as a powerful computational tool to create artworks. One application is Neural Style Transfer, which allows to transfer the style of one image, such as a painting, onto the content of another image, such as a photograph. In the present study, we ask how Neural Sty...

Descripción completa

Detalles Bibliográficos
Autores principales: Geller, Hannah Alexa, Bartho, Ralf, Thömmes, Katja, Redies, Christoph
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9606769/
https://www.ncbi.nlm.nih.gov/pubmed/36312022
http://dx.doi.org/10.3389/fnins.2022.999720
_version_ 1784818371780411392
author Geller, Hannah Alexa
Bartho, Ralf
Thömmes, Katja
Redies, Christoph
author_facet Geller, Hannah Alexa
Bartho, Ralf
Thömmes, Katja
Redies, Christoph
author_sort Geller, Hannah Alexa
collection PubMed
description Artificial intelligence has emerged as a powerful computational tool to create artworks. One application is Neural Style Transfer, which allows to transfer the style of one image, such as a painting, onto the content of another image, such as a photograph. In the present study, we ask how Neural Style Transfer affects objective image properties and how beholders perceive the novel (style-transferred) stimuli. In order to focus on the subjective perception of artistic style, we minimized the confounding effect of cognitive processing by eliminating all representational content from the input images. To this aim, we transferred the styles of 25 diverse abstract paintings onto 150 colored random-phase patterns with six different Fourier spectral slopes. This procedure resulted in 150 style-transferred stimuli. We then computed eight statistical image properties (complexity, self-similarity, edge-orientation entropy, variances of neural network features, and color statistics) for each image. In a rating study, we asked participants to evaluate the images along three aesthetic dimensions (Pleasing, Harmonious, and Interesting). Results demonstrate that not only objective image properties, but also subjective aesthetic preferences transferred from the original artworks onto the style-transferred images. The image properties of the style-transferred images explain 50 – 69% of the variance in the ratings. In the multidimensional space of statistical image properties, participants considered style-transferred images to be more Pleasing and Interesting if they were closer to a “sweet spot” where traditional Western paintings (JenAesthetics dataset) are represented. We conclude that NST is a useful tool to create novel artistic stimuli that preserve the image properties of the input style images. In the novel stimuli, we found a strong relationship between statistical image properties and subjective ratings, suggesting a prominent role of perceptual processing in the aesthetic evaluation of abstract images.
format Online
Article
Text
id pubmed-9606769
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-96067692022-10-28 Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer Geller, Hannah Alexa Bartho, Ralf Thömmes, Katja Redies, Christoph Front Neurosci Neuroscience Artificial intelligence has emerged as a powerful computational tool to create artworks. One application is Neural Style Transfer, which allows to transfer the style of one image, such as a painting, onto the content of another image, such as a photograph. In the present study, we ask how Neural Style Transfer affects objective image properties and how beholders perceive the novel (style-transferred) stimuli. In order to focus on the subjective perception of artistic style, we minimized the confounding effect of cognitive processing by eliminating all representational content from the input images. To this aim, we transferred the styles of 25 diverse abstract paintings onto 150 colored random-phase patterns with six different Fourier spectral slopes. This procedure resulted in 150 style-transferred stimuli. We then computed eight statistical image properties (complexity, self-similarity, edge-orientation entropy, variances of neural network features, and color statistics) for each image. In a rating study, we asked participants to evaluate the images along three aesthetic dimensions (Pleasing, Harmonious, and Interesting). Results demonstrate that not only objective image properties, but also subjective aesthetic preferences transferred from the original artworks onto the style-transferred images. The image properties of the style-transferred images explain 50 – 69% of the variance in the ratings. In the multidimensional space of statistical image properties, participants considered style-transferred images to be more Pleasing and Interesting if they were closer to a “sweet spot” where traditional Western paintings (JenAesthetics dataset) are represented. We conclude that NST is a useful tool to create novel artistic stimuli that preserve the image properties of the input style images. In the novel stimuli, we found a strong relationship between statistical image properties and subjective ratings, suggesting a prominent role of perceptual processing in the aesthetic evaluation of abstract images. Frontiers Media S.A. 2022-10-13 /pmc/articles/PMC9606769/ /pubmed/36312022 http://dx.doi.org/10.3389/fnins.2022.999720 Text en Copyright © 2022 Geller, Bartho, Thömmes and Redies. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Geller, Hannah Alexa
Bartho, Ralf
Thömmes, Katja
Redies, Christoph
Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer
title Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer
title_full Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer
title_fullStr Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer
title_full_unstemmed Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer
title_short Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer
title_sort statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9606769/
https://www.ncbi.nlm.nih.gov/pubmed/36312022
http://dx.doi.org/10.3389/fnins.2022.999720
work_keys_str_mv AT gellerhannahalexa statisticalimagepropertiespredictaestheticratingsinabstractpaintingscreatedbyneuralstyletransfer
AT barthoralf statisticalimagepropertiespredictaestheticratingsinabstractpaintingscreatedbyneuralstyletransfer
AT thommeskatja statisticalimagepropertiespredictaestheticratingsinabstractpaintingscreatedbyneuralstyletransfer
AT redieschristoph statisticalimagepropertiespredictaestheticratingsinabstractpaintingscreatedbyneuralstyletransfer