Cargando…
Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer
Artificial intelligence has emerged as a powerful computational tool to create artworks. One application is Neural Style Transfer, which allows to transfer the style of one image, such as a painting, onto the content of another image, such as a photograph. In the present study, we ask how Neural Sty...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Frontiers Media S.A.
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9606769/ https://www.ncbi.nlm.nih.gov/pubmed/36312022 http://dx.doi.org/10.3389/fnins.2022.999720 |
_version_ | 1784818371780411392 |
---|---|
author | Geller, Hannah Alexa Bartho, Ralf Thömmes, Katja Redies, Christoph |
author_facet | Geller, Hannah Alexa Bartho, Ralf Thömmes, Katja Redies, Christoph |
author_sort | Geller, Hannah Alexa |
collection | PubMed |
description | Artificial intelligence has emerged as a powerful computational tool to create artworks. One application is Neural Style Transfer, which allows to transfer the style of one image, such as a painting, onto the content of another image, such as a photograph. In the present study, we ask how Neural Style Transfer affects objective image properties and how beholders perceive the novel (style-transferred) stimuli. In order to focus on the subjective perception of artistic style, we minimized the confounding effect of cognitive processing by eliminating all representational content from the input images. To this aim, we transferred the styles of 25 diverse abstract paintings onto 150 colored random-phase patterns with six different Fourier spectral slopes. This procedure resulted in 150 style-transferred stimuli. We then computed eight statistical image properties (complexity, self-similarity, edge-orientation entropy, variances of neural network features, and color statistics) for each image. In a rating study, we asked participants to evaluate the images along three aesthetic dimensions (Pleasing, Harmonious, and Interesting). Results demonstrate that not only objective image properties, but also subjective aesthetic preferences transferred from the original artworks onto the style-transferred images. The image properties of the style-transferred images explain 50 – 69% of the variance in the ratings. In the multidimensional space of statistical image properties, participants considered style-transferred images to be more Pleasing and Interesting if they were closer to a “sweet spot” where traditional Western paintings (JenAesthetics dataset) are represented. We conclude that NST is a useful tool to create novel artistic stimuli that preserve the image properties of the input style images. In the novel stimuli, we found a strong relationship between statistical image properties and subjective ratings, suggesting a prominent role of perceptual processing in the aesthetic evaluation of abstract images. |
format | Online Article Text |
id | pubmed-9606769 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | Frontiers Media S.A. |
record_format | MEDLINE/PubMed |
spelling | pubmed-96067692022-10-28 Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer Geller, Hannah Alexa Bartho, Ralf Thömmes, Katja Redies, Christoph Front Neurosci Neuroscience Artificial intelligence has emerged as a powerful computational tool to create artworks. One application is Neural Style Transfer, which allows to transfer the style of one image, such as a painting, onto the content of another image, such as a photograph. In the present study, we ask how Neural Style Transfer affects objective image properties and how beholders perceive the novel (style-transferred) stimuli. In order to focus on the subjective perception of artistic style, we minimized the confounding effect of cognitive processing by eliminating all representational content from the input images. To this aim, we transferred the styles of 25 diverse abstract paintings onto 150 colored random-phase patterns with six different Fourier spectral slopes. This procedure resulted in 150 style-transferred stimuli. We then computed eight statistical image properties (complexity, self-similarity, edge-orientation entropy, variances of neural network features, and color statistics) for each image. In a rating study, we asked participants to evaluate the images along three aesthetic dimensions (Pleasing, Harmonious, and Interesting). Results demonstrate that not only objective image properties, but also subjective aesthetic preferences transferred from the original artworks onto the style-transferred images. The image properties of the style-transferred images explain 50 – 69% of the variance in the ratings. In the multidimensional space of statistical image properties, participants considered style-transferred images to be more Pleasing and Interesting if they were closer to a “sweet spot” where traditional Western paintings (JenAesthetics dataset) are represented. We conclude that NST is a useful tool to create novel artistic stimuli that preserve the image properties of the input style images. In the novel stimuli, we found a strong relationship between statistical image properties and subjective ratings, suggesting a prominent role of perceptual processing in the aesthetic evaluation of abstract images. Frontiers Media S.A. 2022-10-13 /pmc/articles/PMC9606769/ /pubmed/36312022 http://dx.doi.org/10.3389/fnins.2022.999720 Text en Copyright © 2022 Geller, Bartho, Thömmes and Redies. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. |
spellingShingle | Neuroscience Geller, Hannah Alexa Bartho, Ralf Thömmes, Katja Redies, Christoph Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer |
title | Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer |
title_full | Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer |
title_fullStr | Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer |
title_full_unstemmed | Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer |
title_short | Statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer |
title_sort | statistical image properties predict aesthetic ratings in abstract paintings created by neural style transfer |
topic | Neuroscience |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9606769/ https://www.ncbi.nlm.nih.gov/pubmed/36312022 http://dx.doi.org/10.3389/fnins.2022.999720 |
work_keys_str_mv | AT gellerhannahalexa statisticalimagepropertiespredictaestheticratingsinabstractpaintingscreatedbyneuralstyletransfer AT barthoralf statisticalimagepropertiespredictaestheticratingsinabstractpaintingscreatedbyneuralstyletransfer AT thommeskatja statisticalimagepropertiespredictaestheticratingsinabstractpaintingscreatedbyneuralstyletransfer AT redieschristoph statisticalimagepropertiespredictaestheticratingsinabstractpaintingscreatedbyneuralstyletransfer |