Cargando…

On the influence of low-level visual features in film classification

BACKGROUND: In this paper we present a model of parameters to aesthetically characterize films using a multi-disciplinary approach: by combining film theory, visual low-level video descriptors (modeled in order to supply aesthetic information) and classification techniques using machine and deep lea...

Descripción completa

Detalles Bibliográficos
Autores principales: Álvarez, Federico, Sánchez, Faustino, Hernández-Peñaloza, Gustavo, Jiménez, David, Menéndez, José Manuel, Cisneros, Guillermo
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Public Library of Science 2019
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6386315/
https://www.ncbi.nlm.nih.gov/pubmed/30794549
http://dx.doi.org/10.1371/journal.pone.0211406
_version_ 1783397359258959872
author Álvarez, Federico
Sánchez, Faustino
Hernández-Peñaloza, Gustavo
Jiménez, David
Menéndez, José Manuel
Cisneros, Guillermo
author_facet Álvarez, Federico
Sánchez, Faustino
Hernández-Peñaloza, Gustavo
Jiménez, David
Menéndez, José Manuel
Cisneros, Guillermo
author_sort Álvarez, Federico
collection PubMed
description BACKGROUND: In this paper we present a model of parameters to aesthetically characterize films using a multi-disciplinary approach: by combining film theory, visual low-level video descriptors (modeled in order to supply aesthetic information) and classification techniques using machine and deep learning. METHODS: Four different tests have been developed, each for a different application, proving the model's usefulness. These applications are: aesthetic style clustering, prediction of production year, genre detection and influence on film popularity. RESULTS: The results are compared against high-level information to determine the accuracy of the model to classify films without knowing such information previously. The main difference with other film characterization approaches is that we are able to isolate the influence of high-level descriptors to really understand the relevance of low-level features and, accordingly propose a useful set of low-level visual descriptors for that purpose. This model has been tested with a representative number of films to prove that it can be used for different applications.
format Online
Article
Text
id pubmed-6386315
institution National Center for Biotechnology Information
language English
publishDate 2019
publisher Public Library of Science
record_format MEDLINE/PubMed
spelling pubmed-63863152019-03-09 On the influence of low-level visual features in film classification Álvarez, Federico Sánchez, Faustino Hernández-Peñaloza, Gustavo Jiménez, David Menéndez, José Manuel Cisneros, Guillermo PLoS One Research Article BACKGROUND: In this paper we present a model of parameters to aesthetically characterize films using a multi-disciplinary approach: by combining film theory, visual low-level video descriptors (modeled in order to supply aesthetic information) and classification techniques using machine and deep learning. METHODS: Four different tests have been developed, each for a different application, proving the model's usefulness. These applications are: aesthetic style clustering, prediction of production year, genre detection and influence on film popularity. RESULTS: The results are compared against high-level information to determine the accuracy of the model to classify films without knowing such information previously. The main difference with other film characterization approaches is that we are able to isolate the influence of high-level descriptors to really understand the relevance of low-level features and, accordingly propose a useful set of low-level visual descriptors for that purpose. This model has been tested with a representative number of films to prove that it can be used for different applications. Public Library of Science 2019-02-22 /pmc/articles/PMC6386315/ /pubmed/30794549 http://dx.doi.org/10.1371/journal.pone.0211406 Text en © 2019 Álvarez et al http://creativecommons.org/licenses/by/4.0/ This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
spellingShingle Research Article
Álvarez, Federico
Sánchez, Faustino
Hernández-Peñaloza, Gustavo
Jiménez, David
Menéndez, José Manuel
Cisneros, Guillermo
On the influence of low-level visual features in film classification
title On the influence of low-level visual features in film classification
title_full On the influence of low-level visual features in film classification
title_fullStr On the influence of low-level visual features in film classification
title_full_unstemmed On the influence of low-level visual features in film classification
title_short On the influence of low-level visual features in film classification
title_sort on the influence of low-level visual features in film classification
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6386315/
https://www.ncbi.nlm.nih.gov/pubmed/30794549
http://dx.doi.org/10.1371/journal.pone.0211406
work_keys_str_mv AT alvarezfederico ontheinfluenceoflowlevelvisualfeaturesinfilmclassification
AT sanchezfaustino ontheinfluenceoflowlevelvisualfeaturesinfilmclassification
AT hernandezpenalozagustavo ontheinfluenceoflowlevelvisualfeaturesinfilmclassification
AT jimenezdavid ontheinfluenceoflowlevelvisualfeaturesinfilmclassification
AT menendezjosemanuel ontheinfluenceoflowlevelvisualfeaturesinfilmclassification
AT cisnerosguillermo ontheinfluenceoflowlevelvisualfeaturesinfilmclassification