Cargando…

Semi-Supervised Anomaly Detection in Video-Surveillance Scenes in the Wild

Surveillance cameras are being installed in many primary daily living places to maintain public safety. In this video-surveillance context, anomalies occur only for a very short time, and very occasionally. Hence, manual monitoring of such anomalies may be exhaustive and monotonous, resulting in a d...

Descripción completa

Detalles Bibliográficos
Autores principales: Sarker, Mohammad Ibrahim, Losada-Gutiérrez, Cristina, Marrón-Romera, Marta, Fuentes-Jiménez, David, Luengo-Sánchez, Sara
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8230050/
https://www.ncbi.nlm.nih.gov/pubmed/34207883
http://dx.doi.org/10.3390/s21123993
_version_ 1783713115691548672
author Sarker, Mohammad Ibrahim
Losada-Gutiérrez, Cristina
Marrón-Romera, Marta
Fuentes-Jiménez, David
Luengo-Sánchez, Sara
author_facet Sarker, Mohammad Ibrahim
Losada-Gutiérrez, Cristina
Marrón-Romera, Marta
Fuentes-Jiménez, David
Luengo-Sánchez, Sara
author_sort Sarker, Mohammad Ibrahim
collection PubMed
description Surveillance cameras are being installed in many primary daily living places to maintain public safety. In this video-surveillance context, anomalies occur only for a very short time, and very occasionally. Hence, manual monitoring of such anomalies may be exhaustive and monotonous, resulting in a decrease in reliability and speed in emergency situations due to monitor tiredness. Within this framework, the importance of automatic detection of anomalies is clear, and, therefore, an important amount of research works have been made lately in this topic. According to these earlier studies, supervised approaches perform better than unsupervised ones. However, supervised approaches demand manual annotation, making dependent the system reliability of the different situations used in the training (something difficult to set in anomaly context). In this work, it is proposed an approach for anomaly detection in video-surveillance scenes based on a weakly supervised learning algorithm. Spatio-temporal features are extracted from each surveillance video using a temporal convolutional 3D neural network (T-C3D). Then, a novel ranking loss function increases the distance between the classification scores of anomalous and normal videos, reducing the number of false negatives. The proposal has been evaluated and compared against state-of-art approaches, obtaining competitive performance without fine-tuning, which also validates its generalization capability. In this paper, the proposal design and reliability is presented and analyzed, as well as the aforementioned quantitative and qualitative evaluation in-the-wild scenarios, demonstrating its high sensitivity in anomaly detection in all of them.
format Online
Article
Text
id pubmed-8230050
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-82300502021-06-26 Semi-Supervised Anomaly Detection in Video-Surveillance Scenes in the Wild Sarker, Mohammad Ibrahim Losada-Gutiérrez, Cristina Marrón-Romera, Marta Fuentes-Jiménez, David Luengo-Sánchez, Sara Sensors (Basel) Article Surveillance cameras are being installed in many primary daily living places to maintain public safety. In this video-surveillance context, anomalies occur only for a very short time, and very occasionally. Hence, manual monitoring of such anomalies may be exhaustive and monotonous, resulting in a decrease in reliability and speed in emergency situations due to monitor tiredness. Within this framework, the importance of automatic detection of anomalies is clear, and, therefore, an important amount of research works have been made lately in this topic. According to these earlier studies, supervised approaches perform better than unsupervised ones. However, supervised approaches demand manual annotation, making dependent the system reliability of the different situations used in the training (something difficult to set in anomaly context). In this work, it is proposed an approach for anomaly detection in video-surveillance scenes based on a weakly supervised learning algorithm. Spatio-temporal features are extracted from each surveillance video using a temporal convolutional 3D neural network (T-C3D). Then, a novel ranking loss function increases the distance between the classification scores of anomalous and normal videos, reducing the number of false negatives. The proposal has been evaluated and compared against state-of-art approaches, obtaining competitive performance without fine-tuning, which also validates its generalization capability. In this paper, the proposal design and reliability is presented and analyzed, as well as the aforementioned quantitative and qualitative evaluation in-the-wild scenarios, demonstrating its high sensitivity in anomaly detection in all of them. MDPI 2021-06-09 /pmc/articles/PMC8230050/ /pubmed/34207883 http://dx.doi.org/10.3390/s21123993 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Sarker, Mohammad Ibrahim
Losada-Gutiérrez, Cristina
Marrón-Romera, Marta
Fuentes-Jiménez, David
Luengo-Sánchez, Sara
Semi-Supervised Anomaly Detection in Video-Surveillance Scenes in the Wild
title Semi-Supervised Anomaly Detection in Video-Surveillance Scenes in the Wild
title_full Semi-Supervised Anomaly Detection in Video-Surveillance Scenes in the Wild
title_fullStr Semi-Supervised Anomaly Detection in Video-Surveillance Scenes in the Wild
title_full_unstemmed Semi-Supervised Anomaly Detection in Video-Surveillance Scenes in the Wild
title_short Semi-Supervised Anomaly Detection in Video-Surveillance Scenes in the Wild
title_sort semi-supervised anomaly detection in video-surveillance scenes in the wild
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8230050/
https://www.ncbi.nlm.nih.gov/pubmed/34207883
http://dx.doi.org/10.3390/s21123993
work_keys_str_mv AT sarkermohammadibrahim semisupervisedanomalydetectioninvideosurveillancescenesinthewild
AT losadagutierrezcristina semisupervisedanomalydetectioninvideosurveillancescenesinthewild
AT marronromeramarta semisupervisedanomalydetectioninvideosurveillancescenesinthewild
AT fuentesjimenezdavid semisupervisedanomalydetectioninvideosurveillancescenesinthewild
AT luengosanchezsara semisupervisedanomalydetectioninvideosurveillancescenesinthewild