Cargando…

Obscene image detection using transfer learning and feature fusion

Deep learning-based methods have been proven excellent performance in detecting pornographic images/videos flooded on social media. However, in a dearth of huge yet well-labeled datasets, these methods may suffer from under/overfitting problems and may exhibit unstable output responses in the classi...

Descripción completa

Detalles Bibliográficos
Autores principales: Samal, Sonali, Nayak, Rajashree, Jena, Swastik, Balabantaray, Bunil Ku.
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Springer US 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9942052/
https://www.ncbi.nlm.nih.gov/pubmed/36846526
http://dx.doi.org/10.1007/s11042-023-14437-7
_version_ 1784891409603493888
author Samal, Sonali
Nayak, Rajashree
Jena, Swastik
Balabantaray, Bunil Ku.
author_facet Samal, Sonali
Nayak, Rajashree
Jena, Swastik
Balabantaray, Bunil Ku.
author_sort Samal, Sonali
collection PubMed
description Deep learning-based methods have been proven excellent performance in detecting pornographic images/videos flooded on social media. However, in a dearth of huge yet well-labeled datasets, these methods may suffer from under/overfitting problems and may exhibit unstable output responses in the classification process. To deal with the issue we have suggested an automatic pornographic image detection method by utilizing transfer learning (TL) and feature fusion. The novelty of our proposed work is TL based feature fusion process (FFP) which enables the removal of hyper-parameter tuning, improves model performance, and lowers the computational burden of the desired model. FFP fuses low-level and mid-level features of the outperforming pre-trained models followed by transferring the learned knowledge to control the classification process. Key contributions of our proposed method are i) generation of a well-labeled obscene image dataset GGOI via Pix-2-Pix GAN architecture for the training of deep learning models ii) modification of model architectures by integrating batch normalization and mixed pooling strategy to obtain training stability (iii) selection of outperforming models to be integrated with the FFP by performing end-to-end detection of obscene images and iv) design of TL based obscene image detection method by retraining the last layer of the fused model. Extensive experimental analyses are performed on benchmark datasets i.e., NPDI, Pornography 2k, and generated GGOI dataset. The proposed TL model with fused MobileNet V2 + DenseNet169 network performs as the state-of-the-art model compared to existing methods and provides average classification accuracy, sensitivity, and F1 score of 98.50%, 98.46% and 98.49% respectively.
format Online
Article
Text
id pubmed-9942052
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher Springer US
record_format MEDLINE/PubMed
spelling pubmed-99420522023-02-21 Obscene image detection using transfer learning and feature fusion Samal, Sonali Nayak, Rajashree Jena, Swastik Balabantaray, Bunil Ku. Multimed Tools Appl Article Deep learning-based methods have been proven excellent performance in detecting pornographic images/videos flooded on social media. However, in a dearth of huge yet well-labeled datasets, these methods may suffer from under/overfitting problems and may exhibit unstable output responses in the classification process. To deal with the issue we have suggested an automatic pornographic image detection method by utilizing transfer learning (TL) and feature fusion. The novelty of our proposed work is TL based feature fusion process (FFP) which enables the removal of hyper-parameter tuning, improves model performance, and lowers the computational burden of the desired model. FFP fuses low-level and mid-level features of the outperforming pre-trained models followed by transferring the learned knowledge to control the classification process. Key contributions of our proposed method are i) generation of a well-labeled obscene image dataset GGOI via Pix-2-Pix GAN architecture for the training of deep learning models ii) modification of model architectures by integrating batch normalization and mixed pooling strategy to obtain training stability (iii) selection of outperforming models to be integrated with the FFP by performing end-to-end detection of obscene images and iv) design of TL based obscene image detection method by retraining the last layer of the fused model. Extensive experimental analyses are performed on benchmark datasets i.e., NPDI, Pornography 2k, and generated GGOI dataset. The proposed TL model with fused MobileNet V2 + DenseNet169 network performs as the state-of-the-art model compared to existing methods and provides average classification accuracy, sensitivity, and F1 score of 98.50%, 98.46% and 98.49% respectively. Springer US 2023-02-21 /pmc/articles/PMC9942052/ /pubmed/36846526 http://dx.doi.org/10.1007/s11042-023-14437-7 Text en © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023, Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic.
spellingShingle Article
Samal, Sonali
Nayak, Rajashree
Jena, Swastik
Balabantaray, Bunil Ku.
Obscene image detection using transfer learning and feature fusion
title Obscene image detection using transfer learning and feature fusion
title_full Obscene image detection using transfer learning and feature fusion
title_fullStr Obscene image detection using transfer learning and feature fusion
title_full_unstemmed Obscene image detection using transfer learning and feature fusion
title_short Obscene image detection using transfer learning and feature fusion
title_sort obscene image detection using transfer learning and feature fusion
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9942052/
https://www.ncbi.nlm.nih.gov/pubmed/36846526
http://dx.doi.org/10.1007/s11042-023-14437-7
work_keys_str_mv AT samalsonali obsceneimagedetectionusingtransferlearningandfeaturefusion
AT nayakrajashree obsceneimagedetectionusingtransferlearningandfeaturefusion
AT jenaswastik obsceneimagedetectionusingtransferlearningandfeaturefusion
AT balabantaraybunilku obsceneimagedetectionusingtransferlearningandfeaturefusion