Cargando…
Obscene image detection using transfer learning and feature fusion
Deep learning-based methods have been proven excellent performance in detecting pornographic images/videos flooded on social media. However, in a dearth of huge yet well-labeled datasets, these methods may suffer from under/overfitting problems and may exhibit unstable output responses in the classi...
Autores principales: | , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Springer US
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9942052/ https://www.ncbi.nlm.nih.gov/pubmed/36846526 http://dx.doi.org/10.1007/s11042-023-14437-7 |
_version_ | 1784891409603493888 |
---|---|
author | Samal, Sonali Nayak, Rajashree Jena, Swastik Balabantaray, Bunil Ku. |
author_facet | Samal, Sonali Nayak, Rajashree Jena, Swastik Balabantaray, Bunil Ku. |
author_sort | Samal, Sonali |
collection | PubMed |
description | Deep learning-based methods have been proven excellent performance in detecting pornographic images/videos flooded on social media. However, in a dearth of huge yet well-labeled datasets, these methods may suffer from under/overfitting problems and may exhibit unstable output responses in the classification process. To deal with the issue we have suggested an automatic pornographic image detection method by utilizing transfer learning (TL) and feature fusion. The novelty of our proposed work is TL based feature fusion process (FFP) which enables the removal of hyper-parameter tuning, improves model performance, and lowers the computational burden of the desired model. FFP fuses low-level and mid-level features of the outperforming pre-trained models followed by transferring the learned knowledge to control the classification process. Key contributions of our proposed method are i) generation of a well-labeled obscene image dataset GGOI via Pix-2-Pix GAN architecture for the training of deep learning models ii) modification of model architectures by integrating batch normalization and mixed pooling strategy to obtain training stability (iii) selection of outperforming models to be integrated with the FFP by performing end-to-end detection of obscene images and iv) design of TL based obscene image detection method by retraining the last layer of the fused model. Extensive experimental analyses are performed on benchmark datasets i.e., NPDI, Pornography 2k, and generated GGOI dataset. The proposed TL model with fused MobileNet V2 + DenseNet169 network performs as the state-of-the-art model compared to existing methods and provides average classification accuracy, sensitivity, and F1 score of 98.50%, 98.46% and 98.49% respectively. |
format | Online Article Text |
id | pubmed-9942052 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | Springer US |
record_format | MEDLINE/PubMed |
spelling | pubmed-99420522023-02-21 Obscene image detection using transfer learning and feature fusion Samal, Sonali Nayak, Rajashree Jena, Swastik Balabantaray, Bunil Ku. Multimed Tools Appl Article Deep learning-based methods have been proven excellent performance in detecting pornographic images/videos flooded on social media. However, in a dearth of huge yet well-labeled datasets, these methods may suffer from under/overfitting problems and may exhibit unstable output responses in the classification process. To deal with the issue we have suggested an automatic pornographic image detection method by utilizing transfer learning (TL) and feature fusion. The novelty of our proposed work is TL based feature fusion process (FFP) which enables the removal of hyper-parameter tuning, improves model performance, and lowers the computational burden of the desired model. FFP fuses low-level and mid-level features of the outperforming pre-trained models followed by transferring the learned knowledge to control the classification process. Key contributions of our proposed method are i) generation of a well-labeled obscene image dataset GGOI via Pix-2-Pix GAN architecture for the training of deep learning models ii) modification of model architectures by integrating batch normalization and mixed pooling strategy to obtain training stability (iii) selection of outperforming models to be integrated with the FFP by performing end-to-end detection of obscene images and iv) design of TL based obscene image detection method by retraining the last layer of the fused model. Extensive experimental analyses are performed on benchmark datasets i.e., NPDI, Pornography 2k, and generated GGOI dataset. The proposed TL model with fused MobileNet V2 + DenseNet169 network performs as the state-of-the-art model compared to existing methods and provides average classification accuracy, sensitivity, and F1 score of 98.50%, 98.46% and 98.49% respectively. Springer US 2023-02-21 /pmc/articles/PMC9942052/ /pubmed/36846526 http://dx.doi.org/10.1007/s11042-023-14437-7 Text en © The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023, Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law. This article is made available via the PMC Open Access Subset for unrestricted research re-use and secondary analysis in any form or by any means with acknowledgement of the original source. These permissions are granted for the duration of the World Health Organization (WHO) declaration of COVID-19 as a global pandemic. |
spellingShingle | Article Samal, Sonali Nayak, Rajashree Jena, Swastik Balabantaray, Bunil Ku. Obscene image detection using transfer learning and feature fusion |
title | Obscene image detection using transfer learning and feature fusion |
title_full | Obscene image detection using transfer learning and feature fusion |
title_fullStr | Obscene image detection using transfer learning and feature fusion |
title_full_unstemmed | Obscene image detection using transfer learning and feature fusion |
title_short | Obscene image detection using transfer learning and feature fusion |
title_sort | obscene image detection using transfer learning and feature fusion |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9942052/ https://www.ncbi.nlm.nih.gov/pubmed/36846526 http://dx.doi.org/10.1007/s11042-023-14437-7 |
work_keys_str_mv | AT samalsonali obsceneimagedetectionusingtransferlearningandfeaturefusion AT nayakrajashree obsceneimagedetectionusingtransferlearningandfeaturefusion AT jenaswastik obsceneimagedetectionusingtransferlearningandfeaturefusion AT balabantaraybunilku obsceneimagedetectionusingtransferlearningandfeaturefusion |