Cargando…

Auguring Fake Face Images Using Dual Input Convolution Neural Network

Deepfake technology uses auto-encoders and generative adversarial networks to replace or artificially construct fine-tuned faces, emotions, and sounds. Although there have been significant advancements in the identification of particular fake images, a reliable counterfeit face detector is still lac...

Descripción completa

Detalles Bibliográficos
Autores principales: Bhandari, Mohan, Neupane, Arjun, Mallik, Saurav, Gaur, Loveleen, Qin, Hong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9861767/
https://www.ncbi.nlm.nih.gov/pubmed/36662101
http://dx.doi.org/10.3390/jimaging9010003
_version_ 1784874924024791040
author Bhandari, Mohan
Neupane, Arjun
Mallik, Saurav
Gaur, Loveleen
Qin, Hong
author_facet Bhandari, Mohan
Neupane, Arjun
Mallik, Saurav
Gaur, Loveleen
Qin, Hong
author_sort Bhandari, Mohan
collection PubMed
description Deepfake technology uses auto-encoders and generative adversarial networks to replace or artificially construct fine-tuned faces, emotions, and sounds. Although there have been significant advancements in the identification of particular fake images, a reliable counterfeit face detector is still lacking, making it difficult to identify fake photos in situations with further compression, blurring, scaling, etc. Deep learning models resolve the research gap to correctly recognize phony images, whose objectionable content might encourage fraudulent activity and cause major problems. To reduce the gap and enlarge the fields of view of the network, we propose a dual input convolutional neural network (DICNN) model with ten-fold cross validation with an average training accuracy of 99.36 ± 0.62, a test accuracy of 99.08 ± 0.64, and a validation accuracy of 99.30 ± 0.94. Additionally, we used ’SHapley Additive exPlanations (SHAP) ’ as explainable AI (XAI) Shapely values to explain the results and interoperability visually by imposing the model into SHAP. The proposed model holds significant importance for being accepted by forensics and security experts because of its distinctive features and considerably higher accuracy than state-of-the-art methods.
format Online
Article
Text
id pubmed-9861767
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-98617672023-01-22 Auguring Fake Face Images Using Dual Input Convolution Neural Network Bhandari, Mohan Neupane, Arjun Mallik, Saurav Gaur, Loveleen Qin, Hong J Imaging Article Deepfake technology uses auto-encoders and generative adversarial networks to replace or artificially construct fine-tuned faces, emotions, and sounds. Although there have been significant advancements in the identification of particular fake images, a reliable counterfeit face detector is still lacking, making it difficult to identify fake photos in situations with further compression, blurring, scaling, etc. Deep learning models resolve the research gap to correctly recognize phony images, whose objectionable content might encourage fraudulent activity and cause major problems. To reduce the gap and enlarge the fields of view of the network, we propose a dual input convolutional neural network (DICNN) model with ten-fold cross validation with an average training accuracy of 99.36 ± 0.62, a test accuracy of 99.08 ± 0.64, and a validation accuracy of 99.30 ± 0.94. Additionally, we used ’SHapley Additive exPlanations (SHAP) ’ as explainable AI (XAI) Shapely values to explain the results and interoperability visually by imposing the model into SHAP. The proposed model holds significant importance for being accepted by forensics and security experts because of its distinctive features and considerably higher accuracy than state-of-the-art methods. MDPI 2022-12-21 /pmc/articles/PMC9861767/ /pubmed/36662101 http://dx.doi.org/10.3390/jimaging9010003 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Bhandari, Mohan
Neupane, Arjun
Mallik, Saurav
Gaur, Loveleen
Qin, Hong
Auguring Fake Face Images Using Dual Input Convolution Neural Network
title Auguring Fake Face Images Using Dual Input Convolution Neural Network
title_full Auguring Fake Face Images Using Dual Input Convolution Neural Network
title_fullStr Auguring Fake Face Images Using Dual Input Convolution Neural Network
title_full_unstemmed Auguring Fake Face Images Using Dual Input Convolution Neural Network
title_short Auguring Fake Face Images Using Dual Input Convolution Neural Network
title_sort auguring fake face images using dual input convolution neural network
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9861767/
https://www.ncbi.nlm.nih.gov/pubmed/36662101
http://dx.doi.org/10.3390/jimaging9010003
work_keys_str_mv AT bhandarimohan auguringfakefaceimagesusingdualinputconvolutionneuralnetwork
AT neupanearjun auguringfakefaceimagesusingdualinputconvolutionneuralnetwork
AT malliksaurav auguringfakefaceimagesusingdualinputconvolutionneuralnetwork
AT gaurloveleen auguringfakefaceimagesusingdualinputconvolutionneuralnetwork
AT qinhong auguringfakefaceimagesusingdualinputconvolutionneuralnetwork