Cargando…
Auguring Fake Face Images Using Dual Input Convolution Neural Network
Deepfake technology uses auto-encoders and generative adversarial networks to replace or artificially construct fine-tuned faces, emotions, and sounds. Although there have been significant advancements in the identification of particular fake images, a reliable counterfeit face detector is still lac...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9861767/ https://www.ncbi.nlm.nih.gov/pubmed/36662101 http://dx.doi.org/10.3390/jimaging9010003 |
_version_ | 1784874924024791040 |
---|---|
author | Bhandari, Mohan Neupane, Arjun Mallik, Saurav Gaur, Loveleen Qin, Hong |
author_facet | Bhandari, Mohan Neupane, Arjun Mallik, Saurav Gaur, Loveleen Qin, Hong |
author_sort | Bhandari, Mohan |
collection | PubMed |
description | Deepfake technology uses auto-encoders and generative adversarial networks to replace or artificially construct fine-tuned faces, emotions, and sounds. Although there have been significant advancements in the identification of particular fake images, a reliable counterfeit face detector is still lacking, making it difficult to identify fake photos in situations with further compression, blurring, scaling, etc. Deep learning models resolve the research gap to correctly recognize phony images, whose objectionable content might encourage fraudulent activity and cause major problems. To reduce the gap and enlarge the fields of view of the network, we propose a dual input convolutional neural network (DICNN) model with ten-fold cross validation with an average training accuracy of 99.36 ± 0.62, a test accuracy of 99.08 ± 0.64, and a validation accuracy of 99.30 ± 0.94. Additionally, we used ’SHapley Additive exPlanations (SHAP) ’ as explainable AI (XAI) Shapely values to explain the results and interoperability visually by imposing the model into SHAP. The proposed model holds significant importance for being accepted by forensics and security experts because of its distinctive features and considerably higher accuracy than state-of-the-art methods. |
format | Online Article Text |
id | pubmed-9861767 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-98617672023-01-22 Auguring Fake Face Images Using Dual Input Convolution Neural Network Bhandari, Mohan Neupane, Arjun Mallik, Saurav Gaur, Loveleen Qin, Hong J Imaging Article Deepfake technology uses auto-encoders and generative adversarial networks to replace or artificially construct fine-tuned faces, emotions, and sounds. Although there have been significant advancements in the identification of particular fake images, a reliable counterfeit face detector is still lacking, making it difficult to identify fake photos in situations with further compression, blurring, scaling, etc. Deep learning models resolve the research gap to correctly recognize phony images, whose objectionable content might encourage fraudulent activity and cause major problems. To reduce the gap and enlarge the fields of view of the network, we propose a dual input convolutional neural network (DICNN) model with ten-fold cross validation with an average training accuracy of 99.36 ± 0.62, a test accuracy of 99.08 ± 0.64, and a validation accuracy of 99.30 ± 0.94. Additionally, we used ’SHapley Additive exPlanations (SHAP) ’ as explainable AI (XAI) Shapely values to explain the results and interoperability visually by imposing the model into SHAP. The proposed model holds significant importance for being accepted by forensics and security experts because of its distinctive features and considerably higher accuracy than state-of-the-art methods. MDPI 2022-12-21 /pmc/articles/PMC9861767/ /pubmed/36662101 http://dx.doi.org/10.3390/jimaging9010003 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Bhandari, Mohan Neupane, Arjun Mallik, Saurav Gaur, Loveleen Qin, Hong Auguring Fake Face Images Using Dual Input Convolution Neural Network |
title | Auguring Fake Face Images Using Dual Input Convolution Neural Network |
title_full | Auguring Fake Face Images Using Dual Input Convolution Neural Network |
title_fullStr | Auguring Fake Face Images Using Dual Input Convolution Neural Network |
title_full_unstemmed | Auguring Fake Face Images Using Dual Input Convolution Neural Network |
title_short | Auguring Fake Face Images Using Dual Input Convolution Neural Network |
title_sort | auguring fake face images using dual input convolution neural network |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9861767/ https://www.ncbi.nlm.nih.gov/pubmed/36662101 http://dx.doi.org/10.3390/jimaging9010003 |
work_keys_str_mv | AT bhandarimohan auguringfakefaceimagesusingdualinputconvolutionneuralnetwork AT neupanearjun auguringfakefaceimagesusingdualinputconvolutionneuralnetwork AT malliksaurav auguringfakefaceimagesusingdualinputconvolutionneuralnetwork AT gaurloveleen auguringfakefaceimagesusingdualinputconvolutionneuralnetwork AT qinhong auguringfakefaceimagesusingdualinputconvolutionneuralnetwork |