Cargando…
Comparative Analysis of Deepfake Image Detection Method Using Convolutional Neural Network
Generation Z is a data-driven generation. Everyone has the entirety of humanity's knowledge in their hands. The technological possibilities are endless. However, we use and misuse this blessing to face swap using deepfake. Deepfake is an emerging subdomain of artificial intelligence technology...
Autores principales: | , , , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
Hindawi
2021
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8702341/ https://www.ncbi.nlm.nih.gov/pubmed/34956345 http://dx.doi.org/10.1155/2021/3111676 |
_version_ | 1784621225606119424 |
---|---|
author | Shad, Hasin Shahed Rizvee, Md. Mashfiq Roza, Nishat Tasnim Hoq, S. M. Ahsanul Monirujjaman Khan, Mohammad Singh, Arjun Zaguia, Atef Bourouis, Sami |
author_facet | Shad, Hasin Shahed Rizvee, Md. Mashfiq Roza, Nishat Tasnim Hoq, S. M. Ahsanul Monirujjaman Khan, Mohammad Singh, Arjun Zaguia, Atef Bourouis, Sami |
author_sort | Shad, Hasin Shahed |
collection | PubMed |
description | Generation Z is a data-driven generation. Everyone has the entirety of humanity's knowledge in their hands. The technological possibilities are endless. However, we use and misuse this blessing to face swap using deepfake. Deepfake is an emerging subdomain of artificial intelligence technology in which one person's face is overlaid over another person's face, which is very prominent across social media. Machine learning is the main element of deepfakes, and it has allowed deepfake images and videos to be generated considerably faster and at a lower cost. Despite the negative connotations associated with the phrase “deepfakes,” the technology is being more widely employed commercially and individually. Although it is relatively new, the latest technological advances make it more and more challenging to detect deepfakes and synthesized images from real ones. An increasing sense of unease has developed around the emergence of deepfake technologies. Our main objective is to detect deepfake images from real ones accurately. In this research, we implemented several methods to detect deepfake images and make a comparative analysis. Our model was trained by datasets from Kaggle, which had 70,000 images from the Flickr dataset and 70,000 images produced by styleGAN. For this comparative study of the use of convolutional neural networks (CNN) to identify genuine and deepfake pictures, we trained eight different CNN models. Three of these models were trained using the DenseNet architecture (DenseNet121, DenseNet169, and DenseNet201); two were trained using the VGGNet architecture (VGG16, VGG19); one was with the ResNet50 architecture, one with the VGGFace, and one with a bespoke CNN architecture. We have also implemented a custom model that incorporates methods like dropout and padding that aid in determining whether or not the other models reflect their objectives. The results were categorized by five evaluation metrics: accuracy, precision, recall, F1-score, and area under the ROC (receiver operating characteristic) curve. Amongst all the models, VGGFace performed the best, with 99% accuracy. Besides, we obtained 97% from the ResNet50, 96% from the DenseNet201, 95% from the DenseNet169, 94% from the VGG19, 92% from the VGG16, 97% from the DenseNet121 model, and 90% from the custom model. |
format | Online Article Text |
id | pubmed-8702341 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2021 |
publisher | Hindawi |
record_format | MEDLINE/PubMed |
spelling | pubmed-87023412021-12-24 Comparative Analysis of Deepfake Image Detection Method Using Convolutional Neural Network Shad, Hasin Shahed Rizvee, Md. Mashfiq Roza, Nishat Tasnim Hoq, S. M. Ahsanul Monirujjaman Khan, Mohammad Singh, Arjun Zaguia, Atef Bourouis, Sami Comput Intell Neurosci Research Article Generation Z is a data-driven generation. Everyone has the entirety of humanity's knowledge in their hands. The technological possibilities are endless. However, we use and misuse this blessing to face swap using deepfake. Deepfake is an emerging subdomain of artificial intelligence technology in which one person's face is overlaid over another person's face, which is very prominent across social media. Machine learning is the main element of deepfakes, and it has allowed deepfake images and videos to be generated considerably faster and at a lower cost. Despite the negative connotations associated with the phrase “deepfakes,” the technology is being more widely employed commercially and individually. Although it is relatively new, the latest technological advances make it more and more challenging to detect deepfakes and synthesized images from real ones. An increasing sense of unease has developed around the emergence of deepfake technologies. Our main objective is to detect deepfake images from real ones accurately. In this research, we implemented several methods to detect deepfake images and make a comparative analysis. Our model was trained by datasets from Kaggle, which had 70,000 images from the Flickr dataset and 70,000 images produced by styleGAN. For this comparative study of the use of convolutional neural networks (CNN) to identify genuine and deepfake pictures, we trained eight different CNN models. Three of these models were trained using the DenseNet architecture (DenseNet121, DenseNet169, and DenseNet201); two were trained using the VGGNet architecture (VGG16, VGG19); one was with the ResNet50 architecture, one with the VGGFace, and one with a bespoke CNN architecture. We have also implemented a custom model that incorporates methods like dropout and padding that aid in determining whether or not the other models reflect their objectives. The results were categorized by five evaluation metrics: accuracy, precision, recall, F1-score, and area under the ROC (receiver operating characteristic) curve. Amongst all the models, VGGFace performed the best, with 99% accuracy. Besides, we obtained 97% from the ResNet50, 96% from the DenseNet201, 95% from the DenseNet169, 94% from the VGG19, 92% from the VGG16, 97% from the DenseNet121 model, and 90% from the custom model. Hindawi 2021-12-16 /pmc/articles/PMC8702341/ /pubmed/34956345 http://dx.doi.org/10.1155/2021/3111676 Text en Copyright © 2021 Hasin Shahed Shad et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited. |
spellingShingle | Research Article Shad, Hasin Shahed Rizvee, Md. Mashfiq Roza, Nishat Tasnim Hoq, S. M. Ahsanul Monirujjaman Khan, Mohammad Singh, Arjun Zaguia, Atef Bourouis, Sami Comparative Analysis of Deepfake Image Detection Method Using Convolutional Neural Network |
title | Comparative Analysis of Deepfake Image Detection Method Using Convolutional Neural Network |
title_full | Comparative Analysis of Deepfake Image Detection Method Using Convolutional Neural Network |
title_fullStr | Comparative Analysis of Deepfake Image Detection Method Using Convolutional Neural Network |
title_full_unstemmed | Comparative Analysis of Deepfake Image Detection Method Using Convolutional Neural Network |
title_short | Comparative Analysis of Deepfake Image Detection Method Using Convolutional Neural Network |
title_sort | comparative analysis of deepfake image detection method using convolutional neural network |
topic | Research Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8702341/ https://www.ncbi.nlm.nih.gov/pubmed/34956345 http://dx.doi.org/10.1155/2021/3111676 |
work_keys_str_mv | AT shadhasinshahed comparativeanalysisofdeepfakeimagedetectionmethodusingconvolutionalneuralnetwork AT rizveemdmashfiq comparativeanalysisofdeepfakeimagedetectionmethodusingconvolutionalneuralnetwork AT rozanishattasnim comparativeanalysisofdeepfakeimagedetectionmethodusingconvolutionalneuralnetwork AT hoqsmahsanul comparativeanalysisofdeepfakeimagedetectionmethodusingconvolutionalneuralnetwork AT monirujjamankhanmohammad comparativeanalysisofdeepfakeimagedetectionmethodusingconvolutionalneuralnetwork AT singharjun comparativeanalysisofdeepfakeimagedetectionmethodusingconvolutionalneuralnetwork AT zaguiaatef comparativeanalysisofdeepfakeimagedetectionmethodusingconvolutionalneuralnetwork AT bourouissami comparativeanalysisofdeepfakeimagedetectionmethodusingconvolutionalneuralnetwork |