Cargando…

Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets

The emergence of advanced machine learning or deep learning techniques such as autoencoders and generative adversarial networks, can generate images known as deepfakes, which astonishingly resemble the realistic images. These deepfake images are hard to distinguish from the real images and are being...

Descripción completa

Detalles Bibliográficos
Autores principales: Lamichhane, Barsha, Thapa, Keshav, Yang, Sung-Hyun
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9735533/
https://www.ncbi.nlm.nih.gov/pubmed/36501822
http://dx.doi.org/10.3390/s22239121
_version_ 1784846790565036032
author Lamichhane, Barsha
Thapa, Keshav
Yang, Sung-Hyun
author_facet Lamichhane, Barsha
Thapa, Keshav
Yang, Sung-Hyun
author_sort Lamichhane, Barsha
collection PubMed
description The emergence of advanced machine learning or deep learning techniques such as autoencoders and generative adversarial networks, can generate images known as deepfakes, which astonishingly resemble the realistic images. These deepfake images are hard to distinguish from the real images and are being used unethically against famous personalities such as politicians, celebrities, and social workers. Hence, we propose a method to detect these deepfake images using a light weighted convolutional neural network (CNN). Our research is conducted with Deep Fake Detection Challenge (DFDC) full and sample datasets, where we compare the performance of our proposed model with various state-of-the-art pretrained models such as VGG-19, Xception and Inception-ResNet-v2. Furthermore, we perform the experiments with various resolutions maintaining 1:1 and 9:16 aspect ratios, which have not been explored for DFDC datasets by any other groups to date. Thus, the proposed model can flexibly accommodate various resolutions and aspect ratios, without being constrained to a specific resolution or aspect ratio for any type of image classification problem. While most of the reported research is limited to sample or preview DFDC datasets only, we have also attempted the testing on full DFDC datasets and presented the results. Contemplating the fact that the detailed results and resource analysis for various scenarios are provided in this research, the proposed deepfake detection method is anticipated to pave new avenues for deepfake detection research, that engages with DFDC datasets.
format Online
Article
Text
id pubmed-9735533
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-97355332022-12-11 Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets Lamichhane, Barsha Thapa, Keshav Yang, Sung-Hyun Sensors (Basel) Article The emergence of advanced machine learning or deep learning techniques such as autoencoders and generative adversarial networks, can generate images known as deepfakes, which astonishingly resemble the realistic images. These deepfake images are hard to distinguish from the real images and are being used unethically against famous personalities such as politicians, celebrities, and social workers. Hence, we propose a method to detect these deepfake images using a light weighted convolutional neural network (CNN). Our research is conducted with Deep Fake Detection Challenge (DFDC) full and sample datasets, where we compare the performance of our proposed model with various state-of-the-art pretrained models such as VGG-19, Xception and Inception-ResNet-v2. Furthermore, we perform the experiments with various resolutions maintaining 1:1 and 9:16 aspect ratios, which have not been explored for DFDC datasets by any other groups to date. Thus, the proposed model can flexibly accommodate various resolutions and aspect ratios, without being constrained to a specific resolution or aspect ratio for any type of image classification problem. While most of the reported research is limited to sample or preview DFDC datasets only, we have also attempted the testing on full DFDC datasets and presented the results. Contemplating the fact that the detailed results and resource analysis for various scenarios are provided in this research, the proposed deepfake detection method is anticipated to pave new avenues for deepfake detection research, that engages with DFDC datasets. MDPI 2022-11-24 /pmc/articles/PMC9735533/ /pubmed/36501822 http://dx.doi.org/10.3390/s22239121 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Lamichhane, Barsha
Thapa, Keshav
Yang, Sung-Hyun
Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets
title Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets
title_full Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets
title_fullStr Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets
title_full_unstemmed Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets
title_short Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets
title_sort detection of image level forgery with various constraints using dfdc full and sample datasets
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9735533/
https://www.ncbi.nlm.nih.gov/pubmed/36501822
http://dx.doi.org/10.3390/s22239121
work_keys_str_mv AT lamichhanebarsha detectionofimagelevelforgerywithvariousconstraintsusingdfdcfullandsampledatasets
AT thapakeshav detectionofimagelevelforgerywithvariousconstraintsusingdfdcfullandsampledatasets
AT yangsunghyun detectionofimagelevelforgerywithvariousconstraintsusingdfdcfullandsampledatasets