Cargando…
Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets
The emergence of advanced machine learning or deep learning techniques such as autoencoders and generative adversarial networks, can generate images known as deepfakes, which astonishingly resemble the realistic images. These deepfake images are hard to distinguish from the real images and are being...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9735533/ https://www.ncbi.nlm.nih.gov/pubmed/36501822 http://dx.doi.org/10.3390/s22239121 |
_version_ | 1784846790565036032 |
---|---|
author | Lamichhane, Barsha Thapa, Keshav Yang, Sung-Hyun |
author_facet | Lamichhane, Barsha Thapa, Keshav Yang, Sung-Hyun |
author_sort | Lamichhane, Barsha |
collection | PubMed |
description | The emergence of advanced machine learning or deep learning techniques such as autoencoders and generative adversarial networks, can generate images known as deepfakes, which astonishingly resemble the realistic images. These deepfake images are hard to distinguish from the real images and are being used unethically against famous personalities such as politicians, celebrities, and social workers. Hence, we propose a method to detect these deepfake images using a light weighted convolutional neural network (CNN). Our research is conducted with Deep Fake Detection Challenge (DFDC) full and sample datasets, where we compare the performance of our proposed model with various state-of-the-art pretrained models such as VGG-19, Xception and Inception-ResNet-v2. Furthermore, we perform the experiments with various resolutions maintaining 1:1 and 9:16 aspect ratios, which have not been explored for DFDC datasets by any other groups to date. Thus, the proposed model can flexibly accommodate various resolutions and aspect ratios, without being constrained to a specific resolution or aspect ratio for any type of image classification problem. While most of the reported research is limited to sample or preview DFDC datasets only, we have also attempted the testing on full DFDC datasets and presented the results. Contemplating the fact that the detailed results and resource analysis for various scenarios are provided in this research, the proposed deepfake detection method is anticipated to pave new avenues for deepfake detection research, that engages with DFDC datasets. |
format | Online Article Text |
id | pubmed-9735533 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-97355332022-12-11 Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets Lamichhane, Barsha Thapa, Keshav Yang, Sung-Hyun Sensors (Basel) Article The emergence of advanced machine learning or deep learning techniques such as autoencoders and generative adversarial networks, can generate images known as deepfakes, which astonishingly resemble the realistic images. These deepfake images are hard to distinguish from the real images and are being used unethically against famous personalities such as politicians, celebrities, and social workers. Hence, we propose a method to detect these deepfake images using a light weighted convolutional neural network (CNN). Our research is conducted with Deep Fake Detection Challenge (DFDC) full and sample datasets, where we compare the performance of our proposed model with various state-of-the-art pretrained models such as VGG-19, Xception and Inception-ResNet-v2. Furthermore, we perform the experiments with various resolutions maintaining 1:1 and 9:16 aspect ratios, which have not been explored for DFDC datasets by any other groups to date. Thus, the proposed model can flexibly accommodate various resolutions and aspect ratios, without being constrained to a specific resolution or aspect ratio for any type of image classification problem. While most of the reported research is limited to sample or preview DFDC datasets only, we have also attempted the testing on full DFDC datasets and presented the results. Contemplating the fact that the detailed results and resource analysis for various scenarios are provided in this research, the proposed deepfake detection method is anticipated to pave new avenues for deepfake detection research, that engages with DFDC datasets. MDPI 2022-11-24 /pmc/articles/PMC9735533/ /pubmed/36501822 http://dx.doi.org/10.3390/s22239121 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Lamichhane, Barsha Thapa, Keshav Yang, Sung-Hyun Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets |
title | Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets |
title_full | Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets |
title_fullStr | Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets |
title_full_unstemmed | Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets |
title_short | Detection of Image Level Forgery with Various Constraints Using DFDC Full and Sample Datasets |
title_sort | detection of image level forgery with various constraints using dfdc full and sample datasets |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9735533/ https://www.ncbi.nlm.nih.gov/pubmed/36501822 http://dx.doi.org/10.3390/s22239121 |
work_keys_str_mv | AT lamichhanebarsha detectionofimagelevelforgerywithvariousconstraintsusingdfdcfullandsampledatasets AT thapakeshav detectionofimagelevelforgerywithvariousconstraintsusingdfdcfullandsampledatasets AT yangsunghyun detectionofimagelevelforgerywithvariousconstraintsusingdfdcfullandsampledatasets |