Cargando…

Deep fake detection using a sparse auto encoder with a graph capsule dual graph CNN

Deepfake (DF) is a kind of forged image or video that is developed to spread misinformation and facilitate vulnerabilities to privacy hacking and truth masking with advanced technologies, including deep learning and artificial intelligence with trained algorithms. This kind of multimedia manipulatio...

Descripción completa

Detalles Bibliográficos
Autores principales: Kandasamy, Venkatachalam, Hubálovský, Štěpán, Trojovský, Pavel
Formato: Online Artículo Texto
Lenguaje:English
Publicado: PeerJ Inc. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9202621/
https://www.ncbi.nlm.nih.gov/pubmed/35721408
http://dx.doi.org/10.7717/peerj-cs.953
_version_ 1784728569065242624
author Kandasamy, Venkatachalam
Hubálovský, Štěpán
Trojovský, Pavel
author_facet Kandasamy, Venkatachalam
Hubálovský, Štěpán
Trojovský, Pavel
author_sort Kandasamy, Venkatachalam
collection PubMed
description Deepfake (DF) is a kind of forged image or video that is developed to spread misinformation and facilitate vulnerabilities to privacy hacking and truth masking with advanced technologies, including deep learning and artificial intelligence with trained algorithms. This kind of multimedia manipulation, such as changing facial expressions or speech, can be used for a variety of purposes to spread misinformation or exploitation. This kind of multimedia manipulation, such as changing facial expressions or speech, can be used for a variety of purposes to spread misinformation or exploitation. With the recent advancement of generative adversarial networks (GANs) in deep learning models, DF has become an essential part of social media. To detect forged video and images, numerous methods have been developed, and those methods are focused on a particular domain and obsolete in the case of new attacks/threats. Hence, a novel method needs to be developed to tackle new attacks. The method introduced in this article can detect various types of spoofs of images and videos that are computationally generated using deep learning models, such as variants of long short-term memory and convolutional neural networks. The first phase of this proposed work extracts the feature frames from the forged video/image using a sparse autoencoder with a graph long short-term memory (SAE-GLSTM) method at training time. The first phase of this proposed work extracts the feature frames from the forged video/image using a sparse autoencoder with a graph long short-term memory (SAE-GLSTM) method at training time. The proposed DF detection model is tested using the FFHQ database, 100K-Faces, Celeb-DF (V2) and WildDeepfake. The evaluated results show the effectiveness of the proposed method.
format Online
Article
Text
id pubmed-9202621
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher PeerJ Inc.
record_format MEDLINE/PubMed
spelling pubmed-92026212022-06-17 Deep fake detection using a sparse auto encoder with a graph capsule dual graph CNN Kandasamy, Venkatachalam Hubálovský, Štěpán Trojovský, Pavel PeerJ Comput Sci Algorithms and Analysis of Algorithms Deepfake (DF) is a kind of forged image or video that is developed to spread misinformation and facilitate vulnerabilities to privacy hacking and truth masking with advanced technologies, including deep learning and artificial intelligence with trained algorithms. This kind of multimedia manipulation, such as changing facial expressions or speech, can be used for a variety of purposes to spread misinformation or exploitation. This kind of multimedia manipulation, such as changing facial expressions or speech, can be used for a variety of purposes to spread misinformation or exploitation. With the recent advancement of generative adversarial networks (GANs) in deep learning models, DF has become an essential part of social media. To detect forged video and images, numerous methods have been developed, and those methods are focused on a particular domain and obsolete in the case of new attacks/threats. Hence, a novel method needs to be developed to tackle new attacks. The method introduced in this article can detect various types of spoofs of images and videos that are computationally generated using deep learning models, such as variants of long short-term memory and convolutional neural networks. The first phase of this proposed work extracts the feature frames from the forged video/image using a sparse autoencoder with a graph long short-term memory (SAE-GLSTM) method at training time. The first phase of this proposed work extracts the feature frames from the forged video/image using a sparse autoencoder with a graph long short-term memory (SAE-GLSTM) method at training time. The proposed DF detection model is tested using the FFHQ database, 100K-Faces, Celeb-DF (V2) and WildDeepfake. The evaluated results show the effectiveness of the proposed method. PeerJ Inc. 2022-05-31 /pmc/articles/PMC9202621/ /pubmed/35721408 http://dx.doi.org/10.7717/peerj-cs.953 Text en © 2022 Kandasamy et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/) , which permits unrestricted use, distribution, reproduction and adaptation in any medium and for any purpose provided that it is properly attributed. For attribution, the original author(s), title, publication source (PeerJ Computer Science) and either DOI or URL of the article must be cited.
spellingShingle Algorithms and Analysis of Algorithms
Kandasamy, Venkatachalam
Hubálovský, Štěpán
Trojovský, Pavel
Deep fake detection using a sparse auto encoder with a graph capsule dual graph CNN
title Deep fake detection using a sparse auto encoder with a graph capsule dual graph CNN
title_full Deep fake detection using a sparse auto encoder with a graph capsule dual graph CNN
title_fullStr Deep fake detection using a sparse auto encoder with a graph capsule dual graph CNN
title_full_unstemmed Deep fake detection using a sparse auto encoder with a graph capsule dual graph CNN
title_short Deep fake detection using a sparse auto encoder with a graph capsule dual graph CNN
title_sort deep fake detection using a sparse auto encoder with a graph capsule dual graph cnn
topic Algorithms and Analysis of Algorithms
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9202621/
https://www.ncbi.nlm.nih.gov/pubmed/35721408
http://dx.doi.org/10.7717/peerj-cs.953
work_keys_str_mv AT kandasamyvenkatachalam deepfakedetectionusingasparseautoencoderwithagraphcapsuledualgraphcnn
AT hubalovskystepan deepfakedetectionusingasparseautoencoderwithagraphcapsuledualgraphcnn
AT trojovskypavel deepfakedetectionusingasparseautoencoderwithagraphcapsuledualgraphcnn