Cargando…

Global–Local Facial Fusion Based GAN Generated Fake Face Detection

Media content forgery is widely spread over the Internet and has raised severe societal concerns. With the development of deep learning, new technologies such as generative adversarial networks (GANs) and media forgery technology have already been utilized for politicians and celebrity forgery, whic...

Descripción completa

Detalles Bibliográficos
Autores principales: Xue, Ziyu, Jiang, Xiuhua, Liu, Qingtong, Wei, Zhaoshan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9865876/
https://www.ncbi.nlm.nih.gov/pubmed/36679410
http://dx.doi.org/10.3390/s23020616
_version_ 1784875948414337024
author Xue, Ziyu
Jiang, Xiuhua
Liu, Qingtong
Wei, Zhaoshan
author_facet Xue, Ziyu
Jiang, Xiuhua
Liu, Qingtong
Wei, Zhaoshan
author_sort Xue, Ziyu
collection PubMed
description Media content forgery is widely spread over the Internet and has raised severe societal concerns. With the development of deep learning, new technologies such as generative adversarial networks (GANs) and media forgery technology have already been utilized for politicians and celebrity forgery, which has a terrible impact on society. Existing GAN-generated face detection approaches rely on detecting image artifacts and the generated traces. However, these methods are model-specific, and the performance is deteriorated when faced with more complicated methods. What’s more, it is challenging to identify forgery images with perturbations such as JPEG compression, gamma correction, and other disturbances. In this paper, we propose a global–local facial fusion network, namely GLFNet, to fully exploit the local physiological and global receptive features. Specifically, GLFNet consists of two branches, i.e., the local region detection branch and the global detection branch. The former branch detects the forged traces from the facial parts, such as the iris and pupils. The latter branch adopts a residual connection to distinguish real images from fake ones. GLFNet obtains forged traces through various ways by combining physiological characteristics with deep learning. The method is stable with physiological properties when learning the deep learning features. As a result, it is more robust than the single-class detection methods. Experimental results on two benchmarks have demonstrated superiority and generalization compared with other methods.
format Online
Article
Text
id pubmed-9865876
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-98658762023-01-22 Global–Local Facial Fusion Based GAN Generated Fake Face Detection Xue, Ziyu Jiang, Xiuhua Liu, Qingtong Wei, Zhaoshan Sensors (Basel) Article Media content forgery is widely spread over the Internet and has raised severe societal concerns. With the development of deep learning, new technologies such as generative adversarial networks (GANs) and media forgery technology have already been utilized for politicians and celebrity forgery, which has a terrible impact on society. Existing GAN-generated face detection approaches rely on detecting image artifacts and the generated traces. However, these methods are model-specific, and the performance is deteriorated when faced with more complicated methods. What’s more, it is challenging to identify forgery images with perturbations such as JPEG compression, gamma correction, and other disturbances. In this paper, we propose a global–local facial fusion network, namely GLFNet, to fully exploit the local physiological and global receptive features. Specifically, GLFNet consists of two branches, i.e., the local region detection branch and the global detection branch. The former branch detects the forged traces from the facial parts, such as the iris and pupils. The latter branch adopts a residual connection to distinguish real images from fake ones. GLFNet obtains forged traces through various ways by combining physiological characteristics with deep learning. The method is stable with physiological properties when learning the deep learning features. As a result, it is more robust than the single-class detection methods. Experimental results on two benchmarks have demonstrated superiority and generalization compared with other methods. MDPI 2023-01-05 /pmc/articles/PMC9865876/ /pubmed/36679410 http://dx.doi.org/10.3390/s23020616 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Xue, Ziyu
Jiang, Xiuhua
Liu, Qingtong
Wei, Zhaoshan
Global–Local Facial Fusion Based GAN Generated Fake Face Detection
title Global–Local Facial Fusion Based GAN Generated Fake Face Detection
title_full Global–Local Facial Fusion Based GAN Generated Fake Face Detection
title_fullStr Global–Local Facial Fusion Based GAN Generated Fake Face Detection
title_full_unstemmed Global–Local Facial Fusion Based GAN Generated Fake Face Detection
title_short Global–Local Facial Fusion Based GAN Generated Fake Face Detection
title_sort global–local facial fusion based gan generated fake face detection
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9865876/
https://www.ncbi.nlm.nih.gov/pubmed/36679410
http://dx.doi.org/10.3390/s23020616
work_keys_str_mv AT xueziyu globallocalfacialfusionbasedgangeneratedfakefacedetection
AT jiangxiuhua globallocalfacialfusionbasedgangeneratedfakefacedetection
AT liuqingtong globallocalfacialfusionbasedgangeneratedfakefacedetection
AT weizhaoshan globallocalfacialfusionbasedgangeneratedfakefacedetection