Cargando…

Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework

In the era of rapid development of the Internet of things, deep learning, and communication technologies, social media has become an indispensable element. However, while enjoying the convenience brought by technological innovation, people are also facing the negative impact brought by them. Taking...

Descripción completa

Detalles Bibliográficos
Autores principales: Yang, Jiachen, Lan, Guipeng, Xiao, Shuai, Li, Yang, Wen, Jiabao, Zhu, Yong
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9268752/
https://www.ncbi.nlm.nih.gov/pubmed/35808193
http://dx.doi.org/10.3390/s22134697
_version_ 1784744062411079680
author Yang, Jiachen
Lan, Guipeng
Xiao, Shuai
Li, Yang
Wen, Jiabao
Zhu, Yong
author_facet Yang, Jiachen
Lan, Guipeng
Xiao, Shuai
Li, Yang
Wen, Jiabao
Zhu, Yong
author_sort Yang, Jiachen
collection PubMed
description In the era of rapid development of the Internet of things, deep learning, and communication technologies, social media has become an indispensable element. However, while enjoying the convenience brought by technological innovation, people are also facing the negative impact brought by them. Taking the users’ portraits of multimedia systems as examples, with the maturity of deep facial forgery technologies, personal portraits are facing malicious tampering and forgery, which pose a potential threat to personal privacy security and social impact. At present, the deep forgery detection methods are learning-based methods, which depend on the data to a certain extent. Enriching facial anti-spoofing datasets is an effective method to solve the above problem. Therefore, we propose an effective face swapping framework based on StyleGAN. We utilize the feature pyramid network to extract facial features and map them to the latent space of StyleGAN. In order to realize the transformation of identity, we explore the representation of identity information and propose an adaptive identity editing module. We design a simple and effective post-processing process to improve the authenticity of the images. Experiments show that our proposed method can effectively complete face swapping and provide high-quality data for deep forgery detection to ensure the security of multimedia systems.
format Online
Article
Text
id pubmed-9268752
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-92687522022-07-09 Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework Yang, Jiachen Lan, Guipeng Xiao, Shuai Li, Yang Wen, Jiabao Zhu, Yong Sensors (Basel) Article In the era of rapid development of the Internet of things, deep learning, and communication technologies, social media has become an indispensable element. However, while enjoying the convenience brought by technological innovation, people are also facing the negative impact brought by them. Taking the users’ portraits of multimedia systems as examples, with the maturity of deep facial forgery technologies, personal portraits are facing malicious tampering and forgery, which pose a potential threat to personal privacy security and social impact. At present, the deep forgery detection methods are learning-based methods, which depend on the data to a certain extent. Enriching facial anti-spoofing datasets is an effective method to solve the above problem. Therefore, we propose an effective face swapping framework based on StyleGAN. We utilize the feature pyramid network to extract facial features and map them to the latent space of StyleGAN. In order to realize the transformation of identity, we explore the representation of identity information and propose an adaptive identity editing module. We design a simple and effective post-processing process to improve the authenticity of the images. Experiments show that our proposed method can effectively complete face swapping and provide high-quality data for deep forgery detection to ensure the security of multimedia systems. MDPI 2022-06-22 /pmc/articles/PMC9268752/ /pubmed/35808193 http://dx.doi.org/10.3390/s22134697 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Yang, Jiachen
Lan, Guipeng
Xiao, Shuai
Li, Yang
Wen, Jiabao
Zhu, Yong
Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework
title Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework
title_full Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework
title_fullStr Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework
title_full_unstemmed Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework
title_short Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework
title_sort enriching facial anti-spoofing datasets via an effective face swapping framework
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9268752/
https://www.ncbi.nlm.nih.gov/pubmed/35808193
http://dx.doi.org/10.3390/s22134697
work_keys_str_mv AT yangjiachen enrichingfacialantispoofingdatasetsviaaneffectivefaceswappingframework
AT languipeng enrichingfacialantispoofingdatasetsviaaneffectivefaceswappingframework
AT xiaoshuai enrichingfacialantispoofingdatasetsviaaneffectivefaceswappingframework
AT liyang enrichingfacialantispoofingdatasetsviaaneffectivefaceswappingframework
AT wenjiabao enrichingfacialantispoofingdatasetsviaaneffectivefaceswappingframework
AT zhuyong enrichingfacialantispoofingdatasetsviaaneffectivefaceswappingframework