Cargando…
Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework
In the era of rapid development of the Internet of things, deep learning, and communication technologies, social media has become an indispensable element. However, while enjoying the convenience brought by technological innovation, people are also facing the negative impact brought by them. Taking...
Autores principales: | , , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2022
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9268752/ https://www.ncbi.nlm.nih.gov/pubmed/35808193 http://dx.doi.org/10.3390/s22134697 |
_version_ | 1784744062411079680 |
---|---|
author | Yang, Jiachen Lan, Guipeng Xiao, Shuai Li, Yang Wen, Jiabao Zhu, Yong |
author_facet | Yang, Jiachen Lan, Guipeng Xiao, Shuai Li, Yang Wen, Jiabao Zhu, Yong |
author_sort | Yang, Jiachen |
collection | PubMed |
description | In the era of rapid development of the Internet of things, deep learning, and communication technologies, social media has become an indispensable element. However, while enjoying the convenience brought by technological innovation, people are also facing the negative impact brought by them. Taking the users’ portraits of multimedia systems as examples, with the maturity of deep facial forgery technologies, personal portraits are facing malicious tampering and forgery, which pose a potential threat to personal privacy security and social impact. At present, the deep forgery detection methods are learning-based methods, which depend on the data to a certain extent. Enriching facial anti-spoofing datasets is an effective method to solve the above problem. Therefore, we propose an effective face swapping framework based on StyleGAN. We utilize the feature pyramid network to extract facial features and map them to the latent space of StyleGAN. In order to realize the transformation of identity, we explore the representation of identity information and propose an adaptive identity editing module. We design a simple and effective post-processing process to improve the authenticity of the images. Experiments show that our proposed method can effectively complete face swapping and provide high-quality data for deep forgery detection to ensure the security of multimedia systems. |
format | Online Article Text |
id | pubmed-9268752 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2022 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-92687522022-07-09 Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework Yang, Jiachen Lan, Guipeng Xiao, Shuai Li, Yang Wen, Jiabao Zhu, Yong Sensors (Basel) Article In the era of rapid development of the Internet of things, deep learning, and communication technologies, social media has become an indispensable element. However, while enjoying the convenience brought by technological innovation, people are also facing the negative impact brought by them. Taking the users’ portraits of multimedia systems as examples, with the maturity of deep facial forgery technologies, personal portraits are facing malicious tampering and forgery, which pose a potential threat to personal privacy security and social impact. At present, the deep forgery detection methods are learning-based methods, which depend on the data to a certain extent. Enriching facial anti-spoofing datasets is an effective method to solve the above problem. Therefore, we propose an effective face swapping framework based on StyleGAN. We utilize the feature pyramid network to extract facial features and map them to the latent space of StyleGAN. In order to realize the transformation of identity, we explore the representation of identity information and propose an adaptive identity editing module. We design a simple and effective post-processing process to improve the authenticity of the images. Experiments show that our proposed method can effectively complete face swapping and provide high-quality data for deep forgery detection to ensure the security of multimedia systems. MDPI 2022-06-22 /pmc/articles/PMC9268752/ /pubmed/35808193 http://dx.doi.org/10.3390/s22134697 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Yang, Jiachen Lan, Guipeng Xiao, Shuai Li, Yang Wen, Jiabao Zhu, Yong Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework |
title | Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework |
title_full | Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework |
title_fullStr | Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework |
title_full_unstemmed | Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework |
title_short | Enriching Facial Anti-Spoofing Datasets via an Effective Face Swapping Framework |
title_sort | enriching facial anti-spoofing datasets via an effective face swapping framework |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9268752/ https://www.ncbi.nlm.nih.gov/pubmed/35808193 http://dx.doi.org/10.3390/s22134697 |
work_keys_str_mv | AT yangjiachen enrichingfacialantispoofingdatasetsviaaneffectivefaceswappingframework AT languipeng enrichingfacialantispoofingdatasetsviaaneffectivefaceswappingframework AT xiaoshuai enrichingfacialantispoofingdatasetsviaaneffectivefaceswappingframework AT liyang enrichingfacialantispoofingdatasetsviaaneffectivefaceswappingframework AT wenjiabao enrichingfacialantispoofingdatasetsviaaneffectivefaceswappingframework AT zhuyong enrichingfacialantispoofingdatasetsviaaneffectivefaceswappingframework |