Cargando…

MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning

With the development of deepfake technology, deepfake detection has received widespread attention. Although some deepfake forensics techniques have been proposed, they are still very difficult to implement in real-world scenarios. This is due to the differences in different deepfake technologies and...

Descripción completa

Detalles Bibliográficos
Autores principales: Guan, Lei, Liu, Fan, Zhang, Ru, Liu, Jianyi, Tang, Yifan
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10649340/
https://www.ncbi.nlm.nih.gov/pubmed/37960463
http://dx.doi.org/10.3390/s23218763
_version_ 1785135544623169536
author Guan, Lei
Liu, Fan
Zhang, Ru
Liu, Jianyi
Tang, Yifan
author_facet Guan, Lei
Liu, Fan
Zhang, Ru
Liu, Jianyi
Tang, Yifan
author_sort Guan, Lei
collection PubMed
description With the development of deepfake technology, deepfake detection has received widespread attention. Although some deepfake forensics techniques have been proposed, they are still very difficult to implement in real-world scenarios. This is due to the differences in different deepfake technologies and the compression or editing of videos during the propagation process. Considering the issue of sample imbalance with few-shot scenarios in deepfake detection, we propose a multi-feature channel domain-weighted framework based on meta-learning (MCW). In order to obtain outstanding detection performance of a cross-database, the proposed framework improves a meta-learning network in two ways: it enhances the model’s feature extraction ability for detecting targets by combining the RGB domain and frequency domain information of the image and enhances the model’s generalization ability for detecting targets by assigning meta weights to channels on the feature map. The proposed MCW framework solves the problems of poor detection performance and insufficient data compression resistance of the algorithm for samples generated by unknown algorithms. The experiment was set in a zero-shot scenario and few-shot scenario, simulating the deepfake detection environment in real situations. We selected nine detection algorithms as comparative algorithms. The experimental results show that the MCW framework outperforms other algorithms in cross-algorithm detection and cross-dataset detection. The MCW framework demonstrates its ability to generalize and resist compression with low-quality training images and across different generation algorithm scenarios, and it has better fine-tuning potential in few-shot learning scenarios.
format Online
Article
Text
id pubmed-10649340
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-106493402023-10-27 MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning Guan, Lei Liu, Fan Zhang, Ru Liu, Jianyi Tang, Yifan Sensors (Basel) Article With the development of deepfake technology, deepfake detection has received widespread attention. Although some deepfake forensics techniques have been proposed, they are still very difficult to implement in real-world scenarios. This is due to the differences in different deepfake technologies and the compression or editing of videos during the propagation process. Considering the issue of sample imbalance with few-shot scenarios in deepfake detection, we propose a multi-feature channel domain-weighted framework based on meta-learning (MCW). In order to obtain outstanding detection performance of a cross-database, the proposed framework improves a meta-learning network in two ways: it enhances the model’s feature extraction ability for detecting targets by combining the RGB domain and frequency domain information of the image and enhances the model’s generalization ability for detecting targets by assigning meta weights to channels on the feature map. The proposed MCW framework solves the problems of poor detection performance and insufficient data compression resistance of the algorithm for samples generated by unknown algorithms. The experiment was set in a zero-shot scenario and few-shot scenario, simulating the deepfake detection environment in real situations. We selected nine detection algorithms as comparative algorithms. The experimental results show that the MCW framework outperforms other algorithms in cross-algorithm detection and cross-dataset detection. The MCW framework demonstrates its ability to generalize and resist compression with low-quality training images and across different generation algorithm scenarios, and it has better fine-tuning potential in few-shot learning scenarios. MDPI 2023-10-27 /pmc/articles/PMC10649340/ /pubmed/37960463 http://dx.doi.org/10.3390/s23218763 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Guan, Lei
Liu, Fan
Zhang, Ru
Liu, Jianyi
Tang, Yifan
MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning
title MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning
title_full MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning
title_fullStr MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning
title_full_unstemmed MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning
title_short MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning
title_sort mcw: a generalizable deepfake detection method for few-shot learning
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10649340/
https://www.ncbi.nlm.nih.gov/pubmed/37960463
http://dx.doi.org/10.3390/s23218763
work_keys_str_mv AT guanlei mcwageneralizabledeepfakedetectionmethodforfewshotlearning
AT liufan mcwageneralizabledeepfakedetectionmethodforfewshotlearning
AT zhangru mcwageneralizabledeepfakedetectionmethodforfewshotlearning
AT liujianyi mcwageneralizabledeepfakedetectionmethodforfewshotlearning
AT tangyifan mcwageneralizabledeepfakedetectionmethodforfewshotlearning