Cargando…
MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning
With the development of deepfake technology, deepfake detection has received widespread attention. Although some deepfake forensics techniques have been proposed, they are still very difficult to implement in real-world scenarios. This is due to the differences in different deepfake technologies and...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10649340/ https://www.ncbi.nlm.nih.gov/pubmed/37960463 http://dx.doi.org/10.3390/s23218763 |
_version_ | 1785135544623169536 |
---|---|
author | Guan, Lei Liu, Fan Zhang, Ru Liu, Jianyi Tang, Yifan |
author_facet | Guan, Lei Liu, Fan Zhang, Ru Liu, Jianyi Tang, Yifan |
author_sort | Guan, Lei |
collection | PubMed |
description | With the development of deepfake technology, deepfake detection has received widespread attention. Although some deepfake forensics techniques have been proposed, they are still very difficult to implement in real-world scenarios. This is due to the differences in different deepfake technologies and the compression or editing of videos during the propagation process. Considering the issue of sample imbalance with few-shot scenarios in deepfake detection, we propose a multi-feature channel domain-weighted framework based on meta-learning (MCW). In order to obtain outstanding detection performance of a cross-database, the proposed framework improves a meta-learning network in two ways: it enhances the model’s feature extraction ability for detecting targets by combining the RGB domain and frequency domain information of the image and enhances the model’s generalization ability for detecting targets by assigning meta weights to channels on the feature map. The proposed MCW framework solves the problems of poor detection performance and insufficient data compression resistance of the algorithm for samples generated by unknown algorithms. The experiment was set in a zero-shot scenario and few-shot scenario, simulating the deepfake detection environment in real situations. We selected nine detection algorithms as comparative algorithms. The experimental results show that the MCW framework outperforms other algorithms in cross-algorithm detection and cross-dataset detection. The MCW framework demonstrates its ability to generalize and resist compression with low-quality training images and across different generation algorithm scenarios, and it has better fine-tuning potential in few-shot learning scenarios. |
format | Online Article Text |
id | pubmed-10649340 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-106493402023-10-27 MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning Guan, Lei Liu, Fan Zhang, Ru Liu, Jianyi Tang, Yifan Sensors (Basel) Article With the development of deepfake technology, deepfake detection has received widespread attention. Although some deepfake forensics techniques have been proposed, they are still very difficult to implement in real-world scenarios. This is due to the differences in different deepfake technologies and the compression or editing of videos during the propagation process. Considering the issue of sample imbalance with few-shot scenarios in deepfake detection, we propose a multi-feature channel domain-weighted framework based on meta-learning (MCW). In order to obtain outstanding detection performance of a cross-database, the proposed framework improves a meta-learning network in two ways: it enhances the model’s feature extraction ability for detecting targets by combining the RGB domain and frequency domain information of the image and enhances the model’s generalization ability for detecting targets by assigning meta weights to channels on the feature map. The proposed MCW framework solves the problems of poor detection performance and insufficient data compression resistance of the algorithm for samples generated by unknown algorithms. The experiment was set in a zero-shot scenario and few-shot scenario, simulating the deepfake detection environment in real situations. We selected nine detection algorithms as comparative algorithms. The experimental results show that the MCW framework outperforms other algorithms in cross-algorithm detection and cross-dataset detection. The MCW framework demonstrates its ability to generalize and resist compression with low-quality training images and across different generation algorithm scenarios, and it has better fine-tuning potential in few-shot learning scenarios. MDPI 2023-10-27 /pmc/articles/PMC10649340/ /pubmed/37960463 http://dx.doi.org/10.3390/s23218763 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Guan, Lei Liu, Fan Zhang, Ru Liu, Jianyi Tang, Yifan MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning |
title | MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning |
title_full | MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning |
title_fullStr | MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning |
title_full_unstemmed | MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning |
title_short | MCW: A Generalizable Deepfake Detection Method for Few-Shot Learning |
title_sort | mcw: a generalizable deepfake detection method for few-shot learning |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10649340/ https://www.ncbi.nlm.nih.gov/pubmed/37960463 http://dx.doi.org/10.3390/s23218763 |
work_keys_str_mv | AT guanlei mcwageneralizabledeepfakedetectionmethodforfewshotlearning AT liufan mcwageneralizabledeepfakedetectionmethodforfewshotlearning AT zhangru mcwageneralizabledeepfakedetectionmethodforfewshotlearning AT liujianyi mcwageneralizabledeepfakedetectionmethodforfewshotlearning AT tangyifan mcwageneralizabledeepfakedetectionmethodforfewshotlearning |