Cargando…

The Face Deepfake Detection Challenge

Multimedia data manipulation and forgery has never been easier than today, thanks to the power of Artificial Intelligence (AI). AI-generated fake content, commonly called Deepfakes, have been raising new issues and concerns, but also new challenges for the research community. The Deepfake detection...

Descripción completa

Detalles Bibliográficos
Autores principales: Guarnera, Luca, Giudice, Oliver, Guarnera, Francesco, Ortis, Alessandro, Puglisi, Giovanni, Paratore, Antonino, Bui, Linh M. Q., Fontani, Marco, Coccomini, Davide Alessandro, Caldelli, Roberto, Falchi, Fabrizio, Gennaro, Claudio, Messina, Nicola, Amato, Giuseppe, Perelli, Gianpaolo, Concas, Sara, Cuccu, Carlo, Orrù, Giulia, Marcialis, Gian Luca, Battiato, Sebastiano
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9605671/
https://www.ncbi.nlm.nih.gov/pubmed/36286357
http://dx.doi.org/10.3390/jimaging8100263
_version_ 1784818125164773376
author Guarnera, Luca
Giudice, Oliver
Guarnera, Francesco
Ortis, Alessandro
Puglisi, Giovanni
Paratore, Antonino
Bui, Linh M. Q.
Fontani, Marco
Coccomini, Davide Alessandro
Caldelli, Roberto
Falchi, Fabrizio
Gennaro, Claudio
Messina, Nicola
Amato, Giuseppe
Perelli, Gianpaolo
Concas, Sara
Cuccu, Carlo
Orrù, Giulia
Marcialis, Gian Luca
Battiato, Sebastiano
author_facet Guarnera, Luca
Giudice, Oliver
Guarnera, Francesco
Ortis, Alessandro
Puglisi, Giovanni
Paratore, Antonino
Bui, Linh M. Q.
Fontani, Marco
Coccomini, Davide Alessandro
Caldelli, Roberto
Falchi, Fabrizio
Gennaro, Claudio
Messina, Nicola
Amato, Giuseppe
Perelli, Gianpaolo
Concas, Sara
Cuccu, Carlo
Orrù, Giulia
Marcialis, Gian Luca
Battiato, Sebastiano
author_sort Guarnera, Luca
collection PubMed
description Multimedia data manipulation and forgery has never been easier than today, thanks to the power of Artificial Intelligence (AI). AI-generated fake content, commonly called Deepfakes, have been raising new issues and concerns, but also new challenges for the research community. The Deepfake detection task has become widely addressed, but unfortunately, approaches in the literature suffer from generalization issues. In this paper, the Face Deepfake Detection and Reconstruction Challenge is described. Two different tasks were proposed to the participants: (i) creating a Deepfake detector capable of working in an “in the wild” scenario; (ii) creating a method capable of reconstructing original images from Deepfakes. Real images from CelebA and FFHQ and Deepfake images created by StarGAN, StarGAN-v2, StyleGAN, StyleGAN2, AttGAN and GDWCT were collected for the competition. The winning teams were chosen with respect to the highest classification accuracy value (Task I) and “minimum average distance to Manhattan” (Task II). Deep Learning algorithms, particularly those based on the EfficientNet architecture, achieved the best results in Task I. No winners were proclaimed for Task II. A detailed discussion of teams’ proposed methods with corresponding ranking is presented in this paper.
format Online
Article
Text
id pubmed-9605671
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-96056712022-10-27 The Face Deepfake Detection Challenge Guarnera, Luca Giudice, Oliver Guarnera, Francesco Ortis, Alessandro Puglisi, Giovanni Paratore, Antonino Bui, Linh M. Q. Fontani, Marco Coccomini, Davide Alessandro Caldelli, Roberto Falchi, Fabrizio Gennaro, Claudio Messina, Nicola Amato, Giuseppe Perelli, Gianpaolo Concas, Sara Cuccu, Carlo Orrù, Giulia Marcialis, Gian Luca Battiato, Sebastiano J Imaging Article Multimedia data manipulation and forgery has never been easier than today, thanks to the power of Artificial Intelligence (AI). AI-generated fake content, commonly called Deepfakes, have been raising new issues and concerns, but also new challenges for the research community. The Deepfake detection task has become widely addressed, but unfortunately, approaches in the literature suffer from generalization issues. In this paper, the Face Deepfake Detection and Reconstruction Challenge is described. Two different tasks were proposed to the participants: (i) creating a Deepfake detector capable of working in an “in the wild” scenario; (ii) creating a method capable of reconstructing original images from Deepfakes. Real images from CelebA and FFHQ and Deepfake images created by StarGAN, StarGAN-v2, StyleGAN, StyleGAN2, AttGAN and GDWCT were collected for the competition. The winning teams were chosen with respect to the highest classification accuracy value (Task I) and “minimum average distance to Manhattan” (Task II). Deep Learning algorithms, particularly those based on the EfficientNet architecture, achieved the best results in Task I. No winners were proclaimed for Task II. A detailed discussion of teams’ proposed methods with corresponding ranking is presented in this paper. MDPI 2022-09-28 /pmc/articles/PMC9605671/ /pubmed/36286357 http://dx.doi.org/10.3390/jimaging8100263 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Guarnera, Luca
Giudice, Oliver
Guarnera, Francesco
Ortis, Alessandro
Puglisi, Giovanni
Paratore, Antonino
Bui, Linh M. Q.
Fontani, Marco
Coccomini, Davide Alessandro
Caldelli, Roberto
Falchi, Fabrizio
Gennaro, Claudio
Messina, Nicola
Amato, Giuseppe
Perelli, Gianpaolo
Concas, Sara
Cuccu, Carlo
Orrù, Giulia
Marcialis, Gian Luca
Battiato, Sebastiano
The Face Deepfake Detection Challenge
title The Face Deepfake Detection Challenge
title_full The Face Deepfake Detection Challenge
title_fullStr The Face Deepfake Detection Challenge
title_full_unstemmed The Face Deepfake Detection Challenge
title_short The Face Deepfake Detection Challenge
title_sort face deepfake detection challenge
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9605671/
https://www.ncbi.nlm.nih.gov/pubmed/36286357
http://dx.doi.org/10.3390/jimaging8100263
work_keys_str_mv AT guarneraluca thefacedeepfakedetectionchallenge
AT giudiceoliver thefacedeepfakedetectionchallenge
AT guarnerafrancesco thefacedeepfakedetectionchallenge
AT ortisalessandro thefacedeepfakedetectionchallenge
AT puglisigiovanni thefacedeepfakedetectionchallenge
AT paratoreantonino thefacedeepfakedetectionchallenge
AT builinhmq thefacedeepfakedetectionchallenge
AT fontanimarco thefacedeepfakedetectionchallenge
AT coccominidavidealessandro thefacedeepfakedetectionchallenge
AT caldelliroberto thefacedeepfakedetectionchallenge
AT falchifabrizio thefacedeepfakedetectionchallenge
AT gennaroclaudio thefacedeepfakedetectionchallenge
AT messinanicola thefacedeepfakedetectionchallenge
AT amatogiuseppe thefacedeepfakedetectionchallenge
AT perelligianpaolo thefacedeepfakedetectionchallenge
AT concassara thefacedeepfakedetectionchallenge
AT cuccucarlo thefacedeepfakedetectionchallenge
AT orrugiulia thefacedeepfakedetectionchallenge
AT marcialisgianluca thefacedeepfakedetectionchallenge
AT battiatosebastiano thefacedeepfakedetectionchallenge
AT guarneraluca facedeepfakedetectionchallenge
AT giudiceoliver facedeepfakedetectionchallenge
AT guarnerafrancesco facedeepfakedetectionchallenge
AT ortisalessandro facedeepfakedetectionchallenge
AT puglisigiovanni facedeepfakedetectionchallenge
AT paratoreantonino facedeepfakedetectionchallenge
AT builinhmq facedeepfakedetectionchallenge
AT fontanimarco facedeepfakedetectionchallenge
AT coccominidavidealessandro facedeepfakedetectionchallenge
AT caldelliroberto facedeepfakedetectionchallenge
AT falchifabrizio facedeepfakedetectionchallenge
AT gennaroclaudio facedeepfakedetectionchallenge
AT messinanicola facedeepfakedetectionchallenge
AT amatogiuseppe facedeepfakedetectionchallenge
AT perelligianpaolo facedeepfakedetectionchallenge
AT concassara facedeepfakedetectionchallenge
AT cuccucarlo facedeepfakedetectionchallenge
AT orrugiulia facedeepfakedetectionchallenge
AT marcialisgianluca facedeepfakedetectionchallenge
AT battiatosebastiano facedeepfakedetectionchallenge