Cargando…

Copy-Move Forgery Detection (CMFD) Using Deep Learning for Image and Video Forensics

With the exponential growth of high-quality fake images in social networks and media, it is necessary to develop recognition algorithms for this type of content. One of the most common types of image and video editing consists of duplicating areas of the image, known as the copy-move technique. Trad...

Descripción completa

Detalles Bibliográficos
Autores principales: Rodriguez-Ortega, Yohanna, Ballesteros, Dora M., Renza, Diego
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8321314/
https://www.ncbi.nlm.nih.gov/pubmed/34460715
http://dx.doi.org/10.3390/jimaging7030059
_version_ 1783730822113656832
author Rodriguez-Ortega, Yohanna
Ballesteros, Dora M.
Renza, Diego
author_facet Rodriguez-Ortega, Yohanna
Ballesteros, Dora M.
Renza, Diego
author_sort Rodriguez-Ortega, Yohanna
collection PubMed
description With the exponential growth of high-quality fake images in social networks and media, it is necessary to develop recognition algorithms for this type of content. One of the most common types of image and video editing consists of duplicating areas of the image, known as the copy-move technique. Traditional image processing approaches manually look for patterns related to the duplicated content, limiting their use in mass data classification. In contrast, approaches based on deep learning have shown better performance and promising results, but they present generalization problems with a high dependence on training data and the need for appropriate selection of hyperparameters. To overcome this, we propose two approaches that use deep learning, a model by a custom architecture and a model by transfer learning. In each case, the impact of the depth of the network is analyzed in terms of precision (P), recall (R) and F1 score. Additionally, the problem of generalization is addressed with images from eight different open access datasets. Finally, the models are compared in terms of evaluation metrics, and training and inference times. The model by transfer learning of VGG-16 achieves metrics about 10% higher than the model by a custom architecture, however, it requires approximately twice as much inference time as the latter.
format Online
Article
Text
id pubmed-8321314
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-83213142021-08-26 Copy-Move Forgery Detection (CMFD) Using Deep Learning for Image and Video Forensics Rodriguez-Ortega, Yohanna Ballesteros, Dora M. Renza, Diego J Imaging Article With the exponential growth of high-quality fake images in social networks and media, it is necessary to develop recognition algorithms for this type of content. One of the most common types of image and video editing consists of duplicating areas of the image, known as the copy-move technique. Traditional image processing approaches manually look for patterns related to the duplicated content, limiting their use in mass data classification. In contrast, approaches based on deep learning have shown better performance and promising results, but they present generalization problems with a high dependence on training data and the need for appropriate selection of hyperparameters. To overcome this, we propose two approaches that use deep learning, a model by a custom architecture and a model by transfer learning. In each case, the impact of the depth of the network is analyzed in terms of precision (P), recall (R) and F1 score. Additionally, the problem of generalization is addressed with images from eight different open access datasets. Finally, the models are compared in terms of evaluation metrics, and training and inference times. The model by transfer learning of VGG-16 achieves metrics about 10% higher than the model by a custom architecture, however, it requires approximately twice as much inference time as the latter. MDPI 2021-03-20 /pmc/articles/PMC8321314/ /pubmed/34460715 http://dx.doi.org/10.3390/jimaging7030059 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ).
spellingShingle Article
Rodriguez-Ortega, Yohanna
Ballesteros, Dora M.
Renza, Diego
Copy-Move Forgery Detection (CMFD) Using Deep Learning for Image and Video Forensics
title Copy-Move Forgery Detection (CMFD) Using Deep Learning for Image and Video Forensics
title_full Copy-Move Forgery Detection (CMFD) Using Deep Learning for Image and Video Forensics
title_fullStr Copy-Move Forgery Detection (CMFD) Using Deep Learning for Image and Video Forensics
title_full_unstemmed Copy-Move Forgery Detection (CMFD) Using Deep Learning for Image and Video Forensics
title_short Copy-Move Forgery Detection (CMFD) Using Deep Learning for Image and Video Forensics
title_sort copy-move forgery detection (cmfd) using deep learning for image and video forensics
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8321314/
https://www.ncbi.nlm.nih.gov/pubmed/34460715
http://dx.doi.org/10.3390/jimaging7030059
work_keys_str_mv AT rodriguezortegayohanna copymoveforgerydetectioncmfdusingdeeplearningforimageandvideoforensics
AT ballesterosdoram copymoveforgerydetectioncmfdusingdeeplearningforimageandvideoforensics
AT renzadiego copymoveforgerydetectioncmfdusingdeeplearningforimageandvideoforensics