Cargando…

Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks

Generative AI has gained enormous interest nowadays due to new applications like ChatGPT, DALL E, Stable Diffusion, and Deepfake. In particular, DALL E, Stable Diffusion, and others (Adobe Firefly, ImagineArt, etc.) can create images from a text prompt and are even able to create photorealistic imag...

Descripción completa

Detalles Bibliográficos
Autores principales: Martin-Rodriguez, Fernando, Garcia-Mojon, Rocio, Fernandez-Barciela, Monica
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10674908/
https://www.ncbi.nlm.nih.gov/pubmed/38005425
http://dx.doi.org/10.3390/s23229037
_version_ 1785140939274059776
author Martin-Rodriguez, Fernando
Garcia-Mojon, Rocio
Fernandez-Barciela, Monica
author_facet Martin-Rodriguez, Fernando
Garcia-Mojon, Rocio
Fernandez-Barciela, Monica
author_sort Martin-Rodriguez, Fernando
collection PubMed
description Generative AI has gained enormous interest nowadays due to new applications like ChatGPT, DALL E, Stable Diffusion, and Deepfake. In particular, DALL E, Stable Diffusion, and others (Adobe Firefly, ImagineArt, etc.) can create images from a text prompt and are even able to create photorealistic images. Due to this fact, intense research has been performed to create new image forensics applications able to distinguish between real captured images and videos and artificial ones. Detecting forgeries made with Deepfake is one of the most researched issues. This paper is about another kind of forgery detection. The purpose of this research is to detect photorealistic AI-created images versus real photos coming from a physical camera. Id est, making a binary decision over an image, asking whether it is artificially or naturally created. Artificial images do not need to try to represent any real object, person, or place. For this purpose, techniques that perform a pixel-level feature extraction are used. The first one is Photo Response Non-Uniformity (PRNU). PRNU is a special noise due to imperfections on the camera sensor that is used for source camera identification. The underlying idea is that AI images will have a different PRNU pattern. The second one is error level analysis (ELA). This is another type of feature extraction traditionally used for detecting image editing. ELA is being used nowadays by photographers for the manual detection of AI-created images. Both kinds of features are used to train convolutional neural networks to differentiate between AI images and real photographs. Good results are obtained, achieving accuracy rates of over 95%. Both extraction methods are carefully assessed by computing precision/recall and F(1)-score measurements.
format Online
Article
Text
id pubmed-10674908
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-106749082023-11-08 Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks Martin-Rodriguez, Fernando Garcia-Mojon, Rocio Fernandez-Barciela, Monica Sensors (Basel) Article Generative AI has gained enormous interest nowadays due to new applications like ChatGPT, DALL E, Stable Diffusion, and Deepfake. In particular, DALL E, Stable Diffusion, and others (Adobe Firefly, ImagineArt, etc.) can create images from a text prompt and are even able to create photorealistic images. Due to this fact, intense research has been performed to create new image forensics applications able to distinguish between real captured images and videos and artificial ones. Detecting forgeries made with Deepfake is one of the most researched issues. This paper is about another kind of forgery detection. The purpose of this research is to detect photorealistic AI-created images versus real photos coming from a physical camera. Id est, making a binary decision over an image, asking whether it is artificially or naturally created. Artificial images do not need to try to represent any real object, person, or place. For this purpose, techniques that perform a pixel-level feature extraction are used. The first one is Photo Response Non-Uniformity (PRNU). PRNU is a special noise due to imperfections on the camera sensor that is used for source camera identification. The underlying idea is that AI images will have a different PRNU pattern. The second one is error level analysis (ELA). This is another type of feature extraction traditionally used for detecting image editing. ELA is being used nowadays by photographers for the manual detection of AI-created images. Both kinds of features are used to train convolutional neural networks to differentiate between AI images and real photographs. Good results are obtained, achieving accuracy rates of over 95%. Both extraction methods are carefully assessed by computing precision/recall and F(1)-score measurements. MDPI 2023-11-08 /pmc/articles/PMC10674908/ /pubmed/38005425 http://dx.doi.org/10.3390/s23229037 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Martin-Rodriguez, Fernando
Garcia-Mojon, Rocio
Fernandez-Barciela, Monica
Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks
title Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks
title_full Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks
title_fullStr Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks
title_full_unstemmed Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks
title_short Detection of AI-Created Images Using Pixel-Wise Feature Extraction and Convolutional Neural Networks
title_sort detection of ai-created images using pixel-wise feature extraction and convolutional neural networks
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10674908/
https://www.ncbi.nlm.nih.gov/pubmed/38005425
http://dx.doi.org/10.3390/s23229037
work_keys_str_mv AT martinrodriguezfernando detectionofaicreatedimagesusingpixelwisefeatureextractionandconvolutionalneuralnetworks
AT garciamojonrocio detectionofaicreatedimagesusingpixelwisefeatureextractionandconvolutionalneuralnetworks
AT fernandezbarcielamonica detectionofaicreatedimagesusingpixelwisefeatureextractionandconvolutionalneuralnetworks