Cargando…

Facial Emotion Recognition Using a Novel Fusion of Convolutional Neural Network and Local Binary Pattern in Crime Investigation

The exploration of facial emotion recognition aims to analyze psychological characteristics of juveniles involved in crimes and promote the application of deep learning to psychological feature extraction. First, the relationship between facial emotion recognition and psychological characteristics i...

Descripción completa

Detalles Bibliográficos
Autores principales: Zhu, Dimin, Fu, Yuxi, Zhao, Xinjie, Wang, Xin, Yi, Hanxi
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Hindawi 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9522492/
https://www.ncbi.nlm.nih.gov/pubmed/36188698
http://dx.doi.org/10.1155/2022/2249417
_version_ 1784800078926446592
author Zhu, Dimin
Fu, Yuxi
Zhao, Xinjie
Wang, Xin
Yi, Hanxi
author_facet Zhu, Dimin
Fu, Yuxi
Zhao, Xinjie
Wang, Xin
Yi, Hanxi
author_sort Zhu, Dimin
collection PubMed
description The exploration of facial emotion recognition aims to analyze psychological characteristics of juveniles involved in crimes and promote the application of deep learning to psychological feature extraction. First, the relationship between facial emotion recognition and psychological characteristics is discussed. On this basis, a facial emotion recognition model is constructed by increasing the layers of the convolutional neural network (CNN) and integrating CNN with several neural networks such as VGGNet, AlexNet, and LeNet-5. Second, based on the feature fusion, an optimized Central Local Binary Pattern (CLBP) algorithm is introduced into the CNN to construct a CNN-CLBP algorithm for facial emotion recognition. Finally, the validity analysis is conducted on the algorithm after the preprocessing of face images and the optimization of relevant parameters. Compared with other methods, the CNN-CLBP algorithm has higher accuracy in facial expression recognition, with an average recognition rate of 88.16%. Besides, the recognition accuracy of this algorithm is improved by image preprocessing and parameter optimization, and there is no poor-fitting. Moreover, the CNN-CLBP algorithm can recognize 97% of the happy expressions and surprised expressions, but the misidentification rate of sad expressions is 22.54%. The research result provides data reference and direction for analyzing psychological characteristics of juveniles involved in crimes.
format Online
Article
Text
id pubmed-9522492
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Hindawi
record_format MEDLINE/PubMed
spelling pubmed-95224922022-09-30 Facial Emotion Recognition Using a Novel Fusion of Convolutional Neural Network and Local Binary Pattern in Crime Investigation Zhu, Dimin Fu, Yuxi Zhao, Xinjie Wang, Xin Yi, Hanxi Comput Intell Neurosci Research Article The exploration of facial emotion recognition aims to analyze psychological characteristics of juveniles involved in crimes and promote the application of deep learning to psychological feature extraction. First, the relationship between facial emotion recognition and psychological characteristics is discussed. On this basis, a facial emotion recognition model is constructed by increasing the layers of the convolutional neural network (CNN) and integrating CNN with several neural networks such as VGGNet, AlexNet, and LeNet-5. Second, based on the feature fusion, an optimized Central Local Binary Pattern (CLBP) algorithm is introduced into the CNN to construct a CNN-CLBP algorithm for facial emotion recognition. Finally, the validity analysis is conducted on the algorithm after the preprocessing of face images and the optimization of relevant parameters. Compared with other methods, the CNN-CLBP algorithm has higher accuracy in facial expression recognition, with an average recognition rate of 88.16%. Besides, the recognition accuracy of this algorithm is improved by image preprocessing and parameter optimization, and there is no poor-fitting. Moreover, the CNN-CLBP algorithm can recognize 97% of the happy expressions and surprised expressions, but the misidentification rate of sad expressions is 22.54%. The research result provides data reference and direction for analyzing psychological characteristics of juveniles involved in crimes. Hindawi 2022-09-22 /pmc/articles/PMC9522492/ /pubmed/36188698 http://dx.doi.org/10.1155/2022/2249417 Text en Copyright © 2022 Dimin Zhu et al. https://creativecommons.org/licenses/by/4.0/This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
spellingShingle Research Article
Zhu, Dimin
Fu, Yuxi
Zhao, Xinjie
Wang, Xin
Yi, Hanxi
Facial Emotion Recognition Using a Novel Fusion of Convolutional Neural Network and Local Binary Pattern in Crime Investigation
title Facial Emotion Recognition Using a Novel Fusion of Convolutional Neural Network and Local Binary Pattern in Crime Investigation
title_full Facial Emotion Recognition Using a Novel Fusion of Convolutional Neural Network and Local Binary Pattern in Crime Investigation
title_fullStr Facial Emotion Recognition Using a Novel Fusion of Convolutional Neural Network and Local Binary Pattern in Crime Investigation
title_full_unstemmed Facial Emotion Recognition Using a Novel Fusion of Convolutional Neural Network and Local Binary Pattern in Crime Investigation
title_short Facial Emotion Recognition Using a Novel Fusion of Convolutional Neural Network and Local Binary Pattern in Crime Investigation
title_sort facial emotion recognition using a novel fusion of convolutional neural network and local binary pattern in crime investigation
topic Research Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9522492/
https://www.ncbi.nlm.nih.gov/pubmed/36188698
http://dx.doi.org/10.1155/2022/2249417
work_keys_str_mv AT zhudimin facialemotionrecognitionusinganovelfusionofconvolutionalneuralnetworkandlocalbinarypatternincrimeinvestigation
AT fuyuxi facialemotionrecognitionusinganovelfusionofconvolutionalneuralnetworkandlocalbinarypatternincrimeinvestigation
AT zhaoxinjie facialemotionrecognitionusinganovelfusionofconvolutionalneuralnetworkandlocalbinarypatternincrimeinvestigation
AT wangxin facialemotionrecognitionusinganovelfusionofconvolutionalneuralnetworkandlocalbinarypatternincrimeinvestigation
AT yihanxi facialemotionrecognitionusinganovelfusionofconvolutionalneuralnetworkandlocalbinarypatternincrimeinvestigation