Cargando…

Research on efficient feature extraction: Improving YOLOv5 backbone for facial expression detection in live streaming scenes

Facial expressions, whether simple or complex, convey pheromones that can affect others. Plentiful sensory input delivered by marketing anchors' facial expressions to audiences can stimulate consumers' identification and influence decision-making, especially in live streaming media marketi...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Zongwei, Song, Jia, Qiao, Kai, Li, Chenghai, Zhang, Yanhui, Li, Zhenyu
Formato: Online Artículo Texto
Lenguaje:English
Publicado: Frontiers Media S.A. 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9399731/
https://www.ncbi.nlm.nih.gov/pubmed/36034936
http://dx.doi.org/10.3389/fncom.2022.980063
_version_ 1784772591757557760
author Li, Zongwei
Song, Jia
Qiao, Kai
Li, Chenghai
Zhang, Yanhui
Li, Zhenyu
author_facet Li, Zongwei
Song, Jia
Qiao, Kai
Li, Chenghai
Zhang, Yanhui
Li, Zhenyu
author_sort Li, Zongwei
collection PubMed
description Facial expressions, whether simple or complex, convey pheromones that can affect others. Plentiful sensory input delivered by marketing anchors' facial expressions to audiences can stimulate consumers' identification and influence decision-making, especially in live streaming media marketing. This paper proposes an efficient feature extraction network based on the YOLOv5 model for detecting anchors' facial expressions. First, a two-step cascade classifier and recycler is established to filter invalid video frames to generate a facial expression dataset of anchors. Second, GhostNet and coordinate attention are fused in YOLOv5 to eliminate latency and improve accuracy. YOLOv5 modified with the proposed efficient feature extraction structure outperforms the original YOLOv5 on our self-built dataset in both speed and accuracy.
format Online
Article
Text
id pubmed-9399731
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher Frontiers Media S.A.
record_format MEDLINE/PubMed
spelling pubmed-93997312022-08-25 Research on efficient feature extraction: Improving YOLOv5 backbone for facial expression detection in live streaming scenes Li, Zongwei Song, Jia Qiao, Kai Li, Chenghai Zhang, Yanhui Li, Zhenyu Front Comput Neurosci Neuroscience Facial expressions, whether simple or complex, convey pheromones that can affect others. Plentiful sensory input delivered by marketing anchors' facial expressions to audiences can stimulate consumers' identification and influence decision-making, especially in live streaming media marketing. This paper proposes an efficient feature extraction network based on the YOLOv5 model for detecting anchors' facial expressions. First, a two-step cascade classifier and recycler is established to filter invalid video frames to generate a facial expression dataset of anchors. Second, GhostNet and coordinate attention are fused in YOLOv5 to eliminate latency and improve accuracy. YOLOv5 modified with the proposed efficient feature extraction structure outperforms the original YOLOv5 on our self-built dataset in both speed and accuracy. Frontiers Media S.A. 2022-08-10 /pmc/articles/PMC9399731/ /pubmed/36034936 http://dx.doi.org/10.3389/fncom.2022.980063 Text en Copyright © 2022 Li, Song, Qiao, Li, Zhang and Li. https://creativecommons.org/licenses/by/4.0/This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
spellingShingle Neuroscience
Li, Zongwei
Song, Jia
Qiao, Kai
Li, Chenghai
Zhang, Yanhui
Li, Zhenyu
Research on efficient feature extraction: Improving YOLOv5 backbone for facial expression detection in live streaming scenes
title Research on efficient feature extraction: Improving YOLOv5 backbone for facial expression detection in live streaming scenes
title_full Research on efficient feature extraction: Improving YOLOv5 backbone for facial expression detection in live streaming scenes
title_fullStr Research on efficient feature extraction: Improving YOLOv5 backbone for facial expression detection in live streaming scenes
title_full_unstemmed Research on efficient feature extraction: Improving YOLOv5 backbone for facial expression detection in live streaming scenes
title_short Research on efficient feature extraction: Improving YOLOv5 backbone for facial expression detection in live streaming scenes
title_sort research on efficient feature extraction: improving yolov5 backbone for facial expression detection in live streaming scenes
topic Neuroscience
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9399731/
https://www.ncbi.nlm.nih.gov/pubmed/36034936
http://dx.doi.org/10.3389/fncom.2022.980063
work_keys_str_mv AT lizongwei researchonefficientfeatureextractionimprovingyolov5backboneforfacialexpressiondetectioninlivestreamingscenes
AT songjia researchonefficientfeatureextractionimprovingyolov5backboneforfacialexpressiondetectioninlivestreamingscenes
AT qiaokai researchonefficientfeatureextractionimprovingyolov5backboneforfacialexpressiondetectioninlivestreamingscenes
AT lichenghai researchonefficientfeatureextractionimprovingyolov5backboneforfacialexpressiondetectioninlivestreamingscenes
AT zhangyanhui researchonefficientfeatureextractionimprovingyolov5backboneforfacialexpressiondetectioninlivestreamingscenes
AT lizhenyu researchonefficientfeatureextractionimprovingyolov5backboneforfacialexpressiondetectioninlivestreamingscenes