Cargando…
Inception Convolution and Feature Fusion for Person Search
With the rapid advancement of deep learning theory and hardware device computing capacity, computer vision tasks, such as object detection and instance segmentation, have entered a revolutionary phase in recent years. As a result, extremely challenging integrated tasks, such as person search, might...
Autores principales: | , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9963104/ https://www.ncbi.nlm.nih.gov/pubmed/36850579 http://dx.doi.org/10.3390/s23041984 |
_version_ | 1784896168603418624 |
---|---|
author | Ouyang, Huan Zeng, Jiexian Leng, Lu |
author_facet | Ouyang, Huan Zeng, Jiexian Leng, Lu |
author_sort | Ouyang, Huan |
collection | PubMed |
description | With the rapid advancement of deep learning theory and hardware device computing capacity, computer vision tasks, such as object detection and instance segmentation, have entered a revolutionary phase in recent years. As a result, extremely challenging integrated tasks, such as person search, might develop quickly. The majority of efficient network frameworks, such as Seq-Net, are based on Faster R-CNN. However, because of the parallel structure of Faster R-CNN, the performance of re-ID can be significantly impacted by the single-layer, low resolution, and occasionally overlooked check feature diagrams retrieved during pedestrian detection. To address these issues, this paper proposed a person search methodology based on an inception convolution and feature fusion module (IC-FFM) using Seq-Net (Sequential End-to-end Network) as the benchmark. First, we replaced the general convolution in ResNet-50 with the new inception convolution module (ICM), allowing the convolution operation to effectively and dynamically distribute various channels. Then, to improve the accuracy of information extraction, the feature fusion module (FFM) was created to combine multi-level information using various levels of convolution. Finally, Bounding Box regression was created using convolution and the double-head module (DHM), which considerably enhanced the accuracy of pedestrian retrieval by combining global and fine-grained information. Experiments on CHUK-SYSU and PRW datasets showed that our method has higher accuracy than Seq-Net. In addition, our method is simpler and can be easily integrated into existing two-stage frameworks. |
format | Online Article Text |
id | pubmed-9963104 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-99631042023-02-26 Inception Convolution and Feature Fusion for Person Search Ouyang, Huan Zeng, Jiexian Leng, Lu Sensors (Basel) Article With the rapid advancement of deep learning theory and hardware device computing capacity, computer vision tasks, such as object detection and instance segmentation, have entered a revolutionary phase in recent years. As a result, extremely challenging integrated tasks, such as person search, might develop quickly. The majority of efficient network frameworks, such as Seq-Net, are based on Faster R-CNN. However, because of the parallel structure of Faster R-CNN, the performance of re-ID can be significantly impacted by the single-layer, low resolution, and occasionally overlooked check feature diagrams retrieved during pedestrian detection. To address these issues, this paper proposed a person search methodology based on an inception convolution and feature fusion module (IC-FFM) using Seq-Net (Sequential End-to-end Network) as the benchmark. First, we replaced the general convolution in ResNet-50 with the new inception convolution module (ICM), allowing the convolution operation to effectively and dynamically distribute various channels. Then, to improve the accuracy of information extraction, the feature fusion module (FFM) was created to combine multi-level information using various levels of convolution. Finally, Bounding Box regression was created using convolution and the double-head module (DHM), which considerably enhanced the accuracy of pedestrian retrieval by combining global and fine-grained information. Experiments on CHUK-SYSU and PRW datasets showed that our method has higher accuracy than Seq-Net. In addition, our method is simpler and can be easily integrated into existing two-stage frameworks. MDPI 2023-02-10 /pmc/articles/PMC9963104/ /pubmed/36850579 http://dx.doi.org/10.3390/s23041984 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Ouyang, Huan Zeng, Jiexian Leng, Lu Inception Convolution and Feature Fusion for Person Search |
title | Inception Convolution and Feature Fusion for Person Search |
title_full | Inception Convolution and Feature Fusion for Person Search |
title_fullStr | Inception Convolution and Feature Fusion for Person Search |
title_full_unstemmed | Inception Convolution and Feature Fusion for Person Search |
title_short | Inception Convolution and Feature Fusion for Person Search |
title_sort | inception convolution and feature fusion for person search |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9963104/ https://www.ncbi.nlm.nih.gov/pubmed/36850579 http://dx.doi.org/10.3390/s23041984 |
work_keys_str_mv | AT ouyanghuan inceptionconvolutionandfeaturefusionforpersonsearch AT zengjiexian inceptionconvolutionandfeaturefusionforpersonsearch AT lenglu inceptionconvolutionandfeaturefusionforpersonsearch |