Cargando…

Learning Visible Thermal Person Re-Identification via Spatial Dependence and Dual-Constraint Loss

Visible thermal person re-identification (VT Re-ID) is the task of matching pedestrian images collected by thermal and visible light cameras. The two main challenges presented by VT Re-ID are the intra-class variation between pedestrian images and the cross-modality difference between visible and th...

Descripción completa

Detalles Bibliográficos
Autores principales: Wang, Chuandong, Zhang, Chi, Feng, Yujian, Ji, Yimu, Ding, Jianyu
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2022
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9030151/
https://www.ncbi.nlm.nih.gov/pubmed/35455106
http://dx.doi.org/10.3390/e24040443
_version_ 1784692071254196224
author Wang, Chuandong
Zhang, Chi
Feng, Yujian
Ji, Yimu
Ding, Jianyu
author_facet Wang, Chuandong
Zhang, Chi
Feng, Yujian
Ji, Yimu
Ding, Jianyu
author_sort Wang, Chuandong
collection PubMed
description Visible thermal person re-identification (VT Re-ID) is the task of matching pedestrian images collected by thermal and visible light cameras. The two main challenges presented by VT Re-ID are the intra-class variation between pedestrian images and the cross-modality difference between visible and thermal images. Existing works have principally focused on local representation through cross-modality feature distribution, but ignore the internal connection of the local features of pedestrian body parts. Therefore, this paper proposes a dual-path attention network model to establish the spatial dependency relationship between the local features of the pedestrian feature map and to effectively enhance the feature extraction. Meanwhile, we propose cross-modality dual-constraint loss, which adds the center and boundary constraints for each class distribution in the embedding space to promote compactness within the class and enhance the separability between classes. Our experimental results show that our proposed approach has advantages over the state-of-the-art methods on the two public datasets SYSU-MM01 and RegDB. The result for the SYSU-MM01 is Rank-1/mAP 57.74%/54.35%, and the result for the RegDB is Rank-1/mAP 76.07%/69.43%.
format Online
Article
Text
id pubmed-9030151
institution National Center for Biotechnology Information
language English
publishDate 2022
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-90301512022-04-23 Learning Visible Thermal Person Re-Identification via Spatial Dependence and Dual-Constraint Loss Wang, Chuandong Zhang, Chi Feng, Yujian Ji, Yimu Ding, Jianyu Entropy (Basel) Article Visible thermal person re-identification (VT Re-ID) is the task of matching pedestrian images collected by thermal and visible light cameras. The two main challenges presented by VT Re-ID are the intra-class variation between pedestrian images and the cross-modality difference between visible and thermal images. Existing works have principally focused on local representation through cross-modality feature distribution, but ignore the internal connection of the local features of pedestrian body parts. Therefore, this paper proposes a dual-path attention network model to establish the spatial dependency relationship between the local features of the pedestrian feature map and to effectively enhance the feature extraction. Meanwhile, we propose cross-modality dual-constraint loss, which adds the center and boundary constraints for each class distribution in the embedding space to promote compactness within the class and enhance the separability between classes. Our experimental results show that our proposed approach has advantages over the state-of-the-art methods on the two public datasets SYSU-MM01 and RegDB. The result for the SYSU-MM01 is Rank-1/mAP 57.74%/54.35%, and the result for the RegDB is Rank-1/mAP 76.07%/69.43%. MDPI 2022-03-23 /pmc/articles/PMC9030151/ /pubmed/35455106 http://dx.doi.org/10.3390/e24040443 Text en © 2022 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Wang, Chuandong
Zhang, Chi
Feng, Yujian
Ji, Yimu
Ding, Jianyu
Learning Visible Thermal Person Re-Identification via Spatial Dependence and Dual-Constraint Loss
title Learning Visible Thermal Person Re-Identification via Spatial Dependence and Dual-Constraint Loss
title_full Learning Visible Thermal Person Re-Identification via Spatial Dependence and Dual-Constraint Loss
title_fullStr Learning Visible Thermal Person Re-Identification via Spatial Dependence and Dual-Constraint Loss
title_full_unstemmed Learning Visible Thermal Person Re-Identification via Spatial Dependence and Dual-Constraint Loss
title_short Learning Visible Thermal Person Re-Identification via Spatial Dependence and Dual-Constraint Loss
title_sort learning visible thermal person re-identification via spatial dependence and dual-constraint loss
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9030151/
https://www.ncbi.nlm.nih.gov/pubmed/35455106
http://dx.doi.org/10.3390/e24040443
work_keys_str_mv AT wangchuandong learningvisiblethermalpersonreidentificationviaspatialdependenceanddualconstraintloss
AT zhangchi learningvisiblethermalpersonreidentificationviaspatialdependenceanddualconstraintloss
AT fengyujian learningvisiblethermalpersonreidentificationviaspatialdependenceanddualconstraintloss
AT jiyimu learningvisiblethermalpersonreidentificationviaspatialdependenceanddualconstraintloss
AT dingjianyu learningvisiblethermalpersonreidentificationviaspatialdependenceanddualconstraintloss