Cargando…
Joint Modal Alignment and Feature Enhancement for Visible-Infrared Person Re-Identification
Visible-infrared person re-identification aims to solve the matching problem between cross-camera and cross-modal person images. Existing methods strive to perform better cross-modal alignment, but often neglect the critical importance of feature enhancement for achieving better performance. Therefo...
Autores principales: | , , , , |
---|---|
Formato: | Online Artículo Texto |
Lenguaje: | English |
Publicado: |
MDPI
2023
|
Materias: | |
Acceso en línea: | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10255060/ https://www.ncbi.nlm.nih.gov/pubmed/37299715 http://dx.doi.org/10.3390/s23114988 |
_version_ | 1785056781587709952 |
---|---|
author | Lin, Ronghui Wang, Rong Zhang, Wenjing Wu, Ao Bi, Yihan |
author_facet | Lin, Ronghui Wang, Rong Zhang, Wenjing Wu, Ao Bi, Yihan |
author_sort | Lin, Ronghui |
collection | PubMed |
description | Visible-infrared person re-identification aims to solve the matching problem between cross-camera and cross-modal person images. Existing methods strive to perform better cross-modal alignment, but often neglect the critical importance of feature enhancement for achieving better performance. Therefore, we proposed an effective method that combines both modal alignment and feature enhancement. Specifically, we introduced Visible-Infrared Modal Data Augmentation (VIMDA) for visible images to improve modal alignment. Margin MMD-ID Loss was also used to further enhance modal alignment and optimize model convergence. Then, we proposed Multi-Grain Feature Extraction (MGFE) Structure for feature enhancement to further improve recognition performance. Extensive experiments have been carried out on SYSY-MM01 and RegDB. The result indicates that our method outperforms the current state-of-the-art method for visible-infrared person re-identification. Ablation experiments verified the effectiveness of the proposed method. |
format | Online Article Text |
id | pubmed-10255060 |
institution | National Center for Biotechnology Information |
language | English |
publishDate | 2023 |
publisher | MDPI |
record_format | MEDLINE/PubMed |
spelling | pubmed-102550602023-06-10 Joint Modal Alignment and Feature Enhancement for Visible-Infrared Person Re-Identification Lin, Ronghui Wang, Rong Zhang, Wenjing Wu, Ao Bi, Yihan Sensors (Basel) Article Visible-infrared person re-identification aims to solve the matching problem between cross-camera and cross-modal person images. Existing methods strive to perform better cross-modal alignment, but often neglect the critical importance of feature enhancement for achieving better performance. Therefore, we proposed an effective method that combines both modal alignment and feature enhancement. Specifically, we introduced Visible-Infrared Modal Data Augmentation (VIMDA) for visible images to improve modal alignment. Margin MMD-ID Loss was also used to further enhance modal alignment and optimize model convergence. Then, we proposed Multi-Grain Feature Extraction (MGFE) Structure for feature enhancement to further improve recognition performance. Extensive experiments have been carried out on SYSY-MM01 and RegDB. The result indicates that our method outperforms the current state-of-the-art method for visible-infrared person re-identification. Ablation experiments verified the effectiveness of the proposed method. MDPI 2023-05-23 /pmc/articles/PMC10255060/ /pubmed/37299715 http://dx.doi.org/10.3390/s23114988 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/). |
spellingShingle | Article Lin, Ronghui Wang, Rong Zhang, Wenjing Wu, Ao Bi, Yihan Joint Modal Alignment and Feature Enhancement for Visible-Infrared Person Re-Identification |
title | Joint Modal Alignment and Feature Enhancement for Visible-Infrared Person Re-Identification |
title_full | Joint Modal Alignment and Feature Enhancement for Visible-Infrared Person Re-Identification |
title_fullStr | Joint Modal Alignment and Feature Enhancement for Visible-Infrared Person Re-Identification |
title_full_unstemmed | Joint Modal Alignment and Feature Enhancement for Visible-Infrared Person Re-Identification |
title_short | Joint Modal Alignment and Feature Enhancement for Visible-Infrared Person Re-Identification |
title_sort | joint modal alignment and feature enhancement for visible-infrared person re-identification |
topic | Article |
url | https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10255060/ https://www.ncbi.nlm.nih.gov/pubmed/37299715 http://dx.doi.org/10.3390/s23114988 |
work_keys_str_mv | AT linronghui jointmodalalignmentandfeatureenhancementforvisibleinfraredpersonreidentification AT wangrong jointmodalalignmentandfeatureenhancementforvisibleinfraredpersonreidentification AT zhangwenjing jointmodalalignmentandfeatureenhancementforvisibleinfraredpersonreidentification AT wuao jointmodalalignmentandfeatureenhancementforvisibleinfraredpersonreidentification AT biyihan jointmodalalignmentandfeatureenhancementforvisibleinfraredpersonreidentification |