Cargando…

A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification

As a crucial task in surveillance and security, person re-identification (re-ID) aims to identify the targeted pedestrians across multiple images captured by non-overlapping cameras. However, existing person re-ID solutions have two main challenges: the lack of pedestrian identification labels in th...

Descripción completa

Detalles Bibliográficos
Autores principales: Li, Yuanyuan, Chen, Sixin, Qi, Guanqiu, Zhu, Zhiqin, Haner, Matthew, Cai, Ruihua
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2021
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8321335/
https://www.ncbi.nlm.nih.gov/pubmed/34460512
http://dx.doi.org/10.3390/jimaging7040062
_version_ 1783730827576737792
author Li, Yuanyuan
Chen, Sixin
Qi, Guanqiu
Zhu, Zhiqin
Haner, Matthew
Cai, Ruihua
author_facet Li, Yuanyuan
Chen, Sixin
Qi, Guanqiu
Zhu, Zhiqin
Haner, Matthew
Cai, Ruihua
author_sort Li, Yuanyuan
collection PubMed
description As a crucial task in surveillance and security, person re-identification (re-ID) aims to identify the targeted pedestrians across multiple images captured by non-overlapping cameras. However, existing person re-ID solutions have two main challenges: the lack of pedestrian identification labels in the captured images, and domain shift issue between different domains. A generative adversarial networks (GAN)-based self-training framework with progressive augmentation (SPA) is proposed to obtain the robust features of the unlabeled data from the target domain, according to the preknowledge of the labeled data from the source domain. Specifically, the proposed framework consists of two stages: the style transfer stage (STrans), and self-training stage (STrain). First, the targeted data is complemented by a camera style transfer algorithm in the STrans stage, in which CycleGAN and Siamese Network are integrated to preserve the unsupervised self-similarity (the similarity of the same image between before and after transformation) and domain dissimilarity (the dissimilarity between a transferred source image and the targeted image). Second, clustering and classification are alternately applied to enhance the model performance progressively in the STrain stage, in which both global and local features of the target-domain images are obtained. Compared with the state-of-the-art methods, the proposed method achieves the competitive accuracy on two existing datasets.
format Online
Article
Text
id pubmed-8321335
institution National Center for Biotechnology Information
language English
publishDate 2021
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-83213352021-08-26 A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification Li, Yuanyuan Chen, Sixin Qi, Guanqiu Zhu, Zhiqin Haner, Matthew Cai, Ruihua J Imaging Article As a crucial task in surveillance and security, person re-identification (re-ID) aims to identify the targeted pedestrians across multiple images captured by non-overlapping cameras. However, existing person re-ID solutions have two main challenges: the lack of pedestrian identification labels in the captured images, and domain shift issue between different domains. A generative adversarial networks (GAN)-based self-training framework with progressive augmentation (SPA) is proposed to obtain the robust features of the unlabeled data from the target domain, according to the preknowledge of the labeled data from the source domain. Specifically, the proposed framework consists of two stages: the style transfer stage (STrans), and self-training stage (STrain). First, the targeted data is complemented by a camera style transfer algorithm in the STrans stage, in which CycleGAN and Siamese Network are integrated to preserve the unsupervised self-similarity (the similarity of the same image between before and after transformation) and domain dissimilarity (the dissimilarity between a transferred source image and the targeted image). Second, clustering and classification are alternately applied to enhance the model performance progressively in the STrain stage, in which both global and local features of the target-domain images are obtained. Compared with the state-of-the-art methods, the proposed method achieves the competitive accuracy on two existing datasets. MDPI 2021-03-25 /pmc/articles/PMC8321335/ /pubmed/34460512 http://dx.doi.org/10.3390/jimaging7040062 Text en © 2021 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/ (https://creativecommons.org/licenses/by/4.0/) ).
spellingShingle Article
Li, Yuanyuan
Chen, Sixin
Qi, Guanqiu
Zhu, Zhiqin
Haner, Matthew
Cai, Ruihua
A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification
title A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification
title_full A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification
title_fullStr A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification
title_full_unstemmed A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification
title_short A GAN-Based Self-Training Framework for Unsupervised Domain Adaptive Person Re-Identification
title_sort gan-based self-training framework for unsupervised domain adaptive person re-identification
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8321335/
https://www.ncbi.nlm.nih.gov/pubmed/34460512
http://dx.doi.org/10.3390/jimaging7040062
work_keys_str_mv AT liyuanyuan aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT chensixin aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT qiguanqiu aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT zhuzhiqin aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT hanermatthew aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT cairuihua aganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT liyuanyuan ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT chensixin ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT qiguanqiu ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT zhuzhiqin ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT hanermatthew ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification
AT cairuihua ganbasedselftrainingframeworkforunsuperviseddomainadaptivepersonreidentification