Cargando…

Cross-Domain Object Detection by Dual Adaptive Branch

The object detection task usually assumes that the training and test samples obey the same distribution, and this assumption is not valid in reality, therefore the study of cross-domain object detection is proposed. Compared with image classification, the cross-domain object detection task presents...

Descripción completa

Detalles Bibliográficos
Autores principales: Liu, Xinyi, Zhang, Baofeng, Liu, Na
Formato: Online Artículo Texto
Lenguaje:English
Publicado: MDPI 2023
Materias:
Acceso en línea:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9919108/
https://www.ncbi.nlm.nih.gov/pubmed/36772242
http://dx.doi.org/10.3390/s23031199
_version_ 1784886742245965824
author Liu, Xinyi
Zhang, Baofeng
Liu, Na
author_facet Liu, Xinyi
Zhang, Baofeng
Liu, Na
author_sort Liu, Xinyi
collection PubMed
description The object detection task usually assumes that the training and test samples obey the same distribution, and this assumption is not valid in reality, therefore the study of cross-domain object detection is proposed. Compared with image classification, the cross-domain object detection task presents the greater challenge, which requires both accurate classification and localization of samples in the target domain. The teacher–student framework (the student model is supervised by pseudo-labels from the teacher model) has produced a large accuracy improvement in cross-domain object detection. Feature-level adversarial training is used in the student model, which allows features in the source and target domains to share a similar distribution. However, the direction and gradient of the weights can be divided into domain-specific and domain-invariant features, and the purpose of domain adaptive is to focus on the domain-invariant features while eliminating interference from the domain-specific features. Inspired by this, we propose a teacher–student framework named dual adaptive branch (DAB), which uses domain adversarial learning to address the domain distribution. Specifically, we ensure that the student model aligns domain-invariant features and suppresses domain-specific features in this process. We further validate our method based on multiple domains. The experimental results demonstrate that our proposed method significantly improves the performance of cross-domain object detection and achieves the competitive experimental results on common benchmarks.
format Online
Article
Text
id pubmed-9919108
institution National Center for Biotechnology Information
language English
publishDate 2023
publisher MDPI
record_format MEDLINE/PubMed
spelling pubmed-99191082023-02-12 Cross-Domain Object Detection by Dual Adaptive Branch Liu, Xinyi Zhang, Baofeng Liu, Na Sensors (Basel) Article The object detection task usually assumes that the training and test samples obey the same distribution, and this assumption is not valid in reality, therefore the study of cross-domain object detection is proposed. Compared with image classification, the cross-domain object detection task presents the greater challenge, which requires both accurate classification and localization of samples in the target domain. The teacher–student framework (the student model is supervised by pseudo-labels from the teacher model) has produced a large accuracy improvement in cross-domain object detection. Feature-level adversarial training is used in the student model, which allows features in the source and target domains to share a similar distribution. However, the direction and gradient of the weights can be divided into domain-specific and domain-invariant features, and the purpose of domain adaptive is to focus on the domain-invariant features while eliminating interference from the domain-specific features. Inspired by this, we propose a teacher–student framework named dual adaptive branch (DAB), which uses domain adversarial learning to address the domain distribution. Specifically, we ensure that the student model aligns domain-invariant features and suppresses domain-specific features in this process. We further validate our method based on multiple domains. The experimental results demonstrate that our proposed method significantly improves the performance of cross-domain object detection and achieves the competitive experimental results on common benchmarks. MDPI 2023-01-20 /pmc/articles/PMC9919108/ /pubmed/36772242 http://dx.doi.org/10.3390/s23031199 Text en © 2023 by the authors. https://creativecommons.org/licenses/by/4.0/Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
spellingShingle Article
Liu, Xinyi
Zhang, Baofeng
Liu, Na
Cross-Domain Object Detection by Dual Adaptive Branch
title Cross-Domain Object Detection by Dual Adaptive Branch
title_full Cross-Domain Object Detection by Dual Adaptive Branch
title_fullStr Cross-Domain Object Detection by Dual Adaptive Branch
title_full_unstemmed Cross-Domain Object Detection by Dual Adaptive Branch
title_short Cross-Domain Object Detection by Dual Adaptive Branch
title_sort cross-domain object detection by dual adaptive branch
topic Article
url https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9919108/
https://www.ncbi.nlm.nih.gov/pubmed/36772242
http://dx.doi.org/10.3390/s23031199
work_keys_str_mv AT liuxinyi crossdomainobjectdetectionbydualadaptivebranch
AT zhangbaofeng crossdomainobjectdetectionbydualadaptivebranch
AT liuna crossdomainobjectdetectionbydualadaptivebranch