Reconstructing Domain-Specific Features for Unsupervised Domain-Adaptive Object Detection

Unsupervised domain adaptation (UDA) effectively transfers knowledge learned from a labeled source domain to an unlabeled target domain. The teacher–student framework, which generates pseudo-labels for target domain samples and uses them for pseudo-supervised training, enables self-training and impr...

Full description

Saved in:
Bibliographic Details
Main Authors: Shuai Dong, Kang Deng, Kun Zou
Format: Article
Language:English
Published: MDPI AG 2025-05-01
Series:Information
Subjects:
Online Access:https://www.mdpi.com/2078-2489/16/6/439
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849472186246496256
author Shuai Dong
Kang Deng
Kun Zou
author_facet Shuai Dong
Kang Deng
Kun Zou
author_sort Shuai Dong
collection DOAJ
description Unsupervised domain adaptation (UDA) effectively transfers knowledge learned from a labeled source domain to an unlabeled target domain. The teacher–student framework, which generates pseudo-labels for target domain samples and uses them for pseudo-supervised training, enables self-training and improves generalization in UDA object detection. However, for one-stage detection models, pseudo-labels are unreliable when positive and negative samples are imbalanced. This may lead the model to overfit the source domain and overlook important target-domain information. In this work, we propose a novel domain-specific student–teacher framework to address this issue. The innovations of the proposed framework can be summarized in two aspects. First, we employ two domain-specific heads (DSHs) in the student model to handle inputs from the source domain and the target domain separately. These two heads are optimized independently with samples from their respective domains. This design allows for reducing the impact of unreliable pseudo-labels and fully leveraging unique information specific to the target domain. Second, we introduce an auxiliary reconstruction branch, named the multi-scale mask adversarial alignment (MMAA) module, into the teacher–student framework. The MMAA is tasked with reconstructing randomly masked multi-scale features of the source domain, which enhances the student model’s semantic representation capability and facilitates the generation of high-quality pseudo-labels. Experimental results on six diverse cross-domain scenarios demonstrate the effectiveness of our framework.
format Article
id doaj-art-4d2634039c2c47dcb606c1ff00cf472a
institution Kabale University
issn 2078-2489
language English
publishDate 2025-05-01
publisher MDPI AG
record_format Article
series Information
spelling doaj-art-4d2634039c2c47dcb606c1ff00cf472a2025-08-20T03:24:36ZengMDPI AGInformation2078-24892025-05-0116643910.3390/info16060439Reconstructing Domain-Specific Features for Unsupervised Domain-Adaptive Object DetectionShuai Dong0Kang Deng1Kun Zou2Zhongshan Institute, University of Electronic Science and Technology of China, Zhongshan 528400, ChinaMathematic and Information Institute, South China Agricultural University, Guangzhou 510642, ChinaZhongshan Institute, University of Electronic Science and Technology of China, Zhongshan 528400, ChinaUnsupervised domain adaptation (UDA) effectively transfers knowledge learned from a labeled source domain to an unlabeled target domain. The teacher–student framework, which generates pseudo-labels for target domain samples and uses them for pseudo-supervised training, enables self-training and improves generalization in UDA object detection. However, for one-stage detection models, pseudo-labels are unreliable when positive and negative samples are imbalanced. This may lead the model to overfit the source domain and overlook important target-domain information. In this work, we propose a novel domain-specific student–teacher framework to address this issue. The innovations of the proposed framework can be summarized in two aspects. First, we employ two domain-specific heads (DSHs) in the student model to handle inputs from the source domain and the target domain separately. These two heads are optimized independently with samples from their respective domains. This design allows for reducing the impact of unreliable pseudo-labels and fully leveraging unique information specific to the target domain. Second, we introduce an auxiliary reconstruction branch, named the multi-scale mask adversarial alignment (MMAA) module, into the teacher–student framework. The MMAA is tasked with reconstructing randomly masked multi-scale features of the source domain, which enhances the student model’s semantic representation capability and facilitates the generation of high-quality pseudo-labels. Experimental results on six diverse cross-domain scenarios demonstrate the effectiveness of our framework.https://www.mdpi.com/2078-2489/16/6/439one-stage object detectiondomain adaptationdomain-specific headteacher–student frameworkfeature reconstructionunreliable pseudo-labels
spellingShingle Shuai Dong
Kang Deng
Kun Zou
Reconstructing Domain-Specific Features for Unsupervised Domain-Adaptive Object Detection
Information
one-stage object detection
domain adaptation
domain-specific head
teacher–student framework
feature reconstruction
unreliable pseudo-labels
title Reconstructing Domain-Specific Features for Unsupervised Domain-Adaptive Object Detection
title_full Reconstructing Domain-Specific Features for Unsupervised Domain-Adaptive Object Detection
title_fullStr Reconstructing Domain-Specific Features for Unsupervised Domain-Adaptive Object Detection
title_full_unstemmed Reconstructing Domain-Specific Features for Unsupervised Domain-Adaptive Object Detection
title_short Reconstructing Domain-Specific Features for Unsupervised Domain-Adaptive Object Detection
title_sort reconstructing domain specific features for unsupervised domain adaptive object detection
topic one-stage object detection
domain adaptation
domain-specific head
teacher–student framework
feature reconstruction
unreliable pseudo-labels
url https://www.mdpi.com/2078-2489/16/6/439
work_keys_str_mv AT shuaidong reconstructingdomainspecificfeaturesforunsuperviseddomainadaptiveobjectdetection
AT kangdeng reconstructingdomainspecificfeaturesforunsuperviseddomainadaptiveobjectdetection
AT kunzou reconstructingdomainspecificfeaturesforunsuperviseddomainadaptiveobjectdetection