Multitask Siamese Network Guided by Enhanced Change Information for Semantic Change Detection in Bitemporal Remote Sensing Images

Semantic change detection (SCD) represents a challenging task in the interpretation of remote sensing images (RSIs), with the goal of identifying change regions and extracting semantic information from bitemporal RSIs simultaneously. The recent integration of deep neural networks leveraging multitas...

Full description

Saved in:
Bibliographic Details
Main Authors: Xibing Zuo, Fei Jin, Lei Ding, Shuxiang Wang, Yuzhun Lin, Bing Liu, Yao Ding
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10737132/
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Semantic change detection (SCD) represents a challenging task in the interpretation of remote sensing images (RSIs), with the goal of identifying change regions and extracting semantic information from bitemporal RSIs simultaneously. The recent integration of deep neural networks leveraging multitask learning has shown promise in enhancing SCD performance. However, there is still a challenge in improving SCD performance, specifically in designing a fine-grained network structure that can handle the two subtasks of change region localization and semantic information recognition in parallel. In this context, a novel multitask Siamese network, termed EGMS-Net, is proposed to boost the performance of SCD, which consists of three core components. First, a coarse-to-fine multitask Siamese network is constructed to obtain semantic information and change information at multiple levels. Second, an adaptive change information enhancement method based on spatial-spectral collaborative attention mechanism is proposed, which can assist the accurate localization of change regions without significantly increasing the model parameters. Third, a change information guidance module is developed to strengthen the interaction between multitask branches and reduce the difficulty of network training. Experiments on three benchmark datasets demonstrate that the proposed EGMS-Net outperforms existing state-of-the-art methods in the SCD community.
ISSN:1939-1404
2151-1535