MLGFENet: Multiscale Local–Global Feature Enhancement Network for High-Resolution Remote Sensing Image Change Detection
The integration of a convolutional neural network (CNN) and a Transformer has become a dominant framework for change detection (CD) in remote sensing images, because of its ability to effectively model both local and global features. However, existing methods still face challenges in extracting feat...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/11072321/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849430142425759744 |
|---|---|
| author | Huanhuan Lv Xianqi Yan Hui Zhang Cuiping Shi Ruiqin Wang |
| author_facet | Huanhuan Lv Xianqi Yan Hui Zhang Cuiping Shi Ruiqin Wang |
| author_sort | Huanhuan Lv |
| collection | DOAJ |
| description | The integration of a convolutional neural network (CNN) and a Transformer has become a dominant framework for change detection (CD) in remote sensing images, because of its ability to effectively model both local and global features. However, existing methods still face challenges in extracting features from change regions with diverse shapes and sizes, as well as in capturing edge information. To address these issues, this study proposes a CD model for high-resolution remote sensing images that enhances multiscale local and global features by combining CNN and Transformer. Initially, a multiscale local feature extraction module is constructed. By leveraging the enhanced ResNet50 architecture and incorporating the atrous spatial pyramid pooling technique, this module is capable of accurately capturing the multiscale local details of bitemporal images. Subsequently, a hybrid-scale global context feature extraction module is designed. This module enables the modeling of multiscale global contextual information, thereby further enhancing the model’s feature representation capability. Next, a cascading feature decoder is employed to perform upsampling on the extracted features. Through the use of skip connections, local and global features are efficiently merged at multiple scales. Finally, a differential enhancement unit is utilized to generate differential features that are rich in change information. Additionally, a composite loss function is introduced, which takes into account both pixel-based segmentation errors and edge-based segmentation errors, enabling accurate localization of changed regions. Experimental results on three publicly available high-resolution remote sensing image datasets, namely, LEVIR-CD, WHU-CD, and CDD, demonstrate that the proposed method outperforms several state-of-the-art comparative methods in terms of CD efficacy. It effectively addresses common problems in CD, such as undersegmentation, oversegmentation, and rough edges. |
| format | Article |
| id | doaj-art-95c751649f38487aab657272776c7213 |
| institution | Kabale University |
| issn | 1939-1404 2151-1535 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing |
| spelling | doaj-art-95c751649f38487aab657272776c72132025-08-20T03:28:06ZengIEEEIEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing1939-14042151-15352025-01-0118170191703610.1109/JSTARS.2025.358660711072321MLGFENet: Multiscale Local–Global Feature Enhancement Network for High-Resolution Remote Sensing Image Change DetectionHuanhuan Lv0Xianqi Yan1Hui Zhang2https://orcid.org/0009-0001-5618-457XCuiping Shi3https://orcid.org/0000-0001-5877-1762Ruiqin Wang4School of Information Engineering, Huzhou University, Huzhou, ChinaSchool of Information Engineering, Huzhou University, Huzhou, ChinaSchool of Information Engineering, Huzhou University, Huzhou, ChinaSchool of Information Engineering, Huzhou University, Huzhou, ChinaSchool of Information Engineering, Huzhou University, Huzhou, ChinaThe integration of a convolutional neural network (CNN) and a Transformer has become a dominant framework for change detection (CD) in remote sensing images, because of its ability to effectively model both local and global features. However, existing methods still face challenges in extracting features from change regions with diverse shapes and sizes, as well as in capturing edge information. To address these issues, this study proposes a CD model for high-resolution remote sensing images that enhances multiscale local and global features by combining CNN and Transformer. Initially, a multiscale local feature extraction module is constructed. By leveraging the enhanced ResNet50 architecture and incorporating the atrous spatial pyramid pooling technique, this module is capable of accurately capturing the multiscale local details of bitemporal images. Subsequently, a hybrid-scale global context feature extraction module is designed. This module enables the modeling of multiscale global contextual information, thereby further enhancing the model’s feature representation capability. Next, a cascading feature decoder is employed to perform upsampling on the extracted features. Through the use of skip connections, local and global features are efficiently merged at multiple scales. Finally, a differential enhancement unit is utilized to generate differential features that are rich in change information. Additionally, a composite loss function is introduced, which takes into account both pixel-based segmentation errors and edge-based segmentation errors, enabling accurate localization of changed regions. Experimental results on three publicly available high-resolution remote sensing image datasets, namely, LEVIR-CD, WHU-CD, and CDD, demonstrate that the proposed method outperforms several state-of-the-art comparative methods in terms of CD efficacy. It effectively addresses common problems in CD, such as undersegmentation, oversegmentation, and rough edges.https://ieeexplore.ieee.org/document/11072321/Change detection (CD)convolutional neural network (CNN)multiscale featuresremote sensing imagestransformer |
| spellingShingle | Huanhuan Lv Xianqi Yan Hui Zhang Cuiping Shi Ruiqin Wang MLGFENet: Multiscale Local–Global Feature Enhancement Network for High-Resolution Remote Sensing Image Change Detection IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Change detection (CD) convolutional neural network (CNN) multiscale features remote sensing images transformer |
| title | MLGFENet: Multiscale Local–Global Feature Enhancement Network for High-Resolution Remote Sensing Image Change Detection |
| title_full | MLGFENet: Multiscale Local–Global Feature Enhancement Network for High-Resolution Remote Sensing Image Change Detection |
| title_fullStr | MLGFENet: Multiscale Local–Global Feature Enhancement Network for High-Resolution Remote Sensing Image Change Detection |
| title_full_unstemmed | MLGFENet: Multiscale Local–Global Feature Enhancement Network for High-Resolution Remote Sensing Image Change Detection |
| title_short | MLGFENet: Multiscale Local–Global Feature Enhancement Network for High-Resolution Remote Sensing Image Change Detection |
| title_sort | mlgfenet multiscale local x2013 global feature enhancement network for high resolution remote sensing image change detection |
| topic | Change detection (CD) convolutional neural network (CNN) multiscale features remote sensing images transformer |
| url | https://ieeexplore.ieee.org/document/11072321/ |
| work_keys_str_mv | AT huanhuanlv mlgfenetmultiscalelocalx2013globalfeatureenhancementnetworkforhighresolutionremotesensingimagechangedetection AT xianqiyan mlgfenetmultiscalelocalx2013globalfeatureenhancementnetworkforhighresolutionremotesensingimagechangedetection AT huizhang mlgfenetmultiscalelocalx2013globalfeatureenhancementnetworkforhighresolutionremotesensingimagechangedetection AT cuipingshi mlgfenetmultiscalelocalx2013globalfeatureenhancementnetworkforhighresolutionremotesensingimagechangedetection AT ruiqinwang mlgfenetmultiscalelocalx2013globalfeatureenhancementnetworkforhighresolutionremotesensingimagechangedetection |