Multi-Scale Feature Mixed Attention Network for Cloud and Snow Segmentation in Remote Sensing Images
The coexistence of cloud and snow is very common in remote sensing images. It presents persistent challenges for automated interpretation systems, primarily due to their highly similar visible light spectral characteristic in optical remote sensing images. This intrinsic spectral ambiguity significa...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-05-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/17/11/1872 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849722462137221120 |
|---|---|
| author | Liling Zhao Junyu Chen Zichen Liao Feng Shi |
| author_facet | Liling Zhao Junyu Chen Zichen Liao Feng Shi |
| author_sort | Liling Zhao |
| collection | DOAJ |
| description | The coexistence of cloud and snow is very common in remote sensing images. It presents persistent challenges for automated interpretation systems, primarily due to their highly similar visible light spectral characteristic in optical remote sensing images. This intrinsic spectral ambiguity significantly impedes accurate cloud and snow segmentation tasks, particularly in delineating fine boundary features between cloud and snow regions. Much research on cloud and snow segmentation based on deep learning models has been conducted, but there are still deficiencies in the extraction of fine boundaries between cloud and snow regions. In addition, existing segmentation models often misjudge the body of clouds and snow with similar features. This work proposes a Multi-scale Feature Mixed Attention Network (MFMANet). The framework integrates three key components: (1) a Multi-scale Pooling Feature Perception Module to capture multi-level structural features, (2) a Bilateral Feature Mixed Attention Module that enhances boundary detection through spatial-channel attention, and (3) a Multi-scale Feature Convolution Fusion Module to reduce edge blurring. We opted to test the model using a high-resolution cloud and snow dataset based on WorldView2 (CSWV). This dataset contains high-resolution images of cloud and snow, which can meet the training and testing requirements of cloud and snow segmentation tasks. Based on this dataset, we compare MFMANet with other classical deep learning segmentation algorithms. The experimental results show that the MFMANet network has better segmentation accuracy and robustness. Specifically, the average MIoU of the MFMANet network is 89.17%, and the accuracy is about 0.9% higher than CSDNet and about 0.7% higher than UNet. Further verification on the HRC_WHU dataset shows that the MIoU of the proposed model can reach 91.03%, and the performance is also superior to other compared segmentation methods. |
| format | Article |
| id | doaj-art-4e44a354708149e6b7872727052f2f1d |
| institution | DOAJ |
| issn | 2072-4292 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj-art-4e44a354708149e6b7872727052f2f1d2025-08-20T03:11:20ZengMDPI AGRemote Sensing2072-42922025-05-011711187210.3390/rs17111872Multi-Scale Feature Mixed Attention Network for Cloud and Snow Segmentation in Remote Sensing ImagesLiling Zhao0Junyu Chen1Zichen Liao2Feng Shi3School of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, ChinaSchool of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, ChinaSchool of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, ChinaSchool of Automation, Nanjing University of Information Science and Technology, Nanjing 210044, ChinaThe coexistence of cloud and snow is very common in remote sensing images. It presents persistent challenges for automated interpretation systems, primarily due to their highly similar visible light spectral characteristic in optical remote sensing images. This intrinsic spectral ambiguity significantly impedes accurate cloud and snow segmentation tasks, particularly in delineating fine boundary features between cloud and snow regions. Much research on cloud and snow segmentation based on deep learning models has been conducted, but there are still deficiencies in the extraction of fine boundaries between cloud and snow regions. In addition, existing segmentation models often misjudge the body of clouds and snow with similar features. This work proposes a Multi-scale Feature Mixed Attention Network (MFMANet). The framework integrates three key components: (1) a Multi-scale Pooling Feature Perception Module to capture multi-level structural features, (2) a Bilateral Feature Mixed Attention Module that enhances boundary detection through spatial-channel attention, and (3) a Multi-scale Feature Convolution Fusion Module to reduce edge blurring. We opted to test the model using a high-resolution cloud and snow dataset based on WorldView2 (CSWV). This dataset contains high-resolution images of cloud and snow, which can meet the training and testing requirements of cloud and snow segmentation tasks. Based on this dataset, we compare MFMANet with other classical deep learning segmentation algorithms. The experimental results show that the MFMANet network has better segmentation accuracy and robustness. Specifically, the average MIoU of the MFMANet network is 89.17%, and the accuracy is about 0.9% higher than CSDNet and about 0.7% higher than UNet. Further verification on the HRC_WHU dataset shows that the MIoU of the proposed model can reach 91.03%, and the performance is also superior to other compared segmentation methods.https://www.mdpi.com/2072-4292/17/11/1872remote sensingsegmentationdeep learningattention mechanism |
| spellingShingle | Liling Zhao Junyu Chen Zichen Liao Feng Shi Multi-Scale Feature Mixed Attention Network for Cloud and Snow Segmentation in Remote Sensing Images Remote Sensing remote sensing segmentation deep learning attention mechanism |
| title | Multi-Scale Feature Mixed Attention Network for Cloud and Snow Segmentation in Remote Sensing Images |
| title_full | Multi-Scale Feature Mixed Attention Network for Cloud and Snow Segmentation in Remote Sensing Images |
| title_fullStr | Multi-Scale Feature Mixed Attention Network for Cloud and Snow Segmentation in Remote Sensing Images |
| title_full_unstemmed | Multi-Scale Feature Mixed Attention Network for Cloud and Snow Segmentation in Remote Sensing Images |
| title_short | Multi-Scale Feature Mixed Attention Network for Cloud and Snow Segmentation in Remote Sensing Images |
| title_sort | multi scale feature mixed attention network for cloud and snow segmentation in remote sensing images |
| topic | remote sensing segmentation deep learning attention mechanism |
| url | https://www.mdpi.com/2072-4292/17/11/1872 |
| work_keys_str_mv | AT lilingzhao multiscalefeaturemixedattentionnetworkforcloudandsnowsegmentationinremotesensingimages AT junyuchen multiscalefeaturemixedattentionnetworkforcloudandsnowsegmentationinremotesensingimages AT zichenliao multiscalefeaturemixedattentionnetworkforcloudandsnowsegmentationinremotesensingimages AT fengshi multiscalefeaturemixedattentionnetworkforcloudandsnowsegmentationinremotesensingimages |