Multispectral image fusion method based on edge chromatic aberration
In multispectral image fusion, edge distortion, spectral loss, and geometric mismatch seriously affect the fusion accuracy, especially in complex road scenes with shadows or occlusions. Multispectral image fusion aims to preserve surface details and spectral data. In order to solve the problems of e...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Copernicus Publications
2025-07-01
|
| Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| Online Access: | https://isprs-archives.copernicus.org/articles/XLVIII-G-2025/1331/2025/isprs-archives-XLVIII-G-2025-1331-2025.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849706418082414592 |
|---|---|
| author | Y. Shi D. Qiu R. Wu R. Wu W. Niu Z. Wang |
| author_facet | Y. Shi D. Qiu R. Wu R. Wu W. Niu Z. Wang |
| author_sort | Y. Shi |
| collection | DOAJ |
| description | In multispectral image fusion, edge distortion, spectral loss, and geometric mismatch seriously affect the fusion accuracy, especially in complex road scenes with shadows or occlusions. Multispectral image fusion aims to preserve surface details and spectral data. In order to solve the problems of edge distortion and spectral loss in image fusion, this paper proposes a multispectral and hyperspectral fusion method based on edge chromatic aberration. Swin Transformer is used for multi-scale feature extraction, and the GRDB module is added to preserve edge details, which improves the clarity and accuracy of diseased edges in road scene fusion images. In addition, saliency weight mapping can identify and highlight key disease areas, ensuring that they are prominent in the fused image.<br />Experiments show that the multispectral image fusion method based on edge color difference significantly improves the performance of road damage analysis on the self-built BUCEA-MS-Road-Damage dataset: the edge IoU in the detection task is increased to 80.1% (+1.3%), and the target detection accuracy is 92.3% (+3.6%); the accuracy and recall of the classification task are increased to 91.3% (+3.0%) and 89.8% (+3.0%) respectively; the Dice coefficient of the segmentation task is 83.3% (+3.0%). In the cross-sensor test, the fusion result is still robust (SSIM=0.93, SAM=2.7°), and the edge color difference index (ECD-Index=6.3) is 25.9% lower than the baseline. This method effectively solves the problems of multi-scale feature extraction and texture distortion of cracks through adaptive color difference correction and spectral consistency constraints, providing high-precision data support for intelligent road maintenance. |
| format | Article |
| id | doaj-art-e37eeabba45245d98fe3090d002949aa |
| institution | DOAJ |
| issn | 1682-1750 2194-9034 |
| language | English |
| publishDate | 2025-07-01 |
| publisher | Copernicus Publications |
| record_format | Article |
| series | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| spelling | doaj-art-e37eeabba45245d98fe3090d002949aa2025-08-20T03:16:12ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342025-07-01XLVIII-G-20251331133710.5194/isprs-archives-XLVIII-G-2025-1331-2025Multispectral image fusion method based on edge chromatic aberrationY. Shi0D. Qiu1R. Wu2R. Wu3W. Niu4Z. Wang5School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing, ChinaSchool of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing, ChinaSurveying and Natural Resource Spatial Data Technology Wu Runze Studio, Beijing Institute of Surveying and Mapping Design and Research, Beijing, ChinaBeijing Skill Master Studio, Beijing, ChinaSchool of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing, ChinaSchool of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing, ChinaIn multispectral image fusion, edge distortion, spectral loss, and geometric mismatch seriously affect the fusion accuracy, especially in complex road scenes with shadows or occlusions. Multispectral image fusion aims to preserve surface details and spectral data. In order to solve the problems of edge distortion and spectral loss in image fusion, this paper proposes a multispectral and hyperspectral fusion method based on edge chromatic aberration. Swin Transformer is used for multi-scale feature extraction, and the GRDB module is added to preserve edge details, which improves the clarity and accuracy of diseased edges in road scene fusion images. In addition, saliency weight mapping can identify and highlight key disease areas, ensuring that they are prominent in the fused image.<br />Experiments show that the multispectral image fusion method based on edge color difference significantly improves the performance of road damage analysis on the self-built BUCEA-MS-Road-Damage dataset: the edge IoU in the detection task is increased to 80.1% (+1.3%), and the target detection accuracy is 92.3% (+3.6%); the accuracy and recall of the classification task are increased to 91.3% (+3.0%) and 89.8% (+3.0%) respectively; the Dice coefficient of the segmentation task is 83.3% (+3.0%). In the cross-sensor test, the fusion result is still robust (SSIM=0.93, SAM=2.7°), and the edge color difference index (ECD-Index=6.3) is 25.9% lower than the baseline. This method effectively solves the problems of multi-scale feature extraction and texture distortion of cracks through adaptive color difference correction and spectral consistency constraints, providing high-precision data support for intelligent road maintenance.https://isprs-archives.copernicus.org/articles/XLVIII-G-2025/1331/2025/isprs-archives-XLVIII-G-2025-1331-2025.pdf |
| spellingShingle | Y. Shi D. Qiu R. Wu R. Wu W. Niu Z. Wang Multispectral image fusion method based on edge chromatic aberration The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
| title | Multispectral image fusion method based on edge chromatic aberration |
| title_full | Multispectral image fusion method based on edge chromatic aberration |
| title_fullStr | Multispectral image fusion method based on edge chromatic aberration |
| title_full_unstemmed | Multispectral image fusion method based on edge chromatic aberration |
| title_short | Multispectral image fusion method based on edge chromatic aberration |
| title_sort | multispectral image fusion method based on edge chromatic aberration |
| url | https://isprs-archives.copernicus.org/articles/XLVIII-G-2025/1331/2025/isprs-archives-XLVIII-G-2025-1331-2025.pdf |
| work_keys_str_mv | AT yshi multispectralimagefusionmethodbasedonedgechromaticaberration AT dqiu multispectralimagefusionmethodbasedonedgechromaticaberration AT rwu multispectralimagefusionmethodbasedonedgechromaticaberration AT rwu multispectralimagefusionmethodbasedonedgechromaticaberration AT wniu multispectralimagefusionmethodbasedonedgechromaticaberration AT zwang multispectralimagefusionmethodbasedonedgechromaticaberration |