Hyperspectral Image Reconstruction Based on Blur–Kernel–Prior and Spatial–Spectral Attention
Given the problem of spatial detail loss and spectral feature degradation in hyperspectral images (HSIs) characterized as blur, often caused by noise during image acquisition, and methods of removing blur noise designed on HSIs being insufficient, we propose an HSI reconstruction network based on a...
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-04-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/17/8/1401 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850180064896876544 |
|---|---|
| author | Hongyu Xie Mingyu Yang Huansong Huang Mingle Zhang Wei Zhang Qingbin Jiao Liang Xu Xin Tan |
| author_facet | Hongyu Xie Mingyu Yang Huansong Huang Mingle Zhang Wei Zhang Qingbin Jiao Liang Xu Xin Tan |
| author_sort | Hongyu Xie |
| collection | DOAJ |
| description | Given the problem of spatial detail loss and spectral feature degradation in hyperspectral images (HSIs) characterized as blur, often caused by noise during image acquisition, and methods of removing blur noise designed on HSIs being insufficient, we propose an HSI reconstruction network based on a Blur–Kernel–Prior (BKP) method and Spectral–Spatial Attention (SSA) strategy for noise removal and reconstruction of HSIs. Specifically, a grouping strategy is designed to segment the HSIs into spectral dimension sub-images, and the BKP module, based on U-Net, learns the spatially adaptive blur kernel to extract and remove blurred features from each sub-image while preserving spatial features with spatial resolution. Subsequently, the SSA block is employed to extract shallow features, details, and edge information using a hybrid 2D–3D convolution from the sub-images, followed by deep feature extraction using a deep ResNet and multi-head attention (MSA) on the merged image to maximize the preservation of spectral dimension information. The <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msub><mi>L</mi><mn>1</mn></msub></semantics></math></inline-formula> loss function, combined with spectral dimension loss and peak signal-to-noise ratio loss, is utilized to constrain and ensure reconstruction accuracy. Experiments on both synthetic and real datasets demonstrate that our method exhibits excellent performance in reconstructing HSIs affected by blurred noise, outperforming existing methods in terms of quantitative quality and recovery of spectral dimension information. |
| format | Article |
| id | doaj-art-8654abebb6284c549ce80c4ddfd6e252 |
| institution | OA Journals |
| issn | 2072-4292 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj-art-8654abebb6284c549ce80c4ddfd6e2522025-08-20T02:18:20ZengMDPI AGRemote Sensing2072-42922025-04-01178140110.3390/rs17081401Hyperspectral Image Reconstruction Based on Blur–Kernel–Prior and Spatial–Spectral AttentionHongyu Xie0Mingyu Yang1Huansong Huang2Mingle Zhang3Wei Zhang4Qingbin Jiao5Liang Xu6Xin Tan7Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaChangchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, ChinaGiven the problem of spatial detail loss and spectral feature degradation in hyperspectral images (HSIs) characterized as blur, often caused by noise during image acquisition, and methods of removing blur noise designed on HSIs being insufficient, we propose an HSI reconstruction network based on a Blur–Kernel–Prior (BKP) method and Spectral–Spatial Attention (SSA) strategy for noise removal and reconstruction of HSIs. Specifically, a grouping strategy is designed to segment the HSIs into spectral dimension sub-images, and the BKP module, based on U-Net, learns the spatially adaptive blur kernel to extract and remove blurred features from each sub-image while preserving spatial features with spatial resolution. Subsequently, the SSA block is employed to extract shallow features, details, and edge information using a hybrid 2D–3D convolution from the sub-images, followed by deep feature extraction using a deep ResNet and multi-head attention (MSA) on the merged image to maximize the preservation of spectral dimension information. The <inline-formula><math xmlns="http://www.w3.org/1998/Math/MathML" display="inline"><semantics><msub><mi>L</mi><mn>1</mn></msub></semantics></math></inline-formula> loss function, combined with spectral dimension loss and peak signal-to-noise ratio loss, is utilized to constrain and ensure reconstruction accuracy. Experiments on both synthetic and real datasets demonstrate that our method exhibits excellent performance in reconstructing HSIs affected by blurred noise, outperforming existing methods in terms of quantitative quality and recovery of spectral dimension information.https://www.mdpi.com/2072-4292/17/8/1401hyperspectral image reconstructionblur–kernel–prior denoisespectral–spatial attentiondeep learning |
| spellingShingle | Hongyu Xie Mingyu Yang Huansong Huang Mingle Zhang Wei Zhang Qingbin Jiao Liang Xu Xin Tan Hyperspectral Image Reconstruction Based on Blur–Kernel–Prior and Spatial–Spectral Attention Remote Sensing hyperspectral image reconstruction blur–kernel–prior denoise spectral–spatial attention deep learning |
| title | Hyperspectral Image Reconstruction Based on Blur–Kernel–Prior and Spatial–Spectral Attention |
| title_full | Hyperspectral Image Reconstruction Based on Blur–Kernel–Prior and Spatial–Spectral Attention |
| title_fullStr | Hyperspectral Image Reconstruction Based on Blur–Kernel–Prior and Spatial–Spectral Attention |
| title_full_unstemmed | Hyperspectral Image Reconstruction Based on Blur–Kernel–Prior and Spatial–Spectral Attention |
| title_short | Hyperspectral Image Reconstruction Based on Blur–Kernel–Prior and Spatial–Spectral Attention |
| title_sort | hyperspectral image reconstruction based on blur kernel prior and spatial spectral attention |
| topic | hyperspectral image reconstruction blur–kernel–prior denoise spectral–spatial attention deep learning |
| url | https://www.mdpi.com/2072-4292/17/8/1401 |
| work_keys_str_mv | AT hongyuxie hyperspectralimagereconstructionbasedonblurkernelpriorandspatialspectralattention AT mingyuyang hyperspectralimagereconstructionbasedonblurkernelpriorandspatialspectralattention AT huansonghuang hyperspectralimagereconstructionbasedonblurkernelpriorandspatialspectralattention AT minglezhang hyperspectralimagereconstructionbasedonblurkernelpriorandspatialspectralattention AT weizhang hyperspectralimagereconstructionbasedonblurkernelpriorandspatialspectralattention AT qingbinjiao hyperspectralimagereconstructionbasedonblurkernelpriorandspatialspectralattention AT liangxu hyperspectralimagereconstructionbasedonblurkernelpriorandspatialspectralattention AT xintan hyperspectralimagereconstructionbasedonblurkernelpriorandspatialspectralattention |