Pixel-Based Long-Wave Infrared Spectral Image Reconstruction Using a Hierarchical Spectral Transformer
Long-wave infrared (LWIR) spectral imaging plays a critical role in various applications such as gas monitoring, mineral exploration, and fire detection. Recent advancements in computational spectral imaging, powered by advanced algorithms, have enabled the acquisition of high-quality spectral image...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-11-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/24/23/7658 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849220422080397312 |
|---|---|
| author | Zi Wang Yang Yang Liyin Yuan Chunlai Li Jianyu Wang |
| author_facet | Zi Wang Yang Yang Liyin Yuan Chunlai Li Jianyu Wang |
| author_sort | Zi Wang |
| collection | DOAJ |
| description | Long-wave infrared (LWIR) spectral imaging plays a critical role in various applications such as gas monitoring, mineral exploration, and fire detection. Recent advancements in computational spectral imaging, powered by advanced algorithms, have enabled the acquisition of high-quality spectral images in real time, such as with the Uncooled Snapshot Infrared Spectrometer (USIRS). However, the USIRS system faces challenges, particularly a low spectral resolution and large amount of data noise, which can degrade the image quality. Deep learning has emerged as a promising solution to these challenges, as it is particularly effective at handling noisy data and has demonstrated significant success in hyperspectral imaging tasks. Nevertheless, the application of deep learning in LWIR imaging is hindered by the severe scarcity of long-wave hyperspectral image data, which limits the training of robust models. Moreover, existing networks that rely on convolutional layers or attention mechanisms struggle to effectively capture both local and global spectral correlations. To address these limitations, we propose the pixel-based Hierarchical Spectral Transformer (HST), a novel deep learning architecture that learns from publicly available single-pixel long-wave infrared spectral databases. The HST is designed to achieve a high spectral resolution for LWIR spectral image reconstruction, enhancing both the local and global contextual understanding of the spectral data. We evaluated the performance of the proposed method on both simulated and real-world LWIR data, demonstrating the robustness and effectiveness of the HST in improving the spectral resolution and mitigating noise, even with limited data. |
| format | Article |
| id | doaj-art-4df70eca10494d32b7cb80d4bba5722e |
| institution | Kabale University |
| issn | 1424-8220 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj-art-4df70eca10494d32b7cb80d4bba5722e2024-12-13T16:32:20ZengMDPI AGSensors1424-82202024-11-012423765810.3390/s24237658Pixel-Based Long-Wave Infrared Spectral Image Reconstruction Using a Hierarchical Spectral TransformerZi Wang0Yang Yang1Liyin Yuan2Chunlai Li3Jianyu Wang4Key Laboratory of Space Active Opto-Electronics Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, ChinaKey Laboratory of Space Active Opto-Electronics Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, ChinaKey Laboratory of Space Active Opto-Electronics Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, ChinaKey Laboratory of Space Active Opto-Electronics Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, ChinaKey Laboratory of Space Active Opto-Electronics Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, ChinaLong-wave infrared (LWIR) spectral imaging plays a critical role in various applications such as gas monitoring, mineral exploration, and fire detection. Recent advancements in computational spectral imaging, powered by advanced algorithms, have enabled the acquisition of high-quality spectral images in real time, such as with the Uncooled Snapshot Infrared Spectrometer (USIRS). However, the USIRS system faces challenges, particularly a low spectral resolution and large amount of data noise, which can degrade the image quality. Deep learning has emerged as a promising solution to these challenges, as it is particularly effective at handling noisy data and has demonstrated significant success in hyperspectral imaging tasks. Nevertheless, the application of deep learning in LWIR imaging is hindered by the severe scarcity of long-wave hyperspectral image data, which limits the training of robust models. Moreover, existing networks that rely on convolutional layers or attention mechanisms struggle to effectively capture both local and global spectral correlations. To address these limitations, we propose the pixel-based Hierarchical Spectral Transformer (HST), a novel deep learning architecture that learns from publicly available single-pixel long-wave infrared spectral databases. The HST is designed to achieve a high spectral resolution for LWIR spectral image reconstruction, enhancing both the local and global contextual understanding of the spectral data. We evaluated the performance of the proposed method on both simulated and real-world LWIR data, demonstrating the robustness and effectiveness of the HST in improving the spectral resolution and mitigating noise, even with limited data.https://www.mdpi.com/1424-8220/24/23/7658spectral reconstructionlong-wave infraredthermal infraredspectral imagingdeep learningtransformer |
| spellingShingle | Zi Wang Yang Yang Liyin Yuan Chunlai Li Jianyu Wang Pixel-Based Long-Wave Infrared Spectral Image Reconstruction Using a Hierarchical Spectral Transformer Sensors spectral reconstruction long-wave infrared thermal infrared spectral imaging deep learning transformer |
| title | Pixel-Based Long-Wave Infrared Spectral Image Reconstruction Using a Hierarchical Spectral Transformer |
| title_full | Pixel-Based Long-Wave Infrared Spectral Image Reconstruction Using a Hierarchical Spectral Transformer |
| title_fullStr | Pixel-Based Long-Wave Infrared Spectral Image Reconstruction Using a Hierarchical Spectral Transformer |
| title_full_unstemmed | Pixel-Based Long-Wave Infrared Spectral Image Reconstruction Using a Hierarchical Spectral Transformer |
| title_short | Pixel-Based Long-Wave Infrared Spectral Image Reconstruction Using a Hierarchical Spectral Transformer |
| title_sort | pixel based long wave infrared spectral image reconstruction using a hierarchical spectral transformer |
| topic | spectral reconstruction long-wave infrared thermal infrared spectral imaging deep learning transformer |
| url | https://www.mdpi.com/1424-8220/24/23/7658 |
| work_keys_str_mv | AT ziwang pixelbasedlongwaveinfraredspectralimagereconstructionusingahierarchicalspectraltransformer AT yangyang pixelbasedlongwaveinfraredspectralimagereconstructionusingahierarchicalspectraltransformer AT liyinyuan pixelbasedlongwaveinfraredspectralimagereconstructionusingahierarchicalspectraltransformer AT chunlaili pixelbasedlongwaveinfraredspectralimagereconstructionusingahierarchicalspectraltransformer AT jianyuwang pixelbasedlongwaveinfraredspectralimagereconstructionusingahierarchicalspectraltransformer |