Efficient Hyperspectral Video Reconstruction via Dual-Channel DMD Encoding
Hyperspectral video acquisition requires a precise balance between spectral and temporal resolution, often achieved through compressive sampling using two-dimensional detectors and spectral reconstruction algorithms. However, the reliance on spatial light modulators for coding reduces optical effici...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-01-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/17/2/190 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832587611934294016 |
|---|---|
| author | Mingming Ma Yi Niu Dahua Gao Fu Li Guangming Shi |
| author_facet | Mingming Ma Yi Niu Dahua Gao Fu Li Guangming Shi |
| author_sort | Mingming Ma |
| collection | DOAJ |
| description | Hyperspectral video acquisition requires a precise balance between spectral and temporal resolution, often achieved through compressive sampling using two-dimensional detectors and spectral reconstruction algorithms. However, the reliance on spatial light modulators for coding reduces optical efficiency, while complex recovery algorithms hinder real-time reconstruction. To address these challenges, we propose a digital-micromirror-device-based complementary dual-channel hyperspectral (DMD-CDH) video imaging system. This system employs a DMD for simultaneous light splitting and spatial encoding, enabling one channel to perform non-aliasing spectral sampling at lower frame rates while the other provides complementary high-rate sampling for panchromatic video. Featuring high optical throughput and efficient complementary sampling, the system ensures reliable hyperspectral video reconstruction and serves as a robust ground-based validation platform for remote sensing applications. Additionally, we introduce tailored optical error calibration and fixation techniques alongside a lightweight hyperspectral fusion network for reconstruction, achieving hyperspectral frame rates exceeding 30 fps. Compared to the existing models, this system simplifies the calibration process and provides a practical high-performance solution for real-time hyperspectral video imaging. |
| format | Article |
| id | doaj-art-f8f1606d5f7c4b43997a482d2590b110 |
| institution | Kabale University |
| issn | 2072-4292 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj-art-f8f1606d5f7c4b43997a482d2590b1102025-01-24T13:47:40ZengMDPI AGRemote Sensing2072-42922025-01-0117219010.3390/rs17020190Efficient Hyperspectral Video Reconstruction via Dual-Channel DMD EncodingMingming Ma0Yi Niu1Dahua Gao2Fu Li3Guangming Shi4School of Artificial Intelligence, Xidian University, Xi’an 710071, ChinaSchool of Artificial Intelligence, Xidian University, Xi’an 710071, ChinaSchool of Artificial Intelligence, Xidian University, Xi’an 710071, ChinaSchool of Artificial Intelligence, Xidian University, Xi’an 710071, ChinaSchool of Artificial Intelligence, Xidian University, Xi’an 710071, ChinaHyperspectral video acquisition requires a precise balance between spectral and temporal resolution, often achieved through compressive sampling using two-dimensional detectors and spectral reconstruction algorithms. However, the reliance on spatial light modulators for coding reduces optical efficiency, while complex recovery algorithms hinder real-time reconstruction. To address these challenges, we propose a digital-micromirror-device-based complementary dual-channel hyperspectral (DMD-CDH) video imaging system. This system employs a DMD for simultaneous light splitting and spatial encoding, enabling one channel to perform non-aliasing spectral sampling at lower frame rates while the other provides complementary high-rate sampling for panchromatic video. Featuring high optical throughput and efficient complementary sampling, the system ensures reliable hyperspectral video reconstruction and serves as a robust ground-based validation platform for remote sensing applications. Additionally, we introduce tailored optical error calibration and fixation techniques alongside a lightweight hyperspectral fusion network for reconstruction, achieving hyperspectral frame rates exceeding 30 fps. Compared to the existing models, this system simplifies the calibration process and provides a practical high-performance solution for real-time hyperspectral video imaging.https://www.mdpi.com/2072-4292/17/2/190hyperspectral imagespectral videodigital micromirror device (DMD)fusion network |
| spellingShingle | Mingming Ma Yi Niu Dahua Gao Fu Li Guangming Shi Efficient Hyperspectral Video Reconstruction via Dual-Channel DMD Encoding Remote Sensing hyperspectral image spectral video digital micromirror device (DMD) fusion network |
| title | Efficient Hyperspectral Video Reconstruction via Dual-Channel DMD Encoding |
| title_full | Efficient Hyperspectral Video Reconstruction via Dual-Channel DMD Encoding |
| title_fullStr | Efficient Hyperspectral Video Reconstruction via Dual-Channel DMD Encoding |
| title_full_unstemmed | Efficient Hyperspectral Video Reconstruction via Dual-Channel DMD Encoding |
| title_short | Efficient Hyperspectral Video Reconstruction via Dual-Channel DMD Encoding |
| title_sort | efficient hyperspectral video reconstruction via dual channel dmd encoding |
| topic | hyperspectral image spectral video digital micromirror device (DMD) fusion network |
| url | https://www.mdpi.com/2072-4292/17/2/190 |
| work_keys_str_mv | AT mingmingma efficienthyperspectralvideoreconstructionviadualchanneldmdencoding AT yiniu efficienthyperspectralvideoreconstructionviadualchanneldmdencoding AT dahuagao efficienthyperspectralvideoreconstructionviadualchanneldmdencoding AT fuli efficienthyperspectralvideoreconstructionviadualchanneldmdencoding AT guangmingshi efficienthyperspectralvideoreconstructionviadualchanneldmdencoding |