SpectraTrack: megapixel, hundred-fps, and thousand-channel hyperspectral imaging
Abstract Hyperspectral imaging (HSI) finds broad applications in various fields due to its substantial optical signatures for the intrinsic identification of physical and chemical characteristics. However, it faces the inherent challenge of balancing spatial, temporal, and spectral resolution due to...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2024-11-01
|
| Series: | Nature Communications |
| Online Access: | https://doi.org/10.1038/s41467-024-53747-8 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850179240463433728 |
|---|---|
| author | Daoyu Li Jinxuan Wu Jiajun Zhao Hanwen Xu Liheng Bian |
| author_facet | Daoyu Li Jinxuan Wu Jiajun Zhao Hanwen Xu Liheng Bian |
| author_sort | Daoyu Li |
| collection | DOAJ |
| description | Abstract Hyperspectral imaging (HSI) finds broad applications in various fields due to its substantial optical signatures for the intrinsic identification of physical and chemical characteristics. However, it faces the inherent challenge of balancing spatial, temporal, and spectral resolution due to limited bandwidth. Here we present SpectraTrack, a computational HSI scheme that simultaneously achieves high spatial, temporal, and spectral resolution in the visible-to-near-infrared (VIS-NIR) spectral range. We deeply investigated the spatio-temporal-spectral multiplexing principle inherent in HSI videos. Based on this theoretical foundation, the SpectraTrack system uses two cameras including a line-scan imaging spectrometer for temporal-multiplexed hyperspectral data and an auxiliary RGB camera to capture motion flow. The motion flow guides hyperspectral reconstruction by reintegrating the scanned spectra into a 4D video. The SpectraTrack system can achieve around megapixel HSI at 100 fps with 1200 spectral channels, demonstrating its great application potential from drone-based anti-vibration video-rate HSI to high-throughput non-cooperative anti-spoofing. |
| format | Article |
| id | doaj-art-87bed799279d44deb29edf1b6728ec5c |
| institution | OA Journals |
| issn | 2041-1723 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Nature Communications |
| spelling | doaj-art-87bed799279d44deb29edf1b6728ec5c2025-08-20T02:18:33ZengNature PortfolioNature Communications2041-17232024-11-0115111010.1038/s41467-024-53747-8SpectraTrack: megapixel, hundred-fps, and thousand-channel hyperspectral imagingDaoyu Li0Jinxuan Wu1Jiajun Zhao2Hanwen Xu3Liheng Bian4State Key Laboratory of CNS/ATM & MIIT Key Laboratory of Complex-field Intelligent Sensing, Beijing Institute of TechnologyState Key Laboratory of CNS/ATM & MIIT Key Laboratory of Complex-field Intelligent Sensing, Beijing Institute of TechnologyState Key Laboratory of CNS/ATM & MIIT Key Laboratory of Complex-field Intelligent Sensing, Beijing Institute of TechnologyState Key Laboratory of CNS/ATM & MIIT Key Laboratory of Complex-field Intelligent Sensing, Beijing Institute of TechnologyState Key Laboratory of CNS/ATM & MIIT Key Laboratory of Complex-field Intelligent Sensing, Beijing Institute of TechnologyAbstract Hyperspectral imaging (HSI) finds broad applications in various fields due to its substantial optical signatures for the intrinsic identification of physical and chemical characteristics. However, it faces the inherent challenge of balancing spatial, temporal, and spectral resolution due to limited bandwidth. Here we present SpectraTrack, a computational HSI scheme that simultaneously achieves high spatial, temporal, and spectral resolution in the visible-to-near-infrared (VIS-NIR) spectral range. We deeply investigated the spatio-temporal-spectral multiplexing principle inherent in HSI videos. Based on this theoretical foundation, the SpectraTrack system uses two cameras including a line-scan imaging spectrometer for temporal-multiplexed hyperspectral data and an auxiliary RGB camera to capture motion flow. The motion flow guides hyperspectral reconstruction by reintegrating the scanned spectra into a 4D video. The SpectraTrack system can achieve around megapixel HSI at 100 fps with 1200 spectral channels, demonstrating its great application potential from drone-based anti-vibration video-rate HSI to high-throughput non-cooperative anti-spoofing.https://doi.org/10.1038/s41467-024-53747-8 |
| spellingShingle | Daoyu Li Jinxuan Wu Jiajun Zhao Hanwen Xu Liheng Bian SpectraTrack: megapixel, hundred-fps, and thousand-channel hyperspectral imaging Nature Communications |
| title | SpectraTrack: megapixel, hundred-fps, and thousand-channel hyperspectral imaging |
| title_full | SpectraTrack: megapixel, hundred-fps, and thousand-channel hyperspectral imaging |
| title_fullStr | SpectraTrack: megapixel, hundred-fps, and thousand-channel hyperspectral imaging |
| title_full_unstemmed | SpectraTrack: megapixel, hundred-fps, and thousand-channel hyperspectral imaging |
| title_short | SpectraTrack: megapixel, hundred-fps, and thousand-channel hyperspectral imaging |
| title_sort | spectratrack megapixel hundred fps and thousand channel hyperspectral imaging |
| url | https://doi.org/10.1038/s41467-024-53747-8 |
| work_keys_str_mv | AT daoyuli spectratrackmegapixelhundredfpsandthousandchannelhyperspectralimaging AT jinxuanwu spectratrackmegapixelhundredfpsandthousandchannelhyperspectralimaging AT jiajunzhao spectratrackmegapixelhundredfpsandthousandchannelhyperspectralimaging AT hanwenxu spectratrackmegapixelhundredfpsandthousandchannelhyperspectralimaging AT lihengbian spectratrackmegapixelhundredfpsandthousandchannelhyperspectralimaging |