Real-Time Compensation for Unknown Image Displacement and Rotation in Infrared Multispectral Camera Push-Broom Imaging
Digital time-delay integration (TDI) enhances the signal-to-noise ratio (SNR) in infrared (IR) imaging, but its effectiveness in push-broom scanning is contingent upon maintaining a stable image shift velocity. Unpredictable image shifts and rotations, caused by carrier or scene movement, can affect...
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-03-01
|
| Series: | Remote Sensing |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2072-4292/17/7/1113 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849769399504863232 |
|---|---|
| author | Tongxu Zhang Guoliang Tang Shouzheng Zhu Fang Ding Wenli Wu Jindong Bai Chunlai Li Jianyu Wang |
| author_facet | Tongxu Zhang Guoliang Tang Shouzheng Zhu Fang Ding Wenli Wu Jindong Bai Chunlai Li Jianyu Wang |
| author_sort | Tongxu Zhang |
| collection | DOAJ |
| description | Digital time-delay integration (TDI) enhances the signal-to-noise ratio (SNR) in infrared (IR) imaging, but its effectiveness in push-broom scanning is contingent upon maintaining a stable image shift velocity. Unpredictable image shifts and rotations, caused by carrier or scene movement, can affect the imaging process. This paper proposes an advanced technical approach for infrared multispectral TDI imaging. This methodology concurrently estimates the image shift and rotation between frames by utilizing a high-resolution visible camera aligned parallel to the optical axis of the IR camera. Subsequently, parameter prediction is conducted using the Kalman model, and real-time compensation is achieved by dynamically adjusting the infrared TDI integration unit based on the predicted parameters. Simulation and experimental results demonstrate that the proposed algorithm enhances the BRISQUE score of the TDI images by 21.37%, thereby validating its efficacy in push-scan imaging systems characterized by velocity-height ratios instability and varying camera attitudes. This research constitutes a significant contribution to the advancement of high-precision real-time compensation for image shift and rotation in infrared remote sensing and industrial inspection applications. |
| format | Article |
| id | doaj-art-e380e4bd181a45b1b9b139dff654910b |
| institution | DOAJ |
| issn | 2072-4292 |
| language | English |
| publishDate | 2025-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Remote Sensing |
| spelling | doaj-art-e380e4bd181a45b1b9b139dff654910b2025-08-20T03:03:25ZengMDPI AGRemote Sensing2072-42922025-03-01177111310.3390/rs17071113Real-Time Compensation for Unknown Image Displacement and Rotation in Infrared Multispectral Camera Push-Broom ImagingTongxu Zhang0Guoliang Tang1Shouzheng Zhu2Fang Ding3Wenli Wu4Jindong Bai5Chunlai Li6Jianyu Wang7Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaHangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaHangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaHangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaHangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaHangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaHangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaHangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, ChinaDigital time-delay integration (TDI) enhances the signal-to-noise ratio (SNR) in infrared (IR) imaging, but its effectiveness in push-broom scanning is contingent upon maintaining a stable image shift velocity. Unpredictable image shifts and rotations, caused by carrier or scene movement, can affect the imaging process. This paper proposes an advanced technical approach for infrared multispectral TDI imaging. This methodology concurrently estimates the image shift and rotation between frames by utilizing a high-resolution visible camera aligned parallel to the optical axis of the IR camera. Subsequently, parameter prediction is conducted using the Kalman model, and real-time compensation is achieved by dynamically adjusting the infrared TDI integration unit based on the predicted parameters. Simulation and experimental results demonstrate that the proposed algorithm enhances the BRISQUE score of the TDI images by 21.37%, thereby validating its efficacy in push-scan imaging systems characterized by velocity-height ratios instability and varying camera attitudes. This research constitutes a significant contribution to the advancement of high-precision real-time compensation for image shift and rotation in infrared remote sensing and industrial inspection applications.https://www.mdpi.com/2072-4292/17/7/1113digital domain time-delay integrationimage shift compensationuncooled IR detectorattitude correctionvelocity-height ratioremote sensing and sensors |
| spellingShingle | Tongxu Zhang Guoliang Tang Shouzheng Zhu Fang Ding Wenli Wu Jindong Bai Chunlai Li Jianyu Wang Real-Time Compensation for Unknown Image Displacement and Rotation in Infrared Multispectral Camera Push-Broom Imaging Remote Sensing digital domain time-delay integration image shift compensation uncooled IR detector attitude correction velocity-height ratio remote sensing and sensors |
| title | Real-Time Compensation for Unknown Image Displacement and Rotation in Infrared Multispectral Camera Push-Broom Imaging |
| title_full | Real-Time Compensation for Unknown Image Displacement and Rotation in Infrared Multispectral Camera Push-Broom Imaging |
| title_fullStr | Real-Time Compensation for Unknown Image Displacement and Rotation in Infrared Multispectral Camera Push-Broom Imaging |
| title_full_unstemmed | Real-Time Compensation for Unknown Image Displacement and Rotation in Infrared Multispectral Camera Push-Broom Imaging |
| title_short | Real-Time Compensation for Unknown Image Displacement and Rotation in Infrared Multispectral Camera Push-Broom Imaging |
| title_sort | real time compensation for unknown image displacement and rotation in infrared multispectral camera push broom imaging |
| topic | digital domain time-delay integration image shift compensation uncooled IR detector attitude correction velocity-height ratio remote sensing and sensors |
| url | https://www.mdpi.com/2072-4292/17/7/1113 |
| work_keys_str_mv | AT tongxuzhang realtimecompensationforunknownimagedisplacementandrotationininfraredmultispectralcamerapushbroomimaging AT guoliangtang realtimecompensationforunknownimagedisplacementandrotationininfraredmultispectralcamerapushbroomimaging AT shouzhengzhu realtimecompensationforunknownimagedisplacementandrotationininfraredmultispectralcamerapushbroomimaging AT fangding realtimecompensationforunknownimagedisplacementandrotationininfraredmultispectralcamerapushbroomimaging AT wenliwu realtimecompensationforunknownimagedisplacementandrotationininfraredmultispectralcamerapushbroomimaging AT jindongbai realtimecompensationforunknownimagedisplacementandrotationininfraredmultispectralcamerapushbroomimaging AT chunlaili realtimecompensationforunknownimagedisplacementandrotationininfraredmultispectralcamerapushbroomimaging AT jianyuwang realtimecompensationforunknownimagedisplacementandrotationininfraredmultispectralcamerapushbroomimaging |