Onboard Real-Time Hyperspectral Image Processing System Design for Unmanned Aerial Vehicles
This study proposes and implements a dual-processor FPGA-ARM architecture to resolve the critical contradiction between massive data volumes and real-time processing demands in UAV-borne hyperspectral imaging. The integrated system incorporates a shortwave infrared hyperspectral camera, IMU, control...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-08-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/25/15/4822 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849406184594866176 |
|---|---|
| author | Ruifan Yang Min Huang Wenhao Zhao Zixuan Zhang Yan Sun Lulu Qian Zhanchao Wang |
| author_facet | Ruifan Yang Min Huang Wenhao Zhao Zixuan Zhang Yan Sun Lulu Qian Zhanchao Wang |
| author_sort | Ruifan Yang |
| collection | DOAJ |
| description | This study proposes and implements a dual-processor FPGA-ARM architecture to resolve the critical contradiction between massive data volumes and real-time processing demands in UAV-borne hyperspectral imaging. The integrated system incorporates a shortwave infrared hyperspectral camera, IMU, control module, heterogeneous computing core, and SATA SSD storage. Through hardware-level task partitioning—utilizing FPGA for high-speed data buffering and ARM for core computational processing—it achieves a real-time end-to-end acquisition–storage–processing–display pipeline. The compact integrated device exhibits a total weight of merely 6 kg and power consumption of 40 W, suitable for airborne platforms. Experimental validation confirms the system’s capability to store over 200 frames per second (at 640 × 270 resolution, matching the camera’s maximum frame rate), quick-look imaging capability, and demonstrated real-time processing efficacy via relative radio-metric correction tasks (processing 5000 image frames within 1000 ms). This framework provides an effective technical solution to address hyperspectral data processing bottlenecks more efficiently on UAV platforms for dynamic scenario applications. Future work includes actual flight deployment to verify performance in operational environments. |
| format | Article |
| id | doaj-art-4eac3cf484ec43de87ccfbc6fe28faa4 |
| institution | Kabale University |
| issn | 1424-8220 |
| language | English |
| publishDate | 2025-08-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj-art-4eac3cf484ec43de87ccfbc6fe28faa42025-08-20T03:36:30ZengMDPI AGSensors1424-82202025-08-012515482210.3390/s25154822Onboard Real-Time Hyperspectral Image Processing System Design for Unmanned Aerial VehiclesRuifan Yang0Min Huang1Wenhao Zhao2Zixuan Zhang3Yan Sun4Lulu Qian5Zhanchao Wang6Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, ChinaAerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, ChinaAerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, ChinaAerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, ChinaAerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, ChinaAerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, ChinaAerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100094, ChinaThis study proposes and implements a dual-processor FPGA-ARM architecture to resolve the critical contradiction between massive data volumes and real-time processing demands in UAV-borne hyperspectral imaging. The integrated system incorporates a shortwave infrared hyperspectral camera, IMU, control module, heterogeneous computing core, and SATA SSD storage. Through hardware-level task partitioning—utilizing FPGA for high-speed data buffering and ARM for core computational processing—it achieves a real-time end-to-end acquisition–storage–processing–display pipeline. The compact integrated device exhibits a total weight of merely 6 kg and power consumption of 40 W, suitable for airborne platforms. Experimental validation confirms the system’s capability to store over 200 frames per second (at 640 × 270 resolution, matching the camera’s maximum frame rate), quick-look imaging capability, and demonstrated real-time processing efficacy via relative radio-metric correction tasks (processing 5000 image frames within 1000 ms). This framework provides an effective technical solution to address hyperspectral data processing bottlenecks more efficiently on UAV platforms for dynamic scenario applications. Future work includes actual flight deployment to verify performance in operational environments.https://www.mdpi.com/1424-8220/25/15/4822hyperspectralonboardreal-time processingFPGA-ARMembedded system |
| spellingShingle | Ruifan Yang Min Huang Wenhao Zhao Zixuan Zhang Yan Sun Lulu Qian Zhanchao Wang Onboard Real-Time Hyperspectral Image Processing System Design for Unmanned Aerial Vehicles Sensors hyperspectral onboard real-time processing FPGA-ARM embedded system |
| title | Onboard Real-Time Hyperspectral Image Processing System Design for Unmanned Aerial Vehicles |
| title_full | Onboard Real-Time Hyperspectral Image Processing System Design for Unmanned Aerial Vehicles |
| title_fullStr | Onboard Real-Time Hyperspectral Image Processing System Design for Unmanned Aerial Vehicles |
| title_full_unstemmed | Onboard Real-Time Hyperspectral Image Processing System Design for Unmanned Aerial Vehicles |
| title_short | Onboard Real-Time Hyperspectral Image Processing System Design for Unmanned Aerial Vehicles |
| title_sort | onboard real time hyperspectral image processing system design for unmanned aerial vehicles |
| topic | hyperspectral onboard real-time processing FPGA-ARM embedded system |
| url | https://www.mdpi.com/1424-8220/25/15/4822 |
| work_keys_str_mv | AT ruifanyang onboardrealtimehyperspectralimageprocessingsystemdesignforunmannedaerialvehicles AT minhuang onboardrealtimehyperspectralimageprocessingsystemdesignforunmannedaerialvehicles AT wenhaozhao onboardrealtimehyperspectralimageprocessingsystemdesignforunmannedaerialvehicles AT zixuanzhang onboardrealtimehyperspectralimageprocessingsystemdesignforunmannedaerialvehicles AT yansun onboardrealtimehyperspectralimageprocessingsystemdesignforunmannedaerialvehicles AT luluqian onboardrealtimehyperspectralimageprocessingsystemdesignforunmannedaerialvehicles AT zhanchaowang onboardrealtimehyperspectralimageprocessingsystemdesignforunmannedaerialvehicles |