A LiDAR - camera fusion detection method based on weight allocation
In automatic driving target detection problem, the neural network is applied to two methods, vision, and LiDAR. These two methods have some relatively mature models based on neural networks. Combining the two to complement each other has become a hot topic. At present, most autonomous driving sensor...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
EDP Sciences
2025-01-01
|
| Series: | ITM Web of Conferences |
| Online Access: | https://www.itm-conferences.org/articles/itmconf/pdf/2025/01/itmconf_dai2024_01009.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1825206541970571264 |
|---|---|
| author | Kang Haotian Wang Tianshu |
| author_facet | Kang Haotian Wang Tianshu |
| author_sort | Kang Haotian |
| collection | DOAJ |
| description | In automatic driving target detection problem, the neural network is applied to two methods, vision, and LiDAR. These two methods have some relatively mature models based on neural networks. Combining the two to complement each other has become a hot topic. At present, most autonomous driving sensor fusion methods focus on fusion strategy and feature alignment, and there are few studies on the weight ratio of the two sensors after fusion in different environments. In this paper, a fusion target detection model of camera and LiDAR is proposed based on the weighted weight allocation method. The weighted fusion method is adopted, image feature points are extracted by Fast RCNN, and then LiDAR point cloud data is fused into the model by the weighted method, environment variables are introduced, and different weight allocation methods are output under different environments through full connection layer preprocessing. The results on the Nuscenes dataset show that compared with the results without weight assignment, the model can effectively achieve targeted weight assignment in different situations, and the performance is due to the single-sensor method. |
| format | Article |
| id | doaj-art-0e0443bd808948c8aa49cb0c41efc5b7 |
| institution | Kabale University |
| issn | 2271-2097 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | EDP Sciences |
| record_format | Article |
| series | ITM Web of Conferences |
| spelling | doaj-art-0e0443bd808948c8aa49cb0c41efc5b72025-02-07T08:21:10ZengEDP SciencesITM Web of Conferences2271-20972025-01-01700100910.1051/itmconf/20257001009itmconf_dai2024_01009A LiDAR - camera fusion detection method based on weight allocationKang Haotian0Wang Tianshu1The Graduate School, Northwestern UniversityThe Graduate School, Northwestern UniversityIn automatic driving target detection problem, the neural network is applied to two methods, vision, and LiDAR. These two methods have some relatively mature models based on neural networks. Combining the two to complement each other has become a hot topic. At present, most autonomous driving sensor fusion methods focus on fusion strategy and feature alignment, and there are few studies on the weight ratio of the two sensors after fusion in different environments. In this paper, a fusion target detection model of camera and LiDAR is proposed based on the weighted weight allocation method. The weighted fusion method is adopted, image feature points are extracted by Fast RCNN, and then LiDAR point cloud data is fused into the model by the weighted method, environment variables are introduced, and different weight allocation methods are output under different environments through full connection layer preprocessing. The results on the Nuscenes dataset show that compared with the results without weight assignment, the model can effectively achieve targeted weight assignment in different situations, and the performance is due to the single-sensor method.https://www.itm-conferences.org/articles/itmconf/pdf/2025/01/itmconf_dai2024_01009.pdf |
| spellingShingle | Kang Haotian Wang Tianshu A LiDAR - camera fusion detection method based on weight allocation ITM Web of Conferences |
| title | A LiDAR - camera fusion detection method based on weight allocation |
| title_full | A LiDAR - camera fusion detection method based on weight allocation |
| title_fullStr | A LiDAR - camera fusion detection method based on weight allocation |
| title_full_unstemmed | A LiDAR - camera fusion detection method based on weight allocation |
| title_short | A LiDAR - camera fusion detection method based on weight allocation |
| title_sort | lidar camera fusion detection method based on weight allocation |
| url | https://www.itm-conferences.org/articles/itmconf/pdf/2025/01/itmconf_dai2024_01009.pdf |
| work_keys_str_mv | AT kanghaotian alidarcamerafusiondetectionmethodbasedonweightallocation AT wangtianshu alidarcamerafusiondetectionmethodbasedonweightallocation AT kanghaotian lidarcamerafusiondetectionmethodbasedonweightallocation AT wangtianshu lidarcamerafusiondetectionmethodbasedonweightallocation |