DelAwareCol: Delay Aware Collaborative Perception
Multi-agent collaborative perception has gained significant attention due to its ability to overcome the challenges stemming from the limited line-of-sight visibility of individual agents that raised safety concerns for autonomous navigation. Despite notable progress in collaborative perception, sev...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Open Journal of Vehicular Technology |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10946103/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850275969599799296 |
|---|---|
| author | Ahmed N. Ahmed Siegfried Mercelis Ali Anwar |
| author_facet | Ahmed N. Ahmed Siegfried Mercelis Ali Anwar |
| author_sort | Ahmed N. Ahmed |
| collection | DOAJ |
| description | Multi-agent collaborative perception has gained significant attention due to its ability to overcome the challenges stemming from the limited line-of-sight visibility of individual agents that raised safety concerns for autonomous navigation. Despite notable progress in collaborative perception, several persistent challenges hinder optimal performance, such as the size of data being shared, communication delays, computationally expensive collaboration mechanisms, and spatial misalignment. To address these challenges, we propose DelAwareCol, a versatile collaborative perception framework that tackles the transmission delay between connected agents in real-life autonomous driving. Our framework introduces three key modules designed to balance perception performance with communication bandwidth and delay. Firstly, an intra-agent information aggregation module captures valuable semantic cues within the temporal context to enhance the local representation of each ego agent. Secondly, an inter-agent information aggregation module manages inter-agent interactions and spatial relationships, addressing common vehicle-to-vehicle (V2V) and vehicle-to-everything (V2X) issues, such as spatial misalignment, asynchronous information sharing, and pose errors. Thirdly, an adaptive fusion mechanism integrates multi-source representations based on dynamic contributions from different agents. The proposed framework is validated on large-scale simulated and real-life collaborative perception datasets OPV2V, V2XSet, and V2VReal. Our experimental results demonstrate that DelAwareCol achieved state-of-the-art performance in collaborative object detection, maintaining robust performance in the presence of high latency and localization error. |
| format | Article |
| id | doaj-art-c398cd4e80fb49318c4108d3253fa573 |
| institution | OA Journals |
| issn | 2644-1330 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Open Journal of Vehicular Technology |
| spelling | doaj-art-c398cd4e80fb49318c4108d3253fa5732025-08-20T01:50:29ZengIEEEIEEE Open Journal of Vehicular Technology2644-13302025-01-0161164117710.1109/OJVT.2025.355638110946103DelAwareCol: Delay Aware Collaborative PerceptionAhmed N. Ahmed0https://orcid.org/0000-0002-7192-699XSiegfried Mercelis1https://orcid.org/0000-0001-9355-6566Ali Anwar2https://orcid.org/0000-0002-5523-0634Faculty of Applied Engineering, imec - IDLab, University of Antwerp, Antwerp, BelgiumFaculty of Applied Engineering, imec - IDLab, University of Antwerp, Antwerp, BelgiumFaculty of Applied Engineering, imec - IDLab, University of Antwerp, Antwerp, BelgiumMulti-agent collaborative perception has gained significant attention due to its ability to overcome the challenges stemming from the limited line-of-sight visibility of individual agents that raised safety concerns for autonomous navigation. Despite notable progress in collaborative perception, several persistent challenges hinder optimal performance, such as the size of data being shared, communication delays, computationally expensive collaboration mechanisms, and spatial misalignment. To address these challenges, we propose DelAwareCol, a versatile collaborative perception framework that tackles the transmission delay between connected agents in real-life autonomous driving. Our framework introduces three key modules designed to balance perception performance with communication bandwidth and delay. Firstly, an intra-agent information aggregation module captures valuable semantic cues within the temporal context to enhance the local representation of each ego agent. Secondly, an inter-agent information aggregation module manages inter-agent interactions and spatial relationships, addressing common vehicle-to-vehicle (V2V) and vehicle-to-everything (V2X) issues, such as spatial misalignment, asynchronous information sharing, and pose errors. Thirdly, an adaptive fusion mechanism integrates multi-source representations based on dynamic contributions from different agents. The proposed framework is validated on large-scale simulated and real-life collaborative perception datasets OPV2V, V2XSet, and V2VReal. Our experimental results demonstrate that DelAwareCol achieved state-of-the-art performance in collaborative object detection, maintaining robust performance in the presence of high latency and localization error.https://ieeexplore.ieee.org/document/10946103/Collaborative perceptionspatio-temporal modelingattentionV2X communicationautonomous vehicles3D object detection |
| spellingShingle | Ahmed N. Ahmed Siegfried Mercelis Ali Anwar DelAwareCol: Delay Aware Collaborative Perception IEEE Open Journal of Vehicular Technology Collaborative perception spatio-temporal modeling attention V2X communication autonomous vehicles 3D object detection |
| title | DelAwareCol: Delay Aware Collaborative Perception |
| title_full | DelAwareCol: Delay Aware Collaborative Perception |
| title_fullStr | DelAwareCol: Delay Aware Collaborative Perception |
| title_full_unstemmed | DelAwareCol: Delay Aware Collaborative Perception |
| title_short | DelAwareCol: Delay Aware Collaborative Perception |
| title_sort | delawarecol delay aware collaborative perception |
| topic | Collaborative perception spatio-temporal modeling attention V2X communication autonomous vehicles 3D object detection |
| url | https://ieeexplore.ieee.org/document/10946103/ |
| work_keys_str_mv | AT ahmednahmed delawarecoldelayawarecollaborativeperception AT siegfriedmercelis delawarecoldelayawarecollaborativeperception AT alianwar delawarecoldelayawarecollaborativeperception |