Research on multi-view collaborative detection system for UAV swarms based on Pix2Pix framework and BAM attention mechanism
Drone swarm systems, equipped with photoelectric imaging and intelligent target perception, are essential for reconnaissance and strike missions in complex and high-risk environments. They excel in information sharing, anti-jamming capabilities, and combat performance, making them critical for futur...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
KeAi Communications Co., Ltd.
2025-04-01
|
| Series: | Defence Technology |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2214914724002575 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850150811742502912 |
|---|---|
| author | Yan Ding Qingxin Cao Bozhi Zhang Peilin Li Zhongjiao Shi |
| author_facet | Yan Ding Qingxin Cao Bozhi Zhang Peilin Li Zhongjiao Shi |
| author_sort | Yan Ding |
| collection | DOAJ |
| description | Drone swarm systems, equipped with photoelectric imaging and intelligent target perception, are essential for reconnaissance and strike missions in complex and high-risk environments. They excel in information sharing, anti-jamming capabilities, and combat performance, making them critical for future warfare. However, varied perspectives in collaborative combat scenarios pose challenges to object detection, hindering traditional detection algorithms and reducing accuracy. Limited angle-prior data and sparse samples further complicate detection. This paper presents the Multi-View Collaborative Detection System, which tackles the challenges of multi-view object detection in collaborative combat scenarios. The system is designed to enhance multi-view image generation and detection algorithms, thereby improving the accuracy and efficiency of object detection across varying perspectives. First, an observation model for three-dimensional targets through line-of-sight angle transformation is constructed, and a multi-view image generation algorithm based on the Pix2Pix network is designed. For object detection, YOLOX is utilized, and a deep feature extraction network, BA-RepCSPDarknet, is developed to address challenges related to small target scale and feature extraction challenges. Additionally, a feature fusion network NS-PAFPN is developed to mitigate the issue of deep feature map information loss in UAV images. A visual attention module (BAM) is employed to manage appearance differences under varying angles, while a feature mapping module (DFM) prevents fine-grained feature loss. These advancements lead to the development of BA-YOLOX, a multi-view object detection network model suitable for drone platforms, enhancing accuracy and effectively targeting small objects. |
| format | Article |
| id | doaj-art-2811d91759a643bc94866f69b87a473a |
| institution | OA Journals |
| issn | 2214-9147 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | KeAi Communications Co., Ltd. |
| record_format | Article |
| series | Defence Technology |
| spelling | doaj-art-2811d91759a643bc94866f69b87a473a2025-08-20T02:26:27ZengKeAi Communications Co., Ltd.Defence Technology2214-91472025-04-014621322610.1016/j.dt.2024.11.002Research on multi-view collaborative detection system for UAV swarms based on Pix2Pix framework and BAM attention mechanismYan Ding0Qingxin Cao1Bozhi Zhang2Peilin Li3Zhongjiao Shi4School of Aerospace Engineering, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Aerospace Engineering, Beijing Institute of Technology, Beijing 100081, ChinaCorresponding author.; School of Aerospace Engineering, Beijing Institute of Technology, Beijing 100081, ChinaSchool of Aerospace Engineering, Beijing Institute of Technology, Beijing 100081, ChinaCorresponding author.; School of Aerospace Engineering, Beijing Institute of Technology, Beijing 100081, ChinaDrone swarm systems, equipped with photoelectric imaging and intelligent target perception, are essential for reconnaissance and strike missions in complex and high-risk environments. They excel in information sharing, anti-jamming capabilities, and combat performance, making them critical for future warfare. However, varied perspectives in collaborative combat scenarios pose challenges to object detection, hindering traditional detection algorithms and reducing accuracy. Limited angle-prior data and sparse samples further complicate detection. This paper presents the Multi-View Collaborative Detection System, which tackles the challenges of multi-view object detection in collaborative combat scenarios. The system is designed to enhance multi-view image generation and detection algorithms, thereby improving the accuracy and efficiency of object detection across varying perspectives. First, an observation model for three-dimensional targets through line-of-sight angle transformation is constructed, and a multi-view image generation algorithm based on the Pix2Pix network is designed. For object detection, YOLOX is utilized, and a deep feature extraction network, BA-RepCSPDarknet, is developed to address challenges related to small target scale and feature extraction challenges. Additionally, a feature fusion network NS-PAFPN is developed to mitigate the issue of deep feature map information loss in UAV images. A visual attention module (BAM) is employed to manage appearance differences under varying angles, while a feature mapping module (DFM) prevents fine-grained feature loss. These advancements lead to the development of BA-YOLOX, a multi-view object detection network model suitable for drone platforms, enhancing accuracy and effectively targeting small objects.http://www.sciencedirect.com/science/article/pii/S2214914724002575Drone swarm systemsReconnaissance and strikeImage generationMulti-view detectionPix2Pix frameworkAttention mechanism |
| spellingShingle | Yan Ding Qingxin Cao Bozhi Zhang Peilin Li Zhongjiao Shi Research on multi-view collaborative detection system for UAV swarms based on Pix2Pix framework and BAM attention mechanism Defence Technology Drone swarm systems Reconnaissance and strike Image generation Multi-view detection Pix2Pix framework Attention mechanism |
| title | Research on multi-view collaborative detection system for UAV swarms based on Pix2Pix framework and BAM attention mechanism |
| title_full | Research on multi-view collaborative detection system for UAV swarms based on Pix2Pix framework and BAM attention mechanism |
| title_fullStr | Research on multi-view collaborative detection system for UAV swarms based on Pix2Pix framework and BAM attention mechanism |
| title_full_unstemmed | Research on multi-view collaborative detection system for UAV swarms based on Pix2Pix framework and BAM attention mechanism |
| title_short | Research on multi-view collaborative detection system for UAV swarms based on Pix2Pix framework and BAM attention mechanism |
| title_sort | research on multi view collaborative detection system for uav swarms based on pix2pix framework and bam attention mechanism |
| topic | Drone swarm systems Reconnaissance and strike Image generation Multi-view detection Pix2Pix framework Attention mechanism |
| url | http://www.sciencedirect.com/science/article/pii/S2214914724002575 |
| work_keys_str_mv | AT yanding researchonmultiviewcollaborativedetectionsystemforuavswarmsbasedonpix2pixframeworkandbamattentionmechanism AT qingxincao researchonmultiviewcollaborativedetectionsystemforuavswarmsbasedonpix2pixframeworkandbamattentionmechanism AT bozhizhang researchonmultiviewcollaborativedetectionsystemforuavswarmsbasedonpix2pixframeworkandbamattentionmechanism AT peilinli researchonmultiviewcollaborativedetectionsystemforuavswarmsbasedonpix2pixframeworkandbamattentionmechanism AT zhongjiaoshi researchonmultiviewcollaborativedetectionsystemforuavswarmsbasedonpix2pixframeworkandbamattentionmechanism |