Underwater Visual Multi-Target Tracking Algorithm Integrating Re-parameterization and Attention Mechanism
The complex underwater environment can severely impact the stability of imaging devices and the quality of captured images, posing significant challenges for visual multi-target tracking in underwater unmanned autonomous systems. To address the difficulties arising from underwater camera jitter and...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Science Press (China)
2025-04-01
|
| Series: | 水下无人系统学报 |
| Subjects: | |
| Online Access: | https://sxwrxtxb.xml-journal.net/cn/article/doi/10.11993/j.issn.2096-3920.2025-0012 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849426961673224192 |
|---|---|
| author | Junyi LI Mingle HE Chang LIU Yong XU |
| author_facet | Junyi LI Mingle HE Chang LIU Yong XU |
| author_sort | Junyi LI |
| collection | DOAJ |
| description | The complex underwater environment can severely impact the stability of imaging devices and the quality of captured images, posing significant challenges for visual multi-target tracking in underwater unmanned autonomous systems. To address the difficulties arising from underwater camera jitter and image degradation, this paper proposed an underwater visual multi-target tracking algorithm that integrated re-parameterization and attention mechanisms, specifically tailored for underwater unmanned autonomous systems. First, to tackle the diversity of underwater targets and image degradation, an improved YOLOv8 algorithm based on re-parameterization and attention mechanism(RA-YOLOv8) was proposed. This algorithm effectively enhanced the network’s multi-scale feature extraction capability and improved the detection accuracy of the model by integrating a structurally re-parameterized multi-scale feature extraction convolutional structure(DBB-RFAConv) and the AMSCE-attention mechanism. Then, to address the challenges of real-time target tracking caused by underwater camera jitter, an Inner-PIoUv2-enhanced ByteTrack algorithm(IP2-ByteTrack) was proposed. Inner-PIoUv2 was used as the similarity measure in the matching process of the tracking algorithm, which enhanced the model’s performance in underwater detection and tracking tasks, improving the accuracy of tracking trajectory matching. Finally, based on the RA-YOLOv8 and IP2-ByteTrack algorithms, an underwater visual multi-target tracking algorithm that integrated re-parameterization and attention mechanisms for underwater autonomous systems was proposed. Experimental results show that the proposed algorithm exhibits excellent performance in complex underwater environments and can effectively address the shortcomings of existing methods in underwater multi-target tracking. |
| format | Article |
| id | doaj-art-7801bb5b0bd94da9b5ac8a6e800f5abc |
| institution | Kabale University |
| issn | 2096-3920 |
| language | zho |
| publishDate | 2025-04-01 |
| publisher | Science Press (China) |
| record_format | Article |
| series | 水下无人系统学报 |
| spelling | doaj-art-7801bb5b0bd94da9b5ac8a6e800f5abc2025-08-20T03:29:10ZzhoScience Press (China)水下无人系统学报2096-39202025-04-0133224926010.11993/j.issn.2096-3920.2025-00122025-0012Underwater Visual Multi-Target Tracking Algorithm Integrating Re-parameterization and Attention MechanismJunyi LI0Mingle HE1Chang LIU2Yong XU3School of Automation, Guangdong University of Technology, Guangzhou 510006, ChinaSchool of Automation, Guangdong University of Technology, Guangzhou 510006, ChinaSchool of Automation, Guangdong University of Technology, Guangzhou 510006, ChinaSchool of Automation, Guangdong University of Technology, Guangzhou 510006, ChinaThe complex underwater environment can severely impact the stability of imaging devices and the quality of captured images, posing significant challenges for visual multi-target tracking in underwater unmanned autonomous systems. To address the difficulties arising from underwater camera jitter and image degradation, this paper proposed an underwater visual multi-target tracking algorithm that integrated re-parameterization and attention mechanisms, specifically tailored for underwater unmanned autonomous systems. First, to tackle the diversity of underwater targets and image degradation, an improved YOLOv8 algorithm based on re-parameterization and attention mechanism(RA-YOLOv8) was proposed. This algorithm effectively enhanced the network’s multi-scale feature extraction capability and improved the detection accuracy of the model by integrating a structurally re-parameterized multi-scale feature extraction convolutional structure(DBB-RFAConv) and the AMSCE-attention mechanism. Then, to address the challenges of real-time target tracking caused by underwater camera jitter, an Inner-PIoUv2-enhanced ByteTrack algorithm(IP2-ByteTrack) was proposed. Inner-PIoUv2 was used as the similarity measure in the matching process of the tracking algorithm, which enhanced the model’s performance in underwater detection and tracking tasks, improving the accuracy of tracking trajectory matching. Finally, based on the RA-YOLOv8 and IP2-ByteTrack algorithms, an underwater visual multi-target tracking algorithm that integrated re-parameterization and attention mechanisms for underwater autonomous systems was proposed. Experimental results show that the proposed algorithm exhibits excellent performance in complex underwater environments and can effectively address the shortcomings of existing methods in underwater multi-target tracking.https://sxwrxtxb.xml-journal.net/cn/article/doi/10.11993/j.issn.2096-3920.2025-0012underwater visualmulti-target trackingyolobytetrackre-parameterization; attention mechanism |
| spellingShingle | Junyi LI Mingle HE Chang LIU Yong XU Underwater Visual Multi-Target Tracking Algorithm Integrating Re-parameterization and Attention Mechanism 水下无人系统学报 underwater visual multi-target tracking yolo bytetrack re-parameterization; attention mechanism |
| title | Underwater Visual Multi-Target Tracking Algorithm Integrating Re-parameterization and Attention Mechanism |
| title_full | Underwater Visual Multi-Target Tracking Algorithm Integrating Re-parameterization and Attention Mechanism |
| title_fullStr | Underwater Visual Multi-Target Tracking Algorithm Integrating Re-parameterization and Attention Mechanism |
| title_full_unstemmed | Underwater Visual Multi-Target Tracking Algorithm Integrating Re-parameterization and Attention Mechanism |
| title_short | Underwater Visual Multi-Target Tracking Algorithm Integrating Re-parameterization and Attention Mechanism |
| title_sort | underwater visual multi target tracking algorithm integrating re parameterization and attention mechanism |
| topic | underwater visual multi-target tracking yolo bytetrack re-parameterization; attention mechanism |
| url | https://sxwrxtxb.xml-journal.net/cn/article/doi/10.11993/j.issn.2096-3920.2025-0012 |
| work_keys_str_mv | AT junyili underwatervisualmultitargettrackingalgorithmintegratingreparameterizationandattentionmechanism AT minglehe underwatervisualmultitargettrackingalgorithmintegratingreparameterizationandattentionmechanism AT changliu underwatervisualmultitargettrackingalgorithmintegratingreparameterizationandattentionmechanism AT yongxu underwatervisualmultitargettrackingalgorithmintegratingreparameterizationandattentionmechanism |