Vision-Based Control of Robotic Arm Mounted on Unmanned Surface Vehicle for Rocket Recovery

Unmanned surface vehicles (USVs) equipped with robotic arms can perform various complex tasks such as grasping, sampling, and infrastructure repair. USVs are widely used for environmental monitoring, search and rescue missions, maintenance and repair, marine exploration, and its commercial applicati...

Full description

Saved in:
Bibliographic Details
Main Authors: Abenezer Zegeye, Sang Ki Jeong, Hae Yong Park, Sunghun Jung
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/11053815/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849320296140505088
author Abenezer Zegeye
Sang Ki Jeong
Hae Yong Park
Sunghun Jung
author_facet Abenezer Zegeye
Sang Ki Jeong
Hae Yong Park
Sunghun Jung
author_sort Abenezer Zegeye
collection DOAJ
description Unmanned surface vehicles (USVs) equipped with robotic arms can perform various complex tasks such as grasping, sampling, and infrastructure repair. USVs are widely used for environmental monitoring, search and rescue missions, maintenance and repair, marine exploration, and its commercial applications. This paper presents an innovative vision-based strategy that utilizes a manipulator integrated with a USV to recover vertical takeoff vertical landing rockets in oceanic environments. This study focuses on a 4.3-m-long, 150-kg, three degree-of-freedom (DOF) WAM-V14 with a four-DOF manipulator. To detect and localize the landing rockets, a depth camera sensor and an advanced You Only Look Once Version Eight (YOLOv8) object-detection algorithm were employed. To train the YOLO algorithm, a customized bespoke dataset was developed for rocket identification. As the rocket descends and hovers, the system estimates its orientation and distance using a trained model. The measured distance served as the desired trajectory for the controller, thus guiding the USV toward the identified rocket and controlling the manipulator to reach its location. The integration of camera sensors, robotic arm manipulation, autonomous navigation, YOLO-based object detection, and a sliding-mode control system is promising for realizing affordable and safe rocket recovery operations in challenging oceanic environments.
format Article
id doaj-art-ecfc739779224698a55a3b401e394c23
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-ecfc739779224698a55a3b401e394c232025-08-20T03:50:07ZengIEEEIEEE Access2169-35362025-01-011311403811405510.1109/ACCESS.2025.358385411053815Vision-Based Control of Robotic Arm Mounted on Unmanned Surface Vehicle for Rocket RecoveryAbenezer Zegeye0https://orcid.org/0009-0009-9450-312XSang Ki Jeong1Hae Yong Park2Sunghun Jung3https://orcid.org/0000-0002-4729-8241Faculty of Smart Vehicle System Engineering, Chosun University, Dong-gu, Gwangju, Republic of KoreaKorea Institute of Ocean Science and Technology, Yeongdo-gu, Busan, Republic of KoreaKorea Institute of Ocean Science and Technology, Yeongdo-gu, Busan, Republic of KoreaFaculty of Smart Vehicle System Engineering, Chosun University, Dong-gu, Gwangju, Republic of KoreaUnmanned surface vehicles (USVs) equipped with robotic arms can perform various complex tasks such as grasping, sampling, and infrastructure repair. USVs are widely used for environmental monitoring, search and rescue missions, maintenance and repair, marine exploration, and its commercial applications. This paper presents an innovative vision-based strategy that utilizes a manipulator integrated with a USV to recover vertical takeoff vertical landing rockets in oceanic environments. This study focuses on a 4.3-m-long, 150-kg, three degree-of-freedom (DOF) WAM-V14 with a four-DOF manipulator. To detect and localize the landing rockets, a depth camera sensor and an advanced You Only Look Once Version Eight (YOLOv8) object-detection algorithm were employed. To train the YOLO algorithm, a customized bespoke dataset was developed for rocket identification. As the rocket descends and hovers, the system estimates its orientation and distance using a trained model. The measured distance served as the desired trajectory for the controller, thus guiding the USV toward the identified rocket and controlling the manipulator to reach its location. The integration of camera sensors, robotic arm manipulation, autonomous navigation, YOLO-based object detection, and a sliding-mode control system is promising for realizing affordable and safe rocket recovery operations in challenging oceanic environments.https://ieeexplore.ieee.org/document/11053815/Detectionnonlinear controlrobotic armsliding-mode controllerunmanned surface vehicleVTVL rocket
spellingShingle Abenezer Zegeye
Sang Ki Jeong
Hae Yong Park
Sunghun Jung
Vision-Based Control of Robotic Arm Mounted on Unmanned Surface Vehicle for Rocket Recovery
IEEE Access
Detection
nonlinear control
robotic arm
sliding-mode controller
unmanned surface vehicle
VTVL rocket
title Vision-Based Control of Robotic Arm Mounted on Unmanned Surface Vehicle for Rocket Recovery
title_full Vision-Based Control of Robotic Arm Mounted on Unmanned Surface Vehicle for Rocket Recovery
title_fullStr Vision-Based Control of Robotic Arm Mounted on Unmanned Surface Vehicle for Rocket Recovery
title_full_unstemmed Vision-Based Control of Robotic Arm Mounted on Unmanned Surface Vehicle for Rocket Recovery
title_short Vision-Based Control of Robotic Arm Mounted on Unmanned Surface Vehicle for Rocket Recovery
title_sort vision based control of robotic arm mounted on unmanned surface vehicle for rocket recovery
topic Detection
nonlinear control
robotic arm
sliding-mode controller
unmanned surface vehicle
VTVL rocket
url https://ieeexplore.ieee.org/document/11053815/
work_keys_str_mv AT abenezerzegeye visionbasedcontrolofroboticarmmountedonunmannedsurfacevehicleforrocketrecovery
AT sangkijeong visionbasedcontrolofroboticarmmountedonunmannedsurfacevehicleforrocketrecovery
AT haeyongpark visionbasedcontrolofroboticarmmountedonunmannedsurfacevehicleforrocketrecovery
AT sunghunjung visionbasedcontrolofroboticarmmountedonunmannedsurfacevehicleforrocketrecovery