Design of an Intelligent Pear Bagging End-Effector Based on Yolov8 and SGBM Algorithm
Bagging is a crucial step in the full cycle management of pear cultivation, with increasing labor costs annually, driving research on intelligent bagging equipment. We describe an intelligent bagging end-effector for pears, which employs the Yolov8 algorithm for fruitlets detection and the Semi-Glob...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10716499/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850066273240612864 |
|---|---|
| author | Jing Ruijun Liu JingKai LiXin ZhiguoZhao |
| author_facet | Jing Ruijun Liu JingKai LiXin ZhiguoZhao |
| author_sort | Jing Ruijun |
| collection | DOAJ |
| description | Bagging is a crucial step in the full cycle management of pear cultivation, with increasing labor costs annually, driving research on intelligent bagging equipment. We describe an intelligent bagging end-effector for pears, which employs the Yolov8 algorithm for fruitlets detection and the Semi-Global Block Matching (SGBM) algorithm to acquire three-dimensional spatial information of the targets. To address the computational limitations of embedded devices in agricultural intelligent equipment, we improve the YOLOv8 model by replacing its neck component with the Asymptotic Feature Pyramid Network (AFPN) and incorporating Context Guided (CG) blocks into the C2f module. These improvements significantly reduce the model’s parameters and size while enhancing detection accuracy. To provide accurate three-dimensional information to the end-effector, we use the SGBM algorithm to obtain depth information of the targets. We constrain the matching process based on the model’s detected candidate bounding boxes and binocular prior knowledge, which improves the matching accuracy of the model while reducing the computational load. Finally, we deploy the model and matching algorithm on a Jetson Nano, which serves as the controller for the bagging end-effector based on the vacuum negative pressure principle. Experimental results show that the improved model achieves a precision of 96%, an increase of 1.4% over YOLOv8, with the size reduced from 6.2M to 5.0M. The depth information accuracy obtained by the algorithm is within 3cm. The improved model, combined with SGBM, runs at 11.5 fps on the Jetson Nano embedded device, meeting real-time performance requirements. |
| format | Article |
| id | doaj-art-4ff47d0cea854b9a952988dfaa8f4d73 |
| institution | DOAJ |
| issn | 2169-3536 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-4ff47d0cea854b9a952988dfaa8f4d732025-08-20T02:48:47ZengIEEEIEEE Access2169-35362024-01-011217417117418110.1109/ACCESS.2024.347974810716499Design of an Intelligent Pear Bagging End-Effector Based on Yolov8 and SGBM AlgorithmJing Ruijun0https://orcid.org/0000-0002-2112-7786Liu JingKai1https://orcid.org/0009-0002-7715-3462 LiXin2https://orcid.org/0009-0006-5686-3595 ZhiguoZhao3https://orcid.org/0009-0005-5818-285XSchool of Software, Shanxi Agricultural University, Taiyuan, ChinaSchool of Software, Shanxi Agricultural University, Taiyuan, ChinaBeijing Longtian Huayuan Technology Company Ltd., Beijing, ChinaSchool of Software, Shanxi Agricultural University, Taiyuan, ChinaBagging is a crucial step in the full cycle management of pear cultivation, with increasing labor costs annually, driving research on intelligent bagging equipment. We describe an intelligent bagging end-effector for pears, which employs the Yolov8 algorithm for fruitlets detection and the Semi-Global Block Matching (SGBM) algorithm to acquire three-dimensional spatial information of the targets. To address the computational limitations of embedded devices in agricultural intelligent equipment, we improve the YOLOv8 model by replacing its neck component with the Asymptotic Feature Pyramid Network (AFPN) and incorporating Context Guided (CG) blocks into the C2f module. These improvements significantly reduce the model’s parameters and size while enhancing detection accuracy. To provide accurate three-dimensional information to the end-effector, we use the SGBM algorithm to obtain depth information of the targets. We constrain the matching process based on the model’s detected candidate bounding boxes and binocular prior knowledge, which improves the matching accuracy of the model while reducing the computational load. Finally, we deploy the model and matching algorithm on a Jetson Nano, which serves as the controller for the bagging end-effector based on the vacuum negative pressure principle. Experimental results show that the improved model achieves a precision of 96%, an increase of 1.4% over YOLOv8, with the size reduced from 6.2M to 5.0M. The depth information accuracy obtained by the algorithm is within 3cm. The improved model, combined with SGBM, runs at 11.5 fps on the Jetson Nano embedded device, meeting real-time performance requirements.https://ieeexplore.ieee.org/document/10716499/Embedded deviceslightweight modeldepth information |
| spellingShingle | Jing Ruijun Liu JingKai LiXin ZhiguoZhao Design of an Intelligent Pear Bagging End-Effector Based on Yolov8 and SGBM Algorithm IEEE Access Embedded devices lightweight model depth information |
| title | Design of an Intelligent Pear Bagging End-Effector Based on Yolov8 and SGBM Algorithm |
| title_full | Design of an Intelligent Pear Bagging End-Effector Based on Yolov8 and SGBM Algorithm |
| title_fullStr | Design of an Intelligent Pear Bagging End-Effector Based on Yolov8 and SGBM Algorithm |
| title_full_unstemmed | Design of an Intelligent Pear Bagging End-Effector Based on Yolov8 and SGBM Algorithm |
| title_short | Design of an Intelligent Pear Bagging End-Effector Based on Yolov8 and SGBM Algorithm |
| title_sort | design of an intelligent pear bagging end effector based on yolov8 and sgbm algorithm |
| topic | Embedded devices lightweight model depth information |
| url | https://ieeexplore.ieee.org/document/10716499/ |
| work_keys_str_mv | AT jingruijun designofanintelligentpearbaggingendeffectorbasedonyolov8andsgbmalgorithm AT liujingkai designofanintelligentpearbaggingendeffectorbasedonyolov8andsgbmalgorithm AT lixin designofanintelligentpearbaggingendeffectorbasedonyolov8andsgbmalgorithm AT zhiguozhao designofanintelligentpearbaggingendeffectorbasedonyolov8andsgbmalgorithm |