Automatic cutting and suturing control system based on improved FP16 visual recognition algorithm
Objective This study aims to develop and evaluate an autonomous surgical system based on the Toumai laparoscopic surgical robot, focusing on improving the precision and reliability of automated cutting and suturing operations. Methods The proposed system integrates several key components: (1) Roboti...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
SAGE Publishing
2025-07-01
|
| Series: | International Journal of Advanced Robotic Systems |
| Online Access: | https://doi.org/10.1177/17298806251348118 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850067440180920320 |
|---|---|
| author | Jiayin Wang Weidong Zhao |
| author_facet | Jiayin Wang Weidong Zhao |
| author_sort | Jiayin Wang |
| collection | DOAJ |
| description | Objective This study aims to develop and evaluate an autonomous surgical system based on the Toumai laparoscopic surgical robot, focusing on improving the precision and reliability of automated cutting and suturing operations. Methods The proposed system integrates several key components: (1) Robotic arms and associated control systems. (2) An endoscopic system supporting advanced visual image algorithms. (3) Specialized surgical instruments for cutting and suturing. A binocular stereo matching algorithm is employed to obtain depth information from the field of binocular camera. The DarkPose image key point localization algorithm and the Yolov5 image detection algorithm are utilized to accurately determine the positions of surgical instruments, suture needles, and target points. Additionally, an image classification discriminator is introduced to assess the success of the surgical tasks. A finite state machine model is used to guide the robotic arm's end-effector through real-time trajectory planning and execution, ensuring precise completion of surgical tasks. Results Experimental evaluation demonstrated that the autonomous system achieves high precision and reliability in both cutting and suturing tasks. Quantitative analysis shows that the system maintains an 85% success rate in automatic cutting, with a mean time of 5.10 s per cutting action. The automatic suturing task achieves a 92% accuracy rate in instrument positioning and a 90% success rate in needle grasping. Conclusion The developed system shows significant promise in automating key laparoscopic surgical tasks, with the potential to enhance surgical efficiency and improve outcomes in clinical practice. Further development and validation of this system could lead to its broader adoption in the field of autonomous surgery. |
| format | Article |
| id | doaj-art-00aed10406ec4d2e8239ee28b90487b5 |
| institution | DOAJ |
| issn | 1729-8814 |
| language | English |
| publishDate | 2025-07-01 |
| publisher | SAGE Publishing |
| record_format | Article |
| series | International Journal of Advanced Robotic Systems |
| spelling | doaj-art-00aed10406ec4d2e8239ee28b90487b52025-08-20T02:48:19ZengSAGE PublishingInternational Journal of Advanced Robotic Systems1729-88142025-07-012210.1177/17298806251348118Automatic cutting and suturing control system based on improved FP16 visual recognition algorithmJiayin Wang0Weidong Zhao1 Shanghai MicroPort MedBot (Group) Co., Ltd, Shanghai, China College of Electronic and Information Engineering, Tongji University, Shanghai, ChinaObjective This study aims to develop and evaluate an autonomous surgical system based on the Toumai laparoscopic surgical robot, focusing on improving the precision and reliability of automated cutting and suturing operations. Methods The proposed system integrates several key components: (1) Robotic arms and associated control systems. (2) An endoscopic system supporting advanced visual image algorithms. (3) Specialized surgical instruments for cutting and suturing. A binocular stereo matching algorithm is employed to obtain depth information from the field of binocular camera. The DarkPose image key point localization algorithm and the Yolov5 image detection algorithm are utilized to accurately determine the positions of surgical instruments, suture needles, and target points. Additionally, an image classification discriminator is introduced to assess the success of the surgical tasks. A finite state machine model is used to guide the robotic arm's end-effector through real-time trajectory planning and execution, ensuring precise completion of surgical tasks. Results Experimental evaluation demonstrated that the autonomous system achieves high precision and reliability in both cutting and suturing tasks. Quantitative analysis shows that the system maintains an 85% success rate in automatic cutting, with a mean time of 5.10 s per cutting action. The automatic suturing task achieves a 92% accuracy rate in instrument positioning and a 90% success rate in needle grasping. Conclusion The developed system shows significant promise in automating key laparoscopic surgical tasks, with the potential to enhance surgical efficiency and improve outcomes in clinical practice. Further development and validation of this system could lead to its broader adoption in the field of autonomous surgery.https://doi.org/10.1177/17298806251348118 |
| spellingShingle | Jiayin Wang Weidong Zhao Automatic cutting and suturing control system based on improved FP16 visual recognition algorithm International Journal of Advanced Robotic Systems |
| title | Automatic cutting and suturing control system based on improved FP16 visual recognition algorithm |
| title_full | Automatic cutting and suturing control system based on improved FP16 visual recognition algorithm |
| title_fullStr | Automatic cutting and suturing control system based on improved FP16 visual recognition algorithm |
| title_full_unstemmed | Automatic cutting and suturing control system based on improved FP16 visual recognition algorithm |
| title_short | Automatic cutting and suturing control system based on improved FP16 visual recognition algorithm |
| title_sort | automatic cutting and suturing control system based on improved fp16 visual recognition algorithm |
| url | https://doi.org/10.1177/17298806251348118 |
| work_keys_str_mv | AT jiayinwang automaticcuttingandsuturingcontrolsystembasedonimprovedfp16visualrecognitionalgorithm AT weidongzhao automaticcuttingandsuturingcontrolsystembasedonimprovedfp16visualrecognitionalgorithm |