Proposal for semi-automatic control reflecting operator heuristics using fuzzy logic and image detection with monocular camera images
Automation of construction machinery is being advanced to enhance the efficiency of construction work and address the shortage of skilled operators. A key challenge in automating construction machinery lies in responding to various changing external environments. To address this challenge, extant st...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Taylor & Francis Group
2025-12-01
|
| Series: | SICE Journal of Control, Measurement, and System Integration |
| Subjects: | |
| Online Access: | http://dx.doi.org/10.1080/18824889.2025.2513738 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849688070312427520 |
|---|---|
| author | Kaoru Obayashi Yoshiaki Saito Koichi Osuka Yuto Miyahara |
| author_facet | Kaoru Obayashi Yoshiaki Saito Koichi Osuka Yuto Miyahara |
| author_sort | Kaoru Obayashi |
| collection | DOAJ |
| description | Automation of construction machinery is being advanced to enhance the efficiency of construction work and address the shortage of skilled operators. A key challenge in automating construction machinery lies in responding to various changing external environments. To address this challenge, extant studies have sought to incorporate operator models that simulate operator actions into automatic control systems. This paper proposes a semi-automatic control system that integrates human heuristics into the boom operation of the “sweeping operation”. In the proposed method, the automatic control of the boom detects the position of the bucket that the operator is focusing on by using monocular camera images captured from the operator's perspective. Based on the operator's heuristics revealed through interviews, the operational amount of the boom is determined using the bucket's position information combined with the arm speed information. Validation results indicate that the control system successfully integrates the operator's heuristics for boom operation by considering both the position information of the bucket and the speed of the arm. Thus, a framework for semi-automatic control that effectively incorporates operator heuristics is established. |
| format | Article |
| id | doaj-art-35d7d0a261fc40d5833fc5d8173073c8 |
| institution | DOAJ |
| issn | 1884-9970 |
| language | English |
| publishDate | 2025-12-01 |
| publisher | Taylor & Francis Group |
| record_format | Article |
| series | SICE Journal of Control, Measurement, and System Integration |
| spelling | doaj-art-35d7d0a261fc40d5833fc5d8173073c82025-08-20T03:22:08ZengTaylor & Francis GroupSICE Journal of Control, Measurement, and System Integration1884-99702025-12-010010.1080/18824889.2025.25137382513738Proposal for semi-automatic control reflecting operator heuristics using fuzzy logic and image detection with monocular camera imagesKaoru Obayashi0Yoshiaki Saito1Koichi Osuka2Yuto Miyahara3Osaka UniversityKomatsu Ltd.Osaka UniversityKomatsu Ltd.Automation of construction machinery is being advanced to enhance the efficiency of construction work and address the shortage of skilled operators. A key challenge in automating construction machinery lies in responding to various changing external environments. To address this challenge, extant studies have sought to incorporate operator models that simulate operator actions into automatic control systems. This paper proposes a semi-automatic control system that integrates human heuristics into the boom operation of the “sweeping operation”. In the proposed method, the automatic control of the boom detects the position of the bucket that the operator is focusing on by using monocular camera images captured from the operator's perspective. Based on the operator's heuristics revealed through interviews, the operational amount of the boom is determined using the bucket's position information combined with the arm speed information. Validation results indicate that the control system successfully integrates the operator's heuristics for boom operation by considering both the position information of the bucket and the speed of the arm. Thus, a framework for semi-automatic control that effectively incorporates operator heuristics is established.http://dx.doi.org/10.1080/18824889.2025.2513738automationfuzzy logicconstruction machineryexcavatorheuristicssweeping operation |
| spellingShingle | Kaoru Obayashi Yoshiaki Saito Koichi Osuka Yuto Miyahara Proposal for semi-automatic control reflecting operator heuristics using fuzzy logic and image detection with monocular camera images SICE Journal of Control, Measurement, and System Integration automation fuzzy logic construction machinery excavator heuristics sweeping operation |
| title | Proposal for semi-automatic control reflecting operator heuristics using fuzzy logic and image detection with monocular camera images |
| title_full | Proposal for semi-automatic control reflecting operator heuristics using fuzzy logic and image detection with monocular camera images |
| title_fullStr | Proposal for semi-automatic control reflecting operator heuristics using fuzzy logic and image detection with monocular camera images |
| title_full_unstemmed | Proposal for semi-automatic control reflecting operator heuristics using fuzzy logic and image detection with monocular camera images |
| title_short | Proposal for semi-automatic control reflecting operator heuristics using fuzzy logic and image detection with monocular camera images |
| title_sort | proposal for semi automatic control reflecting operator heuristics using fuzzy logic and image detection with monocular camera images |
| topic | automation fuzzy logic construction machinery excavator heuristics sweeping operation |
| url | http://dx.doi.org/10.1080/18824889.2025.2513738 |
| work_keys_str_mv | AT kaoruobayashi proposalforsemiautomaticcontrolreflectingoperatorheuristicsusingfuzzylogicandimagedetectionwithmonocularcameraimages AT yoshiakisaito proposalforsemiautomaticcontrolreflectingoperatorheuristicsusingfuzzylogicandimagedetectionwithmonocularcameraimages AT koichiosuka proposalforsemiautomaticcontrolreflectingoperatorheuristicsusingfuzzylogicandimagedetectionwithmonocularcameraimages AT yutomiyahara proposalforsemiautomaticcontrolreflectingoperatorheuristicsusingfuzzylogicandimagedetectionwithmonocularcameraimages |