Research on visual positioning method of roadheader based on infrared LED line-type target
As the main equipment of fully mechanized mining face in coal mine, the degree of automation and intelligence of roadheader is of great significance to realize intelligent rapid excavation of roadway. Accurate and robust measurement method of the body posture of roadheader is the premise of intellig...
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Office of Journal of China Coal Society
2024-12-01
|
| Series: | Meitan xuebao |
| Subjects: | |
| Online Access: | http://www.mtxb.com.cn/article/doi/10.13225/j.cnki.jccs.2024.0284 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850070222480867328 |
|---|---|
| author | Jicheng WAN Xuhui ZHANG Wenjuan YANG Chao ZHANG Mengyu LEI Yuyang DU Zheng DONG Junhao YANG |
| author_facet | Jicheng WAN Xuhui ZHANG Wenjuan YANG Chao ZHANG Mengyu LEI Yuyang DU Zheng DONG Junhao YANG |
| author_sort | Jicheng WAN |
| collection | DOAJ |
| description | As the main equipment of fully mechanized mining face in coal mine, the degree of automation and intelligence of roadheader is of great significance to realize intelligent rapid excavation of roadway. Accurate and robust measurement method of the body posture of roadheader is the premise of intelligent control of roadheader. Underground dust and water mist, long and narrow confined space and unstructured complex environment have great influence on the accuracy and reliability of the posture measurement method of roadheader fuselage. In order to improve the accuracy and robustness of posture measurement of roadheader fuselage, a visual posture measurement method of roadheader based on infrared LED linear target is proposed. The infrared LED target with the characteristics of curve and straight line combination is designed, and the visual measurement system of roadheader position and posture is constructed. On the basis of analyzing the characteristics of the target image, an adaptive guided Hessian matrix target light bar center extraction method is proposed. The initial center and width of the light bar are obtained by image thinning and Gaussian fitting, the sub-pixel coordinates of the target light bar center are obtained by Hessian matrix, and the ellipse and straight line equations are obtained by least square fitting. A monocular vision pose calculation model of roadheader fuselage based on the combination of curve and straight line is constructed, and the optimal pose estimation is realized by minimizing the projection error, and the pose information of roadheader fuselage is obtained by coordinate system transformation. The influence of different factors on positioning accuracy is analyzed by numerical simulation, and the optimal target size and error distribution at different distances are determined. An experimental verification platform was built, and the maximum measurement errors of X-axis, Y-axis and Z-axis were 58.820, 69.525, 133.2 mm respectively within the 40-meter measurement range. Experiments show that this method effectively overcomes the influence of low illumination, stray light background and occlusion, and has an important reference for the spatial long-distance pose detection of underground tunnels in coal mines. |
| format | Article |
| id | doaj-art-092ce8d826fc4270b57e28a30ebff840 |
| institution | DOAJ |
| issn | 0253-9993 |
| language | zho |
| publishDate | 2024-12-01 |
| publisher | Editorial Office of Journal of China Coal Society |
| record_format | Article |
| series | Meitan xuebao |
| spelling | doaj-art-092ce8d826fc4270b57e28a30ebff8402025-08-20T02:47:36ZzhoEditorial Office of Journal of China Coal SocietyMeitan xuebao0253-99932024-12-0149S21173118310.13225/j.cnki.jccs.2024.02842024-0284Research on visual positioning method of roadheader based on infrared LED line-type targetJicheng WAN0Xuhui ZHANG1Wenjuan YANG2Chao ZHANG3Mengyu LEI4Yuyang DU5Zheng DONG6Junhao YANG7College of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaAs the main equipment of fully mechanized mining face in coal mine, the degree of automation and intelligence of roadheader is of great significance to realize intelligent rapid excavation of roadway. Accurate and robust measurement method of the body posture of roadheader is the premise of intelligent control of roadheader. Underground dust and water mist, long and narrow confined space and unstructured complex environment have great influence on the accuracy and reliability of the posture measurement method of roadheader fuselage. In order to improve the accuracy and robustness of posture measurement of roadheader fuselage, a visual posture measurement method of roadheader based on infrared LED linear target is proposed. The infrared LED target with the characteristics of curve and straight line combination is designed, and the visual measurement system of roadheader position and posture is constructed. On the basis of analyzing the characteristics of the target image, an adaptive guided Hessian matrix target light bar center extraction method is proposed. The initial center and width of the light bar are obtained by image thinning and Gaussian fitting, the sub-pixel coordinates of the target light bar center are obtained by Hessian matrix, and the ellipse and straight line equations are obtained by least square fitting. A monocular vision pose calculation model of roadheader fuselage based on the combination of curve and straight line is constructed, and the optimal pose estimation is realized by minimizing the projection error, and the pose information of roadheader fuselage is obtained by coordinate system transformation. The influence of different factors on positioning accuracy is analyzed by numerical simulation, and the optimal target size and error distribution at different distances are determined. An experimental verification platform was built, and the maximum measurement errors of X-axis, Y-axis and Z-axis were 58.820, 69.525, 133.2 mm respectively within the 40-meter measurement range. Experiments show that this method effectively overcomes the influence of low illumination, stray light background and occlusion, and has an important reference for the spatial long-distance pose detection of underground tunnels in coal mines.http://www.mtxb.com.cn/article/doi/10.13225/j.cnki.jccs.2024.0284boom- type roadheadervisual pose measurementinfrared linear targetfusion featuresfeature extraction |
| spellingShingle | Jicheng WAN Xuhui ZHANG Wenjuan YANG Chao ZHANG Mengyu LEI Yuyang DU Zheng DONG Junhao YANG Research on visual positioning method of roadheader based on infrared LED line-type target Meitan xuebao boom- type roadheader visual pose measurement infrared linear target fusion features feature extraction |
| title | Research on visual positioning method of roadheader based on infrared LED line-type target |
| title_full | Research on visual positioning method of roadheader based on infrared LED line-type target |
| title_fullStr | Research on visual positioning method of roadheader based on infrared LED line-type target |
| title_full_unstemmed | Research on visual positioning method of roadheader based on infrared LED line-type target |
| title_short | Research on visual positioning method of roadheader based on infrared LED line-type target |
| title_sort | research on visual positioning method of roadheader based on infrared led line type target |
| topic | boom- type roadheader visual pose measurement infrared linear target fusion features feature extraction |
| url | http://www.mtxb.com.cn/article/doi/10.13225/j.cnki.jccs.2024.0284 |
| work_keys_str_mv | AT jichengwan researchonvisualpositioningmethodofroadheaderbasedoninfraredledlinetypetarget AT xuhuizhang researchonvisualpositioningmethodofroadheaderbasedoninfraredledlinetypetarget AT wenjuanyang researchonvisualpositioningmethodofroadheaderbasedoninfraredledlinetypetarget AT chaozhang researchonvisualpositioningmethodofroadheaderbasedoninfraredledlinetypetarget AT mengyulei researchonvisualpositioningmethodofroadheaderbasedoninfraredledlinetypetarget AT yuyangdu researchonvisualpositioningmethodofroadheaderbasedoninfraredledlinetypetarget AT zhengdong researchonvisualpositioningmethodofroadheaderbasedoninfraredledlinetypetarget AT junhaoyang researchonvisualpositioningmethodofroadheaderbasedoninfraredledlinetypetarget |