Combined localization method of roadheader based on vision and inertial navigation
Aiming at the problem of low pose accuracy and poor measurement stability of roadheader caused by single position measurement method of roadheader in coal mine, a combined positioning method of roadheader based on machine vision and optical fiber inertial navigation is proposed. Taking the three-las...
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Department of Coal Science and Technology
2025-06-01
|
| Series: | Meitan kexue jishu |
| Subjects: | |
| Online Access: | http://www.mtkxjs.com.cn/article/doi/10.12438/cst.2024-0335 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850118227608207360 |
|---|---|
| author | Jicheng WAN Xuhui ZHANG Wenjuan YANG Chao ZHANG Zheng DONG Yuyang DU Mengyu LEI Xin CHEN Junhao YANG |
| author_facet | Jicheng WAN Xuhui ZHANG Wenjuan YANG Chao ZHANG Zheng DONG Yuyang DU Mengyu LEI Xin CHEN Junhao YANG |
| author_sort | Jicheng WAN |
| collection | DOAJ |
| description | Aiming at the problem of low pose accuracy and poor measurement stability of roadheader caused by single position measurement method of roadheader in coal mine, a combined positioning method of roadheader based on machine vision and optical fiber inertial navigation is proposed. Taking the three-laser pointer fixed on the roof of the roadway as the characteristic target, a visual measurement system of the body pose of the roadheader based on the three-laser target is constructed. The airborne explosion-proof camera is used to collect the laser target, and the spot center position of the laser pointer is obtained by image processing. Combined with the visual measurement model of the body pose of the roadheader and the spatial coordinate transformation, the pose data of the roadheader are obtained. At the same time, the position and attitude information of the roadheader are obtained in real time by using the fiber optic inertial navigation installed on the roadheader fuselage. The Lagrange three-point interpolation method is used to register the visual pose data and the inertial pose data in time. After processing, the Kalman filter fusion algorithm is used to fuse the visual measurement data and the fiber optic inertial navigation data. The pose data after the fusion of the two is used to compensate and correct the cumulative error of the inertial navigation, and the output validity of the sensor of the measurement system is judged, which eliminates the cumulative error caused by the long-term integration operation of the inertial navigation and the short-term occlusion of the visual target and the influence of data loss on the fusion result, so as to obtain the real-time accurate pose data of the roadheader. The visual measurement platform of roadheader pose is built in the laboratory to evaluate the visual positioning method. Within the measurement distance of 60 m, the maximum position error is within 35 mm, and the maximum attitude angle error is within 0.5°. At the same time, the fusion positioning of vision and inertial navigation of roadheader was tested in the industrial field of underground coal mine. The results show that the fusion positioning method of vision and inertial navigation can overcome the influence of complex working conditions in underground mine and make up for the deficiency of single measurement method. The positioning error of roadheader body is within 30 mm, and the attitude angle error is within 0.5°, which meets the requirements of roadway construction accuracy. |
| format | Article |
| id | doaj-art-80e84d1e4daa4618b061d93d331c1f39 |
| institution | OA Journals |
| issn | 0253-2336 |
| language | zho |
| publishDate | 2025-06-01 |
| publisher | Editorial Department of Coal Science and Technology |
| record_format | Article |
| series | Meitan kexue jishu |
| spelling | doaj-art-80e84d1e4daa4618b061d93d331c1f392025-08-20T02:35:54ZzhoEditorial Department of Coal Science and TechnologyMeitan kexue jishu0253-23362025-06-0153645646710.12438/cst.2024-03352024-0335Combined localization method of roadheader based on vision and inertial navigationJicheng WAN0Xuhui ZHANG1Wenjuan YANG2Chao ZHANG3Zheng DONG4Yuyang DU5Mengyu LEI6Xin CHEN7Junhao YANG8College of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaCollege of Mechanical Engineering, Xi’an University of Science and Technology, Xi’an 710054, ChinaAiming at the problem of low pose accuracy and poor measurement stability of roadheader caused by single position measurement method of roadheader in coal mine, a combined positioning method of roadheader based on machine vision and optical fiber inertial navigation is proposed. Taking the three-laser pointer fixed on the roof of the roadway as the characteristic target, a visual measurement system of the body pose of the roadheader based on the three-laser target is constructed. The airborne explosion-proof camera is used to collect the laser target, and the spot center position of the laser pointer is obtained by image processing. Combined with the visual measurement model of the body pose of the roadheader and the spatial coordinate transformation, the pose data of the roadheader are obtained. At the same time, the position and attitude information of the roadheader are obtained in real time by using the fiber optic inertial navigation installed on the roadheader fuselage. The Lagrange three-point interpolation method is used to register the visual pose data and the inertial pose data in time. After processing, the Kalman filter fusion algorithm is used to fuse the visual measurement data and the fiber optic inertial navigation data. The pose data after the fusion of the two is used to compensate and correct the cumulative error of the inertial navigation, and the output validity of the sensor of the measurement system is judged, which eliminates the cumulative error caused by the long-term integration operation of the inertial navigation and the short-term occlusion of the visual target and the influence of data loss on the fusion result, so as to obtain the real-time accurate pose data of the roadheader. The visual measurement platform of roadheader pose is built in the laboratory to evaluate the visual positioning method. Within the measurement distance of 60 m, the maximum position error is within 35 mm, and the maximum attitude angle error is within 0.5°. At the same time, the fusion positioning of vision and inertial navigation of roadheader was tested in the industrial field of underground coal mine. The results show that the fusion positioning method of vision and inertial navigation can overcome the influence of complex working conditions in underground mine and make up for the deficiency of single measurement method. The positioning error of roadheader body is within 30 mm, and the attitude angle error is within 0.5°, which meets the requirements of roadway construction accuracy.http://www.mtkxjs.com.cn/article/doi/10.12438/cst.2024-0335roadheadervisual measurementoptical fiber inertial navigationkalman filtercombined localization |
| spellingShingle | Jicheng WAN Xuhui ZHANG Wenjuan YANG Chao ZHANG Zheng DONG Yuyang DU Mengyu LEI Xin CHEN Junhao YANG Combined localization method of roadheader based on vision and inertial navigation Meitan kexue jishu roadheader visual measurement optical fiber inertial navigation kalman filter combined localization |
| title | Combined localization method of roadheader based on vision and inertial navigation |
| title_full | Combined localization method of roadheader based on vision and inertial navigation |
| title_fullStr | Combined localization method of roadheader based on vision and inertial navigation |
| title_full_unstemmed | Combined localization method of roadheader based on vision and inertial navigation |
| title_short | Combined localization method of roadheader based on vision and inertial navigation |
| title_sort | combined localization method of roadheader based on vision and inertial navigation |
| topic | roadheader visual measurement optical fiber inertial navigation kalman filter combined localization |
| url | http://www.mtkxjs.com.cn/article/doi/10.12438/cst.2024-0335 |
| work_keys_str_mv | AT jichengwan combinedlocalizationmethodofroadheaderbasedonvisionandinertialnavigation AT xuhuizhang combinedlocalizationmethodofroadheaderbasedonvisionandinertialnavigation AT wenjuanyang combinedlocalizationmethodofroadheaderbasedonvisionandinertialnavigation AT chaozhang combinedlocalizationmethodofroadheaderbasedonvisionandinertialnavigation AT zhengdong combinedlocalizationmethodofroadheaderbasedonvisionandinertialnavigation AT yuyangdu combinedlocalizationmethodofroadheaderbasedonvisionandinertialnavigation AT mengyulei combinedlocalizationmethodofroadheaderbasedonvisionandinertialnavigation AT xinchen combinedlocalizationmethodofroadheaderbasedonvisionandinertialnavigation AT junhaoyang combinedlocalizationmethodofroadheaderbasedonvisionandinertialnavigation |