Drill pipe counting for underground drilling rigs based on miner pose recognition
In underground coal mine work sites, moving people and objects may appear between the drill pipes and the monitoring camera, resulting in incomplete video footage and counting omissions of drill pipes. At present, studies on drill pipe counting methods based on image processing and machine vision ra...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | zho |
| Published: |
Editorial Department of Industry and Mine Automation
2025-06-01
|
| Series: | Gong-kuang zidonghua |
| Subjects: | |
| Online Access: | http://www.gkzdh.cn/article/doi/10.13272/j.issn.1671-251x.2024110043 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849414764365611008 |
|---|---|
| author | LIU Jie YANG Cheng CHENG Zeming SUN Xiaohu XU Hao SHENG Guoyu |
| author_facet | LIU Jie YANG Cheng CHENG Zeming SUN Xiaohu XU Hao SHENG Guoyu |
| author_sort | LIU Jie |
| collection | DOAJ |
| description | In underground coal mine work sites, moving people and objects may appear between the drill pipes and the monitoring camera, resulting in incomplete video footage and counting omissions of drill pipes. At present, studies on drill pipe counting methods based on image processing and machine vision rarely address the problem of occlusion. Most existing models require collecting and processing all frames of the target video and performing image preprocessing. To address the above issues, a drill pipe counting algorithm for underground drilling rigs based on miner operation pose recognition named the BlazePose-DPC algorithm, was proposed. This algorithm used the BlazePose network to extract key pose information of miners as the basis for automatic drill pipe counting, transforming the drill pipe counting task into the recognition and matching of key operational poses of miners. Key poses were extracted as skeletal joint coordinates from key pose frames via the BlazePose network. Key pose coordinate matching used normalized Euclidean distance to represent the similarity between poses. When the similarity exceeded a predefined threshold, the action in the video was considered complete, and the count was incremented by one, thereby enabling automatic drill pipe counting. Experiments on the BlazePose-DPC algorithm were conducted using two datasets. Dataset 1 was recorded by a mobile device at the Qinggangping Coal Mine in Xunyi, Shaanxi Province, where video instability was common. Dataset 2 was recorded by a fixed surveillance device at the Huaneng Qingyang Meidian Hetaoyu Coal Mine, where uneven lighting and occlusion were common. Experimental results showed that the BlazePose-DPC algorithm was able to perform accurate counting even under challenging lighting conditions or partial occlusion. It maintained accurate counting during prolonged operation, demonstrating stable performance. The BlazePose-DPC algorithm achieved an accuracy of 95.5%, meeting the requirements for drill pipe counting. |
| format | Article |
| id | doaj-art-dfe3c2c8a80443119c4437814191a3a4 |
| institution | Kabale University |
| issn | 1671-251X |
| language | zho |
| publishDate | 2025-06-01 |
| publisher | Editorial Department of Industry and Mine Automation |
| record_format | Article |
| series | Gong-kuang zidonghua |
| spelling | doaj-art-dfe3c2c8a80443119c4437814191a3a42025-08-20T03:33:43ZzhoEditorial Department of Industry and Mine AutomationGong-kuang zidonghua1671-251X2025-06-01516556010.13272/j.issn.1671-251x.2024110043Drill pipe counting for underground drilling rigs based on miner pose recognitionLIU Jie0YANG Cheng1CHENG Zeming2SUN Xiaohu3XU Hao4SHENG Guoyu5Huaneng Coal Technology Research Co., Ltd., Beijing 100070, ChinaShandong Key Laboratory of Ubiquitous Intelligent Computing(Preparatory), University of Jinan, Jinan 250022, ChinaShandong Key Laboratory of Ubiquitous Intelligent Computing(Preparatory), University of Jinan, Jinan 250022, ChinaHuaneng Coal Technology Research Co., Ltd., Beijing 100070, ChinaHuaneng Coal Technology Research Co., Ltd., Beijing 100070, ChinaShandong Key Laboratory of Ubiquitous Intelligent Computing(Preparatory), University of Jinan, Jinan 250022, ChinaIn underground coal mine work sites, moving people and objects may appear between the drill pipes and the monitoring camera, resulting in incomplete video footage and counting omissions of drill pipes. At present, studies on drill pipe counting methods based on image processing and machine vision rarely address the problem of occlusion. Most existing models require collecting and processing all frames of the target video and performing image preprocessing. To address the above issues, a drill pipe counting algorithm for underground drilling rigs based on miner operation pose recognition named the BlazePose-DPC algorithm, was proposed. This algorithm used the BlazePose network to extract key pose information of miners as the basis for automatic drill pipe counting, transforming the drill pipe counting task into the recognition and matching of key operational poses of miners. Key poses were extracted as skeletal joint coordinates from key pose frames via the BlazePose network. Key pose coordinate matching used normalized Euclidean distance to represent the similarity between poses. When the similarity exceeded a predefined threshold, the action in the video was considered complete, and the count was incremented by one, thereby enabling automatic drill pipe counting. Experiments on the BlazePose-DPC algorithm were conducted using two datasets. Dataset 1 was recorded by a mobile device at the Qinggangping Coal Mine in Xunyi, Shaanxi Province, where video instability was common. Dataset 2 was recorded by a fixed surveillance device at the Huaneng Qingyang Meidian Hetaoyu Coal Mine, where uneven lighting and occlusion were common. Experimental results showed that the BlazePose-DPC algorithm was able to perform accurate counting even under challenging lighting conditions or partial occlusion. It maintained accurate counting during prolonged operation, demonstrating stable performance. The BlazePose-DPC algorithm achieved an accuracy of 95.5%, meeting the requirements for drill pipe counting.http://www.gkzdh.cn/article/doi/10.13272/j.issn.1671-251x.2024110043drill pipe countingblazepose networkoperation pose estimationpose matchingsingle-producer multi-consumer buffer pooleuclidean distance of joint points |
| spellingShingle | LIU Jie YANG Cheng CHENG Zeming SUN Xiaohu XU Hao SHENG Guoyu Drill pipe counting for underground drilling rigs based on miner pose recognition Gong-kuang zidonghua drill pipe counting blazepose network operation pose estimation pose matching single-producer multi-consumer buffer pool euclidean distance of joint points |
| title | Drill pipe counting for underground drilling rigs based on miner pose recognition |
| title_full | Drill pipe counting for underground drilling rigs based on miner pose recognition |
| title_fullStr | Drill pipe counting for underground drilling rigs based on miner pose recognition |
| title_full_unstemmed | Drill pipe counting for underground drilling rigs based on miner pose recognition |
| title_short | Drill pipe counting for underground drilling rigs based on miner pose recognition |
| title_sort | drill pipe counting for underground drilling rigs based on miner pose recognition |
| topic | drill pipe counting blazepose network operation pose estimation pose matching single-producer multi-consumer buffer pool euclidean distance of joint points |
| url | http://www.gkzdh.cn/article/doi/10.13272/j.issn.1671-251x.2024110043 |
| work_keys_str_mv | AT liujie drillpipecountingforundergrounddrillingrigsbasedonminerposerecognition AT yangcheng drillpipecountingforundergrounddrillingrigsbasedonminerposerecognition AT chengzeming drillpipecountingforundergrounddrillingrigsbasedonminerposerecognition AT sunxiaohu drillpipecountingforundergrounddrillingrigsbasedonminerposerecognition AT xuhao drillpipecountingforundergrounddrillingrigsbasedonminerposerecognition AT shengguoyu drillpipecountingforundergrounddrillingrigsbasedonminerposerecognition |