Street View Image-Based Road Marking Inspection System Using Computer Vision and Deep Learning Techniques
Road markings are vital to the infrastructure of roads, conveying extensive guidance and information to drivers and autonomous vehicles. However, road markings will inevitably wear out over time and impact traffic safety. At the same time, the inspection and maintenance of road markings is an enormo...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2024-12-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/24/23/7724 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850060067040133120 |
|---|---|
| author | Junjie Wu Wen Liu Yoshihisa Maruyama |
| author_facet | Junjie Wu Wen Liu Yoshihisa Maruyama |
| author_sort | Junjie Wu |
| collection | DOAJ |
| description | Road markings are vital to the infrastructure of roads, conveying extensive guidance and information to drivers and autonomous vehicles. However, road markings will inevitably wear out over time and impact traffic safety. At the same time, the inspection and maintenance of road markings is an enormous burden on human and economic resources. Considering this, we propose a road marking inspection system using computer vision and deep learning techniques with the aid of street view images captured by a regular digital camera mounted on a vehicle. The damage ratio of road markings was measured according to both the undamaged region and region of road markings using semantic segmentation, inverse perspective mapping, and image thresholding approaches. Furthermore, a road marking damage detector that uses the YOLOv11x model was developed based on the damage ratio of road markings. Finally, the mean average precision achieves 73.5%, showing that the proposed system successfully automates the inspection process for road markings. In addition, we introduce the Road Marking Damage Detection Dataset (RMDDD), which has been made publicly available to facilitate further research in this area. |
| format | Article |
| id | doaj-art-1cb6ef1f44444067b7af86b20647fa52 |
| institution | DOAJ |
| issn | 1424-8220 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj-art-1cb6ef1f44444067b7af86b20647fa522025-08-20T02:50:41ZengMDPI AGSensors1424-82202024-12-012423772410.3390/s24237724Street View Image-Based Road Marking Inspection System Using Computer Vision and Deep Learning TechniquesJunjie Wu0Wen Liu1Yoshihisa Maruyama2Nippon Koei Co., Ltd., 5-4 Kojimachi, Chiyoda-ku, Tokyo 102-8539, JapanGraduate School of Engineering, Chiba University, Inage-ku, Chiba 263-8522, JapanGraduate School of Engineering, Chiba University, Inage-ku, Chiba 263-8522, JapanRoad markings are vital to the infrastructure of roads, conveying extensive guidance and information to drivers and autonomous vehicles. However, road markings will inevitably wear out over time and impact traffic safety. At the same time, the inspection and maintenance of road markings is an enormous burden on human and economic resources. Considering this, we propose a road marking inspection system using computer vision and deep learning techniques with the aid of street view images captured by a regular digital camera mounted on a vehicle. The damage ratio of road markings was measured according to both the undamaged region and region of road markings using semantic segmentation, inverse perspective mapping, and image thresholding approaches. Furthermore, a road marking damage detector that uses the YOLOv11x model was developed based on the damage ratio of road markings. Finally, the mean average precision achieves 73.5%, showing that the proposed system successfully automates the inspection process for road markings. In addition, we introduce the Road Marking Damage Detection Dataset (RMDDD), which has been made publicly available to facilitate further research in this area.https://www.mdpi.com/1424-8220/24/23/7724road markingsdamage detectioncomputer visiondeep learning |
| spellingShingle | Junjie Wu Wen Liu Yoshihisa Maruyama Street View Image-Based Road Marking Inspection System Using Computer Vision and Deep Learning Techniques Sensors road markings damage detection computer vision deep learning |
| title | Street View Image-Based Road Marking Inspection System Using Computer Vision and Deep Learning Techniques |
| title_full | Street View Image-Based Road Marking Inspection System Using Computer Vision and Deep Learning Techniques |
| title_fullStr | Street View Image-Based Road Marking Inspection System Using Computer Vision and Deep Learning Techniques |
| title_full_unstemmed | Street View Image-Based Road Marking Inspection System Using Computer Vision and Deep Learning Techniques |
| title_short | Street View Image-Based Road Marking Inspection System Using Computer Vision and Deep Learning Techniques |
| title_sort | street view image based road marking inspection system using computer vision and deep learning techniques |
| topic | road markings damage detection computer vision deep learning |
| url | https://www.mdpi.com/1424-8220/24/23/7724 |
| work_keys_str_mv | AT junjiewu streetviewimagebasedroadmarkinginspectionsystemusingcomputervisionanddeeplearningtechniques AT wenliu streetviewimagebasedroadmarkinginspectionsystemusingcomputervisionanddeeplearningtechniques AT yoshihisamaruyama streetviewimagebasedroadmarkinginspectionsystemusingcomputervisionanddeeplearningtechniques |