Transferring enhanced material knowledge via image quality enhancement and feature distillation for pavement condition identification
Abstract In the context of rapid advancements in autonomous driving technology, ensuring passengers’ safety and comfort has become a priority. Obstacle or road detection systems, especially accurate pavement condition identification in unfavorable weather or time circumstances, play a crucial role i...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2025-04-01
|
| Series: | Scientific Reports |
| Subjects: | |
| Online Access: | https://doi.org/10.1038/s41598-025-98484-0 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849712758169272320 |
|---|---|
| author | Zejiu Wu Yuxing Zou Boyang Liu Zhijie Li Donghong Ji Hongbin Zhang |
| author_facet | Zejiu Wu Yuxing Zou Boyang Liu Zhijie Li Donghong Ji Hongbin Zhang |
| author_sort | Zejiu Wu |
| collection | DOAJ |
| description | Abstract In the context of rapid advancements in autonomous driving technology, ensuring passengers’ safety and comfort has become a priority. Obstacle or road detection systems, especially accurate pavement condition identification in unfavorable weather or time circumstances, play a crucial role in the safe operation and comfortable riding experience of autonomous vehicles. To this end, we propose a novel framework based on image quality enhancement and feature distillation (IQEFD) for detecting diverse pavement conditions during the day and night to achieve state classification. The IQEFD model first leverages ConvNeXt as its backbone to extract high-quality basic features. Then, a bidirectional fusion module embedded with a hybrid attention mechanism (HAM) is devised to effectively extract multi-scale refined features, thereby mitigating information loss during continuous upsampling and downsampling. Subsequently, the refined features are fused with the enhanced features extracted through the image enhancement network Zero-DCE to generate the fused attention features. Lastly, the enhanced features serve as the guidance online for the fused attention features through feature distillation, transferring enhanced material knowledge and achieving alignment between feature representations. Extensive experimental results on two publicly available datasets validate that IQEFD can accurately classify a variety of pavement conditions, including dry, wet, and snowy conditions, especially showing satisfactory and robust performance in noisy nighttime images. In detail, the IQEFD model achieves the accuracies of 98.04% and 98.68% on the YouTube-w-ALI and YouTube-w/o-ALI datasets, respectively, outperforming the state-of-the-art baselines. It is worth noting that IQEFD has a certain generalization ability on a classical material image dataset named MattrSet, with an average accuracy of 75.86%. This study provides a novel insight into pavement condition identification. The source code of IQEFD will be made available at https://github.com/rainzyx/IQEFD . |
| format | Article |
| id | doaj-art-2df172059b974f0dbf643a6881b6a8a6 |
| institution | DOAJ |
| issn | 2045-2322 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj-art-2df172059b974f0dbf643a6881b6a8a62025-08-20T03:14:10ZengNature PortfolioScientific Reports2045-23222025-04-0115112310.1038/s41598-025-98484-0Transferring enhanced material knowledge via image quality enhancement and feature distillation for pavement condition identificationZejiu Wu0Yuxing Zou1Boyang Liu2Zhijie Li3Donghong Ji4Hongbin Zhang5School of Science, East China Jiaotong UniversitySchool of Information and Software Engineering, East China Jiaotong UniversitySchool of Information and Software Engineering, East China Jiaotong UniversitySchool of Information and Software Engineering, East China Jiaotong UniversityCyber Science and Engineering School, Wuhan UniversitySchool of Information and Software Engineering, East China Jiaotong UniversityAbstract In the context of rapid advancements in autonomous driving technology, ensuring passengers’ safety and comfort has become a priority. Obstacle or road detection systems, especially accurate pavement condition identification in unfavorable weather or time circumstances, play a crucial role in the safe operation and comfortable riding experience of autonomous vehicles. To this end, we propose a novel framework based on image quality enhancement and feature distillation (IQEFD) for detecting diverse pavement conditions during the day and night to achieve state classification. The IQEFD model first leverages ConvNeXt as its backbone to extract high-quality basic features. Then, a bidirectional fusion module embedded with a hybrid attention mechanism (HAM) is devised to effectively extract multi-scale refined features, thereby mitigating information loss during continuous upsampling and downsampling. Subsequently, the refined features are fused with the enhanced features extracted through the image enhancement network Zero-DCE to generate the fused attention features. Lastly, the enhanced features serve as the guidance online for the fused attention features through feature distillation, transferring enhanced material knowledge and achieving alignment between feature representations. Extensive experimental results on two publicly available datasets validate that IQEFD can accurately classify a variety of pavement conditions, including dry, wet, and snowy conditions, especially showing satisfactory and robust performance in noisy nighttime images. In detail, the IQEFD model achieves the accuracies of 98.04% and 98.68% on the YouTube-w-ALI and YouTube-w/o-ALI datasets, respectively, outperforming the state-of-the-art baselines. It is worth noting that IQEFD has a certain generalization ability on a classical material image dataset named MattrSet, with an average accuracy of 75.86%. This study provides a novel insight into pavement condition identification. The source code of IQEFD will be made available at https://github.com/rainzyx/IQEFD .https://doi.org/10.1038/s41598-025-98484-0Pavement condition identificationEnhanced material knowledgeImage quality enhancementFeature distillationHybrid attention mechanism |
| spellingShingle | Zejiu Wu Yuxing Zou Boyang Liu Zhijie Li Donghong Ji Hongbin Zhang Transferring enhanced material knowledge via image quality enhancement and feature distillation for pavement condition identification Scientific Reports Pavement condition identification Enhanced material knowledge Image quality enhancement Feature distillation Hybrid attention mechanism |
| title | Transferring enhanced material knowledge via image quality enhancement and feature distillation for pavement condition identification |
| title_full | Transferring enhanced material knowledge via image quality enhancement and feature distillation for pavement condition identification |
| title_fullStr | Transferring enhanced material knowledge via image quality enhancement and feature distillation for pavement condition identification |
| title_full_unstemmed | Transferring enhanced material knowledge via image quality enhancement and feature distillation for pavement condition identification |
| title_short | Transferring enhanced material knowledge via image quality enhancement and feature distillation for pavement condition identification |
| title_sort | transferring enhanced material knowledge via image quality enhancement and feature distillation for pavement condition identification |
| topic | Pavement condition identification Enhanced material knowledge Image quality enhancement Feature distillation Hybrid attention mechanism |
| url | https://doi.org/10.1038/s41598-025-98484-0 |
| work_keys_str_mv | AT zejiuwu transferringenhancedmaterialknowledgeviaimagequalityenhancementandfeaturedistillationforpavementconditionidentification AT yuxingzou transferringenhancedmaterialknowledgeviaimagequalityenhancementandfeaturedistillationforpavementconditionidentification AT boyangliu transferringenhancedmaterialknowledgeviaimagequalityenhancementandfeaturedistillationforpavementconditionidentification AT zhijieli transferringenhancedmaterialknowledgeviaimagequalityenhancementandfeaturedistillationforpavementconditionidentification AT donghongji transferringenhancedmaterialknowledgeviaimagequalityenhancementandfeaturedistillationforpavementconditionidentification AT hongbinzhang transferringenhancedmaterialknowledgeviaimagequalityenhancementandfeaturedistillationforpavementconditionidentification |