Integrated deep learning framework for driver distraction detection and real-time road object recognition in advanced driver assistance systems
Abstract Most accidents are a result of distractions while driving and road user’s safety is a global concern. The proposed approach integrates advanced deep learning for driver distraction detection with real-time road object recognition to jointly address this problem. The behaviour of a driver is...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2025-07-01
|
| Series: | Scientific Reports |
| Subjects: | |
| Online Access: | https://doi.org/10.1038/s41598-025-08475-4 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849333184976650240 |
|---|---|
| author | Rakesh Salakapuri Naveen Kumar Navuri Thrimurthulu Vobbilineni G. Ravi Karthik Karmakonda K. Asish vardhan |
| author_facet | Rakesh Salakapuri Naveen Kumar Navuri Thrimurthulu Vobbilineni G. Ravi Karthik Karmakonda K. Asish vardhan |
| author_sort | Rakesh Salakapuri |
| collection | DOAJ |
| description | Abstract Most accidents are a result of distractions while driving and road user’s safety is a global concern. The proposed approach integrates advanced deep learning for driver distraction detection with real-time road object recognition to jointly address this problem. The behaviour of a driver is categorized into physical and visual distraction and cognitive distraction using Convolutional Neural Networks (CNN’s) and transfer learning in order to achieve greater accuracy while also consuming lesser computational resources. The YOLO (You Only Look Once) detects vehicles, pedestrians, lane markers, and traffic signals, in real-time. This system has (1) distraction detection and (2) output (or scenario) recognition, which combine other systems and codes to evaluate driving scenarios. A decision-making module evaluates the combined data to assess danger levels and prompt either timely warnings or corrective actions. Our integrated solution will enable a fully-context capable Advanced Driver Assistance System (ADAS) to warn drivers of distractions and hazards, and increases overall situational awareness and reduces accidents. The methodology is supplemented by annotated pictures and videos of driver behavior and road situations in the rain, fog, and low-light scenarios. System reliability under a range of driving scenarios is achieved through data augmentation, model optimization, and transfer learning. State Farm Distracted Driver Dataset, KITTI and MS COCO benchmarks demonstrated better accuracy and efficiency. Integrating existing systems that monitor drivers with systems that are aware of the road would create a multi-target, comprehensive solution that makes both driving safer and helps build upon existing ADAS technology for the better. A real-time and scalable road safety system is established through the integration of CNNs and YOLO deep learning advances. The system’s practicality was further validated through real-time embedded deployment on an NVIDIA Jetson Xavier NX platform, achieving 25 frames per second (FPS) with reduced latency and memory footprint, demonstrating feasibility for resource-constrained Advanced Driver Assistance Systems (ADAS). This paper presents a domain-specific driver monitoring module and a knowledge-based road hazard recognition model that better connect autonomous driving to the human side. |
| format | Article |
| id | doaj-art-6ee49b1fc2c245789247ffaef3541a7c |
| institution | Kabale University |
| issn | 2045-2322 |
| language | English |
| publishDate | 2025-07-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj-art-6ee49b1fc2c245789247ffaef3541a7c2025-08-20T03:45:57ZengNature PortfolioScientific Reports2045-23222025-07-0115112210.1038/s41598-025-08475-4Integrated deep learning framework for driver distraction detection and real-time road object recognition in advanced driver assistance systemsRakesh Salakapuri0Naveen Kumar Navuri1Thrimurthulu Vobbilineni2G. Ravi3Karthik Karmakonda4K. Asish vardhan5Symbiosis Institute of Technology, Hyderabad Campus, Symbiosis International (Deemed University)Department of Computer Science & Engineering, Malla Reddy UniversityDepartment of Computer Science & Engineering, MLR Institute of TechnologyDepartment Computer Science & Engineering, MRCETDepartment Computer Science & Engineering, CVR College of EngineeringDepartment of Computer Science & Engineering, Malla Reddy UniversityAbstract Most accidents are a result of distractions while driving and road user’s safety is a global concern. The proposed approach integrates advanced deep learning for driver distraction detection with real-time road object recognition to jointly address this problem. The behaviour of a driver is categorized into physical and visual distraction and cognitive distraction using Convolutional Neural Networks (CNN’s) and transfer learning in order to achieve greater accuracy while also consuming lesser computational resources. The YOLO (You Only Look Once) detects vehicles, pedestrians, lane markers, and traffic signals, in real-time. This system has (1) distraction detection and (2) output (or scenario) recognition, which combine other systems and codes to evaluate driving scenarios. A decision-making module evaluates the combined data to assess danger levels and prompt either timely warnings or corrective actions. Our integrated solution will enable a fully-context capable Advanced Driver Assistance System (ADAS) to warn drivers of distractions and hazards, and increases overall situational awareness and reduces accidents. The methodology is supplemented by annotated pictures and videos of driver behavior and road situations in the rain, fog, and low-light scenarios. System reliability under a range of driving scenarios is achieved through data augmentation, model optimization, and transfer learning. State Farm Distracted Driver Dataset, KITTI and MS COCO benchmarks demonstrated better accuracy and efficiency. Integrating existing systems that monitor drivers with systems that are aware of the road would create a multi-target, comprehensive solution that makes both driving safer and helps build upon existing ADAS technology for the better. A real-time and scalable road safety system is established through the integration of CNNs and YOLO deep learning advances. The system’s practicality was further validated through real-time embedded deployment on an NVIDIA Jetson Xavier NX platform, achieving 25 frames per second (FPS) with reduced latency and memory footprint, demonstrating feasibility for resource-constrained Advanced Driver Assistance Systems (ADAS). This paper presents a domain-specific driver monitoring module and a knowledge-based road hazard recognition model that better connect autonomous driving to the human side.https://doi.org/10.1038/s41598-025-08475-4Driver distraction detectionRoad object recognitionConvolutional Neural Networks (CNNs)YOLO (You Only Look Once)Advanced Driver Assistance Systems (ADAS)Deep learning |
| spellingShingle | Rakesh Salakapuri Naveen Kumar Navuri Thrimurthulu Vobbilineni G. Ravi Karthik Karmakonda K. Asish vardhan Integrated deep learning framework for driver distraction detection and real-time road object recognition in advanced driver assistance systems Scientific Reports Driver distraction detection Road object recognition Convolutional Neural Networks (CNNs) YOLO (You Only Look Once) Advanced Driver Assistance Systems (ADAS) Deep learning |
| title | Integrated deep learning framework for driver distraction detection and real-time road object recognition in advanced driver assistance systems |
| title_full | Integrated deep learning framework for driver distraction detection and real-time road object recognition in advanced driver assistance systems |
| title_fullStr | Integrated deep learning framework for driver distraction detection and real-time road object recognition in advanced driver assistance systems |
| title_full_unstemmed | Integrated deep learning framework for driver distraction detection and real-time road object recognition in advanced driver assistance systems |
| title_short | Integrated deep learning framework for driver distraction detection and real-time road object recognition in advanced driver assistance systems |
| title_sort | integrated deep learning framework for driver distraction detection and real time road object recognition in advanced driver assistance systems |
| topic | Driver distraction detection Road object recognition Convolutional Neural Networks (CNNs) YOLO (You Only Look Once) Advanced Driver Assistance Systems (ADAS) Deep learning |
| url | https://doi.org/10.1038/s41598-025-08475-4 |
| work_keys_str_mv | AT rakeshsalakapuri integrateddeeplearningframeworkfordriverdistractiondetectionandrealtimeroadobjectrecognitioninadvanceddriverassistancesystems AT naveenkumarnavuri integrateddeeplearningframeworkfordriverdistractiondetectionandrealtimeroadobjectrecognitioninadvanceddriverassistancesystems AT thrimurthuluvobbilineni integrateddeeplearningframeworkfordriverdistractiondetectionandrealtimeroadobjectrecognitioninadvanceddriverassistancesystems AT gravi integrateddeeplearningframeworkfordriverdistractiondetectionandrealtimeroadobjectrecognitioninadvanceddriverassistancesystems AT karthikkarmakonda integrateddeeplearningframeworkfordriverdistractiondetectionandrealtimeroadobjectrecognitioninadvanceddriverassistancesystems AT kasishvardhan integrateddeeplearningframeworkfordriverdistractiondetectionandrealtimeroadobjectrecognitioninadvanceddriverassistancesystems |