Efficient Real-Time Object Detection and Classification Using mmWave Radar and Jetson Xavier NX
Recently, mmWave radars have been used in several automotive and industrial applications to provide the position and speed of detected objects using FMCW algorithms. However, this radar is not able to recognize or classify the detected objects. This paper associates a mmWave radar with a real-time e...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/11024013/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849706115015639040 |
|---|---|
| author | Mohamed Lamane Abdessamad Klilou Mohamed Tabaa |
| author_facet | Mohamed Lamane Abdessamad Klilou Mohamed Tabaa |
| author_sort | Mohamed Lamane |
| collection | DOAJ |
| description | Recently, mmWave radars have been used in several automotive and industrial applications to provide the position and speed of detected objects using FMCW algorithms. However, this radar is not able to recognize or classify the detected objects. This paper associates a mmWave radar with a real-time embedded computing platform and proposes a real-time implementation of deep learning algorithms in order to classify the detected objects. Three different classes of objects have been studied in this paper, i.e., human, car, and motorcycle. The proposed on-board system is based on the AWR2944EVM as a mmWave radar and the Nvidia Jetson Xavier NX as an embedded computing platform. The system was mounted on a motorcycle for data acquisition and real-time classification. The system developed captures radar data and processes it rapidly, converting it into usable formats for efficient object classification. Several YOLO detection deep learning models were evaluated, among which the YOLOv9-E model, which provided the best accuracy and speed performances for our application, i.e., a mAP_0.5 of 84% and an accuracy of 86.4%. The proposed architecture can process up to 18.59 frames per second (FPS). This system has been tested in a wide range of real-life conditions, validating its robustness and ability to operate in a variety of environments. The results obtained show that the proposed implementation delivers good real-time inference performance with optimized power consumption. |
| format | Article |
| id | doaj-art-930e49d2cdc14ceb91a9cb67e59f25da |
| institution | DOAJ |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-930e49d2cdc14ceb91a9cb67e59f25da2025-08-20T03:16:17ZengIEEEIEEE Access2169-35362025-01-011310465110466510.1109/ACCESS.2025.357633111024013Efficient Real-Time Object Detection and Classification Using mmWave Radar and Jetson Xavier NXMohamed Lamane0https://orcid.org/0009-0001-0594-0611Abdessamad Klilou1https://orcid.org/0000-0002-3662-8727Mohamed Tabaa2https://orcid.org/0000-0003-3938-3566MiSET Team, Faculty of Sciences and Technologies, Sultan Moulay Slimane University, Beni Mellal, MoroccoMiSET Team, Faculty of Sciences and Technologies, Sultan Moulay Slimane University, Beni Mellal, MoroccoLPRI, Moroccan School of Engineering Sciences, Casablanca, MoroccoRecently, mmWave radars have been used in several automotive and industrial applications to provide the position and speed of detected objects using FMCW algorithms. However, this radar is not able to recognize or classify the detected objects. This paper associates a mmWave radar with a real-time embedded computing platform and proposes a real-time implementation of deep learning algorithms in order to classify the detected objects. Three different classes of objects have been studied in this paper, i.e., human, car, and motorcycle. The proposed on-board system is based on the AWR2944EVM as a mmWave radar and the Nvidia Jetson Xavier NX as an embedded computing platform. The system was mounted on a motorcycle for data acquisition and real-time classification. The system developed captures radar data and processes it rapidly, converting it into usable formats for efficient object classification. Several YOLO detection deep learning models were evaluated, among which the YOLOv9-E model, which provided the best accuracy and speed performances for our application, i.e., a mAP_0.5 of 84% and an accuracy of 86.4%. The proposed architecture can process up to 18.59 frames per second (FPS). This system has been tested in a wide range of real-life conditions, validating its robustness and ability to operate in a variety of environments. The results obtained show that the proposed implementation delivers good real-time inference performance with optimized power consumption.https://ieeexplore.ieee.org/document/11024013/mmWaveFMCWdetectionclassificationreal-time accelerationYOLO |
| spellingShingle | Mohamed Lamane Abdessamad Klilou Mohamed Tabaa Efficient Real-Time Object Detection and Classification Using mmWave Radar and Jetson Xavier NX IEEE Access mmWave FMCW detection classification real-time acceleration YOLO |
| title | Efficient Real-Time Object Detection and Classification Using mmWave Radar and Jetson Xavier NX |
| title_full | Efficient Real-Time Object Detection and Classification Using mmWave Radar and Jetson Xavier NX |
| title_fullStr | Efficient Real-Time Object Detection and Classification Using mmWave Radar and Jetson Xavier NX |
| title_full_unstemmed | Efficient Real-Time Object Detection and Classification Using mmWave Radar and Jetson Xavier NX |
| title_short | Efficient Real-Time Object Detection and Classification Using mmWave Radar and Jetson Xavier NX |
| title_sort | efficient real time object detection and classification using mmwave radar and jetson xavier nx |
| topic | mmWave FMCW detection classification real-time acceleration YOLO |
| url | https://ieeexplore.ieee.org/document/11024013/ |
| work_keys_str_mv | AT mohamedlamane efficientrealtimeobjectdetectionandclassificationusingmmwaveradarandjetsonxaviernx AT abdessamadklilou efficientrealtimeobjectdetectionandclassificationusingmmwaveradarandjetsonxaviernx AT mohamedtabaa efficientrealtimeobjectdetectionandclassificationusingmmwaveradarandjetsonxaviernx |