Tangential Human Posture Recognition with Sequential Images Based on MIMO Radar
Recent research on radar-based human activity recognition has typically focused on activities that move toward or away from radar in radial directions. Conventional Doppler-based methods can barely describe the true characteristics of nonradial activities, especially static postures or tangential ac...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
China Science Publishing & Media Ltd. (CSPM)
2025-02-01
|
| Series: | Leida xuebao |
| Subjects: | |
| Online Access: | https://radars.ac.cn/cn/article/doi/10.12000/JR24116 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832591805755949056 |
|---|---|
| author | Chuanwei DING Zhilin LIU Li ZHANG Heng ZHAO Qing ZHOU Hong HONG Xiaohua ZHU |
| author_facet | Chuanwei DING Zhilin LIU Li ZHANG Heng ZHAO Qing ZHOU Hong HONG Xiaohua ZHU |
| author_sort | Chuanwei DING |
| collection | DOAJ |
| description | Recent research on radar-based human activity recognition has typically focused on activities that move toward or away from radar in radial directions. Conventional Doppler-based methods can barely describe the true characteristics of nonradial activities, especially static postures or tangential activities, resulting in a considerable decline in recognition performance. To address this issue, a method for recognizing tangential human postures based on sequential images of a Multiple-Input Multiple-Output (MIMO) radar system is proposed. A time sequence of high-quality images is achieved to describe the structure of the human body and corresponding dynamic changes, where spatial and temporal features are extracted to enhance the recognition performance. First, a Constant False Alarm Rate (CFAR) algorithm is applied to locate the human target. A sliding window along the slow time axis is then utilized to divide the received signal into sequential frames. Next, a fast Fourier transform and the 2D Capon algorithm are performed on each frame to estimate range, pitch angle, and azimuth angle information, which are fused to create a tangential posture image. They are connected to form a time sequence of tangential posture images. To improve image quality, a modified joint multidomain adaptive threshold-based denoising algorithm is applied to improve the image quality by suppressing noises and enhancing human body outline and structure. Finally, a Spatio-Temporal-Convolution Long Short Term Memory (ST-ConvLSTM) network is designed to process the sequential images. In particular, the ConvLSTM cell is used to extract continuous image features by combining convolution operation with the LSTM cell. Moreover, spatial and temporal attention modules are utilized to emphasize intraframe and interframe focus for improving recognition performance. Extensive experiments show that our proposed method can achieve an accuracy rate of 96.9% in classifying eight typical tangential human postures, demonstrating its feasibility and superiority in tangential human posture recognition. |
| format | Article |
| id | doaj-art-e933144921584f8ebd90f7901a24188b |
| institution | Kabale University |
| issn | 2095-283X |
| language | English |
| publishDate | 2025-02-01 |
| publisher | China Science Publishing & Media Ltd. (CSPM) |
| record_format | Article |
| series | Leida xuebao |
| spelling | doaj-art-e933144921584f8ebd90f7901a24188b2025-01-22T06:12:25ZengChina Science Publishing & Media Ltd. (CSPM)Leida xuebao2095-283X2025-02-0114115116710.12000/JR24116R24116Tangential Human Posture Recognition with Sequential Images Based on MIMO RadarChuanwei DING0Zhilin LIU1Li ZHANG2Heng ZHAO3Qing ZHOU4Hong HONG5Xiaohua ZHU6Nanjing University of Science and Technology, Nanjing 210000, ChinaNanjing University of Science and Technology, Nanjing 210000, ChinaShanghai Aerospace Electronic Technology Institute, Shanghai 201109, ChinaNanjing University of Science and Technology, Nanjing 210000, ChinaNanjing University of Science and Technology, Nanjing 210000, ChinaNanjing University of Science and Technology, Nanjing 210000, ChinaNanjing University of Science and Technology, Nanjing 210000, ChinaRecent research on radar-based human activity recognition has typically focused on activities that move toward or away from radar in radial directions. Conventional Doppler-based methods can barely describe the true characteristics of nonradial activities, especially static postures or tangential activities, resulting in a considerable decline in recognition performance. To address this issue, a method for recognizing tangential human postures based on sequential images of a Multiple-Input Multiple-Output (MIMO) radar system is proposed. A time sequence of high-quality images is achieved to describe the structure of the human body and corresponding dynamic changes, where spatial and temporal features are extracted to enhance the recognition performance. First, a Constant False Alarm Rate (CFAR) algorithm is applied to locate the human target. A sliding window along the slow time axis is then utilized to divide the received signal into sequential frames. Next, a fast Fourier transform and the 2D Capon algorithm are performed on each frame to estimate range, pitch angle, and azimuth angle information, which are fused to create a tangential posture image. They are connected to form a time sequence of tangential posture images. To improve image quality, a modified joint multidomain adaptive threshold-based denoising algorithm is applied to improve the image quality by suppressing noises and enhancing human body outline and structure. Finally, a Spatio-Temporal-Convolution Long Short Term Memory (ST-ConvLSTM) network is designed to process the sequential images. In particular, the ConvLSTM cell is used to extract continuous image features by combining convolution operation with the LSTM cell. Moreover, spatial and temporal attention modules are utilized to emphasize intraframe and interframe focus for improving recognition performance. Extensive experiments show that our proposed method can achieve an accuracy rate of 96.9% in classifying eight typical tangential human postures, demonstrating its feasibility and superiority in tangential human posture recognition.https://radars.ac.cn/cn/article/doi/10.12000/JR24116mimo radartangential human posture recognitionsequential imagesimage denoisingdeep learning |
| spellingShingle | Chuanwei DING Zhilin LIU Li ZHANG Heng ZHAO Qing ZHOU Hong HONG Xiaohua ZHU Tangential Human Posture Recognition with Sequential Images Based on MIMO Radar Leida xuebao mimo radar tangential human posture recognition sequential images image denoising deep learning |
| title | Tangential Human Posture Recognition with Sequential Images Based on MIMO Radar |
| title_full | Tangential Human Posture Recognition with Sequential Images Based on MIMO Radar |
| title_fullStr | Tangential Human Posture Recognition with Sequential Images Based on MIMO Radar |
| title_full_unstemmed | Tangential Human Posture Recognition with Sequential Images Based on MIMO Radar |
| title_short | Tangential Human Posture Recognition with Sequential Images Based on MIMO Radar |
| title_sort | tangential human posture recognition with sequential images based on mimo radar |
| topic | mimo radar tangential human posture recognition sequential images image denoising deep learning |
| url | https://radars.ac.cn/cn/article/doi/10.12000/JR24116 |
| work_keys_str_mv | AT chuanweiding tangentialhumanposturerecognitionwithsequentialimagesbasedonmimoradar AT zhilinliu tangentialhumanposturerecognitionwithsequentialimagesbasedonmimoradar AT lizhang tangentialhumanposturerecognitionwithsequentialimagesbasedonmimoradar AT hengzhao tangentialhumanposturerecognitionwithsequentialimagesbasedonmimoradar AT qingzhou tangentialhumanposturerecognitionwithsequentialimagesbasedonmimoradar AT honghong tangentialhumanposturerecognitionwithsequentialimagesbasedonmimoradar AT xiaohuazhu tangentialhumanposturerecognitionwithsequentialimagesbasedonmimoradar |