VR-Aided Ankle Rehabilitation Decision-Making Based on Convolutional Gated Recurrent Neural Network

Traditional rehabilitation training for stroke patients with ankle joint issues typically relies on the expertise of physicians. However, when confronted with complex challenges, such as online decision-making or assessing rehabilitation progress, even seasoned experts may not anticipate all potenti...

Full description

Saved in:
Bibliographic Details
Main Authors: Hu Zhang, Yujia Liao, Chang Zhu, Wei Meng, Quan Liu, Sheng Q. Xie
Format: Article
Language:English
Published: MDPI AG 2024-10-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/24/21/6998
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850062779629699072
author Hu Zhang
Yujia Liao
Chang Zhu
Wei Meng
Quan Liu
Sheng Q. Xie
author_facet Hu Zhang
Yujia Liao
Chang Zhu
Wei Meng
Quan Liu
Sheng Q. Xie
author_sort Hu Zhang
collection DOAJ
description Traditional rehabilitation training for stroke patients with ankle joint issues typically relies on the expertise of physicians. However, when confronted with complex challenges, such as online decision-making or assessing rehabilitation progress, even seasoned experts may not anticipate all potential hurdles. A novel approach is necessary—one that effectively addresses these complexities without solely leaning on expert experience. Previous studies have introduced a rehabilitation assessment method based on fuzzy neural networks. This paper proposes a novel approach, which is a VR-aided ankle rehabilitation decision-making model based on a convolutional gated recurrent neural network. This model takes various inputs, including ankle dorsiflexion range of motion, angular velocity, jerk, and motion performance scores, gathered from wearable motion inertial sensors during virtual reality rehabilitation. To overcome the challenge of limited data, data augmentation techniques are employed. This allows for the simulation of five stages of rehabilitation based on the Brunnstrom staging scale, providing tailored control parameters for virtual training scenarios suited to patients at different stages of recovery. Experiments comparing the classification performance of convolutional neural networks and long short-term memory networks were conducted. The results were compelling: the optimized convolutional gated recurrent neural network outperformed both alternatives, boasting an average accuracy of 99.16% and a Macro-F1 score of 0.9786. Importantly, it demonstrated a strong correlation (correlation coefficient r > 0.9) with the assessments made by clinical rehabilitation experts, showing its effectiveness in real-world applications.
format Article
id doaj-art-eae0d8f772ca4b0d84b1a3368934dee6
institution DOAJ
issn 1424-8220
language English
publishDate 2024-10-01
publisher MDPI AG
record_format Article
series Sensors
spelling doaj-art-eae0d8f772ca4b0d84b1a3368934dee62025-08-20T02:49:49ZengMDPI AGSensors1424-82202024-10-012421699810.3390/s24216998VR-Aided Ankle Rehabilitation Decision-Making Based on Convolutional Gated Recurrent Neural NetworkHu Zhang0Yujia Liao1Chang Zhu2Wei Meng3Quan Liu4Sheng Q. Xie5School of Information Engineering, Wuhan University of Technology, Wuhan 430070, ChinaSchool of Information Engineering, Wuhan University of Technology, Wuhan 430070, ChinaSchool of Information Engineering, Wuhan University of Technology, Wuhan 430070, ChinaSchool of Information Engineering, Wuhan University of Technology, Wuhan 430070, ChinaSchool of Information Engineering, Wuhan University of Technology, Wuhan 430070, ChinaSchool of Electronic and Electrical Engineering, University of Leeds, Leeds LS2 9JT, UKTraditional rehabilitation training for stroke patients with ankle joint issues typically relies on the expertise of physicians. However, when confronted with complex challenges, such as online decision-making or assessing rehabilitation progress, even seasoned experts may not anticipate all potential hurdles. A novel approach is necessary—one that effectively addresses these complexities without solely leaning on expert experience. Previous studies have introduced a rehabilitation assessment method based on fuzzy neural networks. This paper proposes a novel approach, which is a VR-aided ankle rehabilitation decision-making model based on a convolutional gated recurrent neural network. This model takes various inputs, including ankle dorsiflexion range of motion, angular velocity, jerk, and motion performance scores, gathered from wearable motion inertial sensors during virtual reality rehabilitation. To overcome the challenge of limited data, data augmentation techniques are employed. This allows for the simulation of five stages of rehabilitation based on the Brunnstrom staging scale, providing tailored control parameters for virtual training scenarios suited to patients at different stages of recovery. Experiments comparing the classification performance of convolutional neural networks and long short-term memory networks were conducted. The results were compelling: the optimized convolutional gated recurrent neural network outperformed both alternatives, boasting an average accuracy of 99.16% and a Macro-F1 score of 0.9786. Importantly, it demonstrated a strong correlation (correlation coefficient r > 0.9) with the assessments made by clinical rehabilitation experts, showing its effectiveness in real-world applications.https://www.mdpi.com/1424-8220/24/21/6998strokerehabilitationrehabilitation decision-makingconvolutional gated recurrent neural networkwhale optimization algorithm
spellingShingle Hu Zhang
Yujia Liao
Chang Zhu
Wei Meng
Quan Liu
Sheng Q. Xie
VR-Aided Ankle Rehabilitation Decision-Making Based on Convolutional Gated Recurrent Neural Network
Sensors
stroke
rehabilitation
rehabilitation decision-making
convolutional gated recurrent neural network
whale optimization algorithm
title VR-Aided Ankle Rehabilitation Decision-Making Based on Convolutional Gated Recurrent Neural Network
title_full VR-Aided Ankle Rehabilitation Decision-Making Based on Convolutional Gated Recurrent Neural Network
title_fullStr VR-Aided Ankle Rehabilitation Decision-Making Based on Convolutional Gated Recurrent Neural Network
title_full_unstemmed VR-Aided Ankle Rehabilitation Decision-Making Based on Convolutional Gated Recurrent Neural Network
title_short VR-Aided Ankle Rehabilitation Decision-Making Based on Convolutional Gated Recurrent Neural Network
title_sort vr aided ankle rehabilitation decision making based on convolutional gated recurrent neural network
topic stroke
rehabilitation
rehabilitation decision-making
convolutional gated recurrent neural network
whale optimization algorithm
url https://www.mdpi.com/1424-8220/24/21/6998
work_keys_str_mv AT huzhang vraidedanklerehabilitationdecisionmakingbasedonconvolutionalgatedrecurrentneuralnetwork
AT yujialiao vraidedanklerehabilitationdecisionmakingbasedonconvolutionalgatedrecurrentneuralnetwork
AT changzhu vraidedanklerehabilitationdecisionmakingbasedonconvolutionalgatedrecurrentneuralnetwork
AT weimeng vraidedanklerehabilitationdecisionmakingbasedonconvolutionalgatedrecurrentneuralnetwork
AT quanliu vraidedanklerehabilitationdecisionmakingbasedonconvolutionalgatedrecurrentneuralnetwork
AT shengqxie vraidedanklerehabilitationdecisionmakingbasedonconvolutionalgatedrecurrentneuralnetwork