A deep learning model for assistive decision-making during robot-aided rehabilitation therapies based on therapists’ demonstrations
Abstract Background A promising approach to improving motor recovery during rehabilitation is the use of robotic rehabilitation devices. These robotic devices provide tools to monitor the patient’s recovery progress while providing highly standardized and intensive therapy. A major challenge in usin...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2025-01-01
|
| Series: | Journal of NeuroEngineering and Rehabilitation |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12984-024-01517-4 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832571922325438464 |
|---|---|
| author | David Martínez-Pascual José M. Catalán Luís D. Lledó Andrea Blanco-Ivorra Nicolás García-Aracil |
| author_facet | David Martínez-Pascual José M. Catalán Luís D. Lledó Andrea Blanco-Ivorra Nicolás García-Aracil |
| author_sort | David Martínez-Pascual |
| collection | DOAJ |
| description | Abstract Background A promising approach to improving motor recovery during rehabilitation is the use of robotic rehabilitation devices. These robotic devices provide tools to monitor the patient’s recovery progress while providing highly standardized and intensive therapy. A major challenge in using these robotic devices is the ability to decide when to assist the user. In this context, we propose a Deep Learning-based solution that can learn from a therapist’s criteria when a patient needs assistance during robot-aided rehabilitation therapy. Methods An experimental session was conducted with diverse people who suffered from neurological conditions. The participants used an upper limb rehabilitation robot to play a point-to-point game. A therapist supervised the robot-aided rehabilitation exercises and assisted the participants when considered necessary. This assistance provided by the therapist was detected to label those trajectories that were assisted to train a Deep Learning model that learns from the therapist when to assist. A series of transformations have been applied to the trajectories performed by the participants to generalize the method. Furthermore, the trajectory data was divided into sequences to be introduced to the model and continuously infer whether the user needs assistance. The data acquired during the experimental sessions have been divided into two datasets to train and evaluate the model: intra-participants (80% training, 20% validation) and test participants. The architecture of the Deep Learning model is conceived to perform time-series classification. It consists of diverse one-dimensional convolutional layers, a convolutional attention mechanism, and a Global Average Pooling layer. In addition, the output layer has one neuron with the sigmoid activation function, whose output can be interpreted as a probability of assistance. The model proposed in this study has been evaluated according to different metrics. In addition, the impact of applying fine-tuning to adapt the assistance to each user has been evaluated with the test participants. Results The proposed model achieved an accuracy of 91.39% and an F1-Score of 75.15% with the validation dataset during a sequence-to-sequence evaluation, surpassing other state-of-the-art architectures. When evaluating the trajectories collected in the test dataset, the method proposed achieved an accuracy of 76.09% and an F1-Score of 74.42% after applying fine-tuning to each participant. Conclusions The results achieved by our Deep Learning-based method show the feasibility of learning assistance decision-making from experimented therapists. Furthermore, fine-tuning can be applied to personalize the assistance to each user and improve the accuracy of the method presented when deciding whether to assist with the rehabilitation robot. |
| format | Article |
| id | doaj-art-4182a42ae1e14cea9d63e07c65751b88 |
| institution | Kabale University |
| issn | 1743-0003 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | BMC |
| record_format | Article |
| series | Journal of NeuroEngineering and Rehabilitation |
| spelling | doaj-art-4182a42ae1e14cea9d63e07c65751b882025-02-02T12:11:46ZengBMCJournal of NeuroEngineering and Rehabilitation1743-00032025-01-0122111510.1186/s12984-024-01517-4A deep learning model for assistive decision-making during robot-aided rehabilitation therapies based on therapists’ demonstrationsDavid Martínez-Pascual0José M. Catalán1Luís D. Lledó2Andrea Blanco-Ivorra3Nicolás García-Aracil4Robotics and Artificial Intelligence Group, Bioengineering Institute, Miguel Hernández UniversityRobotics and Artificial Intelligence Group, Bioengineering Institute, Miguel Hernández UniversityRobotics and Artificial Intelligence Group, Bioengineering Institute, Miguel Hernández UniversityRobotics and Artificial Intelligence Group, Bioengineering Institute, Miguel Hernández UniversityRobotics and Artificial Intelligence Group, Bioengineering Institute, Miguel Hernández UniversityAbstract Background A promising approach to improving motor recovery during rehabilitation is the use of robotic rehabilitation devices. These robotic devices provide tools to monitor the patient’s recovery progress while providing highly standardized and intensive therapy. A major challenge in using these robotic devices is the ability to decide when to assist the user. In this context, we propose a Deep Learning-based solution that can learn from a therapist’s criteria when a patient needs assistance during robot-aided rehabilitation therapy. Methods An experimental session was conducted with diverse people who suffered from neurological conditions. The participants used an upper limb rehabilitation robot to play a point-to-point game. A therapist supervised the robot-aided rehabilitation exercises and assisted the participants when considered necessary. This assistance provided by the therapist was detected to label those trajectories that were assisted to train a Deep Learning model that learns from the therapist when to assist. A series of transformations have been applied to the trajectories performed by the participants to generalize the method. Furthermore, the trajectory data was divided into sequences to be introduced to the model and continuously infer whether the user needs assistance. The data acquired during the experimental sessions have been divided into two datasets to train and evaluate the model: intra-participants (80% training, 20% validation) and test participants. The architecture of the Deep Learning model is conceived to perform time-series classification. It consists of diverse one-dimensional convolutional layers, a convolutional attention mechanism, and a Global Average Pooling layer. In addition, the output layer has one neuron with the sigmoid activation function, whose output can be interpreted as a probability of assistance. The model proposed in this study has been evaluated according to different metrics. In addition, the impact of applying fine-tuning to adapt the assistance to each user has been evaluated with the test participants. Results The proposed model achieved an accuracy of 91.39% and an F1-Score of 75.15% with the validation dataset during a sequence-to-sequence evaluation, surpassing other state-of-the-art architectures. When evaluating the trajectories collected in the test dataset, the method proposed achieved an accuracy of 76.09% and an F1-Score of 74.42% after applying fine-tuning to each participant. Conclusions The results achieved by our Deep Learning-based method show the feasibility of learning assistance decision-making from experimented therapists. Furthermore, fine-tuning can be applied to personalize the assistance to each user and improve the accuracy of the method presented when deciding whether to assist with the rehabilitation robot.https://doi.org/10.1186/s12984-024-01517-4Rehabilitation roboticsNeurorehabilitationDeep learningExergamesAssistance as needed |
| spellingShingle | David Martínez-Pascual José M. Catalán Luís D. Lledó Andrea Blanco-Ivorra Nicolás García-Aracil A deep learning model for assistive decision-making during robot-aided rehabilitation therapies based on therapists’ demonstrations Journal of NeuroEngineering and Rehabilitation Rehabilitation robotics Neurorehabilitation Deep learning Exergames Assistance as needed |
| title | A deep learning model for assistive decision-making during robot-aided rehabilitation therapies based on therapists’ demonstrations |
| title_full | A deep learning model for assistive decision-making during robot-aided rehabilitation therapies based on therapists’ demonstrations |
| title_fullStr | A deep learning model for assistive decision-making during robot-aided rehabilitation therapies based on therapists’ demonstrations |
| title_full_unstemmed | A deep learning model for assistive decision-making during robot-aided rehabilitation therapies based on therapists’ demonstrations |
| title_short | A deep learning model for assistive decision-making during robot-aided rehabilitation therapies based on therapists’ demonstrations |
| title_sort | deep learning model for assistive decision making during robot aided rehabilitation therapies based on therapists demonstrations |
| topic | Rehabilitation robotics Neurorehabilitation Deep learning Exergames Assistance as needed |
| url | https://doi.org/10.1186/s12984-024-01517-4 |
| work_keys_str_mv | AT davidmartinezpascual adeeplearningmodelforassistivedecisionmakingduringrobotaidedrehabilitationtherapiesbasedontherapistsdemonstrations AT josemcatalan adeeplearningmodelforassistivedecisionmakingduringrobotaidedrehabilitationtherapiesbasedontherapistsdemonstrations AT luisdlledo adeeplearningmodelforassistivedecisionmakingduringrobotaidedrehabilitationtherapiesbasedontherapistsdemonstrations AT andreablancoivorra adeeplearningmodelforassistivedecisionmakingduringrobotaidedrehabilitationtherapiesbasedontherapistsdemonstrations AT nicolasgarciaaracil adeeplearningmodelforassistivedecisionmakingduringrobotaidedrehabilitationtherapiesbasedontherapistsdemonstrations AT davidmartinezpascual deeplearningmodelforassistivedecisionmakingduringrobotaidedrehabilitationtherapiesbasedontherapistsdemonstrations AT josemcatalan deeplearningmodelforassistivedecisionmakingduringrobotaidedrehabilitationtherapiesbasedontherapistsdemonstrations AT luisdlledo deeplearningmodelforassistivedecisionmakingduringrobotaidedrehabilitationtherapiesbasedontherapistsdemonstrations AT andreablancoivorra deeplearningmodelforassistivedecisionmakingduringrobotaidedrehabilitationtherapiesbasedontherapistsdemonstrations AT nicolasgarciaaracil deeplearningmodelforassistivedecisionmakingduringrobotaidedrehabilitationtherapiesbasedontherapistsdemonstrations |