Synergy-Based Evaluation of Hand Motor Function in Object Handling Using Virtual and Mixed Realities
This study introduces a novel system for evaluating hand motor function through synergy-based analysis during object manipulation in virtual and mixed-reality environments. Conventional assessments of hand function are often subjective, relying on visual observation by therapists or patient-reported...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-03-01
|
| Series: | Sensors |
| Subjects: | |
| Online Access: | https://www.mdpi.com/1424-8220/25/7/2080 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849769518743683072 |
|---|---|
| author | Yuhei Sorimachi Hiroki Akaida Kyo Kutsuzawa Dai Owaki Mitsuhiro Hayashibe |
| author_facet | Yuhei Sorimachi Hiroki Akaida Kyo Kutsuzawa Dai Owaki Mitsuhiro Hayashibe |
| author_sort | Yuhei Sorimachi |
| collection | DOAJ |
| description | This study introduces a novel system for evaluating hand motor function through synergy-based analysis during object manipulation in virtual and mixed-reality environments. Conventional assessments of hand function are often subjective, relying on visual observation by therapists or patient-reported outcomes. To address these limitations, we developed a system that utilizes the leap motion controller (LMC) to capture finger motion data without the constraints of glove-type devices. Spatial synergies were extracted using principal component analysis (PCA) and Varimax rotation, providing insights into finger motor coordination with the sparse decomposition. Additionally, we incorporated the HoloLens 2 to create a mixed-reality object manipulation task that enhances spatial awareness for the user, improving natural interaction with virtual objects. Our results demonstrate that synergy-based analysis allows for the systematic detection of hand movement abnormalities that are not captured through traditional task performance metrics. This system demonstrates promise in advancing rehabilitation by enabling more objective and detailed evaluations of finger motor function, facilitating personalized therapy, and potentially contributing to the early detection of motor impairments in the future. |
| format | Article |
| id | doaj-art-7a41df59187b46ae802948a1e8fc831e |
| institution | DOAJ |
| issn | 1424-8220 |
| language | English |
| publishDate | 2025-03-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Sensors |
| spelling | doaj-art-7a41df59187b46ae802948a1e8fc831e2025-08-20T03:03:24ZengMDPI AGSensors1424-82202025-03-01257208010.3390/s25072080Synergy-Based Evaluation of Hand Motor Function in Object Handling Using Virtual and Mixed RealitiesYuhei Sorimachi0Hiroki Akaida1Kyo Kutsuzawa2Dai Owaki3Mitsuhiro Hayashibe4Neuro-Robotics Lab, Department of Robotics, Graduate School of Engineering, Tohoku University, Sendai 980-8579, JapanNeuro-Robotics Lab, Department of Robotics, Graduate School of Engineering, Tohoku University, Sendai 980-8579, JapanNeuro-Robotics Lab, Department of Robotics, Graduate School of Engineering, Tohoku University, Sendai 980-8579, JapanNeuro-Robotics Lab, Department of Robotics, Graduate School of Engineering, Tohoku University, Sendai 980-8579, JapanNeuro-Robotics Lab, Department of Robotics, Graduate School of Engineering, Tohoku University, Sendai 980-8579, JapanThis study introduces a novel system for evaluating hand motor function through synergy-based analysis during object manipulation in virtual and mixed-reality environments. Conventional assessments of hand function are often subjective, relying on visual observation by therapists or patient-reported outcomes. To address these limitations, we developed a system that utilizes the leap motion controller (LMC) to capture finger motion data without the constraints of glove-type devices. Spatial synergies were extracted using principal component analysis (PCA) and Varimax rotation, providing insights into finger motor coordination with the sparse decomposition. Additionally, we incorporated the HoloLens 2 to create a mixed-reality object manipulation task that enhances spatial awareness for the user, improving natural interaction with virtual objects. Our results demonstrate that synergy-based analysis allows for the systematic detection of hand movement abnormalities that are not captured through traditional task performance metrics. This system demonstrates promise in advancing rehabilitation by enabling more objective and detailed evaluations of finger motor function, facilitating personalized therapy, and potentially contributing to the early detection of motor impairments in the future.https://www.mdpi.com/1424-8220/25/7/2080synergyhand motor functionleap motion controllermixed realityHoloLens 2 |
| spellingShingle | Yuhei Sorimachi Hiroki Akaida Kyo Kutsuzawa Dai Owaki Mitsuhiro Hayashibe Synergy-Based Evaluation of Hand Motor Function in Object Handling Using Virtual and Mixed Realities Sensors synergy hand motor function leap motion controller mixed reality HoloLens 2 |
| title | Synergy-Based Evaluation of Hand Motor Function in Object Handling Using Virtual and Mixed Realities |
| title_full | Synergy-Based Evaluation of Hand Motor Function in Object Handling Using Virtual and Mixed Realities |
| title_fullStr | Synergy-Based Evaluation of Hand Motor Function in Object Handling Using Virtual and Mixed Realities |
| title_full_unstemmed | Synergy-Based Evaluation of Hand Motor Function in Object Handling Using Virtual and Mixed Realities |
| title_short | Synergy-Based Evaluation of Hand Motor Function in Object Handling Using Virtual and Mixed Realities |
| title_sort | synergy based evaluation of hand motor function in object handling using virtual and mixed realities |
| topic | synergy hand motor function leap motion controller mixed reality HoloLens 2 |
| url | https://www.mdpi.com/1424-8220/25/7/2080 |
| work_keys_str_mv | AT yuheisorimachi synergybasedevaluationofhandmotorfunctioninobjecthandlingusingvirtualandmixedrealities AT hirokiakaida synergybasedevaluationofhandmotorfunctioninobjecthandlingusingvirtualandmixedrealities AT kyokutsuzawa synergybasedevaluationofhandmotorfunctioninobjecthandlingusingvirtualandmixedrealities AT daiowaki synergybasedevaluationofhandmotorfunctioninobjecthandlingusingvirtualandmixedrealities AT mitsuhirohayashibe synergybasedevaluationofhandmotorfunctioninobjecthandlingusingvirtualandmixedrealities |