An Investigation of Hand Gestures for Controlling Video Games in a Rehabilitation Exergame System

<i>Musculoskeletal disorders (MSDs)</i> can significantly impact individuals’ <i>quality of life (QoL)</i>, often requiring effective rehabilitation strategies to promote recovery. However, traditional rehabilitation methods can be expensive and may lack engagement, leading t...

Full description

Saved in:
Bibliographic Details
Main Authors: Radhiatul Husna, Komang Candra Brata, Irin Tri Anggraini, Nobuo Funabiki, Alfiandi Aulia Rahmadani, Chih-Peng Fan
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Computers
Subjects:
Online Access:https://www.mdpi.com/2073-431X/14/1/25
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:<i>Musculoskeletal disorders (MSDs)</i> can significantly impact individuals’ <i>quality of life (QoL)</i>, often requiring effective rehabilitation strategies to promote recovery. However, traditional rehabilitation methods can be expensive and may lack engagement, leading to poor adherence to therapy exercise routines. An <i>exergame</i> system can be a solution to this problem. In this paper, we investigate appropriate hand gestures for controlling video games in a rehabilitation <i>exergame</i> system. The <i>Mediapipe</i> Python library is adopted for the real-time recognition of gestures. We choose 10 easy gestures among 32 possible simple gestures. Then, we specify and compare the best and the second-best groups used to control the game. Comprehensive experiments are conducted with 16 students at Andalas University, Indonesia, to find appropriate gestures and evaluate user experiences of the system using the <i>System Usability Scale (SUS)</i> and <i>User Experience Questionnaire (UEQ)</i>. The results show that the hand gestures in the best group are more accessible than in the second-best group. The results suggest appropriate hand gestures for game controls and confirm the proposal’s validity. In future work, we plan to enhance the <i>exergame</i> system by integrating a diverse set of video games, while expanding its application to a broader and more diverse sample. We will also study other practical applications of the hand gesture control function.
ISSN:2073-431X