Development and Evaluation of a Low-Jitter Hand Tracking System for Improving Typing Efficiency in a Virtual Reality Workspace
Virtual reality technology promises to transform immersive experiences across various applications, particularly within office environments. Despite its potential, the challenge of achieving efficient text entry in virtual reality persists. This study addresses this obstacle by introducing a novel m...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
MDPI AG
2025-01-01
|
| Series: | Multimodal Technologies and Interaction |
| Subjects: | |
| Online Access: | https://www.mdpi.com/2414-4088/9/1/4 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832587781981863936 |
|---|---|
| author | Tianshu Xu Wen Gu Koichi Ota Shinobu Hasegawa |
| author_facet | Tianshu Xu Wen Gu Koichi Ota Shinobu Hasegawa |
| author_sort | Tianshu Xu |
| collection | DOAJ |
| description | Virtual reality technology promises to transform immersive experiences across various applications, particularly within office environments. Despite its potential, the challenge of achieving efficient text entry in virtual reality persists. This study addresses this obstacle by introducing a novel machine learning-based solution, namely, the two-stream long short-term memory typing method, to enhance text entry performance in virtual reality. The two-stream long short-term memory method utilizes the back-of-the-hand image, employing a long short-term memory network and a Kalman filter to enhance hand position tracking accuracy and minimize jitter. Through statistical analysis of the data collected in the experiment and questionnaire results, we confirmed the effectiveness of the proposed method. In addition, we conducted an extra experiment to explore the differences in users’ typing behavior between regular typing and virtual reality-based typing. This additional experiment provides valuable insights into how users adapt their typing behavior in different environments. These findings represent a significant step in advancing text entry within virtual reality, setting the stage for immersive work experiences in office environments and beyond. |
| format | Article |
| id | doaj-art-05b05b2d59974ca185c1399134149002 |
| institution | Kabale University |
| issn | 2414-4088 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | MDPI AG |
| record_format | Article |
| series | Multimodal Technologies and Interaction |
| spelling | doaj-art-05b05b2d59974ca185c13991341490022025-01-24T13:44:02ZengMDPI AGMultimodal Technologies and Interaction2414-40882025-01-0191410.3390/mti9010004Development and Evaluation of a Low-Jitter Hand Tracking System for Improving Typing Efficiency in a Virtual Reality WorkspaceTianshu Xu0Wen Gu1Koichi Ota2Shinobu Hasegawa3Division of Advanced Science and Technology, Japan Advanced Institute of Science and Technology, Ishikawa 923-1292, JapanCenter for Innovative Distance Education and Research, Japan Advanced Institute of Science and Technology, Ishikawa 923-1292, JapanCenter for Innovative Distance Education and Research, Japan Advanced Institute of Science and Technology, Ishikawa 923-1292, JapanCenter for Innovative Distance Education and Research, Japan Advanced Institute of Science and Technology, Ishikawa 923-1292, JapanVirtual reality technology promises to transform immersive experiences across various applications, particularly within office environments. Despite its potential, the challenge of achieving efficient text entry in virtual reality persists. This study addresses this obstacle by introducing a novel machine learning-based solution, namely, the two-stream long short-term memory typing method, to enhance text entry performance in virtual reality. The two-stream long short-term memory method utilizes the back-of-the-hand image, employing a long short-term memory network and a Kalman filter to enhance hand position tracking accuracy and minimize jitter. Through statistical analysis of the data collected in the experiment and questionnaire results, we confirmed the effectiveness of the proposed method. In addition, we conducted an extra experiment to explore the differences in users’ typing behavior between regular typing and virtual reality-based typing. This additional experiment provides valuable insights into how users adapt their typing behavior in different environments. These findings represent a significant step in advancing text entry within virtual reality, setting the stage for immersive work experiences in office environments and beyond.https://www.mdpi.com/2414-4088/9/1/4virtual realitytyping efficiencylow jitterhand tracking |
| spellingShingle | Tianshu Xu Wen Gu Koichi Ota Shinobu Hasegawa Development and Evaluation of a Low-Jitter Hand Tracking System for Improving Typing Efficiency in a Virtual Reality Workspace Multimodal Technologies and Interaction virtual reality typing efficiency low jitter hand tracking |
| title | Development and Evaluation of a Low-Jitter Hand Tracking System for Improving Typing Efficiency in a Virtual Reality Workspace |
| title_full | Development and Evaluation of a Low-Jitter Hand Tracking System for Improving Typing Efficiency in a Virtual Reality Workspace |
| title_fullStr | Development and Evaluation of a Low-Jitter Hand Tracking System for Improving Typing Efficiency in a Virtual Reality Workspace |
| title_full_unstemmed | Development and Evaluation of a Low-Jitter Hand Tracking System for Improving Typing Efficiency in a Virtual Reality Workspace |
| title_short | Development and Evaluation of a Low-Jitter Hand Tracking System for Improving Typing Efficiency in a Virtual Reality Workspace |
| title_sort | development and evaluation of a low jitter hand tracking system for improving typing efficiency in a virtual reality workspace |
| topic | virtual reality typing efficiency low jitter hand tracking |
| url | https://www.mdpi.com/2414-4088/9/1/4 |
| work_keys_str_mv | AT tianshuxu developmentandevaluationofalowjitterhandtrackingsystemforimprovingtypingefficiencyinavirtualrealityworkspace AT wengu developmentandevaluationofalowjitterhandtrackingsystemforimprovingtypingefficiencyinavirtualrealityworkspace AT koichiota developmentandevaluationofalowjitterhandtrackingsystemforimprovingtypingefficiencyinavirtualrealityworkspace AT shinobuhasegawa developmentandevaluationofalowjitterhandtrackingsystemforimprovingtypingefficiencyinavirtualrealityworkspace |