Augmenting visual feedback with visualized interaction forces in haptic-assisted virtual-reality teleoperation
In recent years, providing additional visual feedback about the interaction forces has been found to offer benefits to haptic-assisted teleoperation. However, there is limited insight into the effects of the design of force feedback-related visual cues and the type of visual display on the performan...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2024-12-01
|
| Series: | Frontiers in Robotics and AI |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frobt.2024.1427095/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850065643133468672 |
|---|---|
| author | Alex van den Berg Alex van den Berg Jelle Hofland Cock J. M. Heemskerk David A. Abbink Luka Peternel |
| author_facet | Alex van den Berg Alex van den Berg Jelle Hofland Cock J. M. Heemskerk David A. Abbink Luka Peternel |
| author_sort | Alex van den Berg |
| collection | DOAJ |
| description | In recent years, providing additional visual feedback about the interaction forces has been found to offer benefits to haptic-assisted teleoperation. However, there is limited insight into the effects of the design of force feedback-related visual cues and the type of visual display on the performance of teleoperation of robotic arms executing industrial tasks. In this study, we provide new insights into this interaction by extending these findings to the haptic assistance teleoperation of a simulated robotic arm in a virtual environment, in which the haptic assistance is comprised of a set of virtual fixtures. We design a novel method for providing visual cues about the interaction forces to complement the haptic assistance and augment visual feedback in virtual reality with a head-mounted display. We evaluate the visual cues method and head-mounted display method through human factors experiments in a teleoperated dross removal use case. The results show that both methods are beneficial for task performance, each of them having stronger points in different aspects of the operation. The visual cues method was found to significantly improve safety in terms of peak collision force, whereas the head-mounted display additionally improves the performance significantly. Furthermore, positive scores of the subjective analysis indicate an increased user acceptance of both methods. This work provides a new study on the importance of visual feedback related to (interaction) forces and spatial information for haptic assistance and provides two methods to take advantage of its potential benefits in the teleoperation of robotic arms. |
| format | Article |
| id | doaj-art-c897f85ffc9d4ae1863d5b280a1b7fe8 |
| institution | DOAJ |
| issn | 2296-9144 |
| language | English |
| publishDate | 2024-12-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Robotics and AI |
| spelling | doaj-art-c897f85ffc9d4ae1863d5b280a1b7fe82025-08-20T02:48:57ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442024-12-011110.3389/frobt.2024.14270951427095Augmenting visual feedback with visualized interaction forces in haptic-assisted virtual-reality teleoperationAlex van den Berg0Alex van den Berg1Jelle Hofland2Cock J. M. Heemskerk3David A. Abbink4Luka Peternel5Department of Cognitive Robotics, Delft University of Technology, Delft, NetherlandsHeemskerk Innovative Technology B.V., Delft, NetherlandsHeemskerk Innovative Technology B.V., Delft, NetherlandsHeemskerk Innovative Technology B.V., Delft, NetherlandsDepartment of Cognitive Robotics, Delft University of Technology, Delft, NetherlandsDepartment of Cognitive Robotics, Delft University of Technology, Delft, NetherlandsIn recent years, providing additional visual feedback about the interaction forces has been found to offer benefits to haptic-assisted teleoperation. However, there is limited insight into the effects of the design of force feedback-related visual cues and the type of visual display on the performance of teleoperation of robotic arms executing industrial tasks. In this study, we provide new insights into this interaction by extending these findings to the haptic assistance teleoperation of a simulated robotic arm in a virtual environment, in which the haptic assistance is comprised of a set of virtual fixtures. We design a novel method for providing visual cues about the interaction forces to complement the haptic assistance and augment visual feedback in virtual reality with a head-mounted display. We evaluate the visual cues method and head-mounted display method through human factors experiments in a teleoperated dross removal use case. The results show that both methods are beneficial for task performance, each of them having stronger points in different aspects of the operation. The visual cues method was found to significantly improve safety in terms of peak collision force, whereas the head-mounted display additionally improves the performance significantly. Furthermore, positive scores of the subjective analysis indicate an increased user acceptance of both methods. This work provides a new study on the importance of visual feedback related to (interaction) forces and spatial information for haptic assistance and provides two methods to take advantage of its potential benefits in the teleoperation of robotic arms.https://www.frontiersin.org/articles/10.3389/frobt.2024.1427095/fullteleoperationvisual cuesvirtual realityhead-mounted displayforce feedbackvirtual fixtures |
| spellingShingle | Alex van den Berg Alex van den Berg Jelle Hofland Cock J. M. Heemskerk David A. Abbink Luka Peternel Augmenting visual feedback with visualized interaction forces in haptic-assisted virtual-reality teleoperation Frontiers in Robotics and AI teleoperation visual cues virtual reality head-mounted display force feedback virtual fixtures |
| title | Augmenting visual feedback with visualized interaction forces in haptic-assisted virtual-reality teleoperation |
| title_full | Augmenting visual feedback with visualized interaction forces in haptic-assisted virtual-reality teleoperation |
| title_fullStr | Augmenting visual feedback with visualized interaction forces in haptic-assisted virtual-reality teleoperation |
| title_full_unstemmed | Augmenting visual feedback with visualized interaction forces in haptic-assisted virtual-reality teleoperation |
| title_short | Augmenting visual feedback with visualized interaction forces in haptic-assisted virtual-reality teleoperation |
| title_sort | augmenting visual feedback with visualized interaction forces in haptic assisted virtual reality teleoperation |
| topic | teleoperation visual cues virtual reality head-mounted display force feedback virtual fixtures |
| url | https://www.frontiersin.org/articles/10.3389/frobt.2024.1427095/full |
| work_keys_str_mv | AT alexvandenberg augmentingvisualfeedbackwithvisualizedinteractionforcesinhapticassistedvirtualrealityteleoperation AT alexvandenberg augmentingvisualfeedbackwithvisualizedinteractionforcesinhapticassistedvirtualrealityteleoperation AT jellehofland augmentingvisualfeedbackwithvisualizedinteractionforcesinhapticassistedvirtualrealityteleoperation AT cockjmheemskerk augmentingvisualfeedbackwithvisualizedinteractionforcesinhapticassistedvirtualrealityteleoperation AT davidaabbink augmentingvisualfeedbackwithvisualizedinteractionforcesinhapticassistedvirtualrealityteleoperation AT lukapeternel augmentingvisualfeedbackwithvisualizedinteractionforcesinhapticassistedvirtualrealityteleoperation |