Semi-Autonomous Continuous Robotic Arm Control Using an Augmented Reality Brain-Computer Interface
Noninvasive augmented-reality (AR) brain-computer interfaces (BCIs) that use steady-state visually evoked potentials (SSVEPs) typically adopt a fully-autonomous goal-selection framework to control a robot, where automation is used to compensate for the low information transfer rate of the BCI. This...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Transactions on Neural Systems and Rehabilitation Engineering |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10755142/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | Noninvasive augmented-reality (AR) brain-computer interfaces (BCIs) that use steady-state visually evoked potentials (SSVEPs) typically adopt a fully-autonomous goal-selection framework to control a robot, where automation is used to compensate for the low information transfer rate of the BCI. This scheme improves task performance but users may prefer direct control (DC) of robot motion. To provide users with a balance of autonomous assistance and manual control, we developed a shared control (SC) system for continuous control of robot translation using an SSVEP AR-BCI, which we tested in a 3D reaching task. The SC system used the BCI input and robot sensor data to continuously predict which object the user wanted to reach, generated an assistance signal, and regulated the level of assistance based on prediction confidence. Eighteen healthy participants took part in our study and each completed 24 reaching trials using DC and SC. Compared to DC, SC significantly improved (paired two-tailed t-test, Holm-corrected <inline-formula> <tex-math notation="LaTeX">$\alpha \lt 0.05$ </tex-math></inline-formula>) mean task success rate (<inline-formula> <tex-math notation="LaTeX">${p} \lt 0.0001$ </tex-math></inline-formula>, <inline-formula> <tex-math notation="LaTeX">$\mu =36.1$ </tex-math></inline-formula>%, 95% CI [25.3%, 46.9%]), normalised reaching trajectory length (<inline-formula> <tex-math notation="LaTeX">${p} \lt 0.0001$ </tex-math></inline-formula>, <inline-formula> <tex-math notation="LaTeX">$\mu = -26.8$ </tex-math></inline-formula>%, 95% CI [−36.0%, −17.7%]), and participant workload (<inline-formula> <tex-math notation="LaTeX">${p} =0.02$ </tex-math></inline-formula>, <inline-formula> <tex-math notation="LaTeX">$\mu = -11.6$ </tex-math></inline-formula>, 95% CI [−21.1, −2.0]) measured with the NASA Task Load Index. Therefore, users of SC can control the robot effectively, while experiencing increased agency. Our system can personalise assistive technology by providing users with the ability to select their preferred level of autonomous assistance. |
|---|---|
| ISSN: | 1534-4320 1558-0210 |