Train your robot in AR: insights and challenges for humans and robots in continual teaching and learning
Supportive robots that can be deployed in our homes will need to be understandable, operable, and teachable by non-expert users. This calls for an intuitive Human-Robot Interaction approach that is also safe and sustainable in the long term. Still, few studies have looked at interactive task learnin...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-08-01
|
| Series: | Frontiers in Robotics and AI |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frobt.2025.1605652/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849770970381811712 |
|---|---|
| author | Anna Belardinelli Chao Wang Daniel Tanneberg Stephan Hasler Michael Gienger |
| author_facet | Anna Belardinelli Chao Wang Daniel Tanneberg Stephan Hasler Michael Gienger |
| author_sort | Anna Belardinelli |
| collection | DOAJ |
| description | Supportive robots that can be deployed in our homes will need to be understandable, operable, and teachable by non-expert users. This calls for an intuitive Human-Robot Interaction approach that is also safe and sustainable in the long term. Still, few studies have looked at interactive task learning in repeated, unscripted interactions within loosely supervised settings. In such cases the robot should incrementally learn from the user and consequentially expand its knowledge and abilities, a feature which presents the challenge of designing robots that interact and learn in real time. Here, we present a robotic system capable of continual learning from interaction, generalizing learned skills, and planning task execution based on the received training. We were interested in how interacting with such a system would impact the user experience and understanding. In an exploratory study, we assessed such dynamics with participants free to teach the robot simple tasks in Augmented Reality without supervision. Participants could access AR glasses spontaneously in a shared space and demonstrate physical skills in a virtual kitchen scene. A holographic robot gave feedback on its understanding and, after the demonstration, could ask questions to generalize the acquired task knowledge. The robot learned the semantic effects of the demonstrated actions and, upon request, could reproduce those on observed or novel objects through generalization. The results show that the users found the system engaging, understandable, and trustworthy, but with larger variance on the last two constructs. Participants who explored the scene more were able to expand the robot’s knowledge more effectively, and those who felt they understood the robot better were also more trusting toward it. No significant variation in the user experience or their teaching behavior was found across two interactions, yet the low return rate and free-form comments hint at critical lessons for interactive learning systems. |
| format | Article |
| id | doaj-art-cc6d330e89a640b29184bfeeb0a83547 |
| institution | DOAJ |
| issn | 2296-9144 |
| language | English |
| publishDate | 2025-08-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Robotics and AI |
| spelling | doaj-art-cc6d330e89a640b29184bfeeb0a835472025-08-20T03:02:47ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442025-08-011210.3389/frobt.2025.16056521605652Train your robot in AR: insights and challenges for humans and robots in continual teaching and learningAnna BelardinelliChao WangDaniel TannebergStephan HaslerMichael GiengerSupportive robots that can be deployed in our homes will need to be understandable, operable, and teachable by non-expert users. This calls for an intuitive Human-Robot Interaction approach that is also safe and sustainable in the long term. Still, few studies have looked at interactive task learning in repeated, unscripted interactions within loosely supervised settings. In such cases the robot should incrementally learn from the user and consequentially expand its knowledge and abilities, a feature which presents the challenge of designing robots that interact and learn in real time. Here, we present a robotic system capable of continual learning from interaction, generalizing learned skills, and planning task execution based on the received training. We were interested in how interacting with such a system would impact the user experience and understanding. In an exploratory study, we assessed such dynamics with participants free to teach the robot simple tasks in Augmented Reality without supervision. Participants could access AR glasses spontaneously in a shared space and demonstrate physical skills in a virtual kitchen scene. A holographic robot gave feedback on its understanding and, after the demonstration, could ask questions to generalize the acquired task knowledge. The robot learned the semantic effects of the demonstrated actions and, upon request, could reproduce those on observed or novel objects through generalization. The results show that the users found the system engaging, understandable, and trustworthy, but with larger variance on the last two constructs. Participants who explored the scene more were able to expand the robot’s knowledge more effectively, and those who felt they understood the robot better were also more trusting toward it. No significant variation in the user experience or their teaching behavior was found across two interactions, yet the low return rate and free-form comments hint at critical lessons for interactive learning systems.https://www.frontiersin.org/articles/10.3389/frobt.2025.1605652/fulllong-term human-robot interactioncontinual learninglearning from demonstrationteachable robotsaugmented reality |
| spellingShingle | Anna Belardinelli Chao Wang Daniel Tanneberg Stephan Hasler Michael Gienger Train your robot in AR: insights and challenges for humans and robots in continual teaching and learning Frontiers in Robotics and AI long-term human-robot interaction continual learning learning from demonstration teachable robots augmented reality |
| title | Train your robot in AR: insights and challenges for humans and robots in continual teaching and learning |
| title_full | Train your robot in AR: insights and challenges for humans and robots in continual teaching and learning |
| title_fullStr | Train your robot in AR: insights and challenges for humans and robots in continual teaching and learning |
| title_full_unstemmed | Train your robot in AR: insights and challenges for humans and robots in continual teaching and learning |
| title_short | Train your robot in AR: insights and challenges for humans and robots in continual teaching and learning |
| title_sort | train your robot in ar insights and challenges for humans and robots in continual teaching and learning |
| topic | long-term human-robot interaction continual learning learning from demonstration teachable robots augmented reality |
| url | https://www.frontiersin.org/articles/10.3389/frobt.2025.1605652/full |
| work_keys_str_mv | AT annabelardinelli trainyourrobotinarinsightsandchallengesforhumansandrobotsincontinualteachingandlearning AT chaowang trainyourrobotinarinsightsandchallengesforhumansandrobotsincontinualteachingandlearning AT danieltanneberg trainyourrobotinarinsightsandchallengesforhumansandrobotsincontinualteachingandlearning AT stephanhasler trainyourrobotinarinsightsandchallengesforhumansandrobotsincontinualteachingandlearning AT michaelgienger trainyourrobotinarinsightsandchallengesforhumansandrobotsincontinualteachingandlearning |