Socially interactive industrial robots: a PAD model of flow for emotional co-regulation
This article presents the development of a socially interactive industrial robot. An Avatar is used to embody a cobot for collaborative industrial assembly tasks. The embodied covatar (cobot plus its avatar) is introduced to support Flow experiences through co-regulation, interactive emotion regulat...
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-01-01
|
| Series: | Frontiers in Robotics and AI |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frobt.2024.1418677/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832583507731283968 |
|---|---|
| author | Fabrizio Nunnari Dimitra Tsovaltzi Matteo Lavit Nicora Matteo Lavit Nicora Sebastian Beyrodt Pooja Prajod Lara Chehayeb Ingrid Brdar Antonella Delle Fave Luca Negri Elisabeth André Patrick Gebhard Matteo Malosio |
| author_facet | Fabrizio Nunnari Dimitra Tsovaltzi Matteo Lavit Nicora Matteo Lavit Nicora Sebastian Beyrodt Pooja Prajod Lara Chehayeb Ingrid Brdar Antonella Delle Fave Luca Negri Elisabeth André Patrick Gebhard Matteo Malosio |
| author_sort | Fabrizio Nunnari |
| collection | DOAJ |
| description | This article presents the development of a socially interactive industrial robot. An Avatar is used to embody a cobot for collaborative industrial assembly tasks. The embodied covatar (cobot plus its avatar) is introduced to support Flow experiences through co-regulation, interactive emotion regulation guidance. A real-time continuous emotional modeling method and an aligned transparent behavioral model, BASSF (Boredom, Anxiety, Self-efficacy, Self-compassion, Flow) is developed. The BASSF model anticipates and co-regulates counterproductive emotional experiences of operators working under stress with cobots on tedious industrial tasks. The targeted Flow experience is represented in the three-dimensional Pleasure, Arousal, and Dominance (PAD) space. We present how, despite their noisy nature, PAD signals can be used to drive the BASSF model with its theory-based interventions. The empirical results and analysis provides empirical support for the theoretically defined model, and clearly points to the need for data pre-filtering and per-user calibration. The proposed post-processing method helps quantify the parameters needed to control the frequency of intervention of the agent; still leaving the experimenter with a run-time adjustable global control of its sensitivity. A controlled empirical study (Study 1, N = 20), tested the model’s main theoretical assumptions about Flow, Dominance, Self-Efficacy, and boredom, to legitimate its implementation in this context. Participants worked on a task for an hour, assembling pieces in collaboration with the covatar. After the task, participants completed questionnaires on Flow, their affective experience, and Self-Efficacy, and they were interviewed to understand their emotions and regulation during the task. The results from Study 1 suggest that the Dominance dimension plays a vital role in task-related settings as it predicts the participants’ Self-Efficacy and Flow. However, the relationship between Flow, pleasure, and arousal requires further investigation. Qualitative interview analysis revealed that participants regulated negative emotions, like boredom, also without support, but some strategies could negatively impact wellbeing and productivity, which aligns with theory. Additional results from a first evaluation of the overall system (Study 2, N = 12) align with these findings and provide support for the use of socially interactive industrial robots to support wellbeing, job satisfaction, and involvement, while reducing unproductive emotional experiences and their regulation. |
| format | Article |
| id | doaj-art-db1b9f10c02c47dd9bef00aab0a2ed71 |
| institution | Kabale University |
| issn | 2296-9144 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Robotics and AI |
| spelling | doaj-art-db1b9f10c02c47dd9bef00aab0a2ed712025-01-28T12:48:17ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442025-01-011110.3389/frobt.2024.14186771418677Socially interactive industrial robots: a PAD model of flow for emotional co-regulationFabrizio Nunnari0Dimitra Tsovaltzi 1Matteo Lavit Nicora 2Matteo Lavit Nicora 3Sebastian Beyrodt 4Pooja Prajod 5Lara Chehayeb 6Ingrid Brdar 7Antonella Delle Fave 8Luca Negri 9Elisabeth André10Patrick Gebhard 11Matteo Malosio 12Affecting Computing Group, German Research Center for Artificial Intelligence (DFKI), Saarbrücken, GermanyAffecting Computing Group, German Research Center for Artificial Intelligence (DFKI), Saarbrücken, GermanyIndustrial Engineering Department, University of Bologna, Bologna, ItalySTIIMA, National Research Council of Italy, Lecco, ItalyAffecting Computing Group, German Research Center for Artificial Intelligence (DFKI), Saarbrücken, GermanyHuman-Centered Artificial Intelligence, University of Augsburg, Augsburg, GermanyAffecting Computing Group, German Research Center for Artificial Intelligence (DFKI), Saarbrücken, GermanyDepartment of Psychology, University of Rijeka, Rijeka, CroatiaDepartment of Pathophysiology and Transplantation, University of Milan, Milano, ItalyDepartment of Pathophysiology and Transplantation, University of Milan, Milano, ItalyHuman-Centered Artificial Intelligence, University of Augsburg, Augsburg, GermanyAffecting Computing Group, German Research Center for Artificial Intelligence (DFKI), Saarbrücken, GermanySTIIMA, National Research Council of Italy, Lecco, ItalyThis article presents the development of a socially interactive industrial robot. An Avatar is used to embody a cobot for collaborative industrial assembly tasks. The embodied covatar (cobot plus its avatar) is introduced to support Flow experiences through co-regulation, interactive emotion regulation guidance. A real-time continuous emotional modeling method and an aligned transparent behavioral model, BASSF (Boredom, Anxiety, Self-efficacy, Self-compassion, Flow) is developed. The BASSF model anticipates and co-regulates counterproductive emotional experiences of operators working under stress with cobots on tedious industrial tasks. The targeted Flow experience is represented in the three-dimensional Pleasure, Arousal, and Dominance (PAD) space. We present how, despite their noisy nature, PAD signals can be used to drive the BASSF model with its theory-based interventions. The empirical results and analysis provides empirical support for the theoretically defined model, and clearly points to the need for data pre-filtering and per-user calibration. The proposed post-processing method helps quantify the parameters needed to control the frequency of intervention of the agent; still leaving the experimenter with a run-time adjustable global control of its sensitivity. A controlled empirical study (Study 1, N = 20), tested the model’s main theoretical assumptions about Flow, Dominance, Self-Efficacy, and boredom, to legitimate its implementation in this context. Participants worked on a task for an hour, assembling pieces in collaboration with the covatar. After the task, participants completed questionnaires on Flow, their affective experience, and Self-Efficacy, and they were interviewed to understand their emotions and regulation during the task. The results from Study 1 suggest that the Dominance dimension plays a vital role in task-related settings as it predicts the participants’ Self-Efficacy and Flow. However, the relationship between Flow, pleasure, and arousal requires further investigation. Qualitative interview analysis revealed that participants regulated negative emotions, like boredom, also without support, but some strategies could negatively impact wellbeing and productivity, which aligns with theory. Additional results from a first evaluation of the overall system (Study 2, N = 12) align with these findings and provide support for the use of socially interactive industrial robots to support wellbeing, job satisfaction, and involvement, while reducing unproductive emotional experiences and their regulation.https://www.frontiersin.org/articles/10.3389/frobt.2024.1418677/fullhuman-robot interactionsocially interactive agentsaffective computingaffect modelingemotion (Co-)Regulationsocial signals |
| spellingShingle | Fabrizio Nunnari Dimitra Tsovaltzi Matteo Lavit Nicora Matteo Lavit Nicora Sebastian Beyrodt Pooja Prajod Lara Chehayeb Ingrid Brdar Antonella Delle Fave Luca Negri Elisabeth André Patrick Gebhard Matteo Malosio Socially interactive industrial robots: a PAD model of flow for emotional co-regulation Frontiers in Robotics and AI human-robot interaction socially interactive agents affective computing affect modeling emotion (Co-)Regulation social signals |
| title | Socially interactive industrial robots: a PAD model of flow for emotional co-regulation |
| title_full | Socially interactive industrial robots: a PAD model of flow for emotional co-regulation |
| title_fullStr | Socially interactive industrial robots: a PAD model of flow for emotional co-regulation |
| title_full_unstemmed | Socially interactive industrial robots: a PAD model of flow for emotional co-regulation |
| title_short | Socially interactive industrial robots: a PAD model of flow for emotional co-regulation |
| title_sort | socially interactive industrial robots a pad model of flow for emotional co regulation |
| topic | human-robot interaction socially interactive agents affective computing affect modeling emotion (Co-)Regulation social signals |
| url | https://www.frontiersin.org/articles/10.3389/frobt.2024.1418677/full |
| work_keys_str_mv | AT fabrizionunnari sociallyinteractiveindustrialrobotsapadmodelofflowforemotionalcoregulation AT dimitratsovaltzi sociallyinteractiveindustrialrobotsapadmodelofflowforemotionalcoregulation AT matteolavitnicora sociallyinteractiveindustrialrobotsapadmodelofflowforemotionalcoregulation AT matteolavitnicora sociallyinteractiveindustrialrobotsapadmodelofflowforemotionalcoregulation AT sebastianbeyrodt sociallyinteractiveindustrialrobotsapadmodelofflowforemotionalcoregulation AT poojaprajod sociallyinteractiveindustrialrobotsapadmodelofflowforemotionalcoregulation AT larachehayeb sociallyinteractiveindustrialrobotsapadmodelofflowforemotionalcoregulation AT ingridbrdar sociallyinteractiveindustrialrobotsapadmodelofflowforemotionalcoregulation AT antonelladellefave sociallyinteractiveindustrialrobotsapadmodelofflowforemotionalcoregulation AT lucanegri sociallyinteractiveindustrialrobotsapadmodelofflowforemotionalcoregulation AT elisabethandre sociallyinteractiveindustrialrobotsapadmodelofflowforemotionalcoregulation AT patrickgebhard sociallyinteractiveindustrialrobotsapadmodelofflowforemotionalcoregulation AT matteomalosio sociallyinteractiveindustrialrobotsapadmodelofflowforemotionalcoregulation |