Relative Effects of Positive and Negative Explanations on Satisfaction and Performance in Human-Agent Teams
Improving agent capabilities and increasing availability of computing platforms and Internet connectivity allows for more effective and diverse collaboration between human users and automated agents. To increase the viability and effectiveness of human-agent collaborative teams, there is a pressing...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
LibraryPress@UF
2023-05-01
|
| Series: | Proceedings of the International Florida Artificial Intelligence Research Society Conference |
| Online Access: | https://journals.flvc.org/FLAIRS/article/view/133371 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850154762778968064 |
|---|---|
| author | Bryan Lavender Sami Abuhaimed Sandip Sen |
| author_facet | Bryan Lavender Sami Abuhaimed Sandip Sen |
| author_sort | Bryan Lavender |
| collection | DOAJ |
| description | Improving agent capabilities and increasing availability of computing platforms and Internet connectivity allows for more effective and diverse collaboration between human users and automated agents. To increase the viability and effectiveness of human-agent collaborative teams, there is a pressing need for research enabling such teams to maximally leverage relative strengths of human and automated reasoners. We study virtual and ad-hoc teams, comprising a human and an agent, collaborating over a few episodes where each episode requires them to complete a set of tasks chosen from given task types. Team members are initially unaware of the capabilities of their partners, and the agent, acting as the task allocator, has to adapt the allocation process to maximize team performance. The focus of the current paper is on analyzing how allocation decision explanations can affect both user performance and the human workers' outlook including factors such as motivation and satisfaction. We investigate the effect of explanations provided by the agent allocator to the human on performance and key factors reported by the human teammate on surveys. Survey factors include the effect of explanations on motivation, explanatory power, and understandability, as well as satisfaction with and trust / confidence in the teammate. We evaluated a set of hypotheses on these factors related to positive, negative, and no-explanation scenarios through experiments conducted with MTurk workers. |
| format | Article |
| id | doaj-art-a2e0027759d04a03b5ec003849855da0 |
| institution | OA Journals |
| issn | 2334-0754 2334-0762 |
| language | English |
| publishDate | 2023-05-01 |
| publisher | LibraryPress@UF |
| record_format | Article |
| series | Proceedings of the International Florida Artificial Intelligence Research Society Conference |
| spelling | doaj-art-a2e0027759d04a03b5ec003849855da02025-08-20T02:25:12ZengLibraryPress@UFProceedings of the International Florida Artificial Intelligence Research Society Conference2334-07542334-07622023-05-013610.32473/flairs.36.13337169677Relative Effects of Positive and Negative Explanations on Satisfaction and Performance in Human-Agent TeamsBryan Lavender0https://orcid.org/0009-0003-6012-2675Sami Abuhaimed1https://orcid.org/0009-0001-2230-9856Sandip Sen2The University of TuslaThe University of TulsaThe University of TulsaImproving agent capabilities and increasing availability of computing platforms and Internet connectivity allows for more effective and diverse collaboration between human users and automated agents. To increase the viability and effectiveness of human-agent collaborative teams, there is a pressing need for research enabling such teams to maximally leverage relative strengths of human and automated reasoners. We study virtual and ad-hoc teams, comprising a human and an agent, collaborating over a few episodes where each episode requires them to complete a set of tasks chosen from given task types. Team members are initially unaware of the capabilities of their partners, and the agent, acting as the task allocator, has to adapt the allocation process to maximize team performance. The focus of the current paper is on analyzing how allocation decision explanations can affect both user performance and the human workers' outlook including factors such as motivation and satisfaction. We investigate the effect of explanations provided by the agent allocator to the human on performance and key factors reported by the human teammate on surveys. Survey factors include the effect of explanations on motivation, explanatory power, and understandability, as well as satisfaction with and trust / confidence in the teammate. We evaluated a set of hypotheses on these factors related to positive, negative, and no-explanation scenarios through experiments conducted with MTurk workers.https://journals.flvc.org/FLAIRS/article/view/133371 |
| spellingShingle | Bryan Lavender Sami Abuhaimed Sandip Sen Relative Effects of Positive and Negative Explanations on Satisfaction and Performance in Human-Agent Teams Proceedings of the International Florida Artificial Intelligence Research Society Conference |
| title | Relative Effects of Positive and Negative Explanations on Satisfaction and Performance in Human-Agent Teams |
| title_full | Relative Effects of Positive and Negative Explanations on Satisfaction and Performance in Human-Agent Teams |
| title_fullStr | Relative Effects of Positive and Negative Explanations on Satisfaction and Performance in Human-Agent Teams |
| title_full_unstemmed | Relative Effects of Positive and Negative Explanations on Satisfaction and Performance in Human-Agent Teams |
| title_short | Relative Effects of Positive and Negative Explanations on Satisfaction and Performance in Human-Agent Teams |
| title_sort | relative effects of positive and negative explanations on satisfaction and performance in human agent teams |
| url | https://journals.flvc.org/FLAIRS/article/view/133371 |
| work_keys_str_mv | AT bryanlavender relativeeffectsofpositiveandnegativeexplanationsonsatisfactionandperformanceinhumanagentteams AT samiabuhaimed relativeeffectsofpositiveandnegativeexplanationsonsatisfactionandperformanceinhumanagentteams AT sandipsen relativeeffectsofpositiveandnegativeexplanationsonsatisfactionandperformanceinhumanagentteams |