Choosing the Task Allocator: Effect on Performance and Satisfaction in Human-Agent Team

Ad hoc human-agent teams, where team members interact without prior experience with teammates and only for a limited number of interactions, will be commonplace in dynamic environments with opportunity windows for collaboration between diverse groups. We study the efficacy of virtual ad-hoc teams, c...

Full description

Saved in:
Bibliographic Details
Main Authors: Sami Abuhaimed, Selim Karaoglu, Sandip Sen
Format: Article
Language:English
Published: LibraryPress@UF 2023-05-01
Series:Proceedings of the International Florida Artificial Intelligence Research Society Conference
Online Access:https://journals.flvc.org/FLAIRS/article/view/133310
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850271015791230976
author Sami Abuhaimed
Selim Karaoglu
Sandip Sen
author_facet Sami Abuhaimed
Selim Karaoglu
Sandip Sen
author_sort Sami Abuhaimed
collection DOAJ
description Ad hoc human-agent teams, where team members interact without prior experience with teammates and only for a limited number of interactions, will be commonplace in dynamic environments with opportunity windows for collaboration between diverse groups. We study the efficacy of virtual ad-hoc teams, consisting of a human and an agent, collaborating to complete tasks in each of a few episodes. To maximize team potential, the relative expertise of team members must be measured and utilized in allocating tasks. As team members are not initially aware of each other's task competence and as humans often cannot accurately estimate their competencies, adapting allocation over the episodes is critical to team performance. Human team member satisfaction with allocations is also critical to determining team viability. We therefore use both these criteria to measure the effectiveness of task allocation procedures with varying degree of flexibility and human teammate control: (a) alternating, (b) performance adaptive, (c) agent-guided, (d) human-selected. We report on the relative strengths of these allocation procedures based on results from experiments with MTurk workers.
format Article
id doaj-art-17b7e27073e94946a0176b5045ea7d87
institution OA Journals
issn 2334-0754
2334-0762
language English
publishDate 2023-05-01
publisher LibraryPress@UF
record_format Article
series Proceedings of the International Florida Artificial Intelligence Research Society Conference
spelling doaj-art-17b7e27073e94946a0176b5045ea7d872025-08-20T01:52:22ZengLibraryPress@UFProceedings of the International Florida Artificial Intelligence Research Society Conference2334-07542334-07622023-05-013610.32473/flairs.36.13331069616Choosing the Task Allocator: Effect on Performance and Satisfaction in Human-Agent TeamSami Abuhaimed0https://orcid.org/0009-0001-2230-9856Selim Karaoglu1Sandip Sen2https://orcid.org/0000-0001-6107-4095The University of TulsaThe University of TulsaThe University of TulsaAd hoc human-agent teams, where team members interact without prior experience with teammates and only for a limited number of interactions, will be commonplace in dynamic environments with opportunity windows for collaboration between diverse groups. We study the efficacy of virtual ad-hoc teams, consisting of a human and an agent, collaborating to complete tasks in each of a few episodes. To maximize team potential, the relative expertise of team members must be measured and utilized in allocating tasks. As team members are not initially aware of each other's task competence and as humans often cannot accurately estimate their competencies, adapting allocation over the episodes is critical to team performance. Human team member satisfaction with allocations is also critical to determining team viability. We therefore use both these criteria to measure the effectiveness of task allocation procedures with varying degree of flexibility and human teammate control: (a) alternating, (b) performance adaptive, (c) agent-guided, (d) human-selected. We report on the relative strengths of these allocation procedures based on results from experiments with MTurk workers.https://journals.flvc.org/FLAIRS/article/view/133310
spellingShingle Sami Abuhaimed
Selim Karaoglu
Sandip Sen
Choosing the Task Allocator: Effect on Performance and Satisfaction in Human-Agent Team
Proceedings of the International Florida Artificial Intelligence Research Society Conference
title Choosing the Task Allocator: Effect on Performance and Satisfaction in Human-Agent Team
title_full Choosing the Task Allocator: Effect on Performance and Satisfaction in Human-Agent Team
title_fullStr Choosing the Task Allocator: Effect on Performance and Satisfaction in Human-Agent Team
title_full_unstemmed Choosing the Task Allocator: Effect on Performance and Satisfaction in Human-Agent Team
title_short Choosing the Task Allocator: Effect on Performance and Satisfaction in Human-Agent Team
title_sort choosing the task allocator effect on performance and satisfaction in human agent team
url https://journals.flvc.org/FLAIRS/article/view/133310
work_keys_str_mv AT samiabuhaimed choosingthetaskallocatoreffectonperformanceandsatisfactioninhumanagentteam
AT selimkaraoglu choosingthetaskallocatoreffectonperformanceandsatisfactioninhumanagentteam
AT sandipsen choosingthetaskallocatoreffectonperformanceandsatisfactioninhumanagentteam