Self-assessment in machines boosts human Trust
Low trust in autonomous systems remains a significant barrier to adoption and performance. To effectively increase trust in these systems, machines must perform actions to calibrate human trust based on an accurate assessment of both their capability and human trust in real time. Existing efforts de...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-05-01
|
| Series: | Frontiers in Robotics and AI |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/frobt.2025.1557075/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850254588588851200 |
|---|---|
| author | Dana Warmsley Krishna Choudhary Jocelyn Rego Emma Viani Praveen K. Pilly |
| author_facet | Dana Warmsley Krishna Choudhary Jocelyn Rego Emma Viani Praveen K. Pilly |
| author_sort | Dana Warmsley |
| collection | DOAJ |
| description | Low trust in autonomous systems remains a significant barrier to adoption and performance. To effectively increase trust in these systems, machines must perform actions to calibrate human trust based on an accurate assessment of both their capability and human trust in real time. Existing efforts demonstrate the value of trust calibration in improving team performance but overlook the importance of machine self-assessment capabilities in the trust calibration process. In our work, we develop a closed-loop trust calibration system for a human-machine collaboration task to classify images and demonstrate about 40% improvement in human trust and 5% improvement in team performance with trained machine self-assessment compared to the baseline, despite the same machine performance level between them. Our trust calibration system applies to any semi-autonomous application requiring human-machine collaboration. |
| format | Article |
| id | doaj-art-d5259c43ec594dfab2803a11e562bc82 |
| institution | OA Journals |
| issn | 2296-9144 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Robotics and AI |
| spelling | doaj-art-d5259c43ec594dfab2803a11e562bc822025-08-20T01:57:05ZengFrontiers Media S.A.Frontiers in Robotics and AI2296-91442025-05-011210.3389/frobt.2025.15570751557075Self-assessment in machines boosts human TrustDana WarmsleyKrishna Choudhary Jocelyn Rego Emma Viani Praveen K. Pilly Low trust in autonomous systems remains a significant barrier to adoption and performance. To effectively increase trust in these systems, machines must perform actions to calibrate human trust based on an accurate assessment of both their capability and human trust in real time. Existing efforts demonstrate the value of trust calibration in improving team performance but overlook the importance of machine self-assessment capabilities in the trust calibration process. In our work, we develop a closed-loop trust calibration system for a human-machine collaboration task to classify images and demonstrate about 40% improvement in human trust and 5% improvement in team performance with trained machine self-assessment compared to the baseline, despite the same machine performance level between them. Our trust calibration system applies to any semi-autonomous application requiring human-machine collaboration.https://www.frontiersin.org/articles/10.3389/frobt.2025.1557075/fullmachine self-assessmenttrust calibrationtrust in AIautonomous systemshuman-machine teaming |
| spellingShingle | Dana Warmsley Krishna Choudhary Jocelyn Rego Emma Viani Praveen K. Pilly Self-assessment in machines boosts human Trust Frontiers in Robotics and AI machine self-assessment trust calibration trust in AI autonomous systems human-machine teaming |
| title | Self-assessment in machines boosts human Trust |
| title_full | Self-assessment in machines boosts human Trust |
| title_fullStr | Self-assessment in machines boosts human Trust |
| title_full_unstemmed | Self-assessment in machines boosts human Trust |
| title_short | Self-assessment in machines boosts human Trust |
| title_sort | self assessment in machines boosts human trust |
| topic | machine self-assessment trust calibration trust in AI autonomous systems human-machine teaming |
| url | https://www.frontiersin.org/articles/10.3389/frobt.2025.1557075/full |
| work_keys_str_mv | AT danawarmsley selfassessmentinmachinesboostshumantrust AT krishnachoudhary selfassessmentinmachinesboostshumantrust AT jocelynrego selfassessmentinmachinesboostshumantrust AT emmaviani selfassessmentinmachinesboostshumantrust AT praveenkpilly selfassessmentinmachinesboostshumantrust |