Trusting AI: does uncertainty visualization affect decision-making?
IntroductionDecision-making based on AI can be challenging, especially when considering the uncertainty associated with AI predictions. Visualizing uncertainty in AI refers to techniques that use visual cues to represent the level of confidence or uncertainty in an AI model's outputs, such as p...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-02-01
|
| Series: | Frontiers in Computer Science |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fcomp.2025.1464348/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1825206747565916160 |
|---|---|
| author | Jonatan Reyes Anil Ufuk Batmaz Marta Kersten-Oertel |
| author_facet | Jonatan Reyes Anil Ufuk Batmaz Marta Kersten-Oertel |
| author_sort | Jonatan Reyes |
| collection | DOAJ |
| description | IntroductionDecision-making based on AI can be challenging, especially when considering the uncertainty associated with AI predictions. Visualizing uncertainty in AI refers to techniques that use visual cues to represent the level of confidence or uncertainty in an AI model's outputs, such as predictions or decisions. This study aims to investigate the impact of visualizing uncertainty on decision-making and trust in AI.MethodsWe conducted a user study with 147 participants, utilizing static classic gaming scenarios as a proxy for human-AI collaboration in decision-making. The study measured changes in decisions, trust in AI, and decision-making confidence when uncertainty was visualized in a continuous format compared to a binary output of the AI model.ResultsOur findings indicate that visualizing uncertainty significantly enhances trust in AI for 58% of participants with negative attitudes toward AI. Additionally, 31% of these participants found uncertainty visualization to be useful. The size of the uncertainty visualization was identified as the method that had the most impact on participants' trust in AI and their confidence in their decisions. Furthermore, we observed a strong association between participants' gaming experience and changes in decision-making when uncertainty was visualized, as well as a strong link between trust in AI and individual attitudes toward AI.DiscussionThese results suggest that visualizing uncertainty can improve trust in AI, particularly among individuals with negative attitudes toward AI. The findings also have important implications for the design of human-AI decision-support systems, offering insights into how uncertainty can be visualized to enhance decision-making and user confidence. |
| format | Article |
| id | doaj-art-c2aa68c1fa504453bf51920a741df707 |
| institution | Kabale University |
| issn | 2624-9898 |
| language | English |
| publishDate | 2025-02-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Computer Science |
| spelling | doaj-art-c2aa68c1fa504453bf51920a741df7072025-02-07T06:49:31ZengFrontiers Media S.A.Frontiers in Computer Science2624-98982025-02-01710.3389/fcomp.2025.14643481464348Trusting AI: does uncertainty visualization affect decision-making?Jonatan ReyesAnil Ufuk BatmazMarta Kersten-OertelIntroductionDecision-making based on AI can be challenging, especially when considering the uncertainty associated with AI predictions. Visualizing uncertainty in AI refers to techniques that use visual cues to represent the level of confidence or uncertainty in an AI model's outputs, such as predictions or decisions. This study aims to investigate the impact of visualizing uncertainty on decision-making and trust in AI.MethodsWe conducted a user study with 147 participants, utilizing static classic gaming scenarios as a proxy for human-AI collaboration in decision-making. The study measured changes in decisions, trust in AI, and decision-making confidence when uncertainty was visualized in a continuous format compared to a binary output of the AI model.ResultsOur findings indicate that visualizing uncertainty significantly enhances trust in AI for 58% of participants with negative attitudes toward AI. Additionally, 31% of these participants found uncertainty visualization to be useful. The size of the uncertainty visualization was identified as the method that had the most impact on participants' trust in AI and their confidence in their decisions. Furthermore, we observed a strong association between participants' gaming experience and changes in decision-making when uncertainty was visualized, as well as a strong link between trust in AI and individual attitudes toward AI.DiscussionThese results suggest that visualizing uncertainty can improve trust in AI, particularly among individuals with negative attitudes toward AI. The findings also have important implications for the design of human-AI decision-support systems, offering insights into how uncertainty can be visualized to enhance decision-making and user confidence.https://www.frontiersin.org/articles/10.3389/fcomp.2025.1464348/fulluncertainty visualizationAI uncertaintydecision-makinghuman-AItrustpsychology of players |
| spellingShingle | Jonatan Reyes Anil Ufuk Batmaz Marta Kersten-Oertel Trusting AI: does uncertainty visualization affect decision-making? Frontiers in Computer Science uncertainty visualization AI uncertainty decision-making human-AI trust psychology of players |
| title | Trusting AI: does uncertainty visualization affect decision-making? |
| title_full | Trusting AI: does uncertainty visualization affect decision-making? |
| title_fullStr | Trusting AI: does uncertainty visualization affect decision-making? |
| title_full_unstemmed | Trusting AI: does uncertainty visualization affect decision-making? |
| title_short | Trusting AI: does uncertainty visualization affect decision-making? |
| title_sort | trusting ai does uncertainty visualization affect decision making |
| topic | uncertainty visualization AI uncertainty decision-making human-AI trust psychology of players |
| url | https://www.frontiersin.org/articles/10.3389/fcomp.2025.1464348/full |
| work_keys_str_mv | AT jonatanreyes trustingaidoesuncertaintyvisualizationaffectdecisionmaking AT anilufukbatmaz trustingaidoesuncertaintyvisualizationaffectdecisionmaking AT martakerstenoertel trustingaidoesuncertaintyvisualizationaffectdecisionmaking |