Working memory and the need for explainable AI – Scenarios from healthcare, social media and insurance
Explainable AI (XAI) is discussed as an important feature of AI systems that is required for professional, ethical and commercial reasons. XAI is particularly needed in AI systems that remain relatively closed, i.e. black box, on how to make decisions whether for complexity or commercial sensitivity...
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2025-01-01
|
| Series: | Heliyon |
| Subjects: | |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2405844025002518 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1832573175099031552 |
|---|---|
| author | M. Liebherr E. Gößwein C. Kannen A. Babiker S. Al-Shakhsi V. Staab B.J. Li R. Ali C. Montag |
| author_facet | M. Liebherr E. Gößwein C. Kannen A. Babiker S. Al-Shakhsi V. Staab B.J. Li R. Ali C. Montag |
| author_sort | M. Liebherr |
| collection | DOAJ |
| description | Explainable AI (XAI) is discussed as an important feature of AI systems that is required for professional, ethical and commercial reasons. XAI is particularly needed in AI systems that remain relatively closed, i.e. black box, on how to make decisions whether for complexity or commercial sensitivity. Still, many factors play an important role on whether people perceive a need for XAI. The personal relevance of the AI system might play a role, but also individual differences in personality traits or cognitive functions. In order to test these assumptions, 215 participants (129 female) underwent an online experiment testing their objective working memory capacity and completed the Intellect facet of the Big Five Personality traits (as a proxy for self-assessed cognitive capacity). Further, all participants were presented three AI systems scenarios of relatively different degrees of (personal) relevance and, hence, personal investment: skin cancer detection (i), the personalization of social media feeds (ii), and the amount to pay for a car insurance (iii). We observed that people reported a higher need for XAI in scenarios where they were more personally invested (health, payment for insurance > social media); for signficant differences between these scenarios see the result section. Interestingly, working memory capacity was not associated with XAI needs across the three domains, but self-reported Intellect showed a mild positive association with need for an AI explanation in the context of the insurance story. The present study represents a first attempt to investigate objective working memory capacity in the context of need for XAI. Beyond that, the study indicates that personal investment is crucial for determining the need for XAI. |
| format | Article |
| id | doaj-art-ce4b4c723afc4ae9865dd5f19334d781 |
| institution | Kabale University |
| issn | 2405-8440 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Heliyon |
| spelling | doaj-art-ce4b4c723afc4ae9865dd5f19334d7812025-02-02T05:28:26ZengElsevierHeliyon2405-84402025-01-01112e41871Working memory and the need for explainable AI – Scenarios from healthcare, social media and insuranceM. Liebherr0E. Gößwein1C. Kannen2A. Babiker3S. Al-Shakhsi4V. Staab5B.J. Li6R. Ali7C. Montag8Department of General Psychology: Cognition, University Duisburg-Essen, Duisburg, Germany; Department of Mechatronics, University Duisburg-Essen, Duisburg, Germany; Corresponding author. Department of General Psychology: Cognition, University Duisburg-Essen, Duisburg, Germany.Department of General Psychology: Cognition, University Duisburg-Essen, Duisburg, Germany; Department of Mechatronics, University Duisburg-Essen, Duisburg, GermanyDepartment of Molecular Psychology, Institute of Psychology and Education, Ulm University, Ulm, GermanyCollege of Science and Engineering, Hamad Bin Khalifa University, Doha, QatarCollege of Science and Engineering, Hamad Bin Khalifa University, Doha, QatarDepartment of General Psychology: Cognition, University Duisburg-Essen, Duisburg, GermanyWee Kim Wee School of Communication and Information, Nanyang Technological University, SingaporeCollege of Science and Engineering, Hamad Bin Khalifa University, Doha, QatarDepartment of Molecular Psychology, Institute of Psychology and Education, Ulm University, Ulm, GermanyExplainable AI (XAI) is discussed as an important feature of AI systems that is required for professional, ethical and commercial reasons. XAI is particularly needed in AI systems that remain relatively closed, i.e. black box, on how to make decisions whether for complexity or commercial sensitivity. Still, many factors play an important role on whether people perceive a need for XAI. The personal relevance of the AI system might play a role, but also individual differences in personality traits or cognitive functions. In order to test these assumptions, 215 participants (129 female) underwent an online experiment testing their objective working memory capacity and completed the Intellect facet of the Big Five Personality traits (as a proxy for self-assessed cognitive capacity). Further, all participants were presented three AI systems scenarios of relatively different degrees of (personal) relevance and, hence, personal investment: skin cancer detection (i), the personalization of social media feeds (ii), and the amount to pay for a car insurance (iii). We observed that people reported a higher need for XAI in scenarios where they were more personally invested (health, payment for insurance > social media); for signficant differences between these scenarios see the result section. Interestingly, working memory capacity was not associated with XAI needs across the three domains, but self-reported Intellect showed a mild positive association with need for an AI explanation in the context of the insurance story. The present study represents a first attempt to investigate objective working memory capacity in the context of need for XAI. Beyond that, the study indicates that personal investment is crucial for determining the need for XAI.http://www.sciencedirect.com/science/article/pii/S2405844025002518CognitionWorking memoryXAIIntellectPersonalityContext |
| spellingShingle | M. Liebherr E. Gößwein C. Kannen A. Babiker S. Al-Shakhsi V. Staab B.J. Li R. Ali C. Montag Working memory and the need for explainable AI – Scenarios from healthcare, social media and insurance Heliyon Cognition Working memory XAI Intellect Personality Context |
| title | Working memory and the need for explainable AI – Scenarios from healthcare, social media and insurance |
| title_full | Working memory and the need for explainable AI – Scenarios from healthcare, social media and insurance |
| title_fullStr | Working memory and the need for explainable AI – Scenarios from healthcare, social media and insurance |
| title_full_unstemmed | Working memory and the need for explainable AI – Scenarios from healthcare, social media and insurance |
| title_short | Working memory and the need for explainable AI – Scenarios from healthcare, social media and insurance |
| title_sort | working memory and the need for explainable ai scenarios from healthcare social media and insurance |
| topic | Cognition Working memory XAI Intellect Personality Context |
| url | http://www.sciencedirect.com/science/article/pii/S2405844025002518 |
| work_keys_str_mv | AT mliebherr workingmemoryandtheneedforexplainableaiscenariosfromhealthcaresocialmediaandinsurance AT egoßwein workingmemoryandtheneedforexplainableaiscenariosfromhealthcaresocialmediaandinsurance AT ckannen workingmemoryandtheneedforexplainableaiscenariosfromhealthcaresocialmediaandinsurance AT ababiker workingmemoryandtheneedforexplainableaiscenariosfromhealthcaresocialmediaandinsurance AT salshakhsi workingmemoryandtheneedforexplainableaiscenariosfromhealthcaresocialmediaandinsurance AT vstaab workingmemoryandtheneedforexplainableaiscenariosfromhealthcaresocialmediaandinsurance AT bjli workingmemoryandtheneedforexplainableaiscenariosfromhealthcaresocialmediaandinsurance AT rali workingmemoryandtheneedforexplainableaiscenariosfromhealthcaresocialmediaandinsurance AT cmontag workingmemoryandtheneedforexplainableaiscenariosfromhealthcaresocialmediaandinsurance |