Decision-making efficiency with aided information: the impact of automation reliability and task difficulty

Abstract Although it is commonly believed that automation aids human decision-making, conflicting evidence raises questions about whether individuals would gain greater advantages from automation in difficult tasks. Our study examines the combined influence of task difficulty and automation reliabil...

Full description

Saved in:
Bibliographic Details
Main Authors: Hanshu Zhang, Ran Zhou, Cheng-You Cheng, Sheng-Hsu Huang, Ming-Hui Cheng, Cheng-Ta Yang
Format: Article
Language:English
Published: SpringerOpen 2025-07-01
Series:Cognitive Research
Subjects:
Online Access:https://doi.org/10.1186/s41235-025-00659-w
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849767319921754112
author Hanshu Zhang
Ran Zhou
Cheng-You Cheng
Sheng-Hsu Huang
Ming-Hui Cheng
Cheng-Ta Yang
author_facet Hanshu Zhang
Ran Zhou
Cheng-You Cheng
Sheng-Hsu Huang
Ming-Hui Cheng
Cheng-Ta Yang
author_sort Hanshu Zhang
collection DOAJ
description Abstract Although it is commonly believed that automation aids human decision-making, conflicting evidence raises questions about whether individuals would gain greater advantages from automation in difficult tasks. Our study examines the combined influence of task difficulty and automation reliability on aided decision-making. We assessed decision efficiency by employing the single-target self-terminating (STST) capacity coefficient in Systems Factorial Technology, estimating the ratio of performance with aided information to that without it. Participants were instructed to perform a shape categorization task, wherein they assessed whether the presented stimulus belonged to one category or another. In Experiment 1, three automation reliability conditions (high reliability, low reliability, and unaided) were tested in separate blocks. Our results indicated that, in general, participants exhibited unlimited capacity when provided with valid automated cues, implying that the decision efficiency was unaltered by automated assistance. Despite the failure to gain extra efficiency, the benefits of automated aids in decision-making for difficult tasks were evident. In Experiment 2, various types of automation reliability were randomly intermixed. In this scenario, the impact of automation reliability on participants’ performance diminished; however, the significance of information accuracy increased. Our study illustrates how the presentation of automation, its reliability, and task difficulty interactively influence participants’ processing of automated information for decision-making. Our study may improve processing efficiency in automated systems, hence facilitating superior interface design and automation execution.
format Article
id doaj-art-cfee51796762498eb63ef6f2ef6c0de4
institution DOAJ
issn 2365-7464
language English
publishDate 2025-07-01
publisher SpringerOpen
record_format Article
series Cognitive Research
spelling doaj-art-cfee51796762498eb63ef6f2ef6c0de42025-08-20T03:04:15ZengSpringerOpenCognitive Research2365-74642025-07-0110111810.1186/s41235-025-00659-wDecision-making efficiency with aided information: the impact of automation reliability and task difficultyHanshu Zhang0Ran Zhou1Cheng-You Cheng2Sheng-Hsu Huang3Ming-Hui Cheng4Cheng-Ta Yang5Key Laboratory of Adolescent Cyberpsychology and Behavior (CCNU), Ministry of EducationSchool of Psychology, South China Normal UniversityDepartment of Psychology, National Cheng Kung UniversityDepartment of Psychology, National Cheng Kung UniversityDepartment of Psychology, National Cheng Kung UniversityDepartment of Psychology, National Cheng Kung UniversityAbstract Although it is commonly believed that automation aids human decision-making, conflicting evidence raises questions about whether individuals would gain greater advantages from automation in difficult tasks. Our study examines the combined influence of task difficulty and automation reliability on aided decision-making. We assessed decision efficiency by employing the single-target self-terminating (STST) capacity coefficient in Systems Factorial Technology, estimating the ratio of performance with aided information to that without it. Participants were instructed to perform a shape categorization task, wherein they assessed whether the presented stimulus belonged to one category or another. In Experiment 1, three automation reliability conditions (high reliability, low reliability, and unaided) were tested in separate blocks. Our results indicated that, in general, participants exhibited unlimited capacity when provided with valid automated cues, implying that the decision efficiency was unaltered by automated assistance. Despite the failure to gain extra efficiency, the benefits of automated aids in decision-making for difficult tasks were evident. In Experiment 2, various types of automation reliability were randomly intermixed. In this scenario, the impact of automation reliability on participants’ performance diminished; however, the significance of information accuracy increased. Our study illustrates how the presentation of automation, its reliability, and task difficulty interactively influence participants’ processing of automated information for decision-making. Our study may improve processing efficiency in automated systems, hence facilitating superior interface design and automation execution.https://doi.org/10.1186/s41235-025-00659-wAided decision-makingAutomation reliabilityDecision efficiencySystems factorial technology
spellingShingle Hanshu Zhang
Ran Zhou
Cheng-You Cheng
Sheng-Hsu Huang
Ming-Hui Cheng
Cheng-Ta Yang
Decision-making efficiency with aided information: the impact of automation reliability and task difficulty
Cognitive Research
Aided decision-making
Automation reliability
Decision efficiency
Systems factorial technology
title Decision-making efficiency with aided information: the impact of automation reliability and task difficulty
title_full Decision-making efficiency with aided information: the impact of automation reliability and task difficulty
title_fullStr Decision-making efficiency with aided information: the impact of automation reliability and task difficulty
title_full_unstemmed Decision-making efficiency with aided information: the impact of automation reliability and task difficulty
title_short Decision-making efficiency with aided information: the impact of automation reliability and task difficulty
title_sort decision making efficiency with aided information the impact of automation reliability and task difficulty
topic Aided decision-making
Automation reliability
Decision efficiency
Systems factorial technology
url https://doi.org/10.1186/s41235-025-00659-w
work_keys_str_mv AT hanshuzhang decisionmakingefficiencywithaidedinformationtheimpactofautomationreliabilityandtaskdifficulty
AT ranzhou decisionmakingefficiencywithaidedinformationtheimpactofautomationreliabilityandtaskdifficulty
AT chengyoucheng decisionmakingefficiencywithaidedinformationtheimpactofautomationreliabilityandtaskdifficulty
AT shenghsuhuang decisionmakingefficiencywithaidedinformationtheimpactofautomationreliabilityandtaskdifficulty
AT minghuicheng decisionmakingefficiencywithaidedinformationtheimpactofautomationreliabilityandtaskdifficulty
AT chengtayang decisionmakingefficiencywithaidedinformationtheimpactofautomationreliabilityandtaskdifficulty