Human Factors Requirements for Human-AI Teaming in Aviation

The advent of Artificial Intelligence in the cockpit and the air traffic control centre in the coming decade could mark a step-change improvement in aviation safety, or else could usher in a flush of ‘AI-induced’ accidents. Given that contemporary AI has well-known weaknesses, from data biases and e...

Full description

Saved in:
Bibliographic Details
Main Author: Barry Kirwan
Format: Article
Language:English
Published: MDPI AG 2025-04-01
Series:Future Transportation
Subjects:
Online Access:https://www.mdpi.com/2673-7590/5/2/42
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849432657173151744
author Barry Kirwan
author_facet Barry Kirwan
author_sort Barry Kirwan
collection DOAJ
description The advent of Artificial Intelligence in the cockpit and the air traffic control centre in the coming decade could mark a step-change improvement in aviation safety, or else could usher in a flush of ‘AI-induced’ accidents. Given that contemporary AI has well-known weaknesses, from data biases and edge or corner effects, to outright ‘hallucinations’, in the mid-term AI will almost certainly be partnered with human expertise, its outputs monitored and tempered by human judgement. This is already enshrined in the EU Act on AI, with adherence to principles of human agency and oversight required in safety-critical domains such as aviation. However, such sound policies and principles are unlikely to be enough. Human interactions with current automation in the cockpit or air traffic control tower require extensive requirements, methods, and validations to ensure a robust (accident-free) partnership. Since AI will inevitably push the boundaries of traditional human-automation interaction, there is a need to revisit Human Factors to meet the challenges of future human-AI interaction design. This paper briefly reviews the types of AI and ‘Intelligent Agents’ along with their associated levels of AI autonomy being considered for future aviation applications. It then reviews the evolution of Human Factors to identify the critical areas where Human Factors can aid future human-AI teaming performance and safety, to generate a detailed requirements set organised for Human AI Teaming design. The resultant requirements set comprises eight Human Factors areas, from Human-Centred Design to Organisational Readiness, and 165 detailed requirements, and has been applied to three AI-based Intelligent Agent prototypes (two cockpit, one air traffic control tower). These early applications suggest that the new requirements set is scalable to different design maturity levels and different levels of AI autonomy, and acceptable as an approach to Human-AI Teaming design teams.
format Article
id doaj-art-7ebabbf8b0eb474695131f2ecc2d2583
institution Kabale University
issn 2673-7590
language English
publishDate 2025-04-01
publisher MDPI AG
record_format Article
series Future Transportation
spelling doaj-art-7ebabbf8b0eb474695131f2ecc2d25832025-08-20T03:27:18ZengMDPI AGFuture Transportation2673-75902025-04-01524210.3390/futuretransp5020042Human Factors Requirements for Human-AI Teaming in AviationBarry Kirwan0EUROCONTROL, EIH, Bois-des Bordes, F-91222 Bretigny sur Orge, FranceThe advent of Artificial Intelligence in the cockpit and the air traffic control centre in the coming decade could mark a step-change improvement in aviation safety, or else could usher in a flush of ‘AI-induced’ accidents. Given that contemporary AI has well-known weaknesses, from data biases and edge or corner effects, to outright ‘hallucinations’, in the mid-term AI will almost certainly be partnered with human expertise, its outputs monitored and tempered by human judgement. This is already enshrined in the EU Act on AI, with adherence to principles of human agency and oversight required in safety-critical domains such as aviation. However, such sound policies and principles are unlikely to be enough. Human interactions with current automation in the cockpit or air traffic control tower require extensive requirements, methods, and validations to ensure a robust (accident-free) partnership. Since AI will inevitably push the boundaries of traditional human-automation interaction, there is a need to revisit Human Factors to meet the challenges of future human-AI interaction design. This paper briefly reviews the types of AI and ‘Intelligent Agents’ along with their associated levels of AI autonomy being considered for future aviation applications. It then reviews the evolution of Human Factors to identify the critical areas where Human Factors can aid future human-AI teaming performance and safety, to generate a detailed requirements set organised for Human AI Teaming design. The resultant requirements set comprises eight Human Factors areas, from Human-Centred Design to Organisational Readiness, and 165 detailed requirements, and has been applied to three AI-based Intelligent Agent prototypes (two cockpit, one air traffic control tower). These early applications suggest that the new requirements set is scalable to different design maturity levels and different levels of AI autonomy, and acceptable as an approach to Human-AI Teaming design teams.https://www.mdpi.com/2673-7590/5/2/42aviationhuman-AI teamingintelligent agentshuman factors requirements
spellingShingle Barry Kirwan
Human Factors Requirements for Human-AI Teaming in Aviation
Future Transportation
aviation
human-AI teaming
intelligent agents
human factors requirements
title Human Factors Requirements for Human-AI Teaming in Aviation
title_full Human Factors Requirements for Human-AI Teaming in Aviation
title_fullStr Human Factors Requirements for Human-AI Teaming in Aviation
title_full_unstemmed Human Factors Requirements for Human-AI Teaming in Aviation
title_short Human Factors Requirements for Human-AI Teaming in Aviation
title_sort human factors requirements for human ai teaming in aviation
topic aviation
human-AI teaming
intelligent agents
human factors requirements
url https://www.mdpi.com/2673-7590/5/2/42
work_keys_str_mv AT barrykirwan humanfactorsrequirementsforhumanaiteaminginaviation