Deep Neural Network-Based Modeling of Multimodal Human–Computer Interaction in Aircraft Cockpits

Deep Neural Network-Based Modeling of Multimodal Human–Computer Interaction in Aircraft Cockpits

Improving the performance of human–computer interaction systems is an essential indicator of aircraft intelligence. To address the limitations of single-modal interaction methods, a multimodal interaction model based on gaze and EEG target selection is proposed using deep learning technology. This m...

Full description

Saved in:

Bibliographic Details
Main Authors:	Li Wang, Heming Zhang, Changyuan Wang
Format:	Article
Language:	English
Published:	MDPI AG 2025-03-01
Series:	Future Internet
Subjects:	deep learning multi-modal long short-term memory network transformer human–computer interaction
Online Access:	https://www.mdpi.com/1999-5903/17/3/127
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Fault Diagnosis Method of Rolling Bearing Based on Variational Modal Decomposition Multisynchrosqueezing Transform Combined With Long Short-Term Memory Networks
by: Tao Liang, et al.
Published: (2025-01-01)

Single-level Discrete Two Dimensional Wavelet Transform Based Multiscale Deep Learning Framework for Two-Wheeler Helmet Detection
by: Amrutha Annadurai, et al.
Published: (2025-03-01)

TRAINING OF THE FUTURE INTERPRETERS’ WORKING MEMORY
by: Antonina V. Prokopenko, et al.
Published: (2021-12-01)

Exploring Mixed-Interaction Mode in a Virtual Cockpit: Controller and Hand Gesture Integration
by: Yemon Lee, et al.
Published: (2025-06-01)

Optimized Deep Neural Network for High-Precision Psoriasis Classification from Dermoscopic Images
by: Charu Bolia, et al.
Published: (2025-07-01)

A Dual‐Modal Memory Organic Electrochemical Transistor Implementation for Reservoir Computing
by: Yuyang Yin, et al.
Published: (2025-01-01)

Deep learning-based channel prediction for TDD MIMO systems with imperfect channel reciprocity
by: Heecheol Yang
Published: (2025-06-01)

Photovoltaic Power Generation Forecasting Based on Secondary Data Decomposition and Hybrid Deep Learning Model
by: Liwei Zhang, et al.
Published: (2025-06-01)

Automated detection of quiet eye durations in archery using electrooculography and comparative deep learning models
by: Fatma Söğüt, et al.
Published: (2025-08-01)

Simulation and Empirical Studies of Long Short-Term Memory Performance to Deal with Limited Data
by: Khusnia Nurul Khikmah, et al.
Published: (2025-05-01)

ILSTMA: Enhancing Accuracy and Speed of Long-Term and Short-Term Memory Architecture
by: Zongyu Ming, et al.
Published: (2025-03-01)

Video description method based on multidimensional and multimodal information
by: Enjie DING, et al.
Published: (2020-02-01)

Hybrid Optimization based on Deep Learning Approach for Short-Term Load Forecast of Electricity Demand in Buildings
by: Charan Sekhar Makula, et al.
Published: (2024-06-01)

Monthly Runoff Prediction Based on STL-CEEMDAN-LSTM Model
by: WANG Hai, et al.
Published: (2025-04-01)

Rice Price Prediction with Long Short-Term Memory (LSTM) Neural Network
by: Rahmat Hidayat, et al.
Published: (2024-10-01)

Software Defect Prediction Based on Effective Fusion of Multiple Features
by: Chaozheng Zhang, et al.
Published: (2025-01-01)

Comparison of LSTM and Transformer Models in Predicting NVIDIA Stock Closing Prices and the Application of Rule-based Trading Strategies
by: Muhammad Irfan Abdul Gani, et al.
Published: (2025-09-01)

Deep learning Chinese input method with incremental vocabulary selection
by: Huajian REN, et al.
Published: (2022-12-01)

Aircraft Bearing Fault Diagnosis Method Based on LSTM-IDRSN
by: Lei Wang, et al.
Published: (2025-01-01)

Interactive Multiple-Model Learning Filter for Spacecraft Pursuit–Evasion Game Strategy Switch Based on Long Short-Term Memory Network
by: Chuangge Wang, et al.
Published: (2024-10-01)

A novel hybrid neural network of fluid-structure interaction prediction for two cylinders in tandem arrangement
by: Yanfang Lyu, et al.
Published: (2025-12-01)

Correction of ASCAT, ESA–CCI, and SMAP Soil Moisture Products Using the Multi-Source Long Short-Term Memory (MLSTM)
by: Qiuxia Xie, et al.
Published: (2025-07-01)

Evaluation of Encoder-Only Transformer for Multi-Step Traffic Flow Prediction
by: Mas Omar, et al.
Published: (2025-01-01)

Assessing the effectiveness of long short-term memory and artificial neural network in predicting daily ozone concentrations in Liaocheng City
by: Qingchun Guo, et al.
Published: (2025-02-01)

The influence of intraoperative sedation on memory consolidation: a single-blind randomized controlled trial
by: V. O. Churakov, et al.
Published: (2023-06-01)

ADFCNN-BiLSTM: A Deep Neural Network Based on Attention and Deformable Convolution for Network Intrusion Detection
by: Bin Li, et al.
Published: (2025-02-01)

Using Computational Methods for Persian Collocations Identification and Extraction
by: Zainabolhoda Heshmati, et al.
Published: (2024-12-01)

A multimodal hybrid parallel network intrusion detection model
by: Shuxin Shi, et al.
Published: (2023-12-01)

THE IMPACT OF THE PRESIDENTIAL ELECTION ON IDX COMPOSITE PREDICTIONS USING LONG SHORT TERM MEMORY
by: Ashilla Maula Hudzaifa, et al.
Published: (2024-10-01)

Long Short-Term Memory and Discrete Wavelet Transform based Univariate Stock Market Prediction Model
by: Mutasem Jarrah
Published: (2024-01-01)

SDMA-Net: Swin Transformer-Based Dynamic Memory-Attention Network for Endoscopic Navigation
by: Runnan Zhang, et al.
Published: (2025-01-01)

Application of attention mechanism-based LSTM neural network in stratigraphy identification
by: Cunde Jia, et al.
Published: (2025-09-01)

State of health prediction of lithium-ion batteries in charging chambers based on multi-modal deep learning
by: ZHAO Yinghua, et al.
Published: (2025-05-01)

Prediction of the Remaining Useful Life of Lithium–Ion Batteries Based on Mode Decomposition and ED-LSTM
by: Bingzeng Song, et al.
Published: (2025-02-01)

Short-Term Load Forecasting for Electrical Power Distribution Systems Using Enhanced Deep Neural Networks
by: Shewit Tsegaye, et al.
Published: (2024-01-01)

The use of the interactive DA-42T aircraft cockpit mockup in the process-oriented training
by: A. S. Knyazev, et al.
Published: (2023-08-01)

Cascade Machine Learning Approach Applied to Short-Term Medium Horizon Demand Forecasting
by: Bruno Brentan, et al.
Published: (2024-09-01)

Multimodal data-based human motion intention prediction using adaptive hybrid deep learning network for movement challenged person
by: Mustufa Haider Abidi
Published: (2024-12-01)

A deep learning-based hybrid method for PM2.5 prediction in central and western China
by: Zuhan Liu, et al.
Published: (2025-03-01)

Adversarial Attack Detection in Smart Grids Using Deep Learning Architectures
by: Stephanie Ness
Published: (2025-01-01)