Real-Time EEG-Based BCI for Self-Paced Motor Imagery and Motor Execution Using Functional Neural Networks
This paper introduces a novel application of functional neural networks (FNNs) in the domain of electroencephalography-based (EEG-based) brain-computer interfaces (BCIs), targeting self-paced motor execution (ME) and motor imagery (MI). FNNs represent a neural network architecture tailored to smooth...
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/11004003/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850185149300342784 |
|---|---|
| author | Mavin Heim Florian Heinrichs Michael Hueppe Fran Nunez Alexander Szameitat Muriel Reuter Stefan M. Goetz Corinna Weber |
| author_facet | Mavin Heim Florian Heinrichs Michael Hueppe Fran Nunez Alexander Szameitat Muriel Reuter Stefan M. Goetz Corinna Weber |
| author_sort | Mavin Heim |
| collection | DOAJ |
| description | This paper introduces a novel application of functional neural networks (FNNs) in the domain of electroencephalography-based (EEG-based) brain-computer interfaces (BCIs), targeting self-paced motor execution (ME) and motor imagery (MI). FNNs represent a neural network architecture tailored to smooth processes, and as such have been applied to EEG data classification recently. The paper proposes a comprehensive pipeline encompassing data acquisition, synchronization, pre-processing, training of FNNs, and real-time inference to enable the seamless integration of FNNs into real-world BCI applications. For the first time, FNNs are integrated into an end-to-end pipeline and serve for live inference outside a strict laboratory setting. In pursuit of a more accessible electroencephalography (EEG) artificial intelligence (AI) training scenario, the paper introduces a self-paced environment for auto-labeling EEG data. A customdesigned Pong game serves as the training task and enables subjects to engage in MI/ME tasks while receiving immediate visual feedback. To automate the labeling process of the recorded EEG data, the movements of both arms are captured with inertial measurement units (IMUs) and analyzed through gesture recognition. This novel training framework contributes to more natural and engaging data collection and reduces pre-processing for model training. To provide a comprehensive evaluation, the paper compares the performance of FNN and EEGNet in the self-paced MI/ME tasks. The comparative analysis addresses factors such as classification accuracy, real-time processing speed, and power consumption. Furthermore, the study explores various auto-labeling methods within the self-paced environment, analyzing their impact on the classification performances of both architectures. By evaluating these labeling methods, this work addresses the challenge of accurate and efficient EEG data labeling, crucial for training robust models for prediction of time critical events. The proposed pipeline and experimental design culminate in a full-scale evaluation of the FNN-based classification system to demonstrate its efficacy in real-time MI/ME tasks. The paper’s contributions not only establish FNNs as a potent tool for EEG classification but also provide valuable insights into enhancing the accessibility, usability, and performance of EEG-based AI systems in real-world applications. |
| format | Article |
| id | doaj-art-1f2baae89d3149e9950c0ee99dc7f151 |
| institution | OA Journals |
| issn | 2169-3536 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-1f2baae89d3149e9950c0ee99dc7f1512025-08-20T02:16:49ZengIEEEIEEE Access2169-35362025-01-0113912329124710.1109/ACCESS.2025.356993211004003Real-Time EEG-Based BCI for Self-Paced Motor Imagery and Motor Execution Using Functional Neural NetworksMavin Heim0https://orcid.org/0009-0009-1339-7063Florian Heinrichs1https://orcid.org/0009-0003-9134-2646Michael Hueppe2https://orcid.org/0009-0002-1382-3607Fran Nunez3Alexander Szameitat4Muriel Reuter5https://orcid.org/0009-0004-8174-5393Stefan M. Goetz6https://orcid.org/0000-0002-1944-0714Corinna Weber7BCI Research, SNAP DISCOVERY AG, Bochum, GermanyBCI Research, SNAP DISCOVERY AG, Bochum, GermanyBCI Research, SNAP DISCOVERY AG, Bochum, GermanyBCI Research, SNAP DISCOVERY AG, Bochum, GermanyBCI Research, SNAP DISCOVERY AG, Bochum, GermanyBCI Research, SNAP DISCOVERY AG, Bochum, GermanyDepartment of Electrical and Computer Engineering, Rheinland-Pfälzische Technische Universität Kaiserslautern, Kaiserslautern, GermanyBCI Research, SNAP DISCOVERY AG, Bochum, GermanyThis paper introduces a novel application of functional neural networks (FNNs) in the domain of electroencephalography-based (EEG-based) brain-computer interfaces (BCIs), targeting self-paced motor execution (ME) and motor imagery (MI). FNNs represent a neural network architecture tailored to smooth processes, and as such have been applied to EEG data classification recently. The paper proposes a comprehensive pipeline encompassing data acquisition, synchronization, pre-processing, training of FNNs, and real-time inference to enable the seamless integration of FNNs into real-world BCI applications. For the first time, FNNs are integrated into an end-to-end pipeline and serve for live inference outside a strict laboratory setting. In pursuit of a more accessible electroencephalography (EEG) artificial intelligence (AI) training scenario, the paper introduces a self-paced environment for auto-labeling EEG data. A customdesigned Pong game serves as the training task and enables subjects to engage in MI/ME tasks while receiving immediate visual feedback. To automate the labeling process of the recorded EEG data, the movements of both arms are captured with inertial measurement units (IMUs) and analyzed through gesture recognition. This novel training framework contributes to more natural and engaging data collection and reduces pre-processing for model training. To provide a comprehensive evaluation, the paper compares the performance of FNN and EEGNet in the self-paced MI/ME tasks. The comparative analysis addresses factors such as classification accuracy, real-time processing speed, and power consumption. Furthermore, the study explores various auto-labeling methods within the self-paced environment, analyzing their impact on the classification performances of both architectures. By evaluating these labeling methods, this work addresses the challenge of accurate and efficient EEG data labeling, crucial for training robust models for prediction of time critical events. The proposed pipeline and experimental design culminate in a full-scale evaluation of the FNN-based classification system to demonstrate its efficacy in real-time MI/ME tasks. The paper’s contributions not only establish FNNs as a potent tool for EEG classification but also provide valuable insights into enhancing the accessibility, usability, and performance of EEG-based AI systems in real-world applications.https://ieeexplore.ieee.org/document/11004003/Auto labelingbrain-computer interface (BCI)BCI-illiteracyelectroencephalography (EEG)functional neural network (FNN)gamification |
| spellingShingle | Mavin Heim Florian Heinrichs Michael Hueppe Fran Nunez Alexander Szameitat Muriel Reuter Stefan M. Goetz Corinna Weber Real-Time EEG-Based BCI for Self-Paced Motor Imagery and Motor Execution Using Functional Neural Networks IEEE Access Auto labeling brain-computer interface (BCI) BCI-illiteracy electroencephalography (EEG) functional neural network (FNN) gamification |
| title | Real-Time EEG-Based BCI for Self-Paced Motor Imagery and Motor Execution Using Functional Neural Networks |
| title_full | Real-Time EEG-Based BCI for Self-Paced Motor Imagery and Motor Execution Using Functional Neural Networks |
| title_fullStr | Real-Time EEG-Based BCI for Self-Paced Motor Imagery and Motor Execution Using Functional Neural Networks |
| title_full_unstemmed | Real-Time EEG-Based BCI for Self-Paced Motor Imagery and Motor Execution Using Functional Neural Networks |
| title_short | Real-Time EEG-Based BCI for Self-Paced Motor Imagery and Motor Execution Using Functional Neural Networks |
| title_sort | real time eeg based bci for self paced motor imagery and motor execution using functional neural networks |
| topic | Auto labeling brain-computer interface (BCI) BCI-illiteracy electroencephalography (EEG) functional neural network (FNN) gamification |
| url | https://ieeexplore.ieee.org/document/11004003/ |
| work_keys_str_mv | AT mavinheim realtimeeegbasedbciforselfpacedmotorimageryandmotorexecutionusingfunctionalneuralnetworks AT florianheinrichs realtimeeegbasedbciforselfpacedmotorimageryandmotorexecutionusingfunctionalneuralnetworks AT michaelhueppe realtimeeegbasedbciforselfpacedmotorimageryandmotorexecutionusingfunctionalneuralnetworks AT frannunez realtimeeegbasedbciforselfpacedmotorimageryandmotorexecutionusingfunctionalneuralnetworks AT alexanderszameitat realtimeeegbasedbciforselfpacedmotorimageryandmotorexecutionusingfunctionalneuralnetworks AT murielreuter realtimeeegbasedbciforselfpacedmotorimageryandmotorexecutionusingfunctionalneuralnetworks AT stefanmgoetz realtimeeegbasedbciforselfpacedmotorimageryandmotorexecutionusingfunctionalneuralnetworks AT corinnaweber realtimeeegbasedbciforselfpacedmotorimageryandmotorexecutionusingfunctionalneuralnetworks |