Harnessing the Multi-Phasal Nature of Speech-EEG for Enhancing Imagined Speech Recognition
Analyzing speech-electroencephalogram (EEG) is pivotal for developing non-invasive and naturalistic brain-computer interfaces. Recognizing that the nature of human communication involves multiple phases like audition, imagination, articulation, and production, this study uncovers the shared cognitiv...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2025-01-01
|
| Series: | IEEE Open Journal of Signal Processing |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10839023/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1823859626454548480 |
|---|---|
| author | Rini Sharon Mriganka Sur Hema Murthy |
| author_facet | Rini Sharon Mriganka Sur Hema Murthy |
| author_sort | Rini Sharon |
| collection | DOAJ |
| description | Analyzing speech-electroencephalogram (EEG) is pivotal for developing non-invasive and naturalistic brain-computer interfaces. Recognizing that the nature of human communication involves multiple phases like audition, imagination, articulation, and production, this study uncovers the shared cognitive imprints that represent speech cognition across these phases. Regression analysis, using correlation metrics reveal pronounced inter-phasal congruence. This insight promotes a shift from single-phase-centric recognition models to harnessing integrated phase data, thereby enhancing recognition of cognitive speech. Having established the presence of inter-phase associations, a common representation learning feature extractor is introduced, adept at capturing the correlations and replicability across phases. The features so extracted are observed to provide superior discrimination of cognitive speech units. Notably, the proposed approach proves resilient even in the absence of comprehensive multi-phasal data. Through thorough control checks and illustrative topographical visualizations, our observations are substantiated. The findings indicate that the proposed multi-phase approach significantly enhances EEG-based speech recognition, achieving an accuracy gain of 18.2% for 25 cognitive units in continuous speech EEG over models reliant solely on single-phase data. |
| format | Article |
| id | doaj-art-93aaf129589a4261881a2f6e518a03c8 |
| institution | Kabale University |
| issn | 2644-1322 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Open Journal of Signal Processing |
| spelling | doaj-art-93aaf129589a4261881a2f6e518a03c82025-02-11T00:01:46ZengIEEEIEEE Open Journal of Signal Processing2644-13222025-01-016788810.1109/OJSP.2025.352836810839023Harnessing the Multi-Phasal Nature of Speech-EEG for Enhancing Imagined Speech RecognitionRini Sharon0https://orcid.org/0000-0002-4488-5061Mriganka Sur1https://orcid.org/0000-0003-2442-5671Hema Murthy2Indian Institute of Technology Madras, Chennai, IndiaDepartment of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USAIndian Institute of Technology Madras, Chennai, IndiaAnalyzing speech-electroencephalogram (EEG) is pivotal for developing non-invasive and naturalistic brain-computer interfaces. Recognizing that the nature of human communication involves multiple phases like audition, imagination, articulation, and production, this study uncovers the shared cognitive imprints that represent speech cognition across these phases. Regression analysis, using correlation metrics reveal pronounced inter-phasal congruence. This insight promotes a shift from single-phase-centric recognition models to harnessing integrated phase data, thereby enhancing recognition of cognitive speech. Having established the presence of inter-phase associations, a common representation learning feature extractor is introduced, adept at capturing the correlations and replicability across phases. The features so extracted are observed to provide superior discrimination of cognitive speech units. Notably, the proposed approach proves resilient even in the absence of comprehensive multi-phasal data. Through thorough control checks and illustrative topographical visualizations, our observations are substantiated. The findings indicate that the proposed multi-phase approach significantly enhances EEG-based speech recognition, achieving an accuracy gain of 18.2% for 25 cognitive units in continuous speech EEG over models reliant solely on single-phase data.https://ieeexplore.ieee.org/document/10839023/AuditionarticulationBCIimaginationregressionspeech-EEG correlation |
| spellingShingle | Rini Sharon Mriganka Sur Hema Murthy Harnessing the Multi-Phasal Nature of Speech-EEG for Enhancing Imagined Speech Recognition IEEE Open Journal of Signal Processing Audition articulation BCI imagination regression speech-EEG correlation |
| title | Harnessing the Multi-Phasal Nature of Speech-EEG for Enhancing Imagined Speech Recognition |
| title_full | Harnessing the Multi-Phasal Nature of Speech-EEG for Enhancing Imagined Speech Recognition |
| title_fullStr | Harnessing the Multi-Phasal Nature of Speech-EEG for Enhancing Imagined Speech Recognition |
| title_full_unstemmed | Harnessing the Multi-Phasal Nature of Speech-EEG for Enhancing Imagined Speech Recognition |
| title_short | Harnessing the Multi-Phasal Nature of Speech-EEG for Enhancing Imagined Speech Recognition |
| title_sort | harnessing the multi phasal nature of speech eeg for enhancing imagined speech recognition |
| topic | Audition articulation BCI imagination regression speech-EEG correlation |
| url | https://ieeexplore.ieee.org/document/10839023/ |
| work_keys_str_mv | AT rinisharon harnessingthemultiphasalnatureofspeecheegforenhancingimaginedspeechrecognition AT mrigankasur harnessingthemultiphasalnatureofspeecheegforenhancingimaginedspeechrecognition AT hemamurthy harnessingthemultiphasalnatureofspeecheegforenhancingimaginedspeechrecognition |