Detection of Student Engagement via Transformer-Enhanced Feature Pyramid Networks on Channel-Spatial Attention
One of the most important aspects of contemporary educational systems is student engagement detection, which involves determining how involved, attentive, and active students are in class activities. For educators, this approach is essential as it provides insights into students' learning exper...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Russian Academy of Sciences, St. Petersburg Federal Research Center
2025-04-01
|
| Series: | Информатика и автоматизация |
| Subjects: | |
| Online Access: | https://ia.spcras.ru/index.php/sp/article/view/16715 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849728719495626752 |
|---|---|
| author | A. Naveen I. Jeena Jacob Ajay Kumar Mandava |
| author_facet | A. Naveen I. Jeena Jacob Ajay Kumar Mandava |
| author_sort | A. Naveen |
| collection | DOAJ |
| description | One of the most important aspects of contemporary educational systems is student engagement detection, which involves determining how involved, attentive, and active students are in class activities. For educators, this approach is essential as it provides insights into students' learning experiences, enabling tailored interventions and instructional enhancements. Traditional techniques for evaluating student engagement are often time-consuming and subjective. This study proposes a novel real-time detection framework that leverages Transformer-enhanced Feature Pyramid Networks (FPN) with Channel-Spatial Attention (CSA), referred to as BiusFPN_CSA. The proposed approach automatically analyses student engagement patterns, such as body posture, eye contact, and head position, from visual data streams by integrating cutting-edge deep learning and computer vision techniques. By integrating the attention mechanism of CSA with the hierarchical feature representation capabilities of FPN, the model can accurately detect student engagement levels by capturing contextual and spatial information in the input data. Additionally, by incorporating the Transformer architecture, the model achieves better overall performance by effectively capturing long-range dependencies and semantic relationships within the input sequences. Evaluation using the WACV dataset demonstrates that the proposed model outperforms baseline techniques in terms of accuracy. Specifically, in terms of accuracy, the FPN_CSA_Trans_EH variant of the proposed model outperforms FPN_CSA by 3.28% and 4.98%, respectively. These findings underscore the efficacy of the BiusFPN_CSA framework in real-time student engagement detection, offering educators a valuable tool for enhancing instructional quality, fostering active learning environments, and ultimately improving student outcomes. |
| format | Article |
| id | doaj-art-8157e1ca3a9e459ca15893ec547c9aa9 |
| institution | DOAJ |
| issn | 2713-3192 2713-3206 |
| language | English |
| publishDate | 2025-04-01 |
| publisher | Russian Academy of Sciences, St. Petersburg Federal Research Center |
| record_format | Article |
| series | Информатика и автоматизация |
| spelling | doaj-art-8157e1ca3a9e459ca15893ec547c9aa92025-08-20T03:09:28ZengRussian Academy of Sciences, St. Petersburg Federal Research CenterИнформатика и автоматизация2713-31922713-32062025-04-0124263165610.15622/ia.24.2.1016715Detection of Student Engagement via Transformer-Enhanced Feature Pyramid Networks on Channel-Spatial AttentionA. Naveen0I. Jeena Jacob1Ajay Kumar Mandava2Gitam University-Bengaluru CampusGitam University-Bengaluru CampusGitam University-Bengaluru CampusOne of the most important aspects of contemporary educational systems is student engagement detection, which involves determining how involved, attentive, and active students are in class activities. For educators, this approach is essential as it provides insights into students' learning experiences, enabling tailored interventions and instructional enhancements. Traditional techniques for evaluating student engagement are often time-consuming and subjective. This study proposes a novel real-time detection framework that leverages Transformer-enhanced Feature Pyramid Networks (FPN) with Channel-Spatial Attention (CSA), referred to as BiusFPN_CSA. The proposed approach automatically analyses student engagement patterns, such as body posture, eye contact, and head position, from visual data streams by integrating cutting-edge deep learning and computer vision techniques. By integrating the attention mechanism of CSA with the hierarchical feature representation capabilities of FPN, the model can accurately detect student engagement levels by capturing contextual and spatial information in the input data. Additionally, by incorporating the Transformer architecture, the model achieves better overall performance by effectively capturing long-range dependencies and semantic relationships within the input sequences. Evaluation using the WACV dataset demonstrates that the proposed model outperforms baseline techniques in terms of accuracy. Specifically, in terms of accuracy, the FPN_CSA_Trans_EH variant of the proposed model outperforms FPN_CSA by 3.28% and 4.98%, respectively. These findings underscore the efficacy of the BiusFPN_CSA framework in real-time student engagement detection, offering educators a valuable tool for enhancing instructional quality, fostering active learning environments, and ultimately improving student outcomes.https://ia.spcras.ru/index.php/sp/article/view/16715feature pyramid network (fpn)channel-spatial attention (csa)student engagement detectiontransformer |
| spellingShingle | A. Naveen I. Jeena Jacob Ajay Kumar Mandava Detection of Student Engagement via Transformer-Enhanced Feature Pyramid Networks on Channel-Spatial Attention Информатика и автоматизация feature pyramid network (fpn) channel-spatial attention (csa) student engagement detection transformer |
| title | Detection of Student Engagement via Transformer-Enhanced Feature Pyramid Networks on Channel-Spatial Attention |
| title_full | Detection of Student Engagement via Transformer-Enhanced Feature Pyramid Networks on Channel-Spatial Attention |
| title_fullStr | Detection of Student Engagement via Transformer-Enhanced Feature Pyramid Networks on Channel-Spatial Attention |
| title_full_unstemmed | Detection of Student Engagement via Transformer-Enhanced Feature Pyramid Networks on Channel-Spatial Attention |
| title_short | Detection of Student Engagement via Transformer-Enhanced Feature Pyramid Networks on Channel-Spatial Attention |
| title_sort | detection of student engagement via transformer enhanced feature pyramid networks on channel spatial attention |
| topic | feature pyramid network (fpn) channel-spatial attention (csa) student engagement detection transformer |
| url | https://ia.spcras.ru/index.php/sp/article/view/16715 |
| work_keys_str_mv | AT anaveen detectionofstudentengagementviatransformerenhancedfeaturepyramidnetworksonchannelspatialattention AT ijeenajacob detectionofstudentengagementviatransformerenhancedfeaturepyramidnetworksonchannelspatialattention AT ajaykumarmandava detectionofstudentengagementviatransformerenhancedfeaturepyramidnetworksonchannelspatialattention |