Towards Emotion Detection in Educational Scenarios from Facial Expressions and Body Movements through Multimodal Approaches

We report current findings when considering video recordings of facial expressions and body movements to provide affective personalized support in an educational context from an enriched multimodal emotion detection approach. In particular, we describe an annotation methodology to tag facial express...

Full description

Saved in:
Bibliographic Details
Main Authors: Mar Saneiro, Olga C. Santos, Sergio Salmeron-Majadas, Jesus G. Boticario
Format: Article
Language:English
Published: Wiley 2014-01-01
Series:The Scientific World Journal
Online Access:http://dx.doi.org/10.1155/2014/484873
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We report current findings when considering video recordings of facial expressions and body movements to provide affective personalized support in an educational context from an enriched multimodal emotion detection approach. In particular, we describe an annotation methodology to tag facial expression and body movements that conform to changes in the affective states of learners while dealing with cognitive tasks in a learning process. The ultimate goal is to combine these annotations with additional affective information collected during experimental learning sessions from different sources such as qualitative, self-reported, physiological, and behavioral information. These data altogether are to train data mining algorithms that serve to automatically identify changes in the learners’ affective states when dealing with cognitive tasks which help to provide emotional personalized support.
ISSN:2356-6140
1537-744X