Embodiment, Multimodality, and Composition: Convergent Themes across HCI and Education for Mixed-Reality Learning Environments

We present concurrent theoretical work from HCI and Education that reveals a convergence of trends focused on the importance of three themes: embodiment, multimodality, and composition. We argue that there is great potential for truly transformative work that aligns HCI and Education research, and p...

Full description

Saved in:
Bibliographic Details
Main Authors: David Birchfield, Harvey Thornburg, M. Colleen Megowan-Romanowicz, Sarah Hatton, Brandon Mechtley, Igor Dolgov, Winslow Burleson
Format: Article
Language:English
Published: Wiley 2008-01-01
Series:Advances in Human-Computer Interaction
Online Access:http://dx.doi.org/10.1155/2008/874563
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832549684417134592
author David Birchfield
Harvey Thornburg
M. Colleen Megowan-Romanowicz
Sarah Hatton
Brandon Mechtley
Igor Dolgov
Winslow Burleson
author_facet David Birchfield
Harvey Thornburg
M. Colleen Megowan-Romanowicz
Sarah Hatton
Brandon Mechtley
Igor Dolgov
Winslow Burleson
author_sort David Birchfield
collection DOAJ
description We present concurrent theoretical work from HCI and Education that reveals a convergence of trends focused on the importance of three themes: embodiment, multimodality, and composition. We argue that there is great potential for truly transformative work that aligns HCI and Education research, and posit that there is an important opportunity to advance this effort through the full integration of the three themes into a theoretical and technological framework for learning. We present our own work in this regard, introducing the Situated Multimedia Arts Learning Lab (SMALLab). SMALLab is a mixed-reality environment where students collaborate and interact with sonic and visual media through full-body, 3D movements in an open physical space. SMALLab emphasizes human-to-human interaction within a multimodal, computational context. We present a recent case study that documents the development of a new SMALLab learning scenario, a collaborative student participation framework, a student-centered curriculum, and a three-day teaching experiment for seventy-two earth science students. Participating students demonstrated significant learning gains as a result of the treatment. We conclude that our theoretical and technological framework can be broadly applied in the realization of mixed reality, student-centered learning environments.
format Article
id doaj-art-d17c9fd9ad9e4872b4f2f39b93824e07
institution Kabale University
issn 1687-5893
1687-5907
language English
publishDate 2008-01-01
publisher Wiley
record_format Article
series Advances in Human-Computer Interaction
spelling doaj-art-d17c9fd9ad9e4872b4f2f39b93824e072025-02-03T06:10:50ZengWileyAdvances in Human-Computer Interaction1687-58931687-59072008-01-01200810.1155/2008/874563874563Embodiment, Multimodality, and Composition: Convergent Themes across HCI and Education for Mixed-Reality Learning EnvironmentsDavid Birchfield0Harvey Thornburg1M. Colleen Megowan-Romanowicz2Sarah Hatton3Brandon Mechtley4Igor Dolgov5Winslow Burleson6Arts, Media and Engineering, Arizona State University, Tempe, AZ 85281, USAArts, Media and Engineering, Arizona State University, Tempe, AZ 85281, USAArts, Media and Engineering, Arizona State University, Tempe, AZ 85281, USAArts, Media and Engineering, Arizona State University, Tempe, AZ 85281, USAArts, Media and Engineering, Arizona State University, Tempe, AZ 85281, USAArts, Media and Engineering, Arizona State University, Tempe, AZ 85281, USAArts, Media and Engineering, Arizona State University, Tempe, AZ 85281, USAWe present concurrent theoretical work from HCI and Education that reveals a convergence of trends focused on the importance of three themes: embodiment, multimodality, and composition. We argue that there is great potential for truly transformative work that aligns HCI and Education research, and posit that there is an important opportunity to advance this effort through the full integration of the three themes into a theoretical and technological framework for learning. We present our own work in this regard, introducing the Situated Multimedia Arts Learning Lab (SMALLab). SMALLab is a mixed-reality environment where students collaborate and interact with sonic and visual media through full-body, 3D movements in an open physical space. SMALLab emphasizes human-to-human interaction within a multimodal, computational context. We present a recent case study that documents the development of a new SMALLab learning scenario, a collaborative student participation framework, a student-centered curriculum, and a three-day teaching experiment for seventy-two earth science students. Participating students demonstrated significant learning gains as a result of the treatment. We conclude that our theoretical and technological framework can be broadly applied in the realization of mixed reality, student-centered learning environments.http://dx.doi.org/10.1155/2008/874563
spellingShingle David Birchfield
Harvey Thornburg
M. Colleen Megowan-Romanowicz
Sarah Hatton
Brandon Mechtley
Igor Dolgov
Winslow Burleson
Embodiment, Multimodality, and Composition: Convergent Themes across HCI and Education for Mixed-Reality Learning Environments
Advances in Human-Computer Interaction
title Embodiment, Multimodality, and Composition: Convergent Themes across HCI and Education for Mixed-Reality Learning Environments
title_full Embodiment, Multimodality, and Composition: Convergent Themes across HCI and Education for Mixed-Reality Learning Environments
title_fullStr Embodiment, Multimodality, and Composition: Convergent Themes across HCI and Education for Mixed-Reality Learning Environments
title_full_unstemmed Embodiment, Multimodality, and Composition: Convergent Themes across HCI and Education for Mixed-Reality Learning Environments
title_short Embodiment, Multimodality, and Composition: Convergent Themes across HCI and Education for Mixed-Reality Learning Environments
title_sort embodiment multimodality and composition convergent themes across hci and education for mixed reality learning environments
url http://dx.doi.org/10.1155/2008/874563
work_keys_str_mv AT davidbirchfield embodimentmultimodalityandcompositionconvergentthemesacrosshciandeducationformixedrealitylearningenvironments
AT harveythornburg embodimentmultimodalityandcompositionconvergentthemesacrosshciandeducationformixedrealitylearningenvironments
AT mcolleenmegowanromanowicz embodimentmultimodalityandcompositionconvergentthemesacrosshciandeducationformixedrealitylearningenvironments
AT sarahhatton embodimentmultimodalityandcompositionconvergentthemesacrosshciandeducationformixedrealitylearningenvironments
AT brandonmechtley embodimentmultimodalityandcompositionconvergentthemesacrosshciandeducationformixedrealitylearningenvironments
AT igordolgov embodimentmultimodalityandcompositionconvergentthemesacrosshciandeducationformixedrealitylearningenvironments
AT winslowburleson embodimentmultimodalityandcompositionconvergentthemesacrosshciandeducationformixedrealitylearningenvironments