Adaptive multimodal user interface techniques for mobile augmented reality: Frameworks, modalities and user interaction

Mobile augmented reality (MAR) has revolutionised information perception and real-world interaction. The introduction of MAR has enriched users’ visualisation abilities, enabling them to understand complex objects and reveal previously inaccessible aspects. However, traditional MAR systems predomina...

Full description

Saved in:
Bibliographic Details
Main Authors: Arvind Ramtohul, Kavi Kumar Khedo
Format: Article
Language:English
Published: Elsevier 2025-09-01
Series:Array
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2590005625001146
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849243012947771392
author Arvind Ramtohul
Kavi Kumar Khedo
author_facet Arvind Ramtohul
Kavi Kumar Khedo
author_sort Arvind Ramtohul
collection DOAJ
description Mobile augmented reality (MAR) has revolutionised information perception and real-world interaction. The introduction of MAR has enriched users’ visualisation abilities, enabling them to understand complex objects and reveal previously inaccessible aspects. However, traditional MAR systems predominantly rely on unimodal interaction techniques and the exploitation of user and contextual data has been moderate. This leads to inadequate interaction with augmented content ultimately impacting the user experience and engagement negatively. To address these shortcomings, adaptive multimodal user interface (AMUI) techniques in MAR have emerged, offering refined interaction mechanisms by leveraging multiple modalities and incorporating user and contextual information. In this paper, a systematic review of the adaptive and multimodal literature in MAR is conducted, aiming to assess the impact of AMUI techniques in MAR systems. This paper provides a comprehensive examination of the current state of AMUI-MAR systems and frameworks and identifies key research issues requiring further investigation. The findings of this paper have demonstrated that AMUI techniques have significant potential and can transform the interaction landscape of MAR, offering enhanced user experience and engagement. By leveraging multiple interaction modalities and better utilizing user and contextual information, AMUI techniques can pave the way for more natural and intuitive interactions in MAR.
format Article
id doaj-art-55f9f82e8b0b480f8f6c23b0ada2ced8
institution Kabale University
issn 2590-0056
language English
publishDate 2025-09-01
publisher Elsevier
record_format Article
series Array
spelling doaj-art-55f9f82e8b0b480f8f6c23b0ada2ced82025-08-20T03:59:37ZengElsevierArray2590-00562025-09-012710048710.1016/j.array.2025.100487Adaptive multimodal user interface techniques for mobile augmented reality: Frameworks, modalities and user interactionArvind Ramtohul0Kavi Kumar Khedo1Corresponding author.; Faculty of Information, Communication and Digital Technologies, University of Mauritius, Reduit, MauritiusCorresponding author.; Faculty of Information, Communication and Digital Technologies, University of Mauritius, Reduit, MauritiusMobile augmented reality (MAR) has revolutionised information perception and real-world interaction. The introduction of MAR has enriched users’ visualisation abilities, enabling them to understand complex objects and reveal previously inaccessible aspects. However, traditional MAR systems predominantly rely on unimodal interaction techniques and the exploitation of user and contextual data has been moderate. This leads to inadequate interaction with augmented content ultimately impacting the user experience and engagement negatively. To address these shortcomings, adaptive multimodal user interface (AMUI) techniques in MAR have emerged, offering refined interaction mechanisms by leveraging multiple modalities and incorporating user and contextual information. In this paper, a systematic review of the adaptive and multimodal literature in MAR is conducted, aiming to assess the impact of AMUI techniques in MAR systems. This paper provides a comprehensive examination of the current state of AMUI-MAR systems and frameworks and identifies key research issues requiring further investigation. The findings of this paper have demonstrated that AMUI techniques have significant potential and can transform the interaction landscape of MAR, offering enhanced user experience and engagement. By leveraging multiple interaction modalities and better utilizing user and contextual information, AMUI techniques can pave the way for more natural and intuitive interactions in MAR.http://www.sciencedirect.com/science/article/pii/S2590005625001146Mobile augmented realityHuman-computer interactionUser interfaceAdaptive interactionMultimodal interactionUser experience
spellingShingle Arvind Ramtohul
Kavi Kumar Khedo
Adaptive multimodal user interface techniques for mobile augmented reality: Frameworks, modalities and user interaction
Array
Mobile augmented reality
Human-computer interaction
User interface
Adaptive interaction
Multimodal interaction
User experience
title Adaptive multimodal user interface techniques for mobile augmented reality: Frameworks, modalities and user interaction
title_full Adaptive multimodal user interface techniques for mobile augmented reality: Frameworks, modalities and user interaction
title_fullStr Adaptive multimodal user interface techniques for mobile augmented reality: Frameworks, modalities and user interaction
title_full_unstemmed Adaptive multimodal user interface techniques for mobile augmented reality: Frameworks, modalities and user interaction
title_short Adaptive multimodal user interface techniques for mobile augmented reality: Frameworks, modalities and user interaction
title_sort adaptive multimodal user interface techniques for mobile augmented reality frameworks modalities and user interaction
topic Mobile augmented reality
Human-computer interaction
User interface
Adaptive interaction
Multimodal interaction
User experience
url http://www.sciencedirect.com/science/article/pii/S2590005625001146
work_keys_str_mv AT arvindramtohul adaptivemultimodaluserinterfacetechniquesformobileaugmentedrealityframeworksmodalitiesanduserinteraction
AT kavikumarkhedo adaptivemultimodaluserinterfacetechniquesformobileaugmentedrealityframeworksmodalitiesanduserinteraction