Cognitive Assessment and Training in Extended Reality: Multimodal Systems, Clinical Utility, and Current Challenges

Extended reality (XR) technologies—encompassing virtual reality (VR), augmented reality (AR), and mixed reality (MR)—are transforming cognitive assessment and training by offering immersive, interactive environments that simulate real-world tasks. XR enhances ecological validity while enabling real-...

Full description

Saved in:
Bibliographic Details
Main Authors: Palmira Victoria González-Erena, Sara Fernández-Guinea, Panagiotis Kourtesis
Format: Article
Language:English
Published: MDPI AG 2025-01-01
Series:Encyclopedia
Subjects:
Online Access:https://www.mdpi.com/2673-8392/5/1/8
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849342823641382912
author Palmira Victoria González-Erena
Sara Fernández-Guinea
Panagiotis Kourtesis
author_facet Palmira Victoria González-Erena
Sara Fernández-Guinea
Panagiotis Kourtesis
author_sort Palmira Victoria González-Erena
collection DOAJ
description Extended reality (XR) technologies—encompassing virtual reality (VR), augmented reality (AR), and mixed reality (MR)—are transforming cognitive assessment and training by offering immersive, interactive environments that simulate real-world tasks. XR enhances ecological validity while enabling real-time, multimodal data collection through tools such as galvanic skin response (GSR), electroencephalography (EEG), eye tracking (ET), hand tracking, and body tracking. This allows for a more comprehensive understanding of cognitive and emotional processes, as well as adaptive, personalized interventions for users. Despite these advancements, current XR applications often underutilize the full potential of multimodal integration, relying primarily on visual and auditory inputs. Challenges such as cybersickness, usability concerns, and accessibility barriers further limit the widespread adoption of XR tools in cognitive science and clinical practice. This review examines XR-based cognitive assessment and training, focusing on its advantages over traditional methods, including ecological validity, engagement, and adaptability. It also explores unresolved challenges such as system usability, cost, and the need for multimodal feedback integration. The review concludes by identifying opportunities for optimizing XR tools to improve cognitive evaluation and rehabilitation outcomes, particularly for diverse populations, including older adults and individuals with cognitive impairments.
format Article
id doaj-art-1ea3efe8275d4fc88d947f70b5871ae4
institution Kabale University
issn 2673-8392
language English
publishDate 2025-01-01
publisher MDPI AG
record_format Article
series Encyclopedia
spelling doaj-art-1ea3efe8275d4fc88d947f70b5871ae42025-08-20T03:43:15ZengMDPI AGEncyclopedia2673-83922025-01-0151810.3390/encyclopedia5010008Cognitive Assessment and Training in Extended Reality: Multimodal Systems, Clinical Utility, and Current ChallengesPalmira Victoria González-Erena0Sara Fernández-Guinea1Panagiotis Kourtesis2Department of Psychology, The American College of Greece, 15342 Athens, GreeceDepartment of Experimental Psychology, Cognitive Processes and Speech Therapy, Complutense University of Madrid, 28223 Madrid, SpainDepartment of Psychology, The American College of Greece, 15342 Athens, GreeceExtended reality (XR) technologies—encompassing virtual reality (VR), augmented reality (AR), and mixed reality (MR)—are transforming cognitive assessment and training by offering immersive, interactive environments that simulate real-world tasks. XR enhances ecological validity while enabling real-time, multimodal data collection through tools such as galvanic skin response (GSR), electroencephalography (EEG), eye tracking (ET), hand tracking, and body tracking. This allows for a more comprehensive understanding of cognitive and emotional processes, as well as adaptive, personalized interventions for users. Despite these advancements, current XR applications often underutilize the full potential of multimodal integration, relying primarily on visual and auditory inputs. Challenges such as cybersickness, usability concerns, and accessibility barriers further limit the widespread adoption of XR tools in cognitive science and clinical practice. This review examines XR-based cognitive assessment and training, focusing on its advantages over traditional methods, including ecological validity, engagement, and adaptability. It also explores unresolved challenges such as system usability, cost, and the need for multimodal feedback integration. The review concludes by identifying opportunities for optimizing XR tools to improve cognitive evaluation and rehabilitation outcomes, particularly for diverse populations, including older adults and individuals with cognitive impairments.https://www.mdpi.com/2673-8392/5/1/8extended reality (XR)cognitive assessmentcognitive traininguser experienceusabilityacceptability
spellingShingle Palmira Victoria González-Erena
Sara Fernández-Guinea
Panagiotis Kourtesis
Cognitive Assessment and Training in Extended Reality: Multimodal Systems, Clinical Utility, and Current Challenges
Encyclopedia
extended reality (XR)
cognitive assessment
cognitive training
user experience
usability
acceptability
title Cognitive Assessment and Training in Extended Reality: Multimodal Systems, Clinical Utility, and Current Challenges
title_full Cognitive Assessment and Training in Extended Reality: Multimodal Systems, Clinical Utility, and Current Challenges
title_fullStr Cognitive Assessment and Training in Extended Reality: Multimodal Systems, Clinical Utility, and Current Challenges
title_full_unstemmed Cognitive Assessment and Training in Extended Reality: Multimodal Systems, Clinical Utility, and Current Challenges
title_short Cognitive Assessment and Training in Extended Reality: Multimodal Systems, Clinical Utility, and Current Challenges
title_sort cognitive assessment and training in extended reality multimodal systems clinical utility and current challenges
topic extended reality (XR)
cognitive assessment
cognitive training
user experience
usability
acceptability
url https://www.mdpi.com/2673-8392/5/1/8
work_keys_str_mv AT palmiravictoriagonzalezerena cognitiveassessmentandtraininginextendedrealitymultimodalsystemsclinicalutilityandcurrentchallenges
AT sarafernandezguinea cognitiveassessmentandtraininginextendedrealitymultimodalsystemsclinicalutilityandcurrentchallenges
AT panagiotiskourtesis cognitiveassessmentandtraininginextendedrealitymultimodalsystemsclinicalutilityandcurrentchallenges