Survey of neurocognitive disorder detection methods based on speech, visual, and virtual reality technologies

The global trend of population aging poses significant challenges to society and healthcare systems, particularly because of neurocognitive disorders (NCDs) such as Parkinson's disease (PD) and Alzheimer's disease (AD). In this context, artificial intelligence techniques have demonstrated...

Full description

Saved in:
Bibliographic Details
Main Authors: Tian ZHENG, Xinheng WANG, Xiaolan PENG, Ning SU, Tianyi XU, Xurong XIE, Jin HUANG, Lun XIE, Feng TIAN
Format: Article
Language:English
Published: KeAi Communications Co., Ltd. 2024-12-01
Series:Virtual Reality & Intelligent Hardware
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2096579624000482
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850057915323383808
author Tian ZHENG
Xinheng WANG
Xiaolan PENG
Ning SU
Tianyi XU
Xurong XIE
Jin HUANG
Lun XIE
Feng TIAN
author_facet Tian ZHENG
Xinheng WANG
Xiaolan PENG
Ning SU
Tianyi XU
Xurong XIE
Jin HUANG
Lun XIE
Feng TIAN
author_sort Tian ZHENG
collection DOAJ
description The global trend of population aging poses significant challenges to society and healthcare systems, particularly because of neurocognitive disorders (NCDs) such as Parkinson's disease (PD) and Alzheimer's disease (AD). In this context, artificial intelligence techniques have demonstrated promising potential for the objective assessment and detection of NCDs. Multimodal contactless screening technologies, such as speech-language processing, computer vision, and virtual reality, offer efficient and convenient methods for disease diagnosis and progression tracking. This paper systematically reviews the specific methods and applications of these technologies in the detection of NCDs using data collection paradigms, feature extraction, and modeling approaches. Additionally, the potential applications and future prospects of these technologies for the detection of cognitive and motor disorders are explored. By providing a comprehensive summary and refinement of the extant theories, methodologies, and applications, this study aims to facilitate an in-depth understanding of these technologies for researchers, both within and outside the field. To the best of our knowledge, this is the first survey to cover the use of speech-language processing, computer vision, and virtual reality technologies for the detection of NSDs.
format Article
id doaj-art-e6b74c5deb964864a60c3754eac8d4e9
institution DOAJ
issn 2096-5796
language English
publishDate 2024-12-01
publisher KeAi Communications Co., Ltd.
record_format Article
series Virtual Reality & Intelligent Hardware
spelling doaj-art-e6b74c5deb964864a60c3754eac8d4e92025-08-20T02:51:18ZengKeAi Communications Co., Ltd.Virtual Reality & Intelligent Hardware2096-57962024-12-016642147210.1016/j.vrih.2024.08.001Survey of neurocognitive disorder detection methods based on speech, visual, and virtual reality technologiesTian ZHENG0Xinheng WANG1Xiaolan PENG2Ning SU3Tianyi XU4Xurong XIE5Jin HUANG6Lun XIE7Feng TIAN8Institute of Software, Chinese Academy of Sciences, Beijing 100190, China; School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, ChinaSchool of Computer & Communication Engineering, University of Science and Technology Beijing, Beijing 100083, ChinaInstitute of Software, Chinese Academy of Sciences, Beijing 100190, ChinaPeking Union Medical College Hospital, Peking Union Medical College and Chinese Academy of Medical Science, Beijing 100005,ChinaSchool of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100049, ChinaInstitute of Software, Chinese Academy of Sciences, Beijing 100190, China; Corresponding author,Institute of Software, Chinese Academy of Sciences, Beijing 100190, ChinaSchool of Computer & Communication Engineering, University of Science and Technology Beijing, Beijing 100083, ChinaInstitute of Software, Chinese Academy of Sciences, Beijing 100190, ChinaThe global trend of population aging poses significant challenges to society and healthcare systems, particularly because of neurocognitive disorders (NCDs) such as Parkinson's disease (PD) and Alzheimer's disease (AD). In this context, artificial intelligence techniques have demonstrated promising potential for the objective assessment and detection of NCDs. Multimodal contactless screening technologies, such as speech-language processing, computer vision, and virtual reality, offer efficient and convenient methods for disease diagnosis and progression tracking. This paper systematically reviews the specific methods and applications of these technologies in the detection of NCDs using data collection paradigms, feature extraction, and modeling approaches. Additionally, the potential applications and future prospects of these technologies for the detection of cognitive and motor disorders are explored. By providing a comprehensive summary and refinement of the extant theories, methodologies, and applications, this study aims to facilitate an in-depth understanding of these technologies for researchers, both within and outside the field. To the best of our knowledge, this is the first survey to cover the use of speech-language processing, computer vision, and virtual reality technologies for the detection of NSDs.http://www.sciencedirect.com/science/article/pii/S2096579624000482Neurocognitive disorderSpeech-languageComputer visionVirtual realityArtificial intelligence
spellingShingle Tian ZHENG
Xinheng WANG
Xiaolan PENG
Ning SU
Tianyi XU
Xurong XIE
Jin HUANG
Lun XIE
Feng TIAN
Survey of neurocognitive disorder detection methods based on speech, visual, and virtual reality technologies
Virtual Reality & Intelligent Hardware
Neurocognitive disorder
Speech-language
Computer vision
Virtual reality
Artificial intelligence
title Survey of neurocognitive disorder detection methods based on speech, visual, and virtual reality technologies
title_full Survey of neurocognitive disorder detection methods based on speech, visual, and virtual reality technologies
title_fullStr Survey of neurocognitive disorder detection methods based on speech, visual, and virtual reality technologies
title_full_unstemmed Survey of neurocognitive disorder detection methods based on speech, visual, and virtual reality technologies
title_short Survey of neurocognitive disorder detection methods based on speech, visual, and virtual reality technologies
title_sort survey of neurocognitive disorder detection methods based on speech visual and virtual reality technologies
topic Neurocognitive disorder
Speech-language
Computer vision
Virtual reality
Artificial intelligence
url http://www.sciencedirect.com/science/article/pii/S2096579624000482
work_keys_str_mv AT tianzheng surveyofneurocognitivedisorderdetectionmethodsbasedonspeechvisualandvirtualrealitytechnologies
AT xinhengwang surveyofneurocognitivedisorderdetectionmethodsbasedonspeechvisualandvirtualrealitytechnologies
AT xiaolanpeng surveyofneurocognitivedisorderdetectionmethodsbasedonspeechvisualandvirtualrealitytechnologies
AT ningsu surveyofneurocognitivedisorderdetectionmethodsbasedonspeechvisualandvirtualrealitytechnologies
AT tianyixu surveyofneurocognitivedisorderdetectionmethodsbasedonspeechvisualandvirtualrealitytechnologies
AT xurongxie surveyofneurocognitivedisorderdetectionmethodsbasedonspeechvisualandvirtualrealitytechnologies
AT jinhuang surveyofneurocognitivedisorderdetectionmethodsbasedonspeechvisualandvirtualrealitytechnologies
AT lunxie surveyofneurocognitivedisorderdetectionmethodsbasedonspeechvisualandvirtualrealitytechnologies
AT fengtian surveyofneurocognitivedisorderdetectionmethodsbasedonspeechvisualandvirtualrealitytechnologies