Application of multimodal deep learning in the auxiliary diagnosis and treatment of dermatological diseases

Skin diseases are important factors affecting health and quality of life, especially in rural areas where medical resources are limited. Early and accurate diagnosis can reduce unnecessary health and economic losses. However, traditional visual diagnosis poses a high demand on both doctors’ experien...

Full description

Saved in:
Bibliographic Details
Main Authors: Ting Li, Bowei Li, Yuying Jia, Lian Duan, Ping Sun, Xiaozhen Li, Xiaodong Yang, Hong Cai
Format: Article
Language:English
Published: Elsevier 2025-05-01
Series:Intelligent Medicine
Subjects:
Online Access:http://www.sciencedirect.com/science/article/pii/S2667102625000270
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849695041926201344
author Ting Li
Bowei Li
Yuying Jia
Lian Duan
Ping Sun
Xiaozhen Li
Xiaodong Yang
Hong Cai
author_facet Ting Li
Bowei Li
Yuying Jia
Lian Duan
Ping Sun
Xiaozhen Li
Xiaodong Yang
Hong Cai
author_sort Ting Li
collection DOAJ
description Skin diseases are important factors affecting health and quality of life, especially in rural areas where medical resources are limited. Early and accurate diagnosis can reduce unnecessary health and economic losses. However, traditional visual diagnosis poses a high demand on both doctors’ experience and the examination equipment, and there is a risk of missed diagnosis and misdiagnosis. Recently, advances in artificial intelligence technology, particularly deep learning, have resulted in the use of unimodal computer-aided diagnosis and treatment technologies based on skin images in dermatology. However, due to the small amount of information contained in unimodality, this technology cannot fully demonstrate the advantages of multimodal data in the real-world medical environment. Multimodal data fusion can fully integrate various types of data to help doctors make more accurate clinical decisions. This review aimed to provide a comprehensive overview of multimodal data and deep learning methods that could help dermatologists diagnose and treat skin diseases.
format Article
id doaj-art-034c0bfcf37b49f382fc78494a27f2d0
institution DOAJ
issn 2667-1026
language English
publishDate 2025-05-01
publisher Elsevier
record_format Article
series Intelligent Medicine
spelling doaj-art-034c0bfcf37b49f382fc78494a27f2d02025-08-20T03:19:53ZengElsevierIntelligent Medicine2667-10262025-05-015213214010.1016/j.imed.2024.10.002Application of multimodal deep learning in the auxiliary diagnosis and treatment of dermatological diseasesTing Li0Bowei Li1Yuying Jia2Lian Duan3Ping Sun4Xiaozhen Li5Xiaodong Yang6Hong Cai7Department of Graduate, Hebei North University, Zhangjiakou, Hebei 075132, China; Department of Dermatology, Air Force Medical Center, Chinese People's Liberation Army, Beijing 100142, ChinaDepartment of Dermatology, Air Force Medical Center, Chinese People's Liberation Army, Beijing 100142, ChinaDepartment of Dermatology, Air Force Medical Center, Chinese People's Liberation Army, Beijing 100142, ChinaDepartment of Dermatology, Air Force Medical Center, Chinese People's Liberation Army, Beijing 100142, ChinaDepartment of Dermatology, Air Force Medical Center, Chinese People's Liberation Army, Beijing 100142, ChinaDepartment of Dermatology, Air Force Medical Center, Chinese People's Liberation Army, Beijing 100142, ChinaInstitute of Computing Technology, Chinese Academy of Sciences, Beijing 100083, China; Corresponding authors: Hong Cai, Department of Dermatology, Air Force Medical Center, Chinese People's Liberation Army, Beijing 100142, China; Xiaodong Yang, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100083, China.Department of Dermatology, Air Force Medical Center, Chinese People's Liberation Army, Beijing 100142, China; Corresponding authors: Hong Cai, Department of Dermatology, Air Force Medical Center, Chinese People's Liberation Army, Beijing 100142, China; Xiaodong Yang, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100083, China.Skin diseases are important factors affecting health and quality of life, especially in rural areas where medical resources are limited. Early and accurate diagnosis can reduce unnecessary health and economic losses. However, traditional visual diagnosis poses a high demand on both doctors’ experience and the examination equipment, and there is a risk of missed diagnosis and misdiagnosis. Recently, advances in artificial intelligence technology, particularly deep learning, have resulted in the use of unimodal computer-aided diagnosis and treatment technologies based on skin images in dermatology. However, due to the small amount of information contained in unimodality, this technology cannot fully demonstrate the advantages of multimodal data in the real-world medical environment. Multimodal data fusion can fully integrate various types of data to help doctors make more accurate clinical decisions. This review aimed to provide a comprehensive overview of multimodal data and deep learning methods that could help dermatologists diagnose and treat skin diseases.http://www.sciencedirect.com/science/article/pii/S2667102625000270Skin diseasesMultimodal dataArtificial intelligenceDeep learningComputer-aided diagnosis and treatment
spellingShingle Ting Li
Bowei Li
Yuying Jia
Lian Duan
Ping Sun
Xiaozhen Li
Xiaodong Yang
Hong Cai
Application of multimodal deep learning in the auxiliary diagnosis and treatment of dermatological diseases
Intelligent Medicine
Skin diseases
Multimodal data
Artificial intelligence
Deep learning
Computer-aided diagnosis and treatment
title Application of multimodal deep learning in the auxiliary diagnosis and treatment of dermatological diseases
title_full Application of multimodal deep learning in the auxiliary diagnosis and treatment of dermatological diseases
title_fullStr Application of multimodal deep learning in the auxiliary diagnosis and treatment of dermatological diseases
title_full_unstemmed Application of multimodal deep learning in the auxiliary diagnosis and treatment of dermatological diseases
title_short Application of multimodal deep learning in the auxiliary diagnosis and treatment of dermatological diseases
title_sort application of multimodal deep learning in the auxiliary diagnosis and treatment of dermatological diseases
topic Skin diseases
Multimodal data
Artificial intelligence
Deep learning
Computer-aided diagnosis and treatment
url http://www.sciencedirect.com/science/article/pii/S2667102625000270
work_keys_str_mv AT tingli applicationofmultimodaldeeplearningintheauxiliarydiagnosisandtreatmentofdermatologicaldiseases
AT boweili applicationofmultimodaldeeplearningintheauxiliarydiagnosisandtreatmentofdermatologicaldiseases
AT yuyingjia applicationofmultimodaldeeplearningintheauxiliarydiagnosisandtreatmentofdermatologicaldiseases
AT lianduan applicationofmultimodaldeeplearningintheauxiliarydiagnosisandtreatmentofdermatologicaldiseases
AT pingsun applicationofmultimodaldeeplearningintheauxiliarydiagnosisandtreatmentofdermatologicaldiseases
AT xiaozhenli applicationofmultimodaldeeplearningintheauxiliarydiagnosisandtreatmentofdermatologicaldiseases
AT xiaodongyang applicationofmultimodaldeeplearningintheauxiliarydiagnosisandtreatmentofdermatologicaldiseases
AT hongcai applicationofmultimodaldeeplearningintheauxiliarydiagnosisandtreatmentofdermatologicaldiseases