Qualitative studies: designing a multimodal medical visualization tool for helping patients interpret 3D medical images

BackgroundAccurate understanding of 3D medical images requires a background of specialized medical knowledge. There is a pressing need for easy-to-understand medical visualization tools to help patients accurately interpret 3D image data, especially given the large number of patients requiring such...

Full description

Saved in:
Bibliographic Details
Main Authors: Jinjin Chen, Ji Ma, Yongjian Huai
Format: Article
Language:English
Published: Frontiers Media S.A. 2025-05-01
Series:Frontiers in Physiology
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fphys.2025.1559801/full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850124971426185216
author Jinjin Chen
Ji Ma
Yongjian Huai
author_facet Jinjin Chen
Ji Ma
Yongjian Huai
author_sort Jinjin Chen
collection DOAJ
description BackgroundAccurate understanding of 3D medical images requires a background of specialized medical knowledge. There is a pressing need for easy-to-understand medical visualization tools to help patients accurately interpret 3D image data, especially given the large number of patients requiring such assistance.ObjectiveIn this paper, we explore the design considerations of a multimodal medical visualization tool for interpreting 3D medical images, which can help users to understand and recognize 3D medical image data.MethodsAn observational study and focus group interviews were conducted to explore how patients interact with physicians and the main problems they encounter when interpreting 3D medical images. Additionally, we conducted semi-structured expert interviews with physicians to investigate the common methods, techniques, and challenges involved in doctor-patient communication when interpreting 3D medical images. We also organized a participatory design workshop to discuss the patients’ design preferences for medical visualization tools.ResultsThe study identified three types of physician-patient interactions, eight specific behaviors, and seven main issues. It also summarized eight common methods and techniques to aid in understanding 3D medical images and highlighted five key findings regarding design preferences for medical visualization tools. Based on previous studies and our empirical research results, we propose seven design considerations for designing visual interfaces, interaction design plans, audios, infographics, and animation guides. The comprehensive summary of the weights for the above-mentioned design consideration was obtained. A comprehensive weighting of design consideration elements was calculated based on the Analytic Hierarchy Process. The results show that the design consideration factors (A primary factors) that have the relatively big weights are the interaction design (57.091%) and visual interface (25.352%), and the ones that have relatively small weights are the medical education and popularization (12.766%), and text presentation (4.791%). Additionally, we found that the weights of factors of the design considerations (B primary factors) are different in the web application, software and VR/AR platforms. Furthermore, we presented a case study of the design of a multimodal medical visualization tool applied in the medical context to help patients interpret 3D medical image data and improve doctor-patient communication skills.ConclusionThis study explores the benefits of combining multiple visualization methods for both doctors and patients. We also discuss the advantages and challenges of designing and using multimodal visualization tools in medical settings.
format Article
id doaj-art-c72d95ac44dd40658ca12186aa4d6e5c
institution OA Journals
issn 1664-042X
language English
publishDate 2025-05-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Physiology
spelling doaj-art-c72d95ac44dd40658ca12186aa4d6e5c2025-08-20T02:34:12ZengFrontiers Media S.A.Frontiers in Physiology1664-042X2025-05-011610.3389/fphys.2025.15598011559801Qualitative studies: designing a multimodal medical visualization tool for helping patients interpret 3D medical imagesJinjin Chen0Ji Ma1Yongjian Huai2School of Design and Art, Communication University of Zhejiang, Hangzhou, ChinaSchool of Ocean Information Engineering, Jimei University, Xiamen, ChinaSchool of Information, Beijing Forestry University, Beijing, ChinaBackgroundAccurate understanding of 3D medical images requires a background of specialized medical knowledge. There is a pressing need for easy-to-understand medical visualization tools to help patients accurately interpret 3D image data, especially given the large number of patients requiring such assistance.ObjectiveIn this paper, we explore the design considerations of a multimodal medical visualization tool for interpreting 3D medical images, which can help users to understand and recognize 3D medical image data.MethodsAn observational study and focus group interviews were conducted to explore how patients interact with physicians and the main problems they encounter when interpreting 3D medical images. Additionally, we conducted semi-structured expert interviews with physicians to investigate the common methods, techniques, and challenges involved in doctor-patient communication when interpreting 3D medical images. We also organized a participatory design workshop to discuss the patients’ design preferences for medical visualization tools.ResultsThe study identified three types of physician-patient interactions, eight specific behaviors, and seven main issues. It also summarized eight common methods and techniques to aid in understanding 3D medical images and highlighted five key findings regarding design preferences for medical visualization tools. Based on previous studies and our empirical research results, we propose seven design considerations for designing visual interfaces, interaction design plans, audios, infographics, and animation guides. The comprehensive summary of the weights for the above-mentioned design consideration was obtained. A comprehensive weighting of design consideration elements was calculated based on the Analytic Hierarchy Process. The results show that the design consideration factors (A primary factors) that have the relatively big weights are the interaction design (57.091%) and visual interface (25.352%), and the ones that have relatively small weights are the medical education and popularization (12.766%), and text presentation (4.791%). Additionally, we found that the weights of factors of the design considerations (B primary factors) are different in the web application, software and VR/AR platforms. Furthermore, we presented a case study of the design of a multimodal medical visualization tool applied in the medical context to help patients interpret 3D medical image data and improve doctor-patient communication skills.ConclusionThis study explores the benefits of combining multiple visualization methods for both doctors and patients. We also discuss the advantages and challenges of designing and using multimodal visualization tools in medical settings.https://www.frontiersin.org/articles/10.3389/fphys.2025.1559801/fullinterpreting 3D medical imagesmultimodalmedical visualizationqualitative researchdesign consideration
spellingShingle Jinjin Chen
Ji Ma
Yongjian Huai
Qualitative studies: designing a multimodal medical visualization tool for helping patients interpret 3D medical images
Frontiers in Physiology
interpreting 3D medical images
multimodal
medical visualization
qualitative research
design consideration
title Qualitative studies: designing a multimodal medical visualization tool for helping patients interpret 3D medical images
title_full Qualitative studies: designing a multimodal medical visualization tool for helping patients interpret 3D medical images
title_fullStr Qualitative studies: designing a multimodal medical visualization tool for helping patients interpret 3D medical images
title_full_unstemmed Qualitative studies: designing a multimodal medical visualization tool for helping patients interpret 3D medical images
title_short Qualitative studies: designing a multimodal medical visualization tool for helping patients interpret 3D medical images
title_sort qualitative studies designing a multimodal medical visualization tool for helping patients interpret 3d medical images
topic interpreting 3D medical images
multimodal
medical visualization
qualitative research
design consideration
url https://www.frontiersin.org/articles/10.3389/fphys.2025.1559801/full
work_keys_str_mv AT jinjinchen qualitativestudiesdesigningamultimodalmedicalvisualizationtoolforhelpingpatientsinterpret3dmedicalimages
AT jima qualitativestudiesdesigningamultimodalmedicalvisualizationtoolforhelpingpatientsinterpret3dmedicalimages
AT yongjianhuai qualitativestudiesdesigningamultimodalmedicalvisualizationtoolforhelpingpatientsinterpret3dmedicalimages