Effectiveness of Virtual Simulations Versus Mannequins and Real Persons in Medical and Nursing Education: Meta-Analysis and Trial Sequential Analysis of Randomized Controlled Trials

BackgroundVirtual simulation (VS) is a developing education approach with the recreation of reality using digital technology. The teaching effectiveness of VSs compared to mannequins and real persons (RPs) has never been investigated in medical and nursing education....

Full description

Saved in:
Bibliographic Details
Main Authors: Nan Jiang, Yuelun Zhang, Siyu Liang, Xiaohong Lyu, Shi Chen, Xiaoming Huang, Hui Pan
Format: Article
Language:English
Published: JMIR Publications 2024-12-01
Series:Journal of Medical Internet Research
Online Access:https://www.jmir.org/2024/1/e56195
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1850176962196144128
author Nan Jiang
Yuelun Zhang
Siyu Liang
Xiaohong Lyu
Shi Chen
Xiaoming Huang
Hui Pan
author_facet Nan Jiang
Yuelun Zhang
Siyu Liang
Xiaohong Lyu
Shi Chen
Xiaoming Huang
Hui Pan
author_sort Nan Jiang
collection DOAJ
description BackgroundVirtual simulation (VS) is a developing education approach with the recreation of reality using digital technology. The teaching effectiveness of VSs compared to mannequins and real persons (RPs) has never been investigated in medical and nursing education. ObjectiveThis study aims to compare VSs and mannequins or RPs in improving the following clinical competencies: knowledge, procedural skills, clinical reasoning, and communication skills. MethodsFollowing Cochrane methodology, a meta-analysis was conducted on the effectiveness of VSs in pre- and postregistration medical or nursing participants. The Cochrane Library, PubMed, Embase, and Educational Resource Information Centre databases were searched to identify English-written randomized controlled trials up to August 2024. Two authors independently selected studies, extracted data, and assessed the risk of bias. All pooled estimates were based on random-effects models and assessed by trial sequential analyses. Leave-one-out, subgroup, and univariate meta-regression analyses were performed to explore sources of heterogeneity. ResultsA total of 27 studies with 1480 participants were included. Overall, there were no significant differences between VSs and mannequins or RPs in improving knowledge (standard mean difference [SMD]=0.08; 95% CI –0.30 to 0.47; I2=67%; P=.002), procedural skills (SMD=–0.12; 95% CI –0.47 to 0.23; I2=75%; P<.001), clinical reasoning (SMD=0.29; 95% CI –0.26 to 0.85; I2=88%; P<.001), and communication skills (SMD=–0.02; 95% CI: –0.62 to 0.58; I2=86%; P<.001). Trial sequential analysis for clinical reasoning indicated an insufficient sample size for a definitive judgment. For procedural skills, subgroup analyses showed that VSs were less effective among nursing participants (SMD=–0.55; 95% CI –1.07 to –0.03; I2=69%; P=.04). Univariate meta-regression detected a positive effect of publication year (β=.09; P=.02) on communication skill scores. ConclusionsGiven favorable cost-utility plus high flexibility regarding time and space, VSs are viable alternatives to traditional face-to-face learning modalities. The comparative effectiveness of VSs deserves to be followed up with the emergence of new technology. In addition, further investigation of VSs with different design features will provide novel insights to drive education reform. Trial RegistrationPROSPERO CRD42023466622; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=466622
format Article
id doaj-art-c8e84d5d26254f4e9614bf1cd011b3ea
institution OA Journals
issn 1438-8871
language English
publishDate 2024-12-01
publisher JMIR Publications
record_format Article
series Journal of Medical Internet Research
spelling doaj-art-c8e84d5d26254f4e9614bf1cd011b3ea2025-08-20T02:19:07ZengJMIR PublicationsJournal of Medical Internet Research1438-88712024-12-0126e5619510.2196/56195Effectiveness of Virtual Simulations Versus Mannequins and Real Persons in Medical and Nursing Education: Meta-Analysis and Trial Sequential Analysis of Randomized Controlled TrialsNan Jianghttps://orcid.org/0009-0009-0058-3481Yuelun Zhanghttps://orcid.org/0000-0001-7990-9003Siyu Lianghttps://orcid.org/0000-0002-3686-2679Xiaohong Lyuhttps://orcid.org/0000-0002-4647-7758Shi Chenhttps://orcid.org/0000-0003-2205-5371Xiaoming Huanghttps://orcid.org/0000-0003-2978-6484Hui Panhttps://orcid.org/0000-0003-2413-0646 BackgroundVirtual simulation (VS) is a developing education approach with the recreation of reality using digital technology. The teaching effectiveness of VSs compared to mannequins and real persons (RPs) has never been investigated in medical and nursing education. ObjectiveThis study aims to compare VSs and mannequins or RPs in improving the following clinical competencies: knowledge, procedural skills, clinical reasoning, and communication skills. MethodsFollowing Cochrane methodology, a meta-analysis was conducted on the effectiveness of VSs in pre- and postregistration medical or nursing participants. The Cochrane Library, PubMed, Embase, and Educational Resource Information Centre databases were searched to identify English-written randomized controlled trials up to August 2024. Two authors independently selected studies, extracted data, and assessed the risk of bias. All pooled estimates were based on random-effects models and assessed by trial sequential analyses. Leave-one-out, subgroup, and univariate meta-regression analyses were performed to explore sources of heterogeneity. ResultsA total of 27 studies with 1480 participants were included. Overall, there were no significant differences between VSs and mannequins or RPs in improving knowledge (standard mean difference [SMD]=0.08; 95% CI –0.30 to 0.47; I2=67%; P=.002), procedural skills (SMD=–0.12; 95% CI –0.47 to 0.23; I2=75%; P<.001), clinical reasoning (SMD=0.29; 95% CI –0.26 to 0.85; I2=88%; P<.001), and communication skills (SMD=–0.02; 95% CI: –0.62 to 0.58; I2=86%; P<.001). Trial sequential analysis for clinical reasoning indicated an insufficient sample size for a definitive judgment. For procedural skills, subgroup analyses showed that VSs were less effective among nursing participants (SMD=–0.55; 95% CI –1.07 to –0.03; I2=69%; P=.04). Univariate meta-regression detected a positive effect of publication year (β=.09; P=.02) on communication skill scores. ConclusionsGiven favorable cost-utility plus high flexibility regarding time and space, VSs are viable alternatives to traditional face-to-face learning modalities. The comparative effectiveness of VSs deserves to be followed up with the emergence of new technology. In addition, further investigation of VSs with different design features will provide novel insights to drive education reform. Trial RegistrationPROSPERO CRD42023466622; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=466622https://www.jmir.org/2024/1/e56195
spellingShingle Nan Jiang
Yuelun Zhang
Siyu Liang
Xiaohong Lyu
Shi Chen
Xiaoming Huang
Hui Pan
Effectiveness of Virtual Simulations Versus Mannequins and Real Persons in Medical and Nursing Education: Meta-Analysis and Trial Sequential Analysis of Randomized Controlled Trials
Journal of Medical Internet Research
title Effectiveness of Virtual Simulations Versus Mannequins and Real Persons in Medical and Nursing Education: Meta-Analysis and Trial Sequential Analysis of Randomized Controlled Trials
title_full Effectiveness of Virtual Simulations Versus Mannequins and Real Persons in Medical and Nursing Education: Meta-Analysis and Trial Sequential Analysis of Randomized Controlled Trials
title_fullStr Effectiveness of Virtual Simulations Versus Mannequins and Real Persons in Medical and Nursing Education: Meta-Analysis and Trial Sequential Analysis of Randomized Controlled Trials
title_full_unstemmed Effectiveness of Virtual Simulations Versus Mannequins and Real Persons in Medical and Nursing Education: Meta-Analysis and Trial Sequential Analysis of Randomized Controlled Trials
title_short Effectiveness of Virtual Simulations Versus Mannequins and Real Persons in Medical and Nursing Education: Meta-Analysis and Trial Sequential Analysis of Randomized Controlled Trials
title_sort effectiveness of virtual simulations versus mannequins and real persons in medical and nursing education meta analysis and trial sequential analysis of randomized controlled trials
url https://www.jmir.org/2024/1/e56195
work_keys_str_mv AT nanjiang effectivenessofvirtualsimulationsversusmannequinsandrealpersonsinmedicalandnursingeducationmetaanalysisandtrialsequentialanalysisofrandomizedcontrolledtrials
AT yuelunzhang effectivenessofvirtualsimulationsversusmannequinsandrealpersonsinmedicalandnursingeducationmetaanalysisandtrialsequentialanalysisofrandomizedcontrolledtrials
AT siyuliang effectivenessofvirtualsimulationsversusmannequinsandrealpersonsinmedicalandnursingeducationmetaanalysisandtrialsequentialanalysisofrandomizedcontrolledtrials
AT xiaohonglyu effectivenessofvirtualsimulationsversusmannequinsandrealpersonsinmedicalandnursingeducationmetaanalysisandtrialsequentialanalysisofrandomizedcontrolledtrials
AT shichen effectivenessofvirtualsimulationsversusmannequinsandrealpersonsinmedicalandnursingeducationmetaanalysisandtrialsequentialanalysisofrandomizedcontrolledtrials
AT xiaominghuang effectivenessofvirtualsimulationsversusmannequinsandrealpersonsinmedicalandnursingeducationmetaanalysisandtrialsequentialanalysisofrandomizedcontrolledtrials
AT huipan effectivenessofvirtualsimulationsversusmannequinsandrealpersonsinmedicalandnursingeducationmetaanalysisandtrialsequentialanalysisofrandomizedcontrolledtrials