"I still have not mastered that skill!" Medical student perspectives on a simulation-based evidence-based medicine competency assessment

Objective: We expect medical students to be able to apply evidence-based medicine (EBM) skills in the context of the clinical care of patients. Previous assessments of this domain have primarily utilized decontextualized knowledge tests, which provide limited insights into students’ understanding of...

Full description

Saved in:
Bibliographic Details
Main Authors: Joey Nicholson, Caitlin Plovnick, Juliana Magro, Cees van der Vleuten, Anique de Bruin, Adina Kalet
Format: Article
Language:English
Published: University Library System, University of Pittsburgh 2025-04-01
Series:Journal of the Medical Library Association
Subjects:
Online Access:http://jmla.pitt.edu/ojs/jmla/article/view/2023
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1849700526932885504
author Joey Nicholson
Caitlin Plovnick
Juliana Magro
Cees van der Vleuten
Anique de Bruin
Adina Kalet
author_facet Joey Nicholson
Caitlin Plovnick
Juliana Magro
Cees van der Vleuten
Anique de Bruin
Adina Kalet
author_sort Joey Nicholson
collection DOAJ
description Objective: We expect medical students to be able to apply evidence-based medicine (EBM) skills in the context of the clinical care of patients. Previous assessments of this domain have primarily utilized decontextualized knowledge tests, which provide limited insights into students’ understanding of EBM skills in the context of patient care. New performance-based EBM competence assessments using Objective Structured Clinical Examinations (OSCEs) are being developed and tested. Understanding how students experience and interact with a simulation-based assessment of EBM competence would enable us to improve the modality. Methods: We recruited 13 graduating medical students from one medical school who had recently completed an immersive multi station readiness-for-residency OSCE (Night onCall) which included a case-based EBM assessment. We conducted individual interviews to explore their perceptions of participating in this OSCE as a method of EBM assessment. The interviews were transcribed, coded, and analyzed using Dedoose by three health science librarians. Results: Students discussed their experience and perceptions in six main areas: connection to clinical practice, curricular timing and content coverage, feedback, station instructions, awareness of their own limitations, and an OSCE as a format for assessing EBM. Conclusion: Medical students appreciated the EBM OSCE because it enhanced their learning about how to integrate EBM into clinical practice. They proposed implementing multiple such opportunities throughout medical school because it would improve their competence and provide highly impactful opportunities to build toward EBM mastery. They endorsed that this would be well-accepted by medical students.
format Article
id doaj-art-76e9fd77bbd64365b12aa1bfff62f600
institution DOAJ
issn 1536-5050
1558-9439
language English
publishDate 2025-04-01
publisher University Library System, University of Pittsburgh
record_format Article
series Journal of the Medical Library Association
spelling doaj-art-76e9fd77bbd64365b12aa1bfff62f6002025-08-20T03:18:13ZengUniversity Library System, University of PittsburghJournal of the Medical Library Association1536-50501558-94392025-04-01113210.5195/jmla.2025.2023"I still have not mastered that skill!" Medical student perspectives on a simulation-based evidence-based medicine competency assessmentJoey Nicholson0Caitlin Plovnick1Juliana Magro2Cees van der Vleuten3Anique de Bruin4Adina Kalet5NYU School of MedicineNYU Langone HealthNYU Langone HealthMaastricht UniversityMaastricht UniversityMedical College of WisconsinObjective: We expect medical students to be able to apply evidence-based medicine (EBM) skills in the context of the clinical care of patients. Previous assessments of this domain have primarily utilized decontextualized knowledge tests, which provide limited insights into students’ understanding of EBM skills in the context of patient care. New performance-based EBM competence assessments using Objective Structured Clinical Examinations (OSCEs) are being developed and tested. Understanding how students experience and interact with a simulation-based assessment of EBM competence would enable us to improve the modality. Methods: We recruited 13 graduating medical students from one medical school who had recently completed an immersive multi station readiness-for-residency OSCE (Night onCall) which included a case-based EBM assessment. We conducted individual interviews to explore their perceptions of participating in this OSCE as a method of EBM assessment. The interviews were transcribed, coded, and analyzed using Dedoose by three health science librarians. Results: Students discussed their experience and perceptions in six main areas: connection to clinical practice, curricular timing and content coverage, feedback, station instructions, awareness of their own limitations, and an OSCE as a format for assessing EBM. Conclusion: Medical students appreciated the EBM OSCE because it enhanced their learning about how to integrate EBM into clinical practice. They proposed implementing multiple such opportunities throughout medical school because it would improve their competence and provide highly impactful opportunities to build toward EBM mastery. They endorsed that this would be well-accepted by medical students. http://jmla.pitt.edu/ojs/jmla/article/view/2023Evidence Based PracticeCompetency-Based AssessmentMedical StudentsEvidence-Based Librarianship
spellingShingle Joey Nicholson
Caitlin Plovnick
Juliana Magro
Cees van der Vleuten
Anique de Bruin
Adina Kalet
"I still have not mastered that skill!" Medical student perspectives on a simulation-based evidence-based medicine competency assessment
Journal of the Medical Library Association
Evidence Based Practice
Competency-Based Assessment
Medical Students
Evidence-Based Librarianship
title "I still have not mastered that skill!" Medical student perspectives on a simulation-based evidence-based medicine competency assessment
title_full "I still have not mastered that skill!" Medical student perspectives on a simulation-based evidence-based medicine competency assessment
title_fullStr "I still have not mastered that skill!" Medical student perspectives on a simulation-based evidence-based medicine competency assessment
title_full_unstemmed "I still have not mastered that skill!" Medical student perspectives on a simulation-based evidence-based medicine competency assessment
title_short "I still have not mastered that skill!" Medical student perspectives on a simulation-based evidence-based medicine competency assessment
title_sort i still have not mastered that skill medical student perspectives on a simulation based evidence based medicine competency assessment
topic Evidence Based Practice
Competency-Based Assessment
Medical Students
Evidence-Based Librarianship
url http://jmla.pitt.edu/ojs/jmla/article/view/2023
work_keys_str_mv AT joeynicholson istillhavenotmasteredthatskillmedicalstudentperspectivesonasimulationbasedevidencebasedmedicinecompetencyassessment
AT caitlinplovnick istillhavenotmasteredthatskillmedicalstudentperspectivesonasimulationbasedevidencebasedmedicinecompetencyassessment
AT julianamagro istillhavenotmasteredthatskillmedicalstudentperspectivesonasimulationbasedevidencebasedmedicinecompetencyassessment
AT ceesvandervleuten istillhavenotmasteredthatskillmedicalstudentperspectivesonasimulationbasedevidencebasedmedicinecompetencyassessment
AT aniquedebruin istillhavenotmasteredthatskillmedicalstudentperspectivesonasimulationbasedevidencebasedmedicinecompetencyassessment
AT adinakalet istillhavenotmasteredthatskillmedicalstudentperspectivesonasimulationbasedevidencebasedmedicinecompetencyassessment