Performance of an Electronic Health Record–Based Automated Pulmonary Embolism Severity Index Score Calculator: Cohort Study in the Emergency Department

Abstract BackgroundStudies suggest that less than 4% of patients with pulmonary embolisms (PEs) are managed in the outpatient setting. Strong evidence and multiple guidelines support the use of the Pulmonary Embolism Severity Index (PESI) for the identification of acute PE pat...

Full description

Saved in:
Bibliographic Details
Main Authors: Elizabeth Joyce, James McMullen, Xiaowen Kong, Connor O'Hare, Valerie Gavrila, Anthony Cuttitta, Geoffrey D Barnes, Colin F Greineder
Format: Article
Language:English
Published: JMIR Publications 2025-01-01
Series:JMIR Medical Informatics
Online Access:https://medinform.jmir.org/2025/1/e58800
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832585082792050688
author Elizabeth Joyce
James McMullen
Xiaowen Kong
Connor O'Hare
Valerie Gavrila
Anthony Cuttitta
Geoffrey D Barnes
Colin F Greineder
author_facet Elizabeth Joyce
James McMullen
Xiaowen Kong
Connor O'Hare
Valerie Gavrila
Anthony Cuttitta
Geoffrey D Barnes
Colin F Greineder
author_sort Elizabeth Joyce
collection DOAJ
description Abstract BackgroundStudies suggest that less than 4% of patients with pulmonary embolisms (PEs) are managed in the outpatient setting. Strong evidence and multiple guidelines support the use of the Pulmonary Embolism Severity Index (PESI) for the identification of acute PE patients appropriate for outpatient management. However, calculating the PESI score can be inconvenient in a busy emergency department (ED). To facilitate integration into ED workflow, we created a 2023 Epic ObjectiveThe primary objectives of this study were to determine the overall accuracy of ePESI and its ability to correctly distinguish high- and low-risk PESI scores within the Epic MethodsWe collected ePESI scores on 500 consecutive patients at least 18 years old who underwent a computerized tomography-pulmonary embolism scan in the ED of our tertiary, academic health center between January 3 and February 15, 2023. We compared ePESI results to a PESI score calculated by 2 independent, medically-trained abstractors blinded to the ePESI and each other’s results. ePESI accuracy was calculated with binomial test. The odds ratio (OR) was calculated using logistic regression. ResultsOf the 500 patients, a total of 203 (40.6%) and 297 (59.4%) patients had low- and high-risk PESI scores, respectively. The ePESI exactly matched the calculated PESI in 394 out of 500 cases, with an accuracy of 78.8% (95% CI 74.9%‐82.3%), and correctly identified low- versus high-risk in 477 out of 500 (95.4%) cases. The accuracy of the ePESI was higher for low-risk scores (OR 2.96, PP ConclusionsIn this single-center study, the ePESI was highly accurate in discriminating between low- and high-risk scores. The clinical decision support should facilitate real-time identification of patients who may be candidates for outpatient PE management.
format Article
id doaj-art-98807a5b0ef54917843a43e405d1b827
institution Kabale University
issn 2291-9694
language English
publishDate 2025-01-01
publisher JMIR Publications
record_format Article
series JMIR Medical Informatics
spelling doaj-art-98807a5b0ef54917843a43e405d1b8272025-01-27T04:39:36ZengJMIR PublicationsJMIR Medical Informatics2291-96942025-01-0113e58800e5880010.2196/58800Performance of an Electronic Health Record–Based Automated Pulmonary Embolism Severity Index Score Calculator: Cohort Study in the Emergency DepartmentElizabeth Joycehttp://orcid.org/0000-0002-8133-2298James McMullenhttp://orcid.org/0000-0002-3788-9734Xiaowen Konghttp://orcid.org/0000-0003-4548-3600Connor O'Harehttp://orcid.org/0000-0001-9831-1234Valerie Gavrilahttp://orcid.org/0009-0000-9667-850XAnthony Cuttittahttp://orcid.org/0000-0002-8694-6627Geoffrey D Barneshttp://orcid.org/0000-0002-6532-8440Colin F Greinederhttp://orcid.org/0000-0001-9740-7672 Abstract BackgroundStudies suggest that less than 4% of patients with pulmonary embolisms (PEs) are managed in the outpatient setting. Strong evidence and multiple guidelines support the use of the Pulmonary Embolism Severity Index (PESI) for the identification of acute PE patients appropriate for outpatient management. However, calculating the PESI score can be inconvenient in a busy emergency department (ED). To facilitate integration into ED workflow, we created a 2023 Epic ObjectiveThe primary objectives of this study were to determine the overall accuracy of ePESI and its ability to correctly distinguish high- and low-risk PESI scores within the Epic MethodsWe collected ePESI scores on 500 consecutive patients at least 18 years old who underwent a computerized tomography-pulmonary embolism scan in the ED of our tertiary, academic health center between January 3 and February 15, 2023. We compared ePESI results to a PESI score calculated by 2 independent, medically-trained abstractors blinded to the ePESI and each other’s results. ePESI accuracy was calculated with binomial test. The odds ratio (OR) was calculated using logistic regression. ResultsOf the 500 patients, a total of 203 (40.6%) and 297 (59.4%) patients had low- and high-risk PESI scores, respectively. The ePESI exactly matched the calculated PESI in 394 out of 500 cases, with an accuracy of 78.8% (95% CI 74.9%‐82.3%), and correctly identified low- versus high-risk in 477 out of 500 (95.4%) cases. The accuracy of the ePESI was higher for low-risk scores (OR 2.96, PP ConclusionsIn this single-center study, the ePESI was highly accurate in discriminating between low- and high-risk scores. The clinical decision support should facilitate real-time identification of patients who may be candidates for outpatient PE management.https://medinform.jmir.org/2025/1/e58800
spellingShingle Elizabeth Joyce
James McMullen
Xiaowen Kong
Connor O'Hare
Valerie Gavrila
Anthony Cuttitta
Geoffrey D Barnes
Colin F Greineder
Performance of an Electronic Health Record–Based Automated Pulmonary Embolism Severity Index Score Calculator: Cohort Study in the Emergency Department
JMIR Medical Informatics
title Performance of an Electronic Health Record–Based Automated Pulmonary Embolism Severity Index Score Calculator: Cohort Study in the Emergency Department
title_full Performance of an Electronic Health Record–Based Automated Pulmonary Embolism Severity Index Score Calculator: Cohort Study in the Emergency Department
title_fullStr Performance of an Electronic Health Record–Based Automated Pulmonary Embolism Severity Index Score Calculator: Cohort Study in the Emergency Department
title_full_unstemmed Performance of an Electronic Health Record–Based Automated Pulmonary Embolism Severity Index Score Calculator: Cohort Study in the Emergency Department
title_short Performance of an Electronic Health Record–Based Automated Pulmonary Embolism Severity Index Score Calculator: Cohort Study in the Emergency Department
title_sort performance of an electronic health record based automated pulmonary embolism severity index score calculator cohort study in the emergency department
url https://medinform.jmir.org/2025/1/e58800
work_keys_str_mv AT elizabethjoyce performanceofanelectronichealthrecordbasedautomatedpulmonaryembolismseverityindexscorecalculatorcohortstudyintheemergencydepartment
AT jamesmcmullen performanceofanelectronichealthrecordbasedautomatedpulmonaryembolismseverityindexscorecalculatorcohortstudyintheemergencydepartment
AT xiaowenkong performanceofanelectronichealthrecordbasedautomatedpulmonaryembolismseverityindexscorecalculatorcohortstudyintheemergencydepartment
AT connorohare performanceofanelectronichealthrecordbasedautomatedpulmonaryembolismseverityindexscorecalculatorcohortstudyintheemergencydepartment
AT valeriegavrila performanceofanelectronichealthrecordbasedautomatedpulmonaryembolismseverityindexscorecalculatorcohortstudyintheemergencydepartment
AT anthonycuttitta performanceofanelectronichealthrecordbasedautomatedpulmonaryembolismseverityindexscorecalculatorcohortstudyintheemergencydepartment
AT geoffreydbarnes performanceofanelectronichealthrecordbasedautomatedpulmonaryembolismseverityindexscorecalculatorcohortstudyintheemergencydepartment
AT colinfgreineder performanceofanelectronichealthrecordbasedautomatedpulmonaryembolismseverityindexscorecalculatorcohortstudyintheemergencydepartment