Multisite development and validation of machine learning models to predict severe outcomes and guide decision‐making for emergency department patients with influenza

Abstract Objective Millions of Americans are infected by influenza annually. A minority seek care in the emergency department (ED) and, of those, only a limited number experience severe disease or death. ED clinicians must distinguish those at risk for deterioration from those who can be safely disc...

Full description

Saved in:
Bibliographic Details
Main Authors: Jeremiah S. Hinson, Xihan Zhao, Eili Klein, Oluwakemi Badaki‐Makun, Richard Rothman, Martin Copenhaver, Aria Smith, Katherine Fenstermacher, Matthew Toerper, Andrew Pekosz, Scott Levin
Format: Article
Language:English
Published: Elsevier 2024-04-01
Series:Journal of the American College of Emergency Physicians Open
Online Access:https://doi.org/10.1002/emp2.13117
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Abstract Objective Millions of Americans are infected by influenza annually. A minority seek care in the emergency department (ED) and, of those, only a limited number experience severe disease or death. ED clinicians must distinguish those at risk for deterioration from those who can be safely discharged. Methods We developed random forest machine learning (ML) models to estimate needs for critical care within 24 h and inpatient care within 72 h in ED patients with influenza. Predictor data were limited to those recorded prior to ED disposition decision: demographics, ED complaint, medical problems, vital signs, supplemental oxygen use, and laboratory results. Our study population was comprised of adults diagnosed with influenza at one of five EDs in our university health system between January 1, 2017 and May 18, 2022; visits were divided into two cohorts to facilitate model development and validation. Prediction performance was assessed by the area under the receiver operating characteristic curve (AUC) and the Brier score. Results Among 8032 patients with laboratory‐confirmed influenza, incidence of critical care needs was 6.3% and incidence of inpatient care needs was 19.6%. The most common reasons for ED visit were symptoms of respiratory tract infection, fever, and shortness of breath. Model AUCs were 0.89 (95% CI 0.86–0.93) for prediction of critical care and 0.90 (95% CI 0.88–0.93) for inpatient care needs; Brier scores were 0.026 and 0.042, respectively. Importantpredictors included shortness of breath, increasing respiratory rate, and a high number of comorbid diseases.  Conclusions ML methods can be used to accurately predict clinical deterioration in ED patients with influenza and have potential to support ED disposition decision‐making.
ISSN:2688-1152