Assessing Revisit Risk in Emergency Department Patients: Machine Learning Approach
Abstract BackgroundOvercrowded emergency rooms might degrade the quality of care and overload the clinic staff. Assessing unscheduled return visits (URVs) to the emergency department (ED) is a quality assurance procedure to identify ED-discharged patients with a high likelihoo...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-08-01
|
| Series: | JMIR AI |
| Online Access: | https://ai.jmir.org/2025/1/e74053 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849239269000871936 |
|---|---|
| author | Wang-Chuan Juang Zheng-Xun Cai Chia-Mei Chen Zhi-Hong You |
| author_facet | Wang-Chuan Juang Zheng-Xun Cai Chia-Mei Chen Zhi-Hong You |
| author_sort | Wang-Chuan Juang |
| collection | DOAJ |
| description |
Abstract
BackgroundOvercrowded emergency rooms might degrade the quality of care and overload the clinic staff. Assessing unscheduled return visits (URVs) to the emergency department (ED) is a quality assurance procedure to identify ED-discharged patients with a high likelihood of bounce-back, to ensure patient safety, and ultimately to reduce medical costs by decreasing the frequency of URVs. The field of machine learning (ML) has evolved considerably in the past decades, and many ML applications have been deployed in various contexts.
ObjectiveThis study aims to develop an ML-assisted framework that identifies high-risk patients who may revisit the ED within 72 hours after the initial visit. Furthermore, this study evaluates different ML models, feature sets, and feature encoding methods in order to build an effective prediction model.
MethodsThis study proposes an ML-assisted system that extracts the features from both structured and unstructured medical data to predict patients who are likely to revisit the ED, where the structured data includes patients’ electronic health records, and the unstructured data is their medical notes (subjective, objective, assessment, and plan). A 5-year dataset consisting of 184,687 ED visits, along with 324,111 historical electronic health records and the associated medical notes, was obtained from Kaohsiung Veterans General Hospital, a tertiary medical center in Taiwan, to evaluate the proposed system.
ResultsThe evaluation results indicate that incorporating convolutional neural network–based feature extraction from unstructured ED physician narrative notes, combined with structured vital signs and demographic data, significantly enhances predictive performance. The proposed approach achieves an area under the receiver operating characteristic curve of 0.705 and a recall of 0.718, demonstrating its effectiveness in predicting URVs. These findings highlight the potential of integrating structured and unstructured clinical data to improve predictive accuracy in this context.
ConclusionsThe study demonstrates that an ML-assisted framework may be applied as a decision support tool to assist ED clinicians in identifying revisiting patients, although the model’s performance may not be sufficient for clinic implementation. Given the improvement in the area under the receiver operating characteristic curve, the proposed framework should be further explored as a workable decision support tool to pinpoint ED patients with a high risk of revisit and provide them with appropriate and timely care. |
| format | Article |
| id | doaj-art-e52bed1b00404c0681ea46dc6cd76888 |
| institution | Kabale University |
| issn | 2817-1705 |
| language | English |
| publishDate | 2025-08-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | JMIR AI |
| spelling | doaj-art-e52bed1b00404c0681ea46dc6cd768882025-08-20T04:01:03ZengJMIR PublicationsJMIR AI2817-17052025-08-014e74053e7405310.2196/74053Assessing Revisit Risk in Emergency Department Patients: Machine Learning ApproachWang-Chuan Juanghttp://orcid.org/0000-0001-8077-7706Zheng-Xun Caihttp://orcid.org/0000-0002-2978-9020Chia-Mei Chenhttp://orcid.org/0000-0002-4361-0461Zhi-Hong Youhttp://orcid.org/0009-0005-6102-9071 Abstract BackgroundOvercrowded emergency rooms might degrade the quality of care and overload the clinic staff. Assessing unscheduled return visits (URVs) to the emergency department (ED) is a quality assurance procedure to identify ED-discharged patients with a high likelihood of bounce-back, to ensure patient safety, and ultimately to reduce medical costs by decreasing the frequency of URVs. The field of machine learning (ML) has evolved considerably in the past decades, and many ML applications have been deployed in various contexts. ObjectiveThis study aims to develop an ML-assisted framework that identifies high-risk patients who may revisit the ED within 72 hours after the initial visit. Furthermore, this study evaluates different ML models, feature sets, and feature encoding methods in order to build an effective prediction model. MethodsThis study proposes an ML-assisted system that extracts the features from both structured and unstructured medical data to predict patients who are likely to revisit the ED, where the structured data includes patients’ electronic health records, and the unstructured data is their medical notes (subjective, objective, assessment, and plan). A 5-year dataset consisting of 184,687 ED visits, along with 324,111 historical electronic health records and the associated medical notes, was obtained from Kaohsiung Veterans General Hospital, a tertiary medical center in Taiwan, to evaluate the proposed system. ResultsThe evaluation results indicate that incorporating convolutional neural network–based feature extraction from unstructured ED physician narrative notes, combined with structured vital signs and demographic data, significantly enhances predictive performance. The proposed approach achieves an area under the receiver operating characteristic curve of 0.705 and a recall of 0.718, demonstrating its effectiveness in predicting URVs. These findings highlight the potential of integrating structured and unstructured clinical data to improve predictive accuracy in this context. ConclusionsThe study demonstrates that an ML-assisted framework may be applied as a decision support tool to assist ED clinicians in identifying revisiting patients, although the model’s performance may not be sufficient for clinic implementation. Given the improvement in the area under the receiver operating characteristic curve, the proposed framework should be further explored as a workable decision support tool to pinpoint ED patients with a high risk of revisit and provide them with appropriate and timely care.https://ai.jmir.org/2025/1/e74053 |
| spellingShingle | Wang-Chuan Juang Zheng-Xun Cai Chia-Mei Chen Zhi-Hong You Assessing Revisit Risk in Emergency Department Patients: Machine Learning Approach JMIR AI |
| title | Assessing Revisit Risk in Emergency Department Patients: Machine Learning Approach |
| title_full | Assessing Revisit Risk in Emergency Department Patients: Machine Learning Approach |
| title_fullStr | Assessing Revisit Risk in Emergency Department Patients: Machine Learning Approach |
| title_full_unstemmed | Assessing Revisit Risk in Emergency Department Patients: Machine Learning Approach |
| title_short | Assessing Revisit Risk in Emergency Department Patients: Machine Learning Approach |
| title_sort | assessing revisit risk in emergency department patients machine learning approach |
| url | https://ai.jmir.org/2025/1/e74053 |
| work_keys_str_mv | AT wangchuanjuang assessingrevisitriskinemergencydepartmentpatientsmachinelearningapproach AT zhengxuncai assessingrevisitriskinemergencydepartmentpatientsmachinelearningapproach AT chiameichen assessingrevisitriskinemergencydepartmentpatientsmachinelearningapproach AT zhihongyou assessingrevisitriskinemergencydepartmentpatientsmachinelearningapproach |