Artificial intelligence for severity triage based on conversations in an emergency department in Korea
Abstract In the fast-paced emergency departments, where crises unfold unpredictably, the systematic prioritization of critical patients based on a severity classification is vital for swift and effective treatment. This study aimed to enhance the quality of emergency services by automatically catego...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Nature Portfolio
2025-05-01
|
| Series: | Scientific Reports |
| Subjects: | |
| Online Access: | https://doi.org/10.1038/s41598-025-99874-0 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849726188707119104 |
|---|---|
| author | Jae Won Seo Sung-Joon Park Young Jae Kim Jung-Youn Kim Kwang Gi Kim Young-Hoon Yoon |
| author_facet | Jae Won Seo Sung-Joon Park Young Jae Kim Jung-Youn Kim Kwang Gi Kim Young-Hoon Yoon |
| author_sort | Jae Won Seo |
| collection | DOAJ |
| description | Abstract In the fast-paced emergency departments, where crises unfold unpredictably, the systematic prioritization of critical patients based on a severity classification is vital for swift and effective treatment. This study aimed to enhance the quality of emergency services by automatically categorizing the severity levels of incoming patients using AI-powered natural language processing (NLP) algorithms to analyze conversations between medical staff and patients. The dataset comprised 1,028 transcripts of bedside conversations within emergency rooms. To verify the robustness of the models, we performed tenfold cross-validation. Based on the area under the receiver operating characteristic curve (AUROC) values, the support vector machine achieved the best performance among the term frequency-inverse document frequency-based conventional machine learning models with an AUROC of 0.764 (95% CI 0.019). Among the neural network models, multilayer perceptron performed with an AUROC of 0.759 (± 0.024). This research explored methods for automatically classifying patient severity using real-world conversations, including those with nonsensical and confused content. To achieve this, artificial intelligence algorithms that consider the frequency and order of words used in the conversation were employed alongside neural network models. Our findings have the potential to significantly contribute to alleviating overcrowding in emergency departments of hospitals, with future extensions involving highly efficient large language models. The results suggest that a fluid and immediate response to urgent situations, a reduction in patient waiting time, and effectively addressing the special circumstances of the emergency room environment can be achieved using this approach. |
| format | Article |
| id | doaj-art-1d3ca782e7b14f3e9f9aab9b189f5161 |
| institution | DOAJ |
| issn | 2045-2322 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | Nature Portfolio |
| record_format | Article |
| series | Scientific Reports |
| spelling | doaj-art-1d3ca782e7b14f3e9f9aab9b189f51612025-08-20T03:10:16ZengNature PortfolioScientific Reports2045-23222025-05-011511910.1038/s41598-025-99874-0Artificial intelligence for severity triage based on conversations in an emergency department in KoreaJae Won Seo0Sung-Joon Park1Young Jae Kim2Jung-Youn Kim3Kwang Gi Kim4Young-Hoon Yoon5Department of Health Sciences and Technology, GAIHST, Gachon UniversityDepartment of Emergency Medicine, Korea University College of MedicineDepartment of Gachon Biomedical & Convergence Institute, Gachon University Gil Medical CenterDepartment of Emergency Medicine, Korea University College of MedicineDepartment of Health Sciences and Technology, GAIHST, Gachon UniversityDepartment of Emergency Medicine, Korea University College of MedicineAbstract In the fast-paced emergency departments, where crises unfold unpredictably, the systematic prioritization of critical patients based on a severity classification is vital for swift and effective treatment. This study aimed to enhance the quality of emergency services by automatically categorizing the severity levels of incoming patients using AI-powered natural language processing (NLP) algorithms to analyze conversations between medical staff and patients. The dataset comprised 1,028 transcripts of bedside conversations within emergency rooms. To verify the robustness of the models, we performed tenfold cross-validation. Based on the area under the receiver operating characteristic curve (AUROC) values, the support vector machine achieved the best performance among the term frequency-inverse document frequency-based conventional machine learning models with an AUROC of 0.764 (95% CI 0.019). Among the neural network models, multilayer perceptron performed with an AUROC of 0.759 (± 0.024). This research explored methods for automatically classifying patient severity using real-world conversations, including those with nonsensical and confused content. To achieve this, artificial intelligence algorithms that consider the frequency and order of words used in the conversation were employed alongside neural network models. Our findings have the potential to significantly contribute to alleviating overcrowding in emergency departments of hospitals, with future extensions involving highly efficient large language models. The results suggest that a fluid and immediate response to urgent situations, a reduction in patient waiting time, and effectively addressing the special circumstances of the emergency room environment can be achieved using this approach.https://doi.org/10.1038/s41598-025-99874-0Emergency roomTriageClassificationNatural language processingArtificial intelligence |
| spellingShingle | Jae Won Seo Sung-Joon Park Young Jae Kim Jung-Youn Kim Kwang Gi Kim Young-Hoon Yoon Artificial intelligence for severity triage based on conversations in an emergency department in Korea Scientific Reports Emergency room Triage Classification Natural language processing Artificial intelligence |
| title | Artificial intelligence for severity triage based on conversations in an emergency department in Korea |
| title_full | Artificial intelligence for severity triage based on conversations in an emergency department in Korea |
| title_fullStr | Artificial intelligence for severity triage based on conversations in an emergency department in Korea |
| title_full_unstemmed | Artificial intelligence for severity triage based on conversations in an emergency department in Korea |
| title_short | Artificial intelligence for severity triage based on conversations in an emergency department in Korea |
| title_sort | artificial intelligence for severity triage based on conversations in an emergency department in korea |
| topic | Emergency room Triage Classification Natural language processing Artificial intelligence |
| url | https://doi.org/10.1038/s41598-025-99874-0 |
| work_keys_str_mv | AT jaewonseo artificialintelligenceforseveritytriagebasedonconversationsinanemergencydepartmentinkorea AT sungjoonpark artificialintelligenceforseveritytriagebasedonconversationsinanemergencydepartmentinkorea AT youngjaekim artificialintelligenceforseveritytriagebasedonconversationsinanemergencydepartmentinkorea AT jungyounkim artificialintelligenceforseveritytriagebasedonconversationsinanemergencydepartmentinkorea AT kwanggikim artificialintelligenceforseveritytriagebasedonconversationsinanemergencydepartmentinkorea AT younghoonyoon artificialintelligenceforseveritytriagebasedonconversationsinanemergencydepartmentinkorea |