Interpretable prediction of hospital mortality in bleeding critically ill patients based on machine learning and SHAP
Abstract Background Hemorrhage is a prevalent and critical condition in the intensive care unit (ICU), characterized by high incidence, elevated mortality rates, and substantial therapeutic challenges. Accurate prediction of mortality in patients with hemorrhage is essential for developing personali...
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2025-07-01
|
| Series: | BMC Medical Informatics and Decision Making |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12911-025-03101-9 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849764431318220800 |
|---|---|
| author | Bingkui Ren Yuping Zhang Siying Chen Jinglong Dai Junci Chong Yifei Zhong Mengkai Deng Shaobo Jiang Zhigang Chang |
| author_facet | Bingkui Ren Yuping Zhang Siying Chen Jinglong Dai Junci Chong Yifei Zhong Mengkai Deng Shaobo Jiang Zhigang Chang |
| author_sort | Bingkui Ren |
| collection | DOAJ |
| description | Abstract Background Hemorrhage is a prevalent and critical condition in the intensive care unit (ICU), characterized by high incidence, elevated mortality rates, and substantial therapeutic challenges. Accurate prediction of mortality in patients with hemorrhage is essential for developing personalized prevention and treatment strategies. Nevertheless, the implementation of effective predictive models in clinical practice remains limited, primarily due to the lack of robust and interpretable tools. Objective This study aimed to develop an interpretable model for predicting mortality risk in critically ill patients with hemorrhage admitted to ICUs. The SHapley Additive exPlanations (SHAP) method was applied to interpret the eXtreme Gradient Boosting (XGBoost)model, identifying key prognostic factors in this population. Methods In this retrospective cohort study, we derived data from the eICU Collaborative Research Database (eICU-CRD) to develop and evaluate a predictive model. Clinical data from the first 24 h of ICU admission were extracted, and the dataset was randomly split into training (80%) and validation (20%) sets. Model performance was compared to four other machine learning algorithms using the area under the curve (AUC). SHAP was utilized to interpret the XGBoost model. External validation was subsequently performed using data from the Chinese REFRAIN cohort, which focuses on hemorrhage and coagulopathy in critically ill patients.. Trial registration The study protocol was retrospectively registered in the Chinese Clinical Trial Registry (ChiCTR) on December 17, 2024 (Registration number ChiCTR2400094140). Results A total of 10,306 eligible patients with hemorrhage were included. The observed in-hospital mortality rate was 11.5%.Among the five models compared, XGBoost demonstrated the highest predictive performance (AUC = 0.81), whereas logistic regression (LR) showed the lowest generalizability(AUC = 0.726). Decision curve analysis revealed that the XGBoost model provided a greater net benefit than other models at threshold probabilities of 10–30%. SHAP analysis identified the top 15 predictors of mortality, with bilirubin level ranked as the most influential variable. External validation using the REFRAIN cohort confirmed the robustness of model(AUC = 0.776). Conclusions The interpretable predictive model improves mortality risk stratification in ICU patients with hemorrhage, supporting clinicians in optimizing treatment plans and resource allocation. Enhanced model transparency through SHAP explanations may facilitate clinical adoption by improving trust in model reliability. |
| format | Article |
| id | doaj-art-4a2dd4906079418c9d4490eb8fd9b9e4 |
| institution | DOAJ |
| issn | 1472-6947 |
| language | English |
| publishDate | 2025-07-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Informatics and Decision Making |
| spelling | doaj-art-4a2dd4906079418c9d4490eb8fd9b9e42025-08-20T03:05:09ZengBMCBMC Medical Informatics and Decision Making1472-69472025-07-0125111210.1186/s12911-025-03101-9Interpretable prediction of hospital mortality in bleeding critically ill patients based on machine learning and SHAPBingkui Ren0Yuping Zhang1Siying Chen2Jinglong Dai3Junci Chong4Yifei Zhong5Mengkai Deng6Shaobo Jiang7Zhigang Chang8Department of Critical Care Medicine, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical SciencesDepartment of Critical Care Medicine, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical SciencesDepartment of Intensive Care Medicine, Peking University People’s HospitalDepartment of Critical Care Medicine, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical SciencesDepartment of Surgical Intensive Care Medicine, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical SciencesBeijing Hospital, Institute of Geriatric Medicine, Peking University Fifth School of Clinical MedicineBeijing Hospital, Institute of Geriatric Medicine, Peking University Fifth School of Clinical MedicineDepartment of Critical Care Medicine, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical SciencesDepartment of Critical Care Medicine, Beijing Hospital, National Center of Gerontology, Institute of Geriatric Medicine, Chinese Academy of Medical SciencesAbstract Background Hemorrhage is a prevalent and critical condition in the intensive care unit (ICU), characterized by high incidence, elevated mortality rates, and substantial therapeutic challenges. Accurate prediction of mortality in patients with hemorrhage is essential for developing personalized prevention and treatment strategies. Nevertheless, the implementation of effective predictive models in clinical practice remains limited, primarily due to the lack of robust and interpretable tools. Objective This study aimed to develop an interpretable model for predicting mortality risk in critically ill patients with hemorrhage admitted to ICUs. The SHapley Additive exPlanations (SHAP) method was applied to interpret the eXtreme Gradient Boosting (XGBoost)model, identifying key prognostic factors in this population. Methods In this retrospective cohort study, we derived data from the eICU Collaborative Research Database (eICU-CRD) to develop and evaluate a predictive model. Clinical data from the first 24 h of ICU admission were extracted, and the dataset was randomly split into training (80%) and validation (20%) sets. Model performance was compared to four other machine learning algorithms using the area under the curve (AUC). SHAP was utilized to interpret the XGBoost model. External validation was subsequently performed using data from the Chinese REFRAIN cohort, which focuses on hemorrhage and coagulopathy in critically ill patients.. Trial registration The study protocol was retrospectively registered in the Chinese Clinical Trial Registry (ChiCTR) on December 17, 2024 (Registration number ChiCTR2400094140). Results A total of 10,306 eligible patients with hemorrhage were included. The observed in-hospital mortality rate was 11.5%.Among the five models compared, XGBoost demonstrated the highest predictive performance (AUC = 0.81), whereas logistic regression (LR) showed the lowest generalizability(AUC = 0.726). Decision curve analysis revealed that the XGBoost model provided a greater net benefit than other models at threshold probabilities of 10–30%. SHAP analysis identified the top 15 predictors of mortality, with bilirubin level ranked as the most influential variable. External validation using the REFRAIN cohort confirmed the robustness of model(AUC = 0.776). Conclusions The interpretable predictive model improves mortality risk stratification in ICU patients with hemorrhage, supporting clinicians in optimizing treatment plans and resource allocation. Enhanced model transparency through SHAP explanations may facilitate clinical adoption by improving trust in model reliability.https://doi.org/10.1186/s12911-025-03101-9HemorrhageIntensive care unitPredictionXGBoostSHAP |
| spellingShingle | Bingkui Ren Yuping Zhang Siying Chen Jinglong Dai Junci Chong Yifei Zhong Mengkai Deng Shaobo Jiang Zhigang Chang Interpretable prediction of hospital mortality in bleeding critically ill patients based on machine learning and SHAP BMC Medical Informatics and Decision Making Hemorrhage Intensive care unit Prediction XGBoost SHAP |
| title | Interpretable prediction of hospital mortality in bleeding critically ill patients based on machine learning and SHAP |
| title_full | Interpretable prediction of hospital mortality in bleeding critically ill patients based on machine learning and SHAP |
| title_fullStr | Interpretable prediction of hospital mortality in bleeding critically ill patients based on machine learning and SHAP |
| title_full_unstemmed | Interpretable prediction of hospital mortality in bleeding critically ill patients based on machine learning and SHAP |
| title_short | Interpretable prediction of hospital mortality in bleeding critically ill patients based on machine learning and SHAP |
| title_sort | interpretable prediction of hospital mortality in bleeding critically ill patients based on machine learning and shap |
| topic | Hemorrhage Intensive care unit Prediction XGBoost SHAP |
| url | https://doi.org/10.1186/s12911-025-03101-9 |
| work_keys_str_mv | AT bingkuiren interpretablepredictionofhospitalmortalityinbleedingcriticallyillpatientsbasedonmachinelearningandshap AT yupingzhang interpretablepredictionofhospitalmortalityinbleedingcriticallyillpatientsbasedonmachinelearningandshap AT siyingchen interpretablepredictionofhospitalmortalityinbleedingcriticallyillpatientsbasedonmachinelearningandshap AT jinglongdai interpretablepredictionofhospitalmortalityinbleedingcriticallyillpatientsbasedonmachinelearningandshap AT juncichong interpretablepredictionofhospitalmortalityinbleedingcriticallyillpatientsbasedonmachinelearningandshap AT yifeizhong interpretablepredictionofhospitalmortalityinbleedingcriticallyillpatientsbasedonmachinelearningandshap AT mengkaideng interpretablepredictionofhospitalmortalityinbleedingcriticallyillpatientsbasedonmachinelearningandshap AT shaobojiang interpretablepredictionofhospitalmortalityinbleedingcriticallyillpatientsbasedonmachinelearningandshap AT zhigangchang interpretablepredictionofhospitalmortalityinbleedingcriticallyillpatientsbasedonmachinelearningandshap |