Validation of PREdiction of DELIRium in ICu patients (PRE-DELIRIC) model for ICU delirium in general ICU and patients with liver disease: a retrospective cohort study
Abstract Background Delirium, a neuropsychiatric disorder characterized by disturbances in attention, cognition, and awareness, is a common complication among intensive care unit (ICU) patients. Several predictive models have been developed that aim to identify patients at high risk of delirium. PRE...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2025-06-01
|
| Series: | Journal of Intensive Care |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s40560-025-00800-3 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849329022980325376 |
|---|---|
| author | Areti Papadopoulou Sarah L. Cowan Jacobus Preller Robert J. B. Goudie |
| author_facet | Areti Papadopoulou Sarah L. Cowan Jacobus Preller Robert J. B. Goudie |
| author_sort | Areti Papadopoulou |
| collection | DOAJ |
| description | Abstract Background Delirium, a neuropsychiatric disorder characterized by disturbances in attention, cognition, and awareness, is a common complication among intensive care unit (ICU) patients. Several predictive models have been developed that aim to identify patients at high risk of delirium. PRE-DELIRIC (PREdiction of DELIRium in ICu) and its recalibrated version, have been externally validated in several studies, but modest sample sizes have meant uncertainty remains, particularly in patient subgroups. Of particular relevance to our population (as a tertiary liver disease centre), performance in patients with liver disease has not been specifically assessed. Methods This retrospective cohort study evaluated the PRE-DELIRIC model using data from 3312 adult ICU patients at Cambridge University Hospital, between February 2017 and September 2021. Delirium was primarily defined as either a positive Confusion Assessment Method for the ICU (CAM-ICU) or any new administration of antipsychotic medication. Predictive performance was assessed according to discrimination, measured by the area under the receiver operating characteristic (AUROC) and precision-recall curves; and calibration, as quantified by calibration slope and intercept. We also conducted subgroup analyses in patients with liver disease, sedated patients, and across varying opioid dosing. Results Delirium occurred in 32.9% of patients. Overall, PRE-DELIRIC demonstrated moderate-to-good discriminative performance (AUROC 0.74; 95% CI 0.72–0.76); but the model significantly underpredicted delirium incidence for those patients predicted to have moderate-to-high delirium risk (PRE-DELIRIC score 0.2–0.6); and overpredicted for those predicted to be at very high risk (PRE-DELIRIC score > 0.6). Among patients with liver disease (41.6% delirium incidence), discrimination was similar to the overall cohort (AUROC 0.73; 95% CI 0.66–0.81), but calibration was poor, with significant under-prediction of delirium. Discrimination was significantly poorer in both sedated patients and patients receiving high opioid dosing. Conclusion This is the largest validation study of the PRE-DELIRIC model to date, and the first to specifically consider patients with liver disease. We found moderate-to-good discriminative predictive performance both overall and in liver disease patients, but calibration was only moderate overall, and significantly under-predicted risk in patients with liver disease. Recalibration of the model and further subgroup-specific adjustments may enhance its utility in clinical practice. |
| format | Article |
| id | doaj-art-42b470bb350f4db5bd99f061a355f47d |
| institution | Kabale University |
| issn | 2052-0492 |
| language | English |
| publishDate | 2025-06-01 |
| publisher | BMC |
| record_format | Article |
| series | Journal of Intensive Care |
| spelling | doaj-art-42b470bb350f4db5bd99f061a355f47d2025-08-20T03:47:24ZengBMCJournal of Intensive Care2052-04922025-06-0113111110.1186/s40560-025-00800-3Validation of PREdiction of DELIRium in ICu patients (PRE-DELIRIC) model for ICU delirium in general ICU and patients with liver disease: a retrospective cohort studyAreti Papadopoulou0Sarah L. Cowan1Jacobus Preller2Robert J. B. Goudie3MRC Biostatistics Unit, School of Clinical Medicine, University of CambridgeAddenbrooke’s HospitalAddenbrooke’s HospitalMRC Biostatistics Unit, School of Clinical Medicine, University of CambridgeAbstract Background Delirium, a neuropsychiatric disorder characterized by disturbances in attention, cognition, and awareness, is a common complication among intensive care unit (ICU) patients. Several predictive models have been developed that aim to identify patients at high risk of delirium. PRE-DELIRIC (PREdiction of DELIRium in ICu) and its recalibrated version, have been externally validated in several studies, but modest sample sizes have meant uncertainty remains, particularly in patient subgroups. Of particular relevance to our population (as a tertiary liver disease centre), performance in patients with liver disease has not been specifically assessed. Methods This retrospective cohort study evaluated the PRE-DELIRIC model using data from 3312 adult ICU patients at Cambridge University Hospital, between February 2017 and September 2021. Delirium was primarily defined as either a positive Confusion Assessment Method for the ICU (CAM-ICU) or any new administration of antipsychotic medication. Predictive performance was assessed according to discrimination, measured by the area under the receiver operating characteristic (AUROC) and precision-recall curves; and calibration, as quantified by calibration slope and intercept. We also conducted subgroup analyses in patients with liver disease, sedated patients, and across varying opioid dosing. Results Delirium occurred in 32.9% of patients. Overall, PRE-DELIRIC demonstrated moderate-to-good discriminative performance (AUROC 0.74; 95% CI 0.72–0.76); but the model significantly underpredicted delirium incidence for those patients predicted to have moderate-to-high delirium risk (PRE-DELIRIC score 0.2–0.6); and overpredicted for those predicted to be at very high risk (PRE-DELIRIC score > 0.6). Among patients with liver disease (41.6% delirium incidence), discrimination was similar to the overall cohort (AUROC 0.73; 95% CI 0.66–0.81), but calibration was poor, with significant under-prediction of delirium. Discrimination was significantly poorer in both sedated patients and patients receiving high opioid dosing. Conclusion This is the largest validation study of the PRE-DELIRIC model to date, and the first to specifically consider patients with liver disease. We found moderate-to-good discriminative predictive performance both overall and in liver disease patients, but calibration was only moderate overall, and significantly under-predicted risk in patients with liver disease. Recalibration of the model and further subgroup-specific adjustments may enhance its utility in clinical practice.https://doi.org/10.1186/s40560-025-00800-3DeliriumPRE-DELIRICValidationLiver diseaseSedationOpioids |
| spellingShingle | Areti Papadopoulou Sarah L. Cowan Jacobus Preller Robert J. B. Goudie Validation of PREdiction of DELIRium in ICu patients (PRE-DELIRIC) model for ICU delirium in general ICU and patients with liver disease: a retrospective cohort study Journal of Intensive Care Delirium PRE-DELIRIC Validation Liver disease Sedation Opioids |
| title | Validation of PREdiction of DELIRium in ICu patients (PRE-DELIRIC) model for ICU delirium in general ICU and patients with liver disease: a retrospective cohort study |
| title_full | Validation of PREdiction of DELIRium in ICu patients (PRE-DELIRIC) model for ICU delirium in general ICU and patients with liver disease: a retrospective cohort study |
| title_fullStr | Validation of PREdiction of DELIRium in ICu patients (PRE-DELIRIC) model for ICU delirium in general ICU and patients with liver disease: a retrospective cohort study |
| title_full_unstemmed | Validation of PREdiction of DELIRium in ICu patients (PRE-DELIRIC) model for ICU delirium in general ICU and patients with liver disease: a retrospective cohort study |
| title_short | Validation of PREdiction of DELIRium in ICu patients (PRE-DELIRIC) model for ICU delirium in general ICU and patients with liver disease: a retrospective cohort study |
| title_sort | validation of prediction of delirium in icu patients pre deliric model for icu delirium in general icu and patients with liver disease a retrospective cohort study |
| topic | Delirium PRE-DELIRIC Validation Liver disease Sedation Opioids |
| url | https://doi.org/10.1186/s40560-025-00800-3 |
| work_keys_str_mv | AT aretipapadopoulou validationofpredictionofdeliriuminicupatientspredeliricmodelforicudeliriumingeneralicuandpatientswithliverdiseasearetrospectivecohortstudy AT sarahlcowan validationofpredictionofdeliriuminicupatientspredeliricmodelforicudeliriumingeneralicuandpatientswithliverdiseasearetrospectivecohortstudy AT jacobuspreller validationofpredictionofdeliriuminicupatientspredeliricmodelforicudeliriumingeneralicuandpatientswithliverdiseasearetrospectivecohortstudy AT robertjbgoudie validationofpredictionofdeliriuminicupatientspredeliricmodelforicudeliriumingeneralicuandpatientswithliverdiseasearetrospectivecohortstudy |