An Electronic Medical Record–Based Prognostic Model for Inpatient Falls: Development and Internal-External Cross-Validation
BackgroundEffective fall prevention interventions in hospitals require appropriate allocation of resources early in admission. To address this, fall risk prediction tools and models have been developed with the aim to provide fall prevention strategies to patients at high ris...
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2024-11-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2024/1/e59634 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1850192012342460416 |
|---|---|
| author | Rex Parsons Robin Blythe Susanna Cramb Ahmad Abdel-Hafez Steven McPhail |
| author_facet | Rex Parsons Robin Blythe Susanna Cramb Ahmad Abdel-Hafez Steven McPhail |
| author_sort | Rex Parsons |
| collection | DOAJ |
| description |
BackgroundEffective fall prevention interventions in hospitals require appropriate allocation of resources early in admission. To address this, fall risk prediction tools and models have been developed with the aim to provide fall prevention strategies to patients at high risk. However, fall risk assessment tools have typically been inaccurate for prediction, ineffective in prevention, and time-consuming to complete. Accurate, dynamic, individualized estimates of fall risk for admitted patients using routinely recorded data may assist in prioritizing fall prevention efforts.
ObjectiveThe objective of this study was to develop and validate an accurate and dynamic prognostic model for inpatient falls among a cohort of patients using routinely recorded electronic medical record data.
MethodsWe used routinely recorded data from 5 Australian hospitals to develop and internally-externally validate a prediction model for inpatient falls using a Cox proportional hazards model with time-varying covariates. The study cohort included patients admitted during 2018-2021 to any ward, with no age restriction. Predictors used in the model included admission-related administrative data, length of stay, and number of previous falls during the admission (updated every 12 hours up to 14 days after admission). Model calibration was assessed using Poisson regression and discrimination using the area under the time-dependent receiver operating characteristic curve.
ResultsThere were 1,107,556 inpatient admissions, 6004 falls, and 5341 unique fallers. The area under the time-dependent receiver operating characteristic curve was 0.899 (95% CI 0.88-0.91) at 24 hours after admission and declined throughout admission (eg, 0.765, 95% CI 0.75-0.78 on the seventh day after admission). Site-dependent overestimation and underestimation of risk was observed on the calibration plots.
ConclusionsUsing a large dataset from multiple hospitals and robust methods to model development and validation, we developed a prognostic model for inpatient falls. It had high discrimination, suggesting the model has the potential for operationalization in clinical decision support for prioritizing inpatients for fall prevention. Performance was site dependent, and model recalibration may lead to improved performance. |
| format | Article |
| id | doaj-art-b4eeee1ef69b49b9a0fba26205d29b30 |
| institution | OA Journals |
| issn | 1438-8871 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj-art-b4eeee1ef69b49b9a0fba26205d29b302025-08-20T02:14:42ZengJMIR PublicationsJournal of Medical Internet Research1438-88712024-11-0126e5963410.2196/59634An Electronic Medical Record–Based Prognostic Model for Inpatient Falls: Development and Internal-External Cross-ValidationRex Parsonshttps://orcid.org/0000-0002-6053-8174Robin Blythehttps://orcid.org/0000-0002-3643-4332Susanna Crambhttps://orcid.org/0000-0001-9041-9531Ahmad Abdel-Hafezhttps://orcid.org/0000-0001-6022-9745Steven McPhailhttps://orcid.org/0000-0002-1463-662X BackgroundEffective fall prevention interventions in hospitals require appropriate allocation of resources early in admission. To address this, fall risk prediction tools and models have been developed with the aim to provide fall prevention strategies to patients at high risk. However, fall risk assessment tools have typically been inaccurate for prediction, ineffective in prevention, and time-consuming to complete. Accurate, dynamic, individualized estimates of fall risk for admitted patients using routinely recorded data may assist in prioritizing fall prevention efforts. ObjectiveThe objective of this study was to develop and validate an accurate and dynamic prognostic model for inpatient falls among a cohort of patients using routinely recorded electronic medical record data. MethodsWe used routinely recorded data from 5 Australian hospitals to develop and internally-externally validate a prediction model for inpatient falls using a Cox proportional hazards model with time-varying covariates. The study cohort included patients admitted during 2018-2021 to any ward, with no age restriction. Predictors used in the model included admission-related administrative data, length of stay, and number of previous falls during the admission (updated every 12 hours up to 14 days after admission). Model calibration was assessed using Poisson regression and discrimination using the area under the time-dependent receiver operating characteristic curve. ResultsThere were 1,107,556 inpatient admissions, 6004 falls, and 5341 unique fallers. The area under the time-dependent receiver operating characteristic curve was 0.899 (95% CI 0.88-0.91) at 24 hours after admission and declined throughout admission (eg, 0.765, 95% CI 0.75-0.78 on the seventh day after admission). Site-dependent overestimation and underestimation of risk was observed on the calibration plots. ConclusionsUsing a large dataset from multiple hospitals and robust methods to model development and validation, we developed a prognostic model for inpatient falls. It had high discrimination, suggesting the model has the potential for operationalization in clinical decision support for prioritizing inpatients for fall prevention. Performance was site dependent, and model recalibration may lead to improved performance.https://www.jmir.org/2024/1/e59634 |
| spellingShingle | Rex Parsons Robin Blythe Susanna Cramb Ahmad Abdel-Hafez Steven McPhail An Electronic Medical Record–Based Prognostic Model for Inpatient Falls: Development and Internal-External Cross-Validation Journal of Medical Internet Research |
| title | An Electronic Medical Record–Based Prognostic Model for Inpatient Falls: Development and Internal-External Cross-Validation |
| title_full | An Electronic Medical Record–Based Prognostic Model for Inpatient Falls: Development and Internal-External Cross-Validation |
| title_fullStr | An Electronic Medical Record–Based Prognostic Model for Inpatient Falls: Development and Internal-External Cross-Validation |
| title_full_unstemmed | An Electronic Medical Record–Based Prognostic Model for Inpatient Falls: Development and Internal-External Cross-Validation |
| title_short | An Electronic Medical Record–Based Prognostic Model for Inpatient Falls: Development and Internal-External Cross-Validation |
| title_sort | electronic medical record based prognostic model for inpatient falls development and internal external cross validation |
| url | https://www.jmir.org/2024/1/e59634 |
| work_keys_str_mv | AT rexparsons anelectronicmedicalrecordbasedprognosticmodelforinpatientfallsdevelopmentandinternalexternalcrossvalidation AT robinblythe anelectronicmedicalrecordbasedprognosticmodelforinpatientfallsdevelopmentandinternalexternalcrossvalidation AT susannacramb anelectronicmedicalrecordbasedprognosticmodelforinpatientfallsdevelopmentandinternalexternalcrossvalidation AT ahmadabdelhafez anelectronicmedicalrecordbasedprognosticmodelforinpatientfallsdevelopmentandinternalexternalcrossvalidation AT stevenmcphail anelectronicmedicalrecordbasedprognosticmodelforinpatientfallsdevelopmentandinternalexternalcrossvalidation AT rexparsons electronicmedicalrecordbasedprognosticmodelforinpatientfallsdevelopmentandinternalexternalcrossvalidation AT robinblythe electronicmedicalrecordbasedprognosticmodelforinpatientfallsdevelopmentandinternalexternalcrossvalidation AT susannacramb electronicmedicalrecordbasedprognosticmodelforinpatientfallsdevelopmentandinternalexternalcrossvalidation AT ahmadabdelhafez electronicmedicalrecordbasedprognosticmodelforinpatientfallsdevelopmentandinternalexternalcrossvalidation AT stevenmcphail electronicmedicalrecordbasedprognosticmodelforinpatientfallsdevelopmentandinternalexternalcrossvalidation |