A novel interpretable deep learning model for diagnosis in emergency department dyspnoea patients based on complete data from an entire health care system.
<h4>Background</h4>Dyspnoea is one of the emergency department's (ED) most common and deadly chief complaints, but frequently misdiagnosed and mistreated. We aimed to design a diagnostic decision support which classifies dyspnoeic ED visits into acute heart failure (AHF), exacerbati...
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2024-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0311081 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841555504303702016 |
|---|---|
| author | Ellen T Heyman Awais Ashfaq Ulf Ekelund Mattias Ohlsson Jonas Björk Ardavan M Khoshnood Markus Lingman |
| author_facet | Ellen T Heyman Awais Ashfaq Ulf Ekelund Mattias Ohlsson Jonas Björk Ardavan M Khoshnood Markus Lingman |
| author_sort | Ellen T Heyman |
| collection | DOAJ |
| description | <h4>Background</h4>Dyspnoea is one of the emergency department's (ED) most common and deadly chief complaints, but frequently misdiagnosed and mistreated. We aimed to design a diagnostic decision support which classifies dyspnoeic ED visits into acute heart failure (AHF), exacerbation of chronic obstructive pulmonary disease (eCOPD), pneumonia and "other diagnoses" by using deep learning and complete, unselected data from an entire regional health care system.<h4>Methods</h4>In this cross-sectional study, we included all dyspnoeic ED visits of patients ≥ 18 years of age at the two EDs in the region of Halland, Sweden, 07/01/2017-12/31/2019. Data from the complete regional health care system within five years prior to the ED visit were analysed. Gold standard diagnoses were defined as the subsequent in-hospital or ED discharge notes, and a subsample was manually reviewed by emergency medicine experts. A novel deep learning model, the clinical attention-based recurrent encoder network (CareNet), was developed. Cohort performance was compared to a simpler CatBoost model. A list of all variables and their importance for diagnosis was created. For each unique patient visit, the model selected the most important variables, analysed them and presented them to the clinician interpretably by taking event time and clinical context into account. AUROC, sensitivity and specificity were compared.<h4>Findings</h4>The most prevalent diagnoses among the 10,315 dyspnoeic ED visits were AHF (15.5%), eCOPD (14.0%) and pneumonia (13.3%). Median number of unique events, i.e., registered clinical data with time stamps, per ED visit was 1,095 (IQR 459-2,310). CareNet median AUROC was 87.0%, substantially higher than the CatBoost model´s (81.4%). CareNet median sensitivity for AHF, eCOPD, and pneumonia was 74.5%, 92.6%, and 54.1%, respectively, with a specificity set above 75.0, slightly inferior to that of the CatBoost baseline model. The model assembled a list of 1,596 variables by importance for diagnosis, on top were prior diagnoses of heart failure or COPD, daily smoking, atrial fibrillation/flutter, life management difficulties and maternity care. Each patient visit received their own unique attention plot, graphically displaying important clinical events for the diagnosis.<h4>Interpretation</h4>We designed a novel interpretable deep learning model for diagnosis in emergency department dyspnoea patients by analysing unselected data from a complete regional health care system. |
| format | Article |
| id | doaj-art-0863ffef35df48b1aa6ce53329c07d14 |
| institution | Kabale University |
| issn | 1932-6203 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-0863ffef35df48b1aa6ce53329c07d142025-01-08T05:32:25ZengPublic Library of Science (PLoS)PLoS ONE1932-62032024-01-011912e031108110.1371/journal.pone.0311081A novel interpretable deep learning model for diagnosis in emergency department dyspnoea patients based on complete data from an entire health care system.Ellen T HeymanAwais AshfaqUlf EkelundMattias OhlssonJonas BjörkArdavan M KhoshnoodMarkus Lingman<h4>Background</h4>Dyspnoea is one of the emergency department's (ED) most common and deadly chief complaints, but frequently misdiagnosed and mistreated. We aimed to design a diagnostic decision support which classifies dyspnoeic ED visits into acute heart failure (AHF), exacerbation of chronic obstructive pulmonary disease (eCOPD), pneumonia and "other diagnoses" by using deep learning and complete, unselected data from an entire regional health care system.<h4>Methods</h4>In this cross-sectional study, we included all dyspnoeic ED visits of patients ≥ 18 years of age at the two EDs in the region of Halland, Sweden, 07/01/2017-12/31/2019. Data from the complete regional health care system within five years prior to the ED visit were analysed. Gold standard diagnoses were defined as the subsequent in-hospital or ED discharge notes, and a subsample was manually reviewed by emergency medicine experts. A novel deep learning model, the clinical attention-based recurrent encoder network (CareNet), was developed. Cohort performance was compared to a simpler CatBoost model. A list of all variables and their importance for diagnosis was created. For each unique patient visit, the model selected the most important variables, analysed them and presented them to the clinician interpretably by taking event time and clinical context into account. AUROC, sensitivity and specificity were compared.<h4>Findings</h4>The most prevalent diagnoses among the 10,315 dyspnoeic ED visits were AHF (15.5%), eCOPD (14.0%) and pneumonia (13.3%). Median number of unique events, i.e., registered clinical data with time stamps, per ED visit was 1,095 (IQR 459-2,310). CareNet median AUROC was 87.0%, substantially higher than the CatBoost model´s (81.4%). CareNet median sensitivity for AHF, eCOPD, and pneumonia was 74.5%, 92.6%, and 54.1%, respectively, with a specificity set above 75.0, slightly inferior to that of the CatBoost baseline model. The model assembled a list of 1,596 variables by importance for diagnosis, on top were prior diagnoses of heart failure or COPD, daily smoking, atrial fibrillation/flutter, life management difficulties and maternity care. Each patient visit received their own unique attention plot, graphically displaying important clinical events for the diagnosis.<h4>Interpretation</h4>We designed a novel interpretable deep learning model for diagnosis in emergency department dyspnoea patients by analysing unselected data from a complete regional health care system.https://doi.org/10.1371/journal.pone.0311081 |
| spellingShingle | Ellen T Heyman Awais Ashfaq Ulf Ekelund Mattias Ohlsson Jonas Björk Ardavan M Khoshnood Markus Lingman A novel interpretable deep learning model for diagnosis in emergency department dyspnoea patients based on complete data from an entire health care system. PLoS ONE |
| title | A novel interpretable deep learning model for diagnosis in emergency department dyspnoea patients based on complete data from an entire health care system. |
| title_full | A novel interpretable deep learning model for diagnosis in emergency department dyspnoea patients based on complete data from an entire health care system. |
| title_fullStr | A novel interpretable deep learning model for diagnosis in emergency department dyspnoea patients based on complete data from an entire health care system. |
| title_full_unstemmed | A novel interpretable deep learning model for diagnosis in emergency department dyspnoea patients based on complete data from an entire health care system. |
| title_short | A novel interpretable deep learning model for diagnosis in emergency department dyspnoea patients based on complete data from an entire health care system. |
| title_sort | novel interpretable deep learning model for diagnosis in emergency department dyspnoea patients based on complete data from an entire health care system |
| url | https://doi.org/10.1371/journal.pone.0311081 |
| work_keys_str_mv | AT ellentheyman anovelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem AT awaisashfaq anovelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem AT ulfekelund anovelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem AT mattiasohlsson anovelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem AT jonasbjork anovelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem AT ardavanmkhoshnood anovelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem AT markuslingman anovelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem AT ellentheyman novelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem AT awaisashfaq novelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem AT ulfekelund novelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem AT mattiasohlsson novelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem AT jonasbjork novelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem AT ardavanmkhoshnood novelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem AT markuslingman novelinterpretabledeeplearningmodelfordiagnosisinemergencydepartmentdyspnoeapatientsbasedoncompletedatafromanentirehealthcaresystem |