Deep Learning Models to Predict Fatal Pneumonia Using Chest X-Ray Images

Background and Aims. Chest X-ray (CXR) is indispensable to the assessment of severity, diagnosis, and management of pneumonia. Deep learning is an artificial intelligence (AI) technology that has been applied to the interpretation of medical images. This study investigated the feasibility of classif...

Full description

Saved in:
Bibliographic Details
Main Authors: Satoshi Anai, Junko Hisasue, Yoichi Takaki, Naohiko Hara
Format: Article
Language:English
Published: Wiley 2022-01-01
Series:Canadian Respiratory Journal
Online Access:http://dx.doi.org/10.1155/2022/8026580
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1832548775433863168
author Satoshi Anai
Junko Hisasue
Yoichi Takaki
Naohiko Hara
author_facet Satoshi Anai
Junko Hisasue
Yoichi Takaki
Naohiko Hara
author_sort Satoshi Anai
collection DOAJ
description Background and Aims. Chest X-ray (CXR) is indispensable to the assessment of severity, diagnosis, and management of pneumonia. Deep learning is an artificial intelligence (AI) technology that has been applied to the interpretation of medical images. This study investigated the feasibility of classifying fatal pneumonia based on CXR images using deep learning models on publicly available platforms. Methods. CXR images of patients with pneumonia at diagnosis were labeled as fatal or nonfatal based on medical records. We applied CXR images from 1031 patients with nonfatal pneumonia and 243 patients with fatal pneumonia for training and self-evaluation of the deep learning models. All labeled CXR images were randomly allocated to the training, validation, and test datasets of deep learning models. Data augmentation techniques were not used in this study. We created two deep learning models using two publicly available platforms. Results. The first model showed an area under the precision-recall curve of 0.929 with a sensitivity of 50.0% and a specificity of 92.4% for classifying fatal pneumonia. We evaluated the performance of our deep learning models using sensitivity, specificity, PPV, negative predictive value (NPV), accuracy, and F1 score. Using the external validation test dataset of 100 CXR images, the sensitivity, specificity, accuracy, and F1 score were 68.0%, 86.0%, 77.0%, and 74.7%, respectively. In the original dataset, the performance of the second model showed a sensitivity, specificity, and accuracy of 39.6%, 92.8%, and 82.7%, respectively, while external validation showed values of 38.0%, 92.0%, and 65.0%, respectively. The F1 score was 52.1%. These results were comparable to those obtained by respiratory physicians and residents. Conclusions. The deep learning models yielded good accuracy in classifying fatal pneumonia. By further improving the performance, AI could assist physicians in the severity assessment of patients with pneumonia.
format Article
id doaj-art-9fe2a0540114409a975dd20d002e2782
institution Kabale University
issn 1916-7245
language English
publishDate 2022-01-01
publisher Wiley
record_format Article
series Canadian Respiratory Journal
spelling doaj-art-9fe2a0540114409a975dd20d002e27822025-02-03T06:13:04ZengWileyCanadian Respiratory Journal1916-72452022-01-01202210.1155/2022/8026580Deep Learning Models to Predict Fatal Pneumonia Using Chest X-Ray ImagesSatoshi Anai0Junko Hisasue1Yoichi Takaki2Naohiko Hara3Division of Respiratory MedicineDivision of Respiratory MedicineDivision of Respiratory MedicineDivision of Respiratory MedicineBackground and Aims. Chest X-ray (CXR) is indispensable to the assessment of severity, diagnosis, and management of pneumonia. Deep learning is an artificial intelligence (AI) technology that has been applied to the interpretation of medical images. This study investigated the feasibility of classifying fatal pneumonia based on CXR images using deep learning models on publicly available platforms. Methods. CXR images of patients with pneumonia at diagnosis were labeled as fatal or nonfatal based on medical records. We applied CXR images from 1031 patients with nonfatal pneumonia and 243 patients with fatal pneumonia for training and self-evaluation of the deep learning models. All labeled CXR images were randomly allocated to the training, validation, and test datasets of deep learning models. Data augmentation techniques were not used in this study. We created two deep learning models using two publicly available platforms. Results. The first model showed an area under the precision-recall curve of 0.929 with a sensitivity of 50.0% and a specificity of 92.4% for classifying fatal pneumonia. We evaluated the performance of our deep learning models using sensitivity, specificity, PPV, negative predictive value (NPV), accuracy, and F1 score. Using the external validation test dataset of 100 CXR images, the sensitivity, specificity, accuracy, and F1 score were 68.0%, 86.0%, 77.0%, and 74.7%, respectively. In the original dataset, the performance of the second model showed a sensitivity, specificity, and accuracy of 39.6%, 92.8%, and 82.7%, respectively, while external validation showed values of 38.0%, 92.0%, and 65.0%, respectively. The F1 score was 52.1%. These results were comparable to those obtained by respiratory physicians and residents. Conclusions. The deep learning models yielded good accuracy in classifying fatal pneumonia. By further improving the performance, AI could assist physicians in the severity assessment of patients with pneumonia.http://dx.doi.org/10.1155/2022/8026580
spellingShingle Satoshi Anai
Junko Hisasue
Yoichi Takaki
Naohiko Hara
Deep Learning Models to Predict Fatal Pneumonia Using Chest X-Ray Images
Canadian Respiratory Journal
title Deep Learning Models to Predict Fatal Pneumonia Using Chest X-Ray Images
title_full Deep Learning Models to Predict Fatal Pneumonia Using Chest X-Ray Images
title_fullStr Deep Learning Models to Predict Fatal Pneumonia Using Chest X-Ray Images
title_full_unstemmed Deep Learning Models to Predict Fatal Pneumonia Using Chest X-Ray Images
title_short Deep Learning Models to Predict Fatal Pneumonia Using Chest X-Ray Images
title_sort deep learning models to predict fatal pneumonia using chest x ray images
url http://dx.doi.org/10.1155/2022/8026580
work_keys_str_mv AT satoshianai deeplearningmodelstopredictfatalpneumoniausingchestxrayimages
AT junkohisasue deeplearningmodelstopredictfatalpneumoniausingchestxrayimages
AT yoichitakaki deeplearningmodelstopredictfatalpneumoniausingchestxrayimages
AT naohikohara deeplearningmodelstopredictfatalpneumoniausingchestxrayimages